[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:16:28.732722 17228 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.211.62:35885
I20260709 13:16:28.734388 17228 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:16:28.735460 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:28.752991 17234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:28.753075 17235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:28.753958 17228 server_base.cc:1061] running on GCE node
W20260709 13:16:28.752998 17237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:29.965425 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:29.965668 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:29.965839 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783602989965821 us; error 0 us; skew 500 ppm
I20260709 13:16:29.966821 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:29.974069 17228 webserver.cc:533] Webserver started at http://127.16.211.62:46761/ using document root <none> and password file <none>
I20260709 13:16:29.974967 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:29.975179 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:29.975615 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:29.982086 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/master-0-root/instance:
uuid: "892e29c22784418280232426087e2357"
format_stamp: "Formatted at 2026-07-09 13:16:29 on dist-test-slave-96c3"
I20260709 13:16:29.990381 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:29.995525 17243 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:29.996747 17228 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:16:29.997112 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/master-0-root
uuid: "892e29c22784418280232426087e2357"
format_stamp: "Formatted at 2026-07-09 13:16:29 on dist-test-slave-96c3"
I20260709 13:16:29.997406 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:30.073722 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:30.075330 17228 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:16:30.075799 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:30.152981 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.62:35885
I20260709 13:16:30.153051 17294 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.62:35885 every 8 connection(s)
I20260709 13:16:30.160955 17295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:30.182235 17295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357: Bootstrap starting.
I20260709 13:16:30.187970 17295 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:30.189803 17295 log.cc:826] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357: Log is configured to *not* fsync() on all Append() calls
I20260709 13:16:30.194357 17295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357: No bootstrap required, opened a new log
I20260709 13:16:30.215503 17295 raft_consensus.cc:359] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "892e29c22784418280232426087e2357" member_type: VOTER }
I20260709 13:16:30.216078 17295 raft_consensus.cc:385] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:30.216348 17295 raft_consensus.cc:740] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 892e29c22784418280232426087e2357, State: Initialized, Role: FOLLOWER
I20260709 13:16:30.217270 17295 consensus_queue.cc:260] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "892e29c22784418280232426087e2357" member_type: VOTER }
I20260709 13:16:30.217759 17295 raft_consensus.cc:399] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:30.218137 17295 raft_consensus.cc:493] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:30.218498 17295 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:30.222784 17295 raft_consensus.cc:515] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "892e29c22784418280232426087e2357" member_type: VOTER }
I20260709 13:16:30.223577 17295 leader_election.cc:304] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 892e29c22784418280232426087e2357; no voters: 
I20260709 13:16:30.225283 17295 leader_election.cc:290] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:30.225644 17298 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:30.228422 17298 raft_consensus.cc:697] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [term 1 LEADER]: Becoming Leader. State: Replica: 892e29c22784418280232426087e2357, State: Running, Role: LEADER
I20260709 13:16:30.229334 17298 consensus_queue.cc:237] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "892e29c22784418280232426087e2357" member_type: VOTER }
I20260709 13:16:30.230449 17295 sys_catalog.cc:565] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:30.240698 17300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 892e29c22784418280232426087e2357. Latest consensus state: current_term: 1 leader_uuid: "892e29c22784418280232426087e2357" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "892e29c22784418280232426087e2357" member_type: VOTER } }
I20260709 13:16:30.241585 17300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:30.243418 17299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "892e29c22784418280232426087e2357" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "892e29c22784418280232426087e2357" member_type: VOTER } }
I20260709 13:16:30.244033 17299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:30.246459 17308 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:30.257526 17308 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:30.259968 17228 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:30.274510 17308 catalog_manager.cc:1383] Generated new cluster ID: 632a0e98d9434f769aecf54afe6f2331
I20260709 13:16:30.274824 17308 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:30.297407 17308 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:30.299026 17308 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:30.310299 17308 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357: Generated new TSK 0
I20260709 13:16:30.311182 17308 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:30.326277 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:30.334746 17317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:30.337396 17318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:30.340535 17228 server_base.cc:1061] running on GCE node
W20260709 13:16:30.340739 17320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:30.341645 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:30.341873 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:30.342101 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783602990342081 us; error 0 us; skew 500 ppm
I20260709 13:16:30.342689 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:30.347185 17228 webserver.cc:533] Webserver started at http://127.16.211.1:33291/ using document root <none> and password file <none>
I20260709 13:16:30.347720 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:30.347932 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:30.348212 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:30.349298 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-0-root/instance:
uuid: "7188a99172d54e4a914928679d6a4110"
format_stamp: "Formatted at 2026-07-09 13:16:30 on dist-test-slave-96c3"
I20260709 13:16:30.355316 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.005s
I20260709 13:16:30.359650 17325 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:30.360486 17228 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:16:30.360786 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-0-root
uuid: "7188a99172d54e4a914928679d6a4110"
format_stamp: "Formatted at 2026-07-09 13:16:30 on dist-test-slave-96c3"
I20260709 13:16:30.361061 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:30.383668 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:30.385046 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:30.387871 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:30.392518 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:30.392733 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:30.393045 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:30.393213 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:30.502063 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.1:41659
I20260709 13:16:30.502147 17387 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.1:41659 every 8 connection(s)
I20260709 13:16:30.508800 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:30.523813 17392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:30.530332 17393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:30.536250 17395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:30.536629 17228 server_base.cc:1061] running on GCE node
I20260709 13:16:30.537817 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:30.538198 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:30.538422 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783602990538402 us; error 0 us; skew 500 ppm
I20260709 13:16:30.539008 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:30.541510 17228 webserver.cc:533] Webserver started at http://127.16.211.2:46131/ using document root <none> and password file <none>
I20260709 13:16:30.542094 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:30.542414 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:30.542765 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:30.543901 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-1-root/instance:
uuid: "bb4637970e724b0598289a3e2a2a1c21"
format_stamp: "Formatted at 2026-07-09 13:16:30 on dist-test-slave-96c3"
I20260709 13:16:30.549407 17388 heartbeater.cc:344] Connected to a master server at 127.16.211.62:35885
I20260709 13:16:30.549968 17388 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:30.550285 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:16:30.551033 17388 heartbeater.cc:507] Master 127.16.211.62:35885 requested a full tablet report, sending...
I20260709 13:16:30.553799 17260 ts_manager.cc:194] Registered new tserver with Master: 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659)
I20260709 13:16:30.556425 17400 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:30.556878 17260 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44078
I20260709 13:16:30.557335 17228 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:16:30.557663 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-1-root
uuid: "bb4637970e724b0598289a3e2a2a1c21"
format_stamp: "Formatted at 2026-07-09 13:16:30 on dist-test-slave-96c3"
I20260709 13:16:30.558028 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:30.589690 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:30.591389 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:30.593876 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:30.597414 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:30.597666 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:30.597961 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:30.598173 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:30.686619 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.2:39087
I20260709 13:16:30.686708 17462 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.2:39087 every 8 connection(s)
I20260709 13:16:30.695138 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:30.703670 17466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:30.705535 17467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:30.706622 17463 heartbeater.cc:344] Connected to a master server at 127.16.211.62:35885
I20260709 13:16:30.707046 17463 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:30.708118 17463 heartbeater.cc:507] Master 127.16.211.62:35885 requested a full tablet report, sending...
W20260709 13:16:30.709873 17469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:30.710666 17260 ts_manager.cc:194] Registered new tserver with Master: bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087)
I20260709 13:16:30.712437 17228 server_base.cc:1061] running on GCE node
I20260709 13:16:30.712601 17260 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44082
I20260709 13:16:30.713372 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:30.713653 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:30.713851 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783602990713831 us; error 0 us; skew 500 ppm
I20260709 13:16:30.714452 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:30.717204 17228 webserver.cc:533] Webserver started at http://127.16.211.3:43391/ using document root <none> and password file <none>
I20260709 13:16:30.717693 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:30.717901 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:30.718443 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:30.719668 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-2-root/instance:
uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
format_stamp: "Formatted at 2026-07-09 13:16:30 on dist-test-slave-96c3"
I20260709 13:16:30.724562 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:16:30.728263 17474 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:30.729117 17228 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:16:30.729435 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-2-root
uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
format_stamp: "Formatted at 2026-07-09 13:16:30 on dist-test-slave-96c3"
I20260709 13:16:30.729770 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602988568269-17228-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:30.774219 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:30.775527 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:30.776912 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:30.779356 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:30.779588 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:30.779851 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:30.780037 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:30.872241 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.3:34011
I20260709 13:16:30.872346 17536 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.3:34011 every 8 connection(s)
I20260709 13:16:30.889763 17537 heartbeater.cc:344] Connected to a master server at 127.16.211.62:35885
I20260709 13:16:30.890269 17537 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:30.891106 17537 heartbeater.cc:507] Master 127.16.211.62:35885 requested a full tablet report, sending...
I20260709 13:16:30.893133 17260 ts_manager.cc:194] Registered new tserver with Master: ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:30.893942 17228 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014774688s
I20260709 13:16:30.894737 17260 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44086
I20260709 13:16:30.947297 17260 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44098:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:30.950974 17260 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:31.052706 17428 tablet_service.cc:1511] Processing CreateTablet for tablet c5f43626049d4665b1fee1e27f2c37ff (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:31.054399 17428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5f43626049d4665b1fee1e27f2c37ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.062915 17353 tablet_service.cc:1511] Processing CreateTablet for tablet c5f43626049d4665b1fee1e27f2c37ff (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:31.064308 17353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5f43626049d4665b1fee1e27f2c37ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.067852 17352 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed6587fd8ee4aa69030f634efd3ccb9 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:31.068265 17427 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed6587fd8ee4aa69030f634efd3ccb9 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:31.068555 17426 tablet_service.cc:1511] Processing CreateTablet for tablet bd145685f4e14bd9b8aab4eeeadfabbb (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:31.069355 17352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed6587fd8ee4aa69030f634efd3ccb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.069612 17427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed6587fd8ee4aa69030f634efd3ccb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.074631 17426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd145685f4e14bd9b8aab4eeeadfabbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.075851 17351 tablet_service.cc:1511] Processing CreateTablet for tablet bd145685f4e14bd9b8aab4eeeadfabbb (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:31.077203 17351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd145685f4e14bd9b8aab4eeeadfabbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.083949 17350 tablet_service.cc:1511] Processing CreateTablet for tablet 8689559b839645aabf233f9e8cc5eb30 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:31.085314 17350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8689559b839645aabf233f9e8cc5eb30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.092265 17500 tablet_service.cc:1511] Processing CreateTablet for tablet bd145685f4e14bd9b8aab4eeeadfabbb (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:31.093369 17502 tablet_service.cc:1511] Processing CreateTablet for tablet c5f43626049d4665b1fee1e27f2c37ff (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:31.094375 17501 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed6587fd8ee4aa69030f634efd3ccb9 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:31.098574 17500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd145685f4e14bd9b8aab4eeeadfabbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.099855 17501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed6587fd8ee4aa69030f634efd3ccb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.099949 17425 tablet_service.cc:1511] Processing CreateTablet for tablet 8689559b839645aabf233f9e8cc5eb30 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:31.102546 17502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5f43626049d4665b1fee1e27f2c37ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.103636 17425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8689559b839645aabf233f9e8cc5eb30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.121344 17499 tablet_service.cc:1511] Processing CreateTablet for tablet 8689559b839645aabf233f9e8cc5eb30 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:31.127159 17499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8689559b839645aabf233f9e8cc5eb30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.151568 17555 tablet_bootstrap.cc:492] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21: Bootstrap starting.
I20260709 13:16:31.151594 17349 tablet_service.cc:1511] Processing CreateTablet for tablet d650567aabb8413192eb4cb8957096c9 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:31.155576 17426 tablet_service.cc:1511] Processing CreateTablet for tablet d650567aabb8413192eb4cb8957096c9 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:31.160260 17426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d650567aabb8413192eb4cb8957096c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.159417 17498 tablet_service.cc:1511] Processing CreateTablet for tablet d650567aabb8413192eb4cb8957096c9 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:31.162269 17498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d650567aabb8413192eb4cb8957096c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.167464 17348 tablet_service.cc:1511] Processing CreateTablet for tablet 29f7e8fb9f094838938c0f00c71f3939 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:31.192014 17497 tablet_service.cc:1511] Processing CreateTablet for tablet 29f7e8fb9f094838938c0f00c71f3939 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:31.193765 17497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f7e8fb9f094838938c0f00c71f3939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.211350 17347 tablet_service.cc:1511] Processing CreateTablet for tablet 950593dd09ed479d9b1aeba327bb8bb9 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:31.227571 17428 tablet_service.cc:1511] Processing CreateTablet for tablet 29f7e8fb9f094838938c0f00c71f3939 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:31.238615 17349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d650567aabb8413192eb4cb8957096c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.239588 17428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f7e8fb9f094838938c0f00c71f3939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.240309 17555 tablet_bootstrap.cc:654] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:31.249902 17307 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:31.256541 17556 tablet_bootstrap.cc:492] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046: Bootstrap starting.
I20260709 13:16:31.256423 17424 tablet_service.cc:1511] Processing CreateTablet for tablet 950593dd09ed479d9b1aeba327bb8bb9 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:31.260300 17502 tablet_service.cc:1511] Processing CreateTablet for tablet 950593dd09ed479d9b1aeba327bb8bb9 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:31.261900 17348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f7e8fb9f094838938c0f00c71f3939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.262116 17502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950593dd09ed479d9b1aeba327bb8bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.262763 17424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950593dd09ed479d9b1aeba327bb8bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.269104 17425 tablet_service.cc:1511] Processing CreateTablet for tablet 47fdf35a90f843a1ab32251380b08878 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:31.270149 17347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950593dd09ed479d9b1aeba327bb8bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.287482 17557 tablet_bootstrap.cc:492] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110: Bootstrap starting.
I20260709 13:16:31.286211 17352 tablet_service.cc:1511] Processing CreateTablet for tablet 47fdf35a90f843a1ab32251380b08878 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:31.294705 17352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47fdf35a90f843a1ab32251380b08878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.298504 17425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47fdf35a90f843a1ab32251380b08878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.304258 17556 tablet_bootstrap.cc:654] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.305612 17353 tablet_service.cc:1511] Processing CreateTablet for tablet 772809c7a4184e28883b791067023ca9 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:31.312055 17353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772809c7a4184e28883b791067023ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.321449 17498 tablet_service.cc:1511] Processing CreateTablet for tablet 47fdf35a90f843a1ab32251380b08878 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:31.329674 17426 tablet_service.cc:1511] Processing CreateTablet for tablet 772809c7a4184e28883b791067023ca9 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:31.331698 17498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47fdf35a90f843a1ab32251380b08878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.331911 17426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772809c7a4184e28883b791067023ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.358973 17555 tablet_bootstrap.cc:492] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21: No bootstrap required, opened a new log
I20260709 13:16:31.359514 17555 ts_tablet_manager.cc:1403] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21: Time spent bootstrapping tablet: real 0.213s	user 0.023s	sys 0.010s
I20260709 13:16:31.364934 17555 raft_consensus.cc:359] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.366212 17555 raft_consensus.cc:385] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.366642 17555 raft_consensus.cc:740] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.354872 17497 tablet_service.cc:1511] Processing CreateTablet for tablet 772809c7a4184e28883b791067023ca9 (DEFAULT_TABLE table=test-workload [id=d6c52dc42bef44adb6c2422edb136db3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:31.368209 17497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772809c7a4184e28883b791067023ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:31.379791 17557 tablet_bootstrap.cc:654] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.388121 17555 consensus_queue.cc:260] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.395367 17556 tablet_bootstrap.cc:492] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046: No bootstrap required, opened a new log
I20260709 13:16:31.397344 17556 ts_tablet_manager.cc:1403] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046: Time spent bootstrapping tablet: real 0.148s	user 0.029s	sys 0.025s
I20260709 13:16:31.405618 17463 heartbeater.cc:499] Master 127.16.211.62:35885 was elected leader, sending a full tablet report...
I20260709 13:16:31.406908 17555 ts_tablet_manager.cc:1434] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.006s
I20260709 13:16:31.409292 17555 tablet_bootstrap.cc:492] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21: Bootstrap starting.
I20260709 13:16:31.415251 17557 tablet_bootstrap.cc:492] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110: No bootstrap required, opened a new log
I20260709 13:16:31.415712 17557 ts_tablet_manager.cc:1403] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110: Time spent bootstrapping tablet: real 0.130s	user 0.011s	sys 0.017s
I20260709 13:16:31.416806 17556 raft_consensus.cc:359] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.417544 17556 raft_consensus.cc:385] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.418605 17556 raft_consensus.cc:740] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.419754 17556 consensus_queue.cc:260] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.423578 17557 raft_consensus.cc:359] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.424551 17557 raft_consensus.cc:385] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.424940 17557 raft_consensus.cc:740] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.425832 17557 consensus_queue.cc:260] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.430914 17555 tablet_bootstrap.cc:654] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.443606 17388 heartbeater.cc:499] Master 127.16.211.62:35885 was elected leader, sending a full tablet report...
I20260709 13:16:31.443975 17557 ts_tablet_manager.cc:1434] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 13:16:31.444331 17537 heartbeater.cc:499] Master 127.16.211.62:35885 was elected leader, sending a full tablet report...
I20260709 13:16:31.444991 17557 tablet_bootstrap.cc:492] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110: Bootstrap starting.
W20260709 13:16:31.445891 17464 tablet.cc:2406] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:31.450713 17556 ts_tablet_manager.cc:1434] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.012s
I20260709 13:16:31.451644 17556 tablet_bootstrap.cc:492] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046: Bootstrap starting.
I20260709 13:16:31.451809 17557 tablet_bootstrap.cc:654] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.469810 17555 tablet_bootstrap.cc:492] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21: No bootstrap required, opened a new log
I20260709 13:16:31.470515 17555 ts_tablet_manager.cc:1403] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.001s
I20260709 13:16:31.474848 17555 raft_consensus.cc:359] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.475816 17555 raft_consensus.cc:385] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.476191 17555 raft_consensus.cc:740] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.482710 17560 raft_consensus.cc:493] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.483385 17560 raft_consensus.cc:515] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.491654 17560 leader_election.cc:290] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:31.492929 17563 raft_consensus.cc:493] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.493463 17563 raft_consensus.cc:515] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.494694 17556 tablet_bootstrap.cc:654] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.496266 17563 leader_election.cc:290] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:31.477115 17555 consensus_queue.cc:260] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.499615 17555 ts_tablet_manager.cc:1434] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:16:31.500587 17555 tablet_bootstrap.cc:492] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21: Bootstrap starting.
I20260709 13:16:31.527856 17555 tablet_bootstrap.cc:654] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.544641 17557 tablet_bootstrap.cc:492] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110: No bootstrap required, opened a new log
I20260709 13:16:31.545223 17557 ts_tablet_manager.cc:1403] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110: Time spent bootstrapping tablet: real 0.100s	user 0.027s	sys 0.026s
I20260709 13:16:31.557384 17557 raft_consensus.cc:359] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.558087 17557 raft_consensus.cc:385] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.558339 17557 raft_consensus.cc:740] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.562297 17557 consensus_queue.cc:260] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.565758 17557 ts_tablet_manager.cc:1434] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.004s
I20260709 13:16:31.567000 17557 tablet_bootstrap.cc:492] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110: Bootstrap starting.
I20260709 13:16:31.580423 17556 tablet_bootstrap.cc:492] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046: No bootstrap required, opened a new log
I20260709 13:16:31.580951 17556 ts_tablet_manager.cc:1403] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046: Time spent bootstrapping tablet: real 0.130s	user 0.022s	sys 0.003s
I20260709 13:16:31.590576 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110" is_pre_election: true
I20260709 13:16:31.591251 17363 raft_consensus.cc:2468] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 0.
I20260709 13:16:31.593866 17557 tablet_bootstrap.cc:654] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.594715 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21" is_pre_election: true
I20260709 13:16:31.596801 17401 leader_election.cc:304] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:31.596959 17438 raft_consensus.cc:2468] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 0.
I20260709 13:16:31.598567 17560 raft_consensus.cc:2804] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:31.598918 17560 raft_consensus.cc:493] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.599246 17560 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:31.599505 17555 tablet_bootstrap.cc:492] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21: No bootstrap required, opened a new log
I20260709 13:16:31.599550 17326 leader_election.cc:304] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:31.600898 17555 ts_tablet_manager.cc:1403] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.013s
I20260709 13:16:31.599892 17556 raft_consensus.cc:359] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.602018 17563 raft_consensus.cc:2804] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:31.602138 17556 raft_consensus.cc:385] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.602445 17563 raft_consensus.cc:493] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.602484 17556 raft_consensus.cc:740] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.602864 17563 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:31.603303 17556 consensus_queue.cc:260] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.605142 17512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" is_pre_election: true
I20260709 13:16:31.606643 17512 raft_consensus.cc:2468] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 0.
I20260709 13:16:31.612703 17563 raft_consensus.cc:515] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.614777 17563 leader_election.cc:290] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 election: Requested vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:31.615545 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:31.618363 17556 ts_tablet_manager.cc:1434] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 13:16:31.619375 17556 tablet_bootstrap.cc:492] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046: Bootstrap starting.
I20260709 13:16:31.619220 17512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" is_pre_election: true
I20260709 13:16:31.619771 17511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:31.619869 17512 raft_consensus.cc:2468] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 0.
I20260709 13:16:31.622768 17557 tablet_bootstrap.cc:492] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110: No bootstrap required, opened a new log
I20260709 13:16:31.623773 17557 ts_tablet_manager.cc:1403] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.005s
I20260709 13:16:31.626917 17556 tablet_bootstrap.cc:654] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.620872 17555 raft_consensus.cc:359] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.627384 17555 raft_consensus.cc:385] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.627748 17555 raft_consensus.cc:740] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.628541 17555 consensus_queue.cc:260] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.626740 17557 raft_consensus.cc:359] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.631163 17557 raft_consensus.cc:385] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.629707 17560 raft_consensus.cc:515] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.631641 17557 raft_consensus.cc:740] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.632943 17438 raft_consensus.cc:2393] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7188a99172d54e4a914928679d6a4110 in current term 1: Already voted for candidate bb4637970e724b0598289a3e2a2a1c21 in this term.
I20260709 13:16:31.632575 17557 consensus_queue.cc:260] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.635105 17512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:31.635706 17512 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:31.636953 17557 ts_tablet_manager.cc:1434] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:16:31.636760 17326 leader_election.cc:304] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7188a99172d54e4a914928679d6a4110; no voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21
I20260709 13:16:31.639132 17555 ts_tablet_manager.cc:1434] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21: Time spent starting tablet: real 0.037s	user 0.001s	sys 0.007s
I20260709 13:16:31.639796 17563 raft_consensus.cc:2749] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:31.641077 17555 tablet_bootstrap.cc:492] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21: Bootstrap starting.
I20260709 13:16:31.643548 17557 tablet_bootstrap.cc:492] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110: Bootstrap starting.
I20260709 13:16:31.643683 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:31.644901 17363 raft_consensus.cc:2393] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb4637970e724b0598289a3e2a2a1c21 in current term 1: Already voted for candidate 7188a99172d54e4a914928679d6a4110 in this term.
I20260709 13:16:31.644026 17560 leader_election.cc:290] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:31.650125 17556 tablet_bootstrap.cc:492] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046: No bootstrap required, opened a new log
I20260709 13:16:31.650110 17512 raft_consensus.cc:2468] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 1.
I20260709 13:16:31.650720 17556 ts_tablet_manager.cc:1403] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.003s
I20260709 13:16:31.657456 17402 leader_election.cc:304] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 7188a99172d54e4a914928679d6a4110
I20260709 13:16:31.660808 17560 raft_consensus.cc:2804] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:31.661017 17557 tablet_bootstrap.cc:654] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.661999 17560 raft_consensus.cc:697] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Becoming Leader. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:31.663678 17555 tablet_bootstrap.cc:654] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.665974 17556 raft_consensus.cc:359] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.666844 17556 raft_consensus.cc:385] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.667235 17556 raft_consensus.cc:740] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.668128 17556 consensus_queue.cc:260] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.670610 17560 consensus_queue.cc:237] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.675904 17556 ts_tablet_manager.cc:1434] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:16:31.677389 17556 tablet_bootstrap.cc:492] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046: Bootstrap starting.
I20260709 13:16:31.683945 17555 tablet_bootstrap.cc:492] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21: No bootstrap required, opened a new log
I20260709 13:16:31.684492 17555 ts_tablet_manager.cc:1403] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.003s
I20260709 13:16:31.684980 17557 tablet_bootstrap.cc:492] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110: No bootstrap required, opened a new log
I20260709 13:16:31.685662 17557 ts_tablet_manager.cc:1403] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.002s
I20260709 13:16:31.687286 17260 catalog_manager.cc:5697] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "bb4637970e724b0598289a3e2a2a1c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:31.688040 17555 raft_consensus.cc:359] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.688887 17555 raft_consensus.cc:385] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.689239 17555 raft_consensus.cc:740] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.691120 17555 consensus_queue.cc:260] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.692236 17556 tablet_bootstrap.cc:654] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.690538 17557 raft_consensus.cc:359] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.694689 17557 raft_consensus.cc:385] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.695130 17557 raft_consensus.cc:740] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.696408 17557 consensus_queue.cc:260] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.699853 17555 ts_tablet_manager.cc:1434] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:16:31.703317 17555 tablet_bootstrap.cc:492] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21: Bootstrap starting.
I20260709 13:16:31.709877 17557 ts_tablet_manager.cc:1434] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
I20260709 13:16:31.710939 17555 tablet_bootstrap.cc:654] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.711141 17557 tablet_bootstrap.cc:492] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110: Bootstrap starting.
I20260709 13:16:31.716604 17556 tablet_bootstrap.cc:492] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046: No bootstrap required, opened a new log
I20260709 13:16:31.717175 17556 ts_tablet_manager.cc:1403] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent bootstrapping tablet: real 0.040s	user 0.004s	sys 0.011s
I20260709 13:16:31.718725 17557 tablet_bootstrap.cc:654] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.720557 17556 raft_consensus.cc:359] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.721418 17556 raft_consensus.cc:385] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.721768 17556 raft_consensus.cc:740] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.722865 17556 consensus_queue.cc:260] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.723502 17562 raft_consensus.cc:493] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.724005 17562 raft_consensus.cc:515] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.728207 17562 leader_election.cc:290] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087)
I20260709 13:16:31.738296 17556 ts_tablet_manager.cc:1434] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.008s
I20260709 13:16:31.739436 17556 tablet_bootstrap.cc:492] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046: Bootstrap starting.
I20260709 13:16:31.753127 17555 tablet_bootstrap.cc:492] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21: No bootstrap required, opened a new log
I20260709 13:16:31.753705 17555 ts_tablet_manager.cc:1403] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.007s
I20260709 13:16:31.756588 17555 raft_consensus.cc:359] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.760850 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6587fd8ee4aa69030f634efd3ccb9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110" is_pre_election: true
I20260709 13:16:31.765009 17363 raft_consensus.cc:2468] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 0.
I20260709 13:16:31.765617 17556 tablet_bootstrap.cc:654] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.766489 17475 leader_election.cc:304] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, ba6a72526a7c40f5aa8b1953b90e8046; no voters: 
I20260709 13:16:31.767493 17583 raft_consensus.cc:2804] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:31.767853 17583 raft_consensus.cc:493] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.768181 17583 raft_consensus.cc:3060] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:31.771428 17557 tablet_bootstrap.cc:492] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110: No bootstrap required, opened a new log
I20260709 13:16:31.771960 17557 ts_tablet_manager.cc:1403] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110: Time spent bootstrapping tablet: real 0.061s	user 0.026s	sys 0.005s
I20260709 13:16:31.775063 17583 raft_consensus.cc:515] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.776172 17557 raft_consensus.cc:359] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.777320 17557 raft_consensus.cc:385] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.777748 17557 raft_consensus.cc:740] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.778419 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6587fd8ee4aa69030f634efd3ccb9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:31.778981 17363 raft_consensus.cc:3060] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:31.778826 17557 consensus_queue.cc:260] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.782656 17557 ts_tablet_manager.cc:1434] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 13:16:31.784086 17557 tablet_bootstrap.cc:492] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110: Bootstrap starting.
I20260709 13:16:31.790706 17560 raft_consensus.cc:493] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.791296 17560 raft_consensus.cc:515] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.793187 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6587fd8ee4aa69030f634efd3ccb9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21" is_pre_election: true
I20260709 13:16:31.793613 17560 leader_election.cc:290] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:31.793812 17438 raft_consensus.cc:2468] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 0.
I20260709 13:16:31.794725 17512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" is_pre_election: true
I20260709 13:16:31.795389 17512 raft_consensus.cc:2468] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 0.
I20260709 13:16:31.795948 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110" is_pre_election: true
I20260709 13:16:31.796603 17362 raft_consensus.cc:2468] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 0.
I20260709 13:16:31.797331 17402 leader_election.cc:304] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:31.798209 17557 tablet_bootstrap.cc:654] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.798918 17363 raft_consensus.cc:2468] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 1.
I20260709 13:16:31.799201 17560 raft_consensus.cc:2804] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:31.800105 17560 raft_consensus.cc:493] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.800511 17560 raft_consensus.cc:3060] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:31.800853 17475 leader_election.cc:304] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, ba6a72526a7c40f5aa8b1953b90e8046; no voters: 
I20260709 13:16:31.799656 17555 raft_consensus.cc:385] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.801676 17562 raft_consensus.cc:2804] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:31.802428 17583 leader_election.cc:290] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087)
I20260709 13:16:31.803747 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6587fd8ee4aa69030f634efd3ccb9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:31.804575 17438 raft_consensus.cc:3060] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:31.807662 17556 tablet_bootstrap.cc:492] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046: No bootstrap required, opened a new log
I20260709 13:16:31.808188 17556 ts_tablet_manager.cc:1403] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.018s
I20260709 13:16:31.809191 17560 raft_consensus.cc:515] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.811437 17556 raft_consensus.cc:359] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.812234 17556 raft_consensus.cc:385] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.812253 17438 raft_consensus.cc:2468] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 1.
I20260709 13:16:31.812680 17512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:31.813326 17512 raft_consensus.cc:3060] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:31.801748 17555 raft_consensus.cc:740] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.813788 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:31.816504 17363 raft_consensus.cc:3060] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:31.815164 17555 consensus_queue.cc:260] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.819744 17555 ts_tablet_manager.cc:1434] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21: Time spent starting tablet: real 0.066s	user 0.003s	sys 0.003s
I20260709 13:16:31.812587 17556 raft_consensus.cc:740] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.825803 17555 tablet_bootstrap.cc:492] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21: Bootstrap starting.
I20260709 13:16:31.826001 17556 consensus_queue.cc:260] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.828747 17556 ts_tablet_manager.cc:1434] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:16:31.829227 17562 raft_consensus.cc:697] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Becoming Leader. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Running, Role: LEADER
I20260709 13:16:31.831130 17562 consensus_queue.cc:237] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.824568 17363 raft_consensus.cc:2468] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 1.
I20260709 13:16:31.835240 17401 leader_election.cc:304] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:31.836164 17574 raft_consensus.cc:2804] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:31.837747 17556 tablet_bootstrap.cc:492] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046: Bootstrap starting.
I20260709 13:16:31.838202 17512 raft_consensus.cc:2468] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 1.
I20260709 13:16:31.839747 17560 leader_election.cc:290] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:31.842296 17557 tablet_bootstrap.cc:492] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110: No bootstrap required, opened a new log
I20260709 13:16:31.842741 17557 ts_tablet_manager.cc:1403] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.003s
I20260709 13:16:31.845531 17555 tablet_bootstrap.cc:654] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.848834 17574 raft_consensus.cc:697] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Becoming Leader. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:31.849716 17574 consensus_queue.cc:237] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.856720 17260 catalog_manager.cc:5697] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3). New cstate: current_term: 1 leader_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:31.862509 17557 raft_consensus.cc:359] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.863420 17557 raft_consensus.cc:385] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.863757 17557 raft_consensus.cc:740] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.864559 17557 consensus_queue.cc:260] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.869534 17556 tablet_bootstrap.cc:654] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.874756 17555 tablet_bootstrap.cc:492] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21: No bootstrap required, opened a new log
I20260709 13:16:31.875243 17555 ts_tablet_manager.cc:1403] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.000s
I20260709 13:16:31.878106 17555 raft_consensus.cc:359] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.878851 17555 raft_consensus.cc:385] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.879132 17555 raft_consensus.cc:740] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.879820 17555 consensus_queue.cc:260] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.880776 17557 ts_tablet_manager.cc:1434] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.015s
I20260709 13:16:31.882328 17555 ts_tablet_manager.cc:1434] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:16:31.883337 17555 tablet_bootstrap.cc:492] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21: Bootstrap starting.
I20260709 13:16:31.883646 17557 tablet_bootstrap.cc:492] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110: Bootstrap starting.
I20260709 13:16:31.879144 17259 catalog_manager.cc:5697] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "bb4637970e724b0598289a3e2a2a1c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:31.889775 17555 tablet_bootstrap.cc:654] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.890081 17557 tablet_bootstrap.cc:654] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.902667 17555 tablet_bootstrap.cc:492] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21: No bootstrap required, opened a new log
I20260709 13:16:31.903129 17555 ts_tablet_manager.cc:1403] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.011s
I20260709 13:16:31.905779 17555 raft_consensus.cc:359] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.906477 17555 raft_consensus.cc:385] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.906744 17555 raft_consensus.cc:740] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.907397 17555 consensus_queue.cc:260] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.909962 17555 ts_tablet_manager.cc:1434] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:31.910967 17555 tablet_bootstrap.cc:492] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21: Bootstrap starting.
I20260709 13:16:31.912027 17557 tablet_bootstrap.cc:492] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110: No bootstrap required, opened a new log
I20260709 13:16:31.912519 17557 ts_tablet_manager.cc:1403] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.004s
I20260709 13:16:31.915555 17557 raft_consensus.cc:359] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.916293 17557 raft_consensus.cc:385] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.916676 17557 raft_consensus.cc:740] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.917814 17555 tablet_bootstrap.cc:654] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.917582 17557 consensus_queue.cc:260] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.924256 17557 ts_tablet_manager.cc:1434] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:16:31.926116 17557 tablet_bootstrap.cc:492] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110: Bootstrap starting.
I20260709 13:16:31.930262 17562 raft_consensus.cc:493] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.930933 17562 raft_consensus.cc:515] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.933439 17562 leader_election.cc:290] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087)
I20260709 13:16:31.934150 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110" is_pre_election: true
I20260709 13:16:31.937166 17363 raft_consensus.cc:2468] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 0.
I20260709 13:16:31.938433 17475 leader_election.cc:304] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, ba6a72526a7c40f5aa8b1953b90e8046; no voters: 
I20260709 13:16:31.939178 17562 raft_consensus.cc:2804] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:31.939549 17562 raft_consensus.cc:493] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.939885 17562 raft_consensus.cc:3060] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:31.940429 17555 tablet_bootstrap.cc:492] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21: No bootstrap required, opened a new log
I20260709 13:16:31.935164 17556 tablet_bootstrap.cc:492] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046: No bootstrap required, opened a new log
I20260709 13:16:31.935767 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21" is_pre_election: true
I20260709 13:16:31.941244 17556 ts_tablet_manager.cc:1403] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent bootstrapping tablet: real 0.104s	user 0.005s	sys 0.015s
I20260709 13:16:31.941286 17438 raft_consensus.cc:2468] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 0.
I20260709 13:16:31.940878 17555 ts_tablet_manager.cc:1403] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.012s
I20260709 13:16:31.944339 17556 raft_consensus.cc:359] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.945288 17555 raft_consensus.cc:359] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.945611 17556 raft_consensus.cc:385] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.945979 17555 raft_consensus.cc:385] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.946115 17556 raft_consensus.cc:740] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.946332 17555 raft_consensus.cc:740] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.947029 17562 raft_consensus.cc:515] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.947177 17555 consensus_queue.cc:260] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.947213 17556 consensus_queue.cc:260] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.949141 17562 leader_election.cc:290] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087)
I20260709 13:16:31.950580 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:31.951145 17363 raft_consensus.cc:3060] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:31.951526 17557 tablet_bootstrap.cc:654] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.956290 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:31.956861 17438 raft_consensus.cc:3060] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:31.963894 17557 tablet_bootstrap.cc:492] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110: No bootstrap required, opened a new log
I20260709 13:16:31.964368 17557 ts_tablet_manager.cc:1403] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.003s
I20260709 13:16:31.965428 17556 ts_tablet_manager.cc:1434] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.006s
I20260709 13:16:31.965834 17363 raft_consensus.cc:2468] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 1.
I20260709 13:16:31.967060 17475 leader_election.cc:304] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, ba6a72526a7c40f5aa8b1953b90e8046; no voters: 
I20260709 13:16:31.967926 17562 raft_consensus.cc:2804] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:31.968391 17562 raft_consensus.cc:697] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Becoming Leader. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Running, Role: LEADER
I20260709 13:16:31.969095 17438 raft_consensus.cc:2468] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 1.
I20260709 13:16:31.969287 17562 consensus_queue.cc:237] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.972054 17555 ts_tablet_manager.cc:1434] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:16:31.972991 17555 tablet_bootstrap.cc:492] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21: Bootstrap starting.
I20260709 13:16:31.967103 17557 raft_consensus.cc:359] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.974733 17557 raft_consensus.cc:385] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.975009 17557 raft_consensus.cc:740] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.975632 17557 consensus_queue.cc:260] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.978725 17555 tablet_bootstrap.cc:654] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.981706 17556 tablet_bootstrap.cc:492] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046: Bootstrap starting.
I20260709 13:16:31.986385 17557 ts_tablet_manager.cc:1434] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:16:31.989235 17556 tablet_bootstrap.cc:654] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:31.990295 17555 tablet_bootstrap.cc:492] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21: No bootstrap required, opened a new log
I20260709 13:16:31.990782 17555 ts_tablet_manager.cc:1403] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:16:31.993273 17555 raft_consensus.cc:359] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.993898 17555 raft_consensus.cc:385] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:31.994163 17557 tablet_bootstrap.cc:492] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110: Bootstrap starting.
I20260709 13:16:31.994313 17555 raft_consensus.cc:740] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Initialized, Role: FOLLOWER
I20260709 13:16:31.994969 17555 consensus_queue.cc:260] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:31.997146 17555 ts_tablet_manager.cc:1434] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:16:32.000469 17557 tablet_bootstrap.cc:654] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.004159 17258 catalog_manager.cc:5697] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3). New cstate: current_term: 1 leader_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.022593 17574 raft_consensus.cc:493] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.023202 17574 raft_consensus.cc:515] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.025533 17574 leader_election.cc:290] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.027153 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f7e8fb9f094838938c0f00c71f3939" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110" is_pre_election: true
W20260709 13:16:32.028887 17401 leader_election.cc:343] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.029887 17512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f7e8fb9f094838938c0f00c71f3939" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" is_pre_election: true
I20260709 13:16:32.030761 17512 raft_consensus.cc:2468] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 0.
I20260709 13:16:32.034860 17402 leader_election.cc:304] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 7188a99172d54e4a914928679d6a4110
I20260709 13:16:32.039433 17574 raft_consensus.cc:2804] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.039814 17574 raft_consensus.cc:493] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.040146 17574 raft_consensus.cc:3060] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.047566 17574 raft_consensus.cc:515] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.049492 17592 raft_consensus.cc:493] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.050065 17592 raft_consensus.cc:515] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.052526 17592 leader_election.cc:290] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.053615 17574 leader_election.cc:290] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.054417 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110" is_pre_election: true
I20260709 13:16:32.055881 17512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" is_pre_election: true
I20260709 13:16:32.056210 17363 raft_consensus.cc:2468] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 0.
I20260709 13:16:32.058604 17401 leader_election.cc:304] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:32.058939 17557 tablet_bootstrap.cc:492] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110: No bootstrap required, opened a new log
I20260709 13:16:32.059468 17557 ts_tablet_manager.cc:1403] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110: Time spent bootstrapping tablet: real 0.065s	user 0.033s	sys 0.027s
W20260709 13:16:32.059733 17402 leader_election.cc:343] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.060598 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f7e8fb9f094838938c0f00c71f3939" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:32.061021 17512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f7e8fb9f094838938c0f00c71f3939" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:32.061553 17512 raft_consensus.cc:3060] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:32.061983 17401 leader_election.cc:343] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.062431 17557 raft_consensus.cc:359] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.063285 17557 raft_consensus.cc:385] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.063623 17557 raft_consensus.cc:740] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.064363 17557 consensus_queue.cc:260] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.066776 17557 ts_tablet_manager.cc:1434] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:32.069481 17512 raft_consensus.cc:2468] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 1.
I20260709 13:16:32.070838 17402 leader_election.cc:304] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 7188a99172d54e4a914928679d6a4110
I20260709 13:16:32.071663 17592 raft_consensus.cc:2804] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.072091 17592 raft_consensus.cc:493] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.072428 17592 raft_consensus.cc:3060] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.078859 17556 tablet_bootstrap.cc:492] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046: No bootstrap required, opened a new log
I20260709 13:16:32.082558 17556 ts_tablet_manager.cc:1403] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.020s
I20260709 13:16:32.078882 17560 raft_consensus.cc:2804] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.084146 17560 raft_consensus.cc:697] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Becoming Leader. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:32.085131 17560 consensus_queue.cc:237] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.085315 17556 raft_consensus.cc:359] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.086086 17556 raft_consensus.cc:385] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.086380 17556 raft_consensus.cc:740] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.087095 17556 consensus_queue.cc:260] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.089365 17556 ts_tablet_manager.cc:1434] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:32.090368 17556 tablet_bootstrap.cc:492] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046: Bootstrap starting.
I20260709 13:16:32.094431 17604 consensus_queue.cc:1048] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:32.096848 17556 tablet_bootstrap.cc:654] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.104710 17604 raft_consensus.cc:493] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.105291 17604 raft_consensus.cc:515] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.107836 17562 raft_consensus.cc:493] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.108230 17556 tablet_bootstrap.cc:492] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046: No bootstrap required, opened a new log
I20260709 13:16:32.108728 17556 ts_tablet_manager.cc:1403] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent bootstrapping tablet: real 0.019s	user 0.002s	sys 0.014s
I20260709 13:16:32.108286 17562 raft_consensus.cc:515] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.109653 17512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772809c7a4184e28883b791067023ca9" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" is_pre_election: true
I20260709 13:16:32.110088 17563 raft_consensus.cc:493] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.110627 17563 raft_consensus.cc:515] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.080664 17592 raft_consensus.cc:515] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.165650 17562 leader_election.cc:290] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087)
W20260709 13:16:32.168726 17402 leader_election.cc:343] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.165635 17604 leader_election.cc:290] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.169682 17604 raft_consensus.cc:493] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.169837 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950593dd09ed479d9b1aeba327bb8bb9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110" is_pre_election: true
I20260709 13:16:32.135015 17258 catalog_manager.cc:5697] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "bb4637970e724b0598289a3e2a2a1c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.170128 17604 raft_consensus.cc:515] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.170480 17363 raft_consensus.cc:2468] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 0.
I20260709 13:16:32.172138 17475 leader_election.cc:304] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, ba6a72526a7c40f5aa8b1953b90e8046; no voters: 
I20260709 13:16:32.110733 17362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772809c7a4184e28883b791067023ca9" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110" is_pre_election: true
I20260709 13:16:32.172986 17562 raft_consensus.cc:2804] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.173213 17362 raft_consensus.cc:2468] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 0.
I20260709 13:16:32.173367 17562 raft_consensus.cc:493] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.174713 17563 leader_election.cc:290] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.174607 17562 raft_consensus.cc:3060] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.174552 17401 leader_election.cc:304] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: ba6a72526a7c40f5aa8b1953b90e8046
I20260709 13:16:32.175711 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950593dd09ed479d9b1aeba327bb8bb9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21" is_pre_election: true
I20260709 13:16:32.175952 17563 raft_consensus.cc:493] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.176333 17438 raft_consensus.cc:2468] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 0.
I20260709 13:16:32.177043 17512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950593dd09ed479d9b1aeba327bb8bb9" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" is_pre_election: true
I20260709 13:16:32.176376 17563 raft_consensus.cc:515] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.167630 17556 raft_consensus.cc:359] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.179185 17563 leader_election.cc:290] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.180260 17511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdf35a90f843a1ab32251380b08878" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" is_pre_election: true
I20260709 13:16:32.180966 17556 raft_consensus.cc:385] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.183216 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950593dd09ed479d9b1aeba327bb8bb9" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21" is_pre_election: true
I20260709 13:16:32.184437 17556 raft_consensus.cc:740] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.184587 17438 raft_consensus.cc:2468] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 0.
I20260709 13:16:32.181638 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdf35a90f843a1ab32251380b08878" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110" is_pre_election: true
I20260709 13:16:32.183756 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdf35a90f843a1ab32251380b08878" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21" is_pre_election: true
I20260709 13:16:32.185109 17562 raft_consensus.cc:515] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.185576 17363 raft_consensus.cc:2468] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 0.
I20260709 13:16:32.185650 17437 raft_consensus.cc:2468] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 0.
I20260709 13:16:32.190703 17608 raft_consensus.cc:2804] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.190478 17401 leader_election.cc:304] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:32.190479 17326 leader_election.cc:304] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:32.191198 17608 raft_consensus.cc:493] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.191267 17592 leader_election.cc:290] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.192019 17604 leader_election.cc:290] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.193141 17326 leader_election.cc:304] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:32.193673 17512 raft_consensus.cc:2393] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7188a99172d54e4a914928679d6a4110 in current term 1: Already voted for candidate ba6a72526a7c40f5aa8b1953b90e8046 in this term.
I20260709 13:16:32.193889 17563 raft_consensus.cc:2804] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.194386 17563 raft_consensus.cc:493] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.196341 17509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdf35a90f843a1ab32251380b08878" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" is_pre_election: true
I20260709 13:16:32.196516 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950593dd09ed479d9b1aeba327bb8bb9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:32.195930 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:32.195051 17563 raft_consensus.cc:3060] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.197490 17562 leader_election.cc:290] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087)
I20260709 13:16:32.197602 17510 raft_consensus.cc:3060] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.201464 17609 raft_consensus.cc:2804] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.204262 17609 raft_consensus.cc:493] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.205435 17609 raft_consensus.cc:3060] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.194157 17556 consensus_queue.cc:260] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.207355 17510 raft_consensus.cc:2468] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 1.
I20260709 13:16:32.207479 17511 raft_consensus.cc:2468] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 0.
I20260709 13:16:32.209046 17563 raft_consensus.cc:515] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.210268 17363 raft_consensus.cc:2393] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba6a72526a7c40f5aa8b1953b90e8046 in current term 1: Already voted for candidate 7188a99172d54e4a914928679d6a4110 in this term.
I20260709 13:16:32.192359 17592 raft_consensus.cc:2804] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.191851 17608 raft_consensus.cc:3060] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.214460 17556 ts_tablet_manager.cc:1434] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.001s
I20260709 13:16:32.213817 17592 raft_consensus.cc:493] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.210283 17402 leader_election.cc:304] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:32.216691 17556 tablet_bootstrap.cc:492] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046: Bootstrap starting.
I20260709 13:16:32.218328 17574 raft_consensus.cc:2804] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.218788 17574 raft_consensus.cc:697] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Becoming Leader. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:32.217329 17592 raft_consensus.cc:3060] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.219988 17574 consensus_queue.cc:237] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.220692 17511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950593dd09ed479d9b1aeba327bb8bb9" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:32.221447 17511 raft_consensus.cc:2393] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7188a99172d54e4a914928679d6a4110 in current term 1: Already voted for candidate ba6a72526a7c40f5aa8b1953b90e8046 in this term.
I20260709 13:16:32.226092 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:32.226724 17363 raft_consensus.cc:3060] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.228449 17560 consensus_queue.cc:1048] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:32.226889 17592 raft_consensus.cc:515] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.218830 17563 leader_election.cc:290] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 election: Requested vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.235219 17563 raft_consensus.cc:493] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.235634 17563 raft_consensus.cc:515] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.237610 17563 leader_election.cc:290] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.240724 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950593dd09ed479d9b1aeba327bb8bb9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:32.244002 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f7e8fb9f094838938c0f00c71f3939" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" is_pre_election: true
I20260709 13:16:32.246156 17512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdf35a90f843a1ab32251380b08878" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:32.243628 17592 leader_election.cc:290] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.245083 17438 raft_consensus.cc:3060] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.245868 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950593dd09ed479d9b1aeba327bb8bb9" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:32.263345 17510 raft_consensus.cc:2393] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7188a99172d54e4a914928679d6a4110 in current term 1: Already voted for candidate bb4637970e724b0598289a3e2a2a1c21 in this term.
I20260709 13:16:32.262701 17562 consensus_queue.cc:1048] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:32.244036 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdf35a90f843a1ab32251380b08878" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:32.259055 17512 raft_consensus.cc:3060] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.263406 17436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f7e8fb9f094838938c0f00c71f3939" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21" is_pre_election: true
I20260709 13:16:32.275815 17363 raft_consensus.cc:2468] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 1.
I20260709 13:16:32.288698 17326 leader_election.cc:304] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7188a99172d54e4a914928679d6a4110; no voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21
I20260709 13:16:32.291853 17556 tablet_bootstrap.cc:654] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.292698 17574 consensus_queue.cc:1048] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:32.283821 17327 leader_election.cc:304] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7188a99172d54e4a914928679d6a4110; no voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21
I20260709 13:16:32.301402 17613 raft_consensus.cc:2749] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:32.302892 17260 catalog_manager.cc:5697] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "bb4637970e724b0598289a3e2a2a1c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.306852 17608 raft_consensus.cc:515] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.301769 17563 raft_consensus.cc:3060] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.311208 17608 leader_election.cc:290] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.312729 17509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772809c7a4184e28883b791067023ca9" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
W20260709 13:16:32.315039 17402 leader_election.cc:343] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.322607 17512 raft_consensus.cc:2468] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 1.
I20260709 13:16:32.313186 17438 raft_consensus.cc:2468] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 1.
I20260709 13:16:32.324254 17402 leader_election.cc:304] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:32.324667 17475 leader_election.cc:304] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 7188a99172d54e4a914928679d6a4110
I20260709 13:16:32.325008 17574 raft_consensus.cc:2804] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.325685 17574 raft_consensus.cc:697] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Becoming Leader. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:32.326819 17562 raft_consensus.cc:2804] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.327049 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772809c7a4184e28883b791067023ca9" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:32.327354 17562 raft_consensus.cc:697] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Becoming Leader. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Running, Role: LEADER
I20260709 13:16:32.327762 17363 raft_consensus.cc:3060] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:32.328190 17307 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:32.328307 17562 consensus_queue.cc:237] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.329391 17563 raft_consensus.cc:2749] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:32.331881 17574 consensus_queue.cc:237] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.336609 17592 consensus_queue.cc:1048] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:32.352806 17260 catalog_manager.cc:5697] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3). New cstate: current_term: 1 leader_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.362262 17556 tablet_bootstrap.cc:492] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046: No bootstrap required, opened a new log
I20260709 13:16:32.362797 17556 ts_tablet_manager.cc:1403] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent bootstrapping tablet: real 0.146s	user 0.022s	sys 0.012s
I20260709 13:16:32.352270 17562 consensus_queue.cc:1048] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:32.365559 17556 raft_consensus.cc:359] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.369289 17609 raft_consensus.cc:515] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.370570 17361 raft_consensus.cc:2393] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb4637970e724b0598289a3e2a2a1c21 in current term 1: Already voted for candidate 7188a99172d54e4a914928679d6a4110 in this term.
I20260709 13:16:32.366266 17556 raft_consensus.cc:385] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.371774 17556 raft_consensus.cc:740] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.373216 17363 raft_consensus.cc:2468] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 1.
I20260709 13:16:32.374015 17258 catalog_manager.cc:5697] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "bb4637970e724b0598289a3e2a2a1c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.374656 17556 consensus_queue.cc:260] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.377295 17401 leader_election.cc:304] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: ba6a72526a7c40f5aa8b1953b90e8046
I20260709 13:16:32.378329 17608 raft_consensus.cc:2804] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.378886 17608 raft_consensus.cc:697] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Becoming Leader. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:32.380095 17556 ts_tablet_manager.cc:1434] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 13:16:32.379804 17608 consensus_queue.cc:237] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.386857 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdf35a90f843a1ab32251380b08878" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:32.389330 17609 leader_election.cc:290] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 election: Requested vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.390213 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdf35a90f843a1ab32251380b08878" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:32.391057 17510 raft_consensus.cc:2393] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7188a99172d54e4a914928679d6a4110 in current term 1: Already voted for candidate bb4637970e724b0598289a3e2a2a1c21 in this term.
I20260709 13:16:32.392704 17327 leader_election.cc:304] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7188a99172d54e4a914928679d6a4110; no voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21
I20260709 13:16:32.393760 17609 raft_consensus.cc:2749] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:32.400683 17583 consensus_queue.cc:1048] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:32.418910 17589 consensus_queue.cc:1048] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:32.426049 17259 catalog_manager.cc:5697] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "bb4637970e724b0598289a3e2a2a1c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.437474 17589 raft_consensus.cc:493] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.437959 17589 raft_consensus.cc:515] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.439646 17589 leader_election.cc:290] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087)
I20260709 13:16:32.440356 17363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772809c7a4184e28883b791067023ca9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7188a99172d54e4a914928679d6a4110" is_pre_election: true
I20260709 13:16:32.440646 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772809c7a4184e28883b791067023ca9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4637970e724b0598289a3e2a2a1c21" is_pre_election: true
I20260709 13:16:32.441206 17363 raft_consensus.cc:2393] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba6a72526a7c40f5aa8b1953b90e8046 in current term 1: Already voted for candidate bb4637970e724b0598289a3e2a2a1c21 in this term.
I20260709 13:16:32.442361 17475 leader_election.cc:304] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046; no voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21
I20260709 13:16:32.443162 17589 raft_consensus.cc:3060] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.448700 17589 raft_consensus.cc:2749] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:32.514216 17438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
mode: GRACEFUL
new_leader_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:38764
I20260709 13:16:32.514874 17438 raft_consensus.cc:606] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Received request to transfer leadership to TS 7188a99172d54e4a914928679d6a4110
I20260709 13:16:32.528666 17510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed6587fd8ee4aa69030f634efd3ccb9"
dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
mode: GRACEFUL
new_leader_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:38644
I20260709 13:16:32.529198 17510 raft_consensus.cc:606] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Received request to transfer leadership to TS 7188a99172d54e4a914928679d6a4110
I20260709 13:16:32.534493 17438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
mode: GRACEFUL
new_leader_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:38764
I20260709 13:16:32.535084 17438 raft_consensus.cc:606] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Received request to transfer leadership to TS 7188a99172d54e4a914928679d6a4110
I20260709 13:16:32.540566 17438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
mode: GRACEFUL
new_leader_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:38764
I20260709 13:16:32.541242 17438 raft_consensus.cc:606] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Received request to transfer leadership to TS 7188a99172d54e4a914928679d6a4110
I20260709 13:16:32.546828 17510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9"
dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
mode: GRACEFUL
new_leader_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:38644
I20260709 13:16:32.547359 17510 raft_consensus.cc:606] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Received request to transfer leadership to TS bb4637970e724b0598289a3e2a2a1c21
I20260709 13:16:32.555470 17510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "950593dd09ed479d9b1aeba327bb8bb9"
dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
mode: GRACEFUL
new_leader_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:38644
I20260709 13:16:32.556140 17510 raft_consensus.cc:606] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Received request to transfer leadership to TS bb4637970e724b0598289a3e2a2a1c21
I20260709 13:16:32.565107 17438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "772809c7a4184e28883b791067023ca9"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
mode: GRACEFUL
new_leader_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
 from {username='slave'} at 127.0.0.1:38764
I20260709 13:16:32.565707 17438 raft_consensus.cc:606] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Received request to transfer leadership to TS ba6a72526a7c40f5aa8b1953b90e8046
I20260709 13:16:32.633667 17608 consensus_queue.cc:1048] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:32.634907 17611 consensus_queue.cc:1048] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:32.646448 17592 consensus_queue.cc:1048] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:32.652046 17574 consensus_queue.cc:1048] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:32.662971 17574 raft_consensus.cc:993] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21: : Instructing follower 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:32.663625 17574 raft_consensus.cc:1081] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Signalling peer 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:32.665599 17360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff"
dest_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:55046
I20260709 13:16:32.666216 17360 raft_consensus.cc:493] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.666560 17360 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.678377 17360 raft_consensus.cc:515] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.681021 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:32.681545 17438 raft_consensus.cc:3055] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:32.681818 17438 raft_consensus.cc:740] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:32.682595 17438 consensus_queue.cc:260] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.680423 17360 leader_election.cc:290] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 2 election: Requested vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.683580 17438 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.688444 17574 raft_consensus.cc:993] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21: : Instructing follower 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:32.686465 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:32.688879 17510 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.688874 17560 raft_consensus.cc:1081] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Signalling peer 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:32.692456 17438 raft_consensus.cc:2468] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 2.
I20260709 13:16:32.693711 17326 leader_election.cc:304] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:32.694536 17609 raft_consensus.cc:2804] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:32.694983 17609 raft_consensus.cc:697] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Becoming Leader. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Running, Role: LEADER
I20260709 13:16:32.695483 17510 raft_consensus.cc:2468] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 2.
I20260709 13:16:32.695760 17609 consensus_queue.cc:237] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.696480 17361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30"
dest_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:55046
I20260709 13:16:32.697032 17361 raft_consensus.cc:493] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.697404 17361 raft_consensus.cc:3060] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.704020 17361 raft_consensus.cc:515] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.706162 17361 leader_election.cc:290] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 2 election: Requested vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.707115 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:32.708088 17438 raft_consensus.cc:3055] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:32.708396 17438 raft_consensus.cc:740] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:32.709144 17438 consensus_queue.cc:260] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.710363 17438 raft_consensus.cc:3060] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.710489 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:32.711105 17510 raft_consensus.cc:3060] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.710705 17259 catalog_manager.cc:5697] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 reported cstate change: term changed from 1 to 2, leader changed from bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2) to 7188a99172d54e4a914928679d6a4110 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "7188a99172d54e4a914928679d6a4110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.717193 17438 raft_consensus.cc:2468] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 2.
I20260709 13:16:32.718266 17326 leader_election.cc:304] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:32.718475 17510 raft_consensus.cc:2468] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 2.
I20260709 13:16:32.720219 17609 raft_consensus.cc:2804] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:32.721544 17609 raft_consensus.cc:697] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Becoming Leader. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Running, Role: LEADER
I20260709 13:16:32.721570 17589 consensus_queue.cc:1048] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:32.722795 17609 consensus_queue.cc:237] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.729934 17259 catalog_manager.cc:5697] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 reported cstate change: term changed from 1 to 2, leader changed from bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2) to 7188a99172d54e4a914928679d6a4110 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "7188a99172d54e4a914928679d6a4110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.736169 17583 consensus_queue.cc:1048] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:32.745385 17562 raft_consensus.cc:993] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046: : Instructing follower bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:32.745829 17562 raft_consensus.cc:1081] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Signalling peer bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:32.747464 17438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "950593dd09ed479d9b1aeba327bb8bb9"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:38750
I20260709 13:16:32.748448 17438 raft_consensus.cc:493] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.748828 17438 raft_consensus.cc:3060] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.753892 17438 raft_consensus.cc:515] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.756664 17574 consensus_queue.cc:1048] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:32.757319 17438 leader_election.cc:290] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 2 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.759167 17361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950593dd09ed479d9b1aeba327bb8bb9" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:32.759739 17361 raft_consensus.cc:3060] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.759744 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950593dd09ed479d9b1aeba327bb8bb9" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:32.763381 17510 raft_consensus.cc:3055] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:32.763708 17510 raft_consensus.cc:740] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Running, Role: LEADER
I20260709 13:16:32.764477 17510 consensus_queue.cc:260] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.765431 17510 raft_consensus.cc:3060] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.770977 17510 raft_consensus.cc:2468] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 2.
I20260709 13:16:32.772161 17402 leader_election.cc:304] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:32.772944 17574 raft_consensus.cc:2804] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:32.773424 17574 raft_consensus.cc:697] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 LEADER]: Becoming Leader. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:32.774009 17361 raft_consensus.cc:2468] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 2.
I20260709 13:16:32.774279 17574 consensus_queue.cc:237] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.782895 17592 consensus_queue.cc:1048] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:32.785832 17258 catalog_manager.cc:5697] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 reported cstate change: term changed from 1 to 2, leader changed from ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3) to bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "bb4637970e724b0598289a3e2a2a1c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.807823 17562 raft_consensus.cc:993] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046: : Instructing follower 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:32.807677 17592 consensus_queue.cc:1048] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:32.810597 17583 raft_consensus.cc:1081] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Signalling peer 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:32.814476 17360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ed6587fd8ee4aa69030f634efd3ccb9"
dest_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:55056
I20260709 13:16:32.815744 17360 raft_consensus.cc:493] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.816725 17360 raft_consensus.cc:3060] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.823851 17360 raft_consensus.cc:515] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.826581 17583 raft_consensus.cc:993] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046: : Instructing follower bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:32.832062 17592 consensus_queue.cc:1048] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:32.835412 17589 raft_consensus.cc:1081] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Signalling peer bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:32.836973 17360 leader_election.cc:290] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 2 election: Requested vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.837318 17438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:38750
I20260709 13:16:32.837858 17438 raft_consensus.cc:493] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.838241 17438 raft_consensus.cc:3060] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.838688 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6587fd8ee4aa69030f634efd3ccb9" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:32.839277 17510 raft_consensus.cc:3055] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:32.839583 17510 raft_consensus.cc:740] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Running, Role: LEADER
I20260709 13:16:32.840337 17510 consensus_queue.cc:260] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.841259 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6587fd8ee4aa69030f634efd3ccb9" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:32.841537 17510 raft_consensus.cc:3060] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.841787 17437 raft_consensus.cc:3060] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.848529 17437 raft_consensus.cc:2468] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 2.
I20260709 13:16:32.849802 17326 leader_election.cc:304] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:32.850862 17609 raft_consensus.cc:2804] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:32.851347 17609 raft_consensus.cc:697] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Becoming Leader. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Running, Role: LEADER
I20260709 13:16:32.852154 17609 consensus_queue.cc:237] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.849277 17510 raft_consensus.cc:2468] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 2.
I20260709 13:16:32.856168 17438 raft_consensus.cc:515] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.860010 17438 leader_election.cc:290] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 2 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.861096 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:32.861735 17510 raft_consensus.cc:3055] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:32.862109 17510 raft_consensus.cc:740] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Running, Role: LEADER
I20260709 13:16:32.863166 17510 consensus_queue.cc:260] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.864423 17510 raft_consensus.cc:3060] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.866485 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:32.867123 17360 raft_consensus.cc:3060] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.870045 17257 catalog_manager.cc:5697] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 reported cstate change: term changed from 1 to 2, leader changed from ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3) to 7188a99172d54e4a914928679d6a4110 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "7188a99172d54e4a914928679d6a4110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.872460 17510 raft_consensus.cc:2468] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 2.
I20260709 13:16:32.873677 17402 leader_election.cc:304] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:32.874840 17592 raft_consensus.cc:2804] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:32.875303 17592 raft_consensus.cc:697] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 LEADER]: Becoming Leader. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:32.876111 17592 consensus_queue.cc:237] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.880095 17608 raft_consensus.cc:993] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21: : Instructing follower ba6a72526a7c40f5aa8b1953b90e8046 to start an election
I20260709 13:16:32.880515 17608 raft_consensus.cc:1081] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Signalling peer ba6a72526a7c40f5aa8b1953b90e8046 to start an election
I20260709 13:16:32.882522 17360 raft_consensus.cc:2468] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 2.
I20260709 13:16:32.883008 17512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "772809c7a4184e28883b791067023ca9"
dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
 from {username='slave'} at 127.0.0.1:38634
I20260709 13:16:32.883555 17512 raft_consensus.cc:493] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.883903 17512 raft_consensus.cc:3060] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.890211 17258 catalog_manager.cc:5697] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 reported cstate change: term changed from 1 to 2, leader changed from ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3) to bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "bb4637970e724b0598289a3e2a2a1c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.890929 17512 raft_consensus.cc:515] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.892895 17512 leader_election.cc:290] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 2 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087)
I20260709 13:16:32.894398 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772809c7a4184e28883b791067023ca9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:32.894932 17438 raft_consensus.cc:3055] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:32.895216 17438 raft_consensus.cc:740] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:32.895888 17438 consensus_queue.cc:260] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.894377 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772809c7a4184e28883b791067023ca9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:32.896934 17438 raft_consensus.cc:3060] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.897358 17360 raft_consensus.cc:3060] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.903034 17438 raft_consensus.cc:2468] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 2.
I20260709 13:16:32.904050 17475 leader_election.cc:304] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:32.904341 17360 raft_consensus.cc:2468] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 2.
I20260709 13:16:32.904747 17639 raft_consensus.cc:2804] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:32.905208 17639 raft_consensus.cc:697] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 LEADER]: Becoming Leader. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Running, Role: LEADER
I20260709 13:16:32.905974 17639 consensus_queue.cc:237] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.911973 17258 catalog_manager.cc:5697] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 reported cstate change: term changed from 1 to 2, leader changed from bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2) to ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3). New cstate: current_term: 2 leader_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.972268 17611 raft_consensus.cc:993] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21: : Instructing follower 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:32.972792 17592 raft_consensus.cc:1081] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Signalling peer 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:32.974372 17360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb"
dest_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:55046
I20260709 13:16:32.974870 17360 raft_consensus.cc:493] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.975201 17360 raft_consensus.cc:3060] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.979969 17360 raft_consensus.cc:515] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.981860 17360 leader_election.cc:290] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 2 election: Requested vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:32.982635 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:32.983206 17438 raft_consensus.cc:3055] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:32.983088 17512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:32.983611 17438 raft_consensus.cc:740] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:32.983793 17512 raft_consensus.cc:3060] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.984459 17438 consensus_queue.cc:260] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.985630 17438 raft_consensus.cc:3060] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.988842 17512 raft_consensus.cc:2468] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 2.
I20260709 13:16:32.990074 17327 leader_election.cc:304] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, ba6a72526a7c40f5aa8b1953b90e8046; no voters: 
I20260709 13:16:32.990823 17609 raft_consensus.cc:2804] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:32.991287 17609 raft_consensus.cc:697] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Becoming Leader. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Running, Role: LEADER
I20260709 13:16:32.992023 17438 raft_consensus.cc:2468] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 2.
I20260709 13:16:32.992182 17609 consensus_queue.cc:237] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:32.999116 17258 catalog_manager.cc:5697] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 reported cstate change: term changed from 1 to 2, leader changed from bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2) to 7188a99172d54e4a914928679d6a4110 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "7188a99172d54e4a914928679d6a4110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.125819 17512 raft_consensus.cc:1275] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.127198 17609 consensus_queue.cc:1048] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.132423 17438 raft_consensus.cc:1275] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.136435 17609 consensus_queue.cc:1048] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:33.262173 17437 raft_consensus.cc:1275] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.263949 17642 consensus_queue.cc:1048] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:33.272894 17512 raft_consensus.cc:1275] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.274526 17609 consensus_queue.cc:1048] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.302937 17512 raft_consensus.cc:1275] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.304203 17611 consensus_queue.cc:1048] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.311028 17360 raft_consensus.cc:1275] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.312707 17560 consensus_queue.cc:1048] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.356822 17360 raft_consensus.cc:1275] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.358387 17560 consensus_queue.cc:1048] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.366659 17512 raft_consensus.cc:1275] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.368432 17574 consensus_queue.cc:1048] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.391852 17512 raft_consensus.cc:1275] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.393150 17642 consensus_queue.cc:1048] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.401834 17437 raft_consensus.cc:1275] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.402670 17438 raft_consensus.cc:1275] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.403992 17642 consensus_queue.cc:1048] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:33.404022 17609 consensus_queue.cc:1048] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.415702 17512 raft_consensus.cc:1275] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.418273 17360 raft_consensus.cc:1275] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Refusing update from remote peer ba6a72526a7c40f5aa8b1953b90e8046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.418977 17563 consensus_queue.cc:1048] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.420007 17639 consensus_queue.cc:1048] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.431639 17437 raft_consensus.cc:1275] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Refusing update from remote peer ba6a72526a7c40f5aa8b1953b90e8046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.433472 17639 consensus_queue.cc:1048] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:35.594142 17228 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:16:35.595235 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:35.615823 17360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff"
dest_uuid: "7188a99172d54e4a914928679d6a4110"
mode: GRACEFUL
new_leader_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
 from {username='slave'} at 127.0.0.1:46364
I20260709 13:16:35.616350 17360 raft_consensus.cc:606] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Received request to transfer leadership to TS ba6a72526a7c40f5aa8b1953b90e8046
I20260709 13:16:35.627306 17438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
mode: GRACEFUL
new_leader_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
 from {username='slave'} at 127.0.0.1:41472
I20260709 13:16:35.627895 17438 raft_consensus.cc:606] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 LEADER]: Received request to transfer leadership to TS ba6a72526a7c40f5aa8b1953b90e8046
I20260709 13:16:35.629010 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:35.629442 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:35.871336 17609 raft_consensus.cc:993] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110: : Instructing follower ba6a72526a7c40f5aa8b1953b90e8046 to start an election
I20260709 13:16:35.871743 17655 raft_consensus.cc:1081] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Signalling peer ba6a72526a7c40f5aa8b1953b90e8046 to start an election
I20260709 13:16:35.873441 17510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff"
dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
 from {username='slave'} at 127.0.0.1:38640
I20260709 13:16:35.874002 17510 raft_consensus.cc:493] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:35.874301 17510 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.878616 17510 raft_consensus.cc:515] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:35.880244 17510 leader_election.cc:290] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 3 election: Requested vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659)
I20260709 13:16:35.881107 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:35.881423 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:35.881692 17438 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.882014 17360 raft_consensus.cc:3055] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:35.882308 17360 raft_consensus.cc:740] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Running, Role: LEADER
I20260709 13:16:35.883056 17360 consensus_queue.cc:260] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:35.884195 17360 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.887692 17438 raft_consensus.cc:2468] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 3.
I20260709 13:16:35.888854 17475 leader_election.cc:304] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:35.889621 17649 raft_consensus.cc:2804] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:35.890352 17360 raft_consensus.cc:2468] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 3.
I20260709 13:16:35.890980 17649 raft_consensus.cc:697] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 LEADER]: Becoming Leader. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Running, Role: LEADER
I20260709 13:16:35.891739 17649 consensus_queue.cc:237] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:35.899864 17259 catalog_manager.cc:5697] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 reported cstate change: term changed from 2 to 3, leader changed from 7188a99172d54e4a914928679d6a4110 (127.16.211.1) to ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3). New cstate: current_term: 3 leader_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:36.036748 17654 raft_consensus.cc:993] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21: : Instructing follower ba6a72526a7c40f5aa8b1953b90e8046 to start an election
I20260709 13:16:36.037230 17611 raft_consensus.cc:1081] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 LEADER]: Signalling peer ba6a72526a7c40f5aa8b1953b90e8046 to start an election
I20260709 13:16:36.038578 17510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9"
dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
 from {username='slave'} at 127.0.0.1:38634
I20260709 13:16:36.039057 17510 raft_consensus.cc:493] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.039394 17510 raft_consensus.cc:3060] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.043951 17510 raft_consensus.cc:515] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.045683 17510 leader_election.cc:290] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 3 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087)
I20260709 13:16:36.046479 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:36.046730 17438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:36.047065 17360 raft_consensus.cc:3060] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.047219 17438 raft_consensus.cc:3055] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:36.047536 17438 raft_consensus.cc:740] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:36.048214 17438 consensus_queue.cc:260] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.049281 17438 raft_consensus.cc:3060] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.053357 17360 raft_consensus.cc:2468] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 3.
I20260709 13:16:36.054450 17475 leader_election.cc:304] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, ba6a72526a7c40f5aa8b1953b90e8046; no voters: 
I20260709 13:16:36.055186 17438 raft_consensus.cc:2468] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 3.
I20260709 13:16:36.055212 17649 raft_consensus.cc:2804] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:36.055802 17649 raft_consensus.cc:697] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 LEADER]: Becoming Leader. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Running, Role: LEADER
I20260709 13:16:36.056579 17649 consensus_queue.cc:237] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.062805 17259 catalog_manager.cc:5697] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 reported cstate change: term changed from 2 to 3, leader changed from bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2) to ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3). New cstate: current_term: 3 leader_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:36.355579 17360 raft_consensus.cc:1275] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Refusing update from remote peer ba6a72526a7c40f5aa8b1953b90e8046: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:36.356808 17649 consensus_queue.cc:1048] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:36.367707 17438 raft_consensus.cc:1275] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Refusing update from remote peer ba6a72526a7c40f5aa8b1953b90e8046: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:36.369639 17649 consensus_queue.cc:1048] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:36.535552 17360 raft_consensus.cc:1275] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Refusing update from remote peer ba6a72526a7c40f5aa8b1953b90e8046: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:36.536785 17649 consensus_queue.cc:1048] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:36.545553 17437 raft_consensus.cc:1275] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Refusing update from remote peer ba6a72526a7c40f5aa8b1953b90e8046: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:36.546957 17649 consensus_queue.cc:1048] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:36.630226 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:36.639727 17510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff"
dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
mode: GRACEFUL
new_leader_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:38644
I20260709 13:16:36.640239 17510 raft_consensus.cc:606] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 LEADER]: Received request to transfer leadership to TS bb4637970e724b0598289a3e2a2a1c21
I20260709 13:16:36.653314 17360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed6587fd8ee4aa69030f634efd3ccb9"
dest_uuid: "7188a99172d54e4a914928679d6a4110"
mode: GRACEFUL
new_leader_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:46368
I20260709 13:16:36.653855 17360 raft_consensus.cc:606] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Received request to transfer leadership to TS bb4637970e724b0598289a3e2a2a1c21
I20260709 13:16:36.659053 17360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb"
dest_uuid: "7188a99172d54e4a914928679d6a4110"
mode: GRACEFUL
new_leader_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:46368
I20260709 13:16:36.659567 17360 raft_consensus.cc:606] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Received request to transfer leadership to TS bb4637970e724b0598289a3e2a2a1c21
I20260709 13:16:36.664189 17360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30"
dest_uuid: "7188a99172d54e4a914928679d6a4110"
mode: GRACEFUL
new_leader_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:46368
I20260709 13:16:36.664671 17360 raft_consensus.cc:606] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Received request to transfer leadership to TS bb4637970e724b0598289a3e2a2a1c21
I20260709 13:16:36.668942 17510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9"
dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
mode: GRACEFUL
new_leader_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:38644
I20260709 13:16:36.669446 17510 raft_consensus.cc:606] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 LEADER]: Received request to transfer leadership to TS bb4637970e724b0598289a3e2a2a1c21
I20260709 13:16:36.683456 17673 raft_consensus.cc:993] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110: : Instructing follower bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:36.683913 17673 raft_consensus.cc:1081] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Signalling peer bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:36.685294 17437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:38734
I20260709 13:16:36.685748 17437 raft_consensus.cc:493] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.686090 17437 raft_consensus.cc:3060] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.690398 17437 raft_consensus.cc:515] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.692054 17437 leader_election.cc:290] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 3 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:36.692751 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:36.693079 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:36.693336 17360 raft_consensus.cc:3055] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:36.693634 17510 raft_consensus.cc:3060] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.693668 17360 raft_consensus.cc:740] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Running, Role: LEADER
I20260709 13:16:36.694506 17360 consensus_queue.cc:260] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.695394 17360 raft_consensus.cc:3060] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.698446 17510 raft_consensus.cc:2468] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 3.
I20260709 13:16:36.699571 17402 leader_election.cc:304] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:36.700258 17360 raft_consensus.cc:2468] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 3.
I20260709 13:16:36.700385 17611 raft_consensus.cc:2804] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:36.701853 17611 raft_consensus.cc:697] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 3 LEADER]: Becoming Leader. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:36.702602 17611 consensus_queue.cc:237] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.709174 17258 catalog_manager.cc:5697] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 reported cstate change: term changed from 2 to 3, leader changed from 7188a99172d54e4a914928679d6a4110 (127.16.211.1) to bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "bb4637970e724b0598289a3e2a2a1c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:36.833058 17673 raft_consensus.cc:993] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110: : Instructing follower bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:36.833470 17673 raft_consensus.cc:1081] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Signalling peer bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:36.835068 17437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ed6587fd8ee4aa69030f634efd3ccb9"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:38734
I20260709 13:16:36.835541 17437 raft_consensus.cc:493] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.835831 17437 raft_consensus.cc:3060] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.840252 17437 raft_consensus.cc:515] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.841930 17437 leader_election.cc:290] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 3 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:36.842692 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6587fd8ee4aa69030f634efd3ccb9" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:36.842980 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6587fd8ee4aa69030f634efd3ccb9" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:36.843245 17360 raft_consensus.cc:3055] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:36.843488 17510 raft_consensus.cc:3060] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.843595 17360 raft_consensus.cc:740] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Running, Role: LEADER
I20260709 13:16:36.844420 17360 consensus_queue.cc:260] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.845304 17360 raft_consensus.cc:3060] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.848310 17510 raft_consensus.cc:2468] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 3.
I20260709 13:16:36.849160 17360 raft_consensus.cc:2468] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 3.
I20260709 13:16:36.849243 17402 leader_election.cc:304] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:36.850039 17611 raft_consensus.cc:2804] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:36.850446 17611 raft_consensus.cc:697] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 3 LEADER]: Becoming Leader. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:36.851191 17611 consensus_queue.cc:237] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.858420 17258 catalog_manager.cc:5697] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 reported cstate change: term changed from 2 to 3, leader changed from 7188a99172d54e4a914928679d6a4110 (127.16.211.1) to bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "bb4637970e724b0598289a3e2a2a1c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:36.941376 17669 raft_consensus.cc:993] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046: : Instructing follower bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:36.941857 17669 raft_consensus.cc:1081] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 LEADER]: Signalling peer bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:36.943464 17437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:38750
I20260709 13:16:36.943997 17437 raft_consensus.cc:493] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.944391 17437 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.948796 17437 raft_consensus.cc:515] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.950317 17437 leader_election.cc:290] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 4 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:36.951129 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:36.951380 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:36.951678 17360 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.951933 17510 raft_consensus.cc:3055] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:36.952248 17510 raft_consensus.cc:740] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Running, Role: LEADER
I20260709 13:16:36.952948 17510 consensus_queue.cc:260] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.953810 17510 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.955823 17360 raft_consensus.cc:2468] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 4.
I20260709 13:16:36.956779 17401 leader_election.cc:304] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:36.957471 17611 raft_consensus.cc:2804] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:36.957854 17611 raft_consensus.cc:697] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 4 LEADER]: Becoming Leader. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:36.958137 17510 raft_consensus.cc:2468] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 4.
I20260709 13:16:36.958622 17611 consensus_queue.cc:237] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.964675 17258 catalog_manager.cc:5697] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 reported cstate change: term changed from 3 to 4, leader changed from ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3) to bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2). New cstate: current_term: 4 leader_uuid: "bb4637970e724b0598289a3e2a2a1c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:36.974131 17655 raft_consensus.cc:993] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110: : Instructing follower bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:36.974552 17673 raft_consensus.cc:1081] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Signalling peer bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:36.975853 17437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:38734
I20260709 13:16:36.976258 17437 raft_consensus.cc:493] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.976504 17437 raft_consensus.cc:3060] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.980774 17437 raft_consensus.cc:515] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.982626 17437 leader_election.cc:290] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 3 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:36.983494 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:36.983835 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:36.984139 17360 raft_consensus.cc:3055] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:36.984377 17510 raft_consensus.cc:3060] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.984486 17360 raft_consensus.cc:740] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Running, Role: LEADER
I20260709 13:16:36.985208 17360 consensus_queue.cc:260] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.986264 17360 raft_consensus.cc:3060] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.990312 17510 raft_consensus.cc:2468] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 3.
I20260709 13:16:36.991361 17402 leader_election.cc:304] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba6a72526a7c40f5aa8b1953b90e8046, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:36.991935 17360 raft_consensus.cc:2468] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 3.
I20260709 13:16:36.992118 17611 raft_consensus.cc:2804] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:36.992637 17611 raft_consensus.cc:697] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 3 LEADER]: Becoming Leader. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:36.993431 17611 consensus_queue.cc:237] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:36.999781 17258 catalog_manager.cc:5697] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 reported cstate change: term changed from 2 to 3, leader changed from 7188a99172d54e4a914928679d6a4110 (127.16.211.1) to bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "bb4637970e724b0598289a3e2a2a1c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.056229 17656 raft_consensus.cc:993] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046: : Instructing follower bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:37.056708 17669 raft_consensus.cc:1081] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 LEADER]: Signalling peer bb4637970e724b0598289a3e2a2a1c21 to start an election
I20260709 13:16:37.058221 17437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
 from {username='slave'} at 127.0.0.1:38750
I20260709 13:16:37.058732 17437 raft_consensus.cc:493] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.059183 17437 raft_consensus.cc:3060] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:37.064181 17437 raft_consensus.cc:515] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:37.066210 17437 leader_election.cc:290] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 4 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:37.066857 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:37.067039 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650567aabb8413192eb4cb8957096c9" candidate_uuid: "bb4637970e724b0598289a3e2a2a1c21" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:37.067505 17360 raft_consensus.cc:3060] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:37.067612 17510 raft_consensus.cc:3055] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:37.067957 17510 raft_consensus.cc:740] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Running, Role: LEADER
I20260709 13:16:37.068545 17510 consensus_queue.cc:260] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:37.069353 17510 raft_consensus.cc:3060] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:37.071838 17360 raft_consensus.cc:2468] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 4.
I20260709 13:16:37.072732 17401 leader_election.cc:304] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, bb4637970e724b0598289a3e2a2a1c21; no voters: 
I20260709 13:16:37.073426 17611 raft_consensus.cc:2804] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:37.073465 17510 raft_consensus.cc:2468] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4637970e724b0598289a3e2a2a1c21 in term 4.
I20260709 13:16:37.073977 17611 raft_consensus.cc:697] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 4 LEADER]: Becoming Leader. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:37.074723 17611 consensus_queue.cc:237] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:37.080127 17258 catalog_manager.cc:5697] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 reported cstate change: term changed from 3 to 4, leader changed from ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3) to bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2). New cstate: current_term: 4 leader_uuid: "bb4637970e724b0598289a3e2a2a1c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.171000 17360 raft_consensus.cc:1275] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:37.172089 17611 consensus_queue.cc:1048] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:37.180120 17510 raft_consensus.cc:1275] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:37.181716 17611 consensus_queue.cc:1048] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:37.255118 17510 raft_consensus.cc:1275] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:37.256242 17611 consensus_queue.cc:1048] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:37.264905 17360 raft_consensus.cc:1275] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:37.266489 17687 consensus_queue.cc:1048] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:37.454531 17360 raft_consensus.cc:1275] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:37.455770 17687 consensus_queue.cc:1048] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:37.463236 17510 raft_consensus.cc:1275] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:37.464702 17687 consensus_queue.cc:1048] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:37.478468 17510 raft_consensus.cc:1275] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:37.479526 17687 consensus_queue.cc:1048] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:37.487872 17360 raft_consensus.cc:1275] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:37.489017 17687 consensus_queue.cc:1048] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:37.565701 17510 raft_consensus.cc:1275] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:37.566973 17687 consensus_queue.cc:1048] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:37.576069 17360 raft_consensus.cc:1275] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Refusing update from remote peer bb4637970e724b0598289a3e2a2a1c21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:37.578503 17689 consensus_queue.cc:1048] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:39.680285 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:39.687188 17437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29f7e8fb9f094838938c0f00c71f3939"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
mode: GRACEFUL
new_leader_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:41472
I20260709 13:16:39.687971 17437 raft_consensus.cc:606] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Received request to transfer leadership to TS 7188a99172d54e4a914928679d6a4110
I20260709 13:16:39.690924 17437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47fdf35a90f843a1ab32251380b08878"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
mode: GRACEFUL
new_leader_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
 from {username='slave'} at 127.0.0.1:41472
I20260709 13:16:39.691440 17437 raft_consensus.cc:606] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Received request to transfer leadership to TS ba6a72526a7c40f5aa8b1953b90e8046
I20260709 13:16:39.693588 17437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
mode: GRACEFUL
new_leader_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:41472
I20260709 13:16:39.694185 17437 raft_consensus.cc:606] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 3 LEADER]: Received request to transfer leadership to TS 7188a99172d54e4a914928679d6a4110
I20260709 13:16:39.696355 17437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
mode: GRACEFUL
new_leader_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
 from {username='slave'} at 127.0.0.1:41472
I20260709 13:16:39.696893 17437 raft_consensus.cc:606] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 3 LEADER]: Received request to transfer leadership to TS ba6a72526a7c40f5aa8b1953b90e8046
I20260709 13:16:39.699103 17437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff"
dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
mode: GRACEFUL
new_leader_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:41472
I20260709 13:16:39.699548 17437 raft_consensus.cc:606] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 4 LEADER]: Received request to transfer leadership to TS 7188a99172d54e4a914928679d6a4110
I20260709 13:16:39.700654 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:39.701308 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:39.753108 17694 raft_consensus.cc:993] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21: : Instructing follower ba6a72526a7c40f5aa8b1953b90e8046 to start an election
I20260709 13:16:39.753746 17689 raft_consensus.cc:1081] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Signalling peer ba6a72526a7c40f5aa8b1953b90e8046 to start an election
I20260709 13:16:39.755328 17510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47fdf35a90f843a1ab32251380b08878"
dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
 from {username='slave'} at 127.0.0.1:38634
I20260709 13:16:39.755787 17510 raft_consensus.cc:493] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.756145 17510 raft_consensus.cc:3060] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.761113 17510 raft_consensus.cc:515] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:39.762740 17510 leader_election.cc:290] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 2 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087)
I20260709 13:16:39.763850 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdf35a90f843a1ab32251380b08878" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:39.764031 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fdf35a90f843a1ab32251380b08878" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:39.764469 17360 raft_consensus.cc:3060] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.764724 17437 raft_consensus.cc:3055] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:39.765039 17437 raft_consensus.cc:740] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:39.765677 17437 consensus_queue.cc:260] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:39.766760 17437 raft_consensus.cc:3060] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.768906 17360 raft_consensus.cc:2468] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 2.
I20260709 13:16:39.770090 17475 leader_election.cc:304] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, ba6a72526a7c40f5aa8b1953b90e8046; no voters: 
I20260709 13:16:39.770972 17669 raft_consensus.cc:2804] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:39.772019 17437 raft_consensus.cc:2468] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 2.
I20260709 13:16:39.772022 17669 raft_consensus.cc:697] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 LEADER]: Becoming Leader. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Running, Role: LEADER
I20260709 13:16:39.773430 17669 consensus_queue.cc:237] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:39.780557 17259 catalog_manager.cc:5697] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 reported cstate change: term changed from 1 to 2, leader changed from bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2) to ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3). New cstate: current_term: 2 leader_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.811448 17694 raft_consensus.cc:993] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21: : Instructing follower 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:39.811921 17694 raft_consensus.cc:1081] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 4 LEADER]: Signalling peer 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:39.813372 17360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff"
dest_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:55046
I20260709 13:16:39.813786 17360 raft_consensus.cc:493] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.814057 17360 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:39.817873 17360 raft_consensus.cc:515] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:39.819321 17360 leader_election.cc:290] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 5 election: Requested vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:39.820425 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:39.820425 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f43626049d4665b1fee1e27f2c37ff" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:39.821162 17510 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:39.821201 17437 raft_consensus.cc:3055] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:39.821621 17437 raft_consensus.cc:740] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:39.822430 17437 consensus_queue.cc:260] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:39.823630 17437 raft_consensus.cc:3060] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:39.827358 17510 raft_consensus.cc:2468] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 5.
I20260709 13:16:39.828748 17327 leader_election.cc:304] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, ba6a72526a7c40f5aa8b1953b90e8046; no voters: 
I20260709 13:16:39.829706 17437 raft_consensus.cc:2468] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 5.
I20260709 13:16:39.830610 17702 raft_consensus.cc:2804] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:39.832056 17702 raft_consensus.cc:697] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 5 LEADER]: Becoming Leader. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Running, Role: LEADER
I20260709 13:16:39.833097 17694 raft_consensus.cc:993] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21: : Instructing follower 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:39.833065 17702 consensus_queue.cc:237] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:39.833714 17689 raft_consensus.cc:1081] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Signalling peer 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:39.835335 17360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29f7e8fb9f094838938c0f00c71f3939"
dest_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:55046
I20260709 13:16:39.835820 17360 raft_consensus.cc:493] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.836200 17360 raft_consensus.cc:3060] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.840356 17360 raft_consensus.cc:515] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:39.840853 17259 catalog_manager.cc:5697] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 reported cstate change: term changed from 4 to 5, leader changed from bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2) to 7188a99172d54e4a914928679d6a4110 (127.16.211.1). New cstate: current_term: 5 leader_uuid: "7188a99172d54e4a914928679d6a4110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.841774 17360 leader_election.cc:290] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 2 election: Requested vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:39.842504 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f7e8fb9f094838938c0f00c71f3939" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:39.842792 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f7e8fb9f094838938c0f00c71f3939" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:39.843035 17437 raft_consensus.cc:3055] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:39.843225 17510 raft_consensus.cc:3060] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.843580 17437 raft_consensus.cc:740] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:39.844357 17437 consensus_queue.cc:260] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:39.845566 17437 raft_consensus.cc:3060] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.848347 17510 raft_consensus.cc:2468] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 2.
I20260709 13:16:39.849424 17327 leader_election.cc:304] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, ba6a72526a7c40f5aa8b1953b90e8046; no voters: 
I20260709 13:16:39.850200 17702 raft_consensus.cc:2804] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:39.850632 17702 raft_consensus.cc:697] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Becoming Leader. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Running, Role: LEADER
I20260709 13:16:39.851251 17437 raft_consensus.cc:2468] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 2.
I20260709 13:16:39.851322 17702 consensus_queue.cc:237] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:39.857632 17259 catalog_manager.cc:5697] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 reported cstate change: term changed from 1 to 2, leader changed from bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2) to 7188a99172d54e4a914928679d6a4110 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "7188a99172d54e4a914928679d6a4110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.870620 17694 raft_consensus.cc:993] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21: : Instructing follower ba6a72526a7c40f5aa8b1953b90e8046 to start an election
I20260709 13:16:39.871037 17694 raft_consensus.cc:1081] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 3 LEADER]: Signalling peer ba6a72526a7c40f5aa8b1953b90e8046 to start an election
I20260709 13:16:39.872364 17510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb"
dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
 from {username='slave'} at 127.0.0.1:38634
I20260709 13:16:39.872783 17510 raft_consensus.cc:493] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.873068 17510 raft_consensus.cc:3060] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:39.876983 17510 raft_consensus.cc:515] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:39.878511 17510 leader_election.cc:290] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 4 election: Requested vote from peers 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659), bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087)
I20260709 13:16:39.879352 17360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7188a99172d54e4a914928679d6a4110"
I20260709 13:16:39.879613 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd145685f4e14bd9b8aab4eeeadfabbb" candidate_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:39.879837 17360 raft_consensus.cc:3060] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:39.880208 17437 raft_consensus.cc:3055] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:39.880484 17437 raft_consensus.cc:740] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:39.881145 17437 consensus_queue.cc:260] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:39.882061 17437 raft_consensus.cc:3060] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:39.884907 17360 raft_consensus.cc:2468] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 4.
I20260709 13:16:39.885814 17475 leader_election.cc:304] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, ba6a72526a7c40f5aa8b1953b90e8046; no voters: 
I20260709 13:16:39.886469 17437 raft_consensus.cc:2468] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba6a72526a7c40f5aa8b1953b90e8046 in term 4.
I20260709 13:16:39.886562 17669 raft_consensus.cc:2804] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:39.887068 17669 raft_consensus.cc:697] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 LEADER]: Becoming Leader. State: Replica: ba6a72526a7c40f5aa8b1953b90e8046, State: Running, Role: LEADER
I20260709 13:16:39.887859 17669 consensus_queue.cc:237] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:39.893982 17259 catalog_manager.cc:5697] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 reported cstate change: term changed from 3 to 4, leader changed from bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2) to ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3). New cstate: current_term: 4 leader_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:40.018610 17689 raft_consensus.cc:993] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21: : Instructing follower 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:40.019155 17694 raft_consensus.cc:1081] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 3 LEADER]: Signalling peer 7188a99172d54e4a914928679d6a4110 to start an election
I20260709 13:16:40.020543 17360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30"
dest_uuid: "7188a99172d54e4a914928679d6a4110"
 from {username='slave'} at 127.0.0.1:55046
I20260709 13:16:40.021008 17360 raft_consensus.cc:493] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:40.021281 17360 raft_consensus.cc:3060] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:40.025126 17360 raft_consensus.cc:515] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:40.026597 17360 leader_election.cc:290] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 4 election: Requested vote from peers bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087), ba6a72526a7c40f5aa8b1953b90e8046 (127.16.211.3:34011)
I20260709 13:16:40.027495 17437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bb4637970e724b0598289a3e2a2a1c21"
I20260709 13:16:40.028043 17437 raft_consensus.cc:3055] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:40.027640 17510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8689559b839645aabf233f9e8cc5eb30" candidate_uuid: "7188a99172d54e4a914928679d6a4110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ba6a72526a7c40f5aa8b1953b90e8046"
I20260709 13:16:40.028510 17437 raft_consensus.cc:740] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb4637970e724b0598289a3e2a2a1c21, State: Running, Role: LEADER
I20260709 13:16:40.028692 17510 raft_consensus.cc:3060] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:40.029335 17437 consensus_queue.cc:260] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:40.030453 17437 raft_consensus.cc:3060] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:40.033865 17510 raft_consensus.cc:2468] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 4.
I20260709 13:16:40.034927 17327 leader_election.cc:304] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7188a99172d54e4a914928679d6a4110, ba6a72526a7c40f5aa8b1953b90e8046; no voters: 
I20260709 13:16:40.035590 17702 raft_consensus.cc:2804] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:40.035689 17437 raft_consensus.cc:2468] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7188a99172d54e4a914928679d6a4110 in term 4.
I20260709 13:16:40.036011 17702 raft_consensus.cc:697] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 4 LEADER]: Becoming Leader. State: Replica: 7188a99172d54e4a914928679d6a4110, State: Running, Role: LEADER
I20260709 13:16:40.036914 17702 consensus_queue.cc:237] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } }
I20260709 13:16:40.043804 17259 catalog_manager.cc:5697] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 reported cstate change: term changed from 3 to 4, leader changed from bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2) to 7188a99172d54e4a914928679d6a4110 (127.16.211.1). New cstate: current_term: 4 leader_uuid: "7188a99172d54e4a914928679d6a4110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:40.281955 17437 raft_consensus.cc:1275] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 5 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:40.283097 17702 consensus_queue.cc:1048] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:40.292865 17510 raft_consensus.cc:1275] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 5 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:40.294421 17703 consensus_queue.cc:1048] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:40.337487 17510 raft_consensus.cc:1275] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.338812 17710 consensus_queue.cc:1048] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.347321 17437 raft_consensus.cc:1275] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.348798 17703 consensus_queue.cc:1048] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.354285 17438 raft_consensus.cc:1275] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Refusing update from remote peer ba6a72526a7c40f5aa8b1953b90e8046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.355780 17669 consensus_queue.cc:1048] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.364614 17360 raft_consensus.cc:1275] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Refusing update from remote peer ba6a72526a7c40f5aa8b1953b90e8046: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.366153 17717 consensus_queue.cc:1048] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:40.397019 17360 raft_consensus.cc:1275] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Refusing update from remote peer ba6a72526a7c40f5aa8b1953b90e8046: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:40.398168 17717 consensus_queue.cc:1048] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7188a99172d54e4a914928679d6a4110" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:40.406733 17437 raft_consensus.cc:1275] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Refusing update from remote peer ba6a72526a7c40f5aa8b1953b90e8046: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:40.408490 17669 consensus_queue.cc:1048] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:40.430760 17510 raft_consensus.cc:1275] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:40.431912 17703 consensus_queue.cc:1048] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba6a72526a7c40f5aa8b1953b90e8046" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:40.444077 17437 raft_consensus.cc:1275] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Refusing update from remote peer 7188a99172d54e4a914928679d6a4110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:40.445322 17703 consensus_queue.cc:1048] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4637970e724b0598289a3e2a2a1c21" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:40.702199 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:40.707763 17228 tablet_server.cc:179] TabletServer@127.16.211.1:0 shutting down...
I20260709 13:16:40.738679 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:40.739428 17228 tablet_replica.cc:333] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110: stopping tablet replica
I20260709 13:16:40.740234 17228 raft_consensus.cc:2243] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.740979 17228 raft_consensus.cc:2272] T 29f7e8fb9f094838938c0f00c71f3939 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.743430 17228 tablet_replica.cc:333] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110: stopping tablet replica
I20260709 13:16:40.743888 17228 raft_consensus.cc:2243] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.744222 17228 raft_consensus.cc:2272] T 950593dd09ed479d9b1aeba327bb8bb9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.746013 17228 tablet_replica.cc:333] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110: stopping tablet replica
I20260709 13:16:40.746424 17228 raft_consensus.cc:2243] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.746740 17228 raft_consensus.cc:2272] T 47fdf35a90f843a1ab32251380b08878 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.748541 17228 tablet_replica.cc:333] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110: stopping tablet replica
I20260709 13:16:40.748971 17228 raft_consensus.cc:2243] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.749312 17228 raft_consensus.cc:2272] T 772809c7a4184e28883b791067023ca9 P 7188a99172d54e4a914928679d6a4110 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.750771 17228 tablet_replica.cc:333] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110: stopping tablet replica
I20260709 13:16:40.751181 17228 raft_consensus.cc:2243] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.751502 17228 raft_consensus.cc:2272] T d650567aabb8413192eb4cb8957096c9 P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.752977 17228 tablet_replica.cc:333] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110: stopping tablet replica
I20260709 13:16:40.753365 17228 raft_consensus.cc:2243] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.753696 17228 raft_consensus.cc:2272] T bd145685f4e14bd9b8aab4eeeadfabbb P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.755720 17228 tablet_replica.cc:333] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110: stopping tablet replica
I20260709 13:16:40.756173 17228 raft_consensus.cc:2243] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.756549 17228 raft_consensus.cc:2272] T 6ed6587fd8ee4aa69030f634efd3ccb9 P 7188a99172d54e4a914928679d6a4110 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.758162 17228 tablet_replica.cc:333] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110: stopping tablet replica
I20260709 13:16:40.758587 17228 raft_consensus.cc:2243] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.759258 17228 raft_consensus.cc:2272] T 8689559b839645aabf233f9e8cc5eb30 P 7188a99172d54e4a914928679d6a4110 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.761184 17228 tablet_replica.cc:333] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110: stopping tablet replica
I20260709 13:16:40.761600 17228 raft_consensus.cc:2243] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.762322 17228 raft_consensus.cc:2272] T c5f43626049d4665b1fee1e27f2c37ff P 7188a99172d54e4a914928679d6a4110 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:40.771664 17475 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:40.775487 17475 consensus_peers.cc:597] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 -> Peer 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659): Couldn't send request to peer 7188a99172d54e4a914928679d6a4110. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:40.859149 17228 tablet_server.cc:196] TabletServer@127.16.211.1:0 shutdown complete.
I20260709 13:16:40.876921 17228 tablet_server.cc:179] TabletServer@127.16.211.2:0 shutting down...
I20260709 13:16:40.899199 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:40.899892 17228 tablet_replica.cc:333] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21: stopping tablet replica
I20260709 13:16:40.900468 17228 raft_consensus.cc:2243] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.901165 17228 raft_consensus.cc:2272] T 950593dd09ed479d9b1aeba327bb8bb9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.902956 17228 tablet_replica.cc:333] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21: stopping tablet replica
I20260709 13:16:40.903420 17228 raft_consensus.cc:2243] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.903760 17228 raft_consensus.cc:2272] T 47fdf35a90f843a1ab32251380b08878 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.906098 17228 tablet_replica.cc:333] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21: stopping tablet replica
I20260709 13:16:40.907055 17228 raft_consensus.cc:2243] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.907660 17228 raft_consensus.cc:2272] T 29f7e8fb9f094838938c0f00c71f3939 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.910177 17228 tablet_replica.cc:333] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21: stopping tablet replica
I20260709 13:16:40.910889 17228 raft_consensus.cc:2243] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.911540 17228 raft_consensus.cc:2272] T 772809c7a4184e28883b791067023ca9 P bb4637970e724b0598289a3e2a2a1c21 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:40.913887 17475 consensus_peers.cc:597] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 -> Peer bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087): Couldn't send request to peer bb4637970e724b0598289a3e2a2a1c21. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:40.914330 17228 tablet_replica.cc:333] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21: stopping tablet replica
I20260709 13:16:40.914999 17228 raft_consensus.cc:2243] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.915823 17228 raft_consensus.cc:2272] T d650567aabb8413192eb4cb8957096c9 P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.917394 17228 tablet_replica.cc:333] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21: stopping tablet replica
I20260709 13:16:40.917795 17228 raft_consensus.cc:2243] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.918190 17228 raft_consensus.cc:2272] T bd145685f4e14bd9b8aab4eeeadfabbb P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.919868 17228 tablet_replica.cc:333] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21: stopping tablet replica
I20260709 13:16:40.920266 17228 raft_consensus.cc:2243] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:40.920876 17228 raft_consensus.cc:2272] T 6ed6587fd8ee4aa69030f634efd3ccb9 P bb4637970e724b0598289a3e2a2a1c21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.922274 17228 tablet_replica.cc:333] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21: stopping tablet replica
I20260709 13:16:40.922645 17228 raft_consensus.cc:2243] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.922943 17228 raft_consensus.cc:2272] T 8689559b839645aabf233f9e8cc5eb30 P bb4637970e724b0598289a3e2a2a1c21 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:40.924616 17228 tablet_replica.cc:333] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21: stopping tablet replica
I20260709 13:16:40.924973 17228 raft_consensus.cc:2243] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.925271 17228 raft_consensus.cc:2272] T c5f43626049d4665b1fee1e27f2c37ff P bb4637970e724b0598289a3e2a2a1c21 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:40.929442 17475 consensus_peers.cc:597] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 -> Peer bb4637970e724b0598289a3e2a2a1c21 (127.16.211.2:39087): Couldn't send request to peer bb4637970e724b0598289a3e2a2a1c21. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:40.951290 17228 tablet_server.cc:196] TabletServer@127.16.211.2:0 shutdown complete.
I20260709 13:16:40.967069 17228 tablet_server.cc:179] TabletServer@127.16.211.3:0 shutting down...
W20260709 13:16:40.983180 17475 consensus_peers.cc:597] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 -> Peer 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659): Couldn't send request to peer 7188a99172d54e4a914928679d6a4110. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:41659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:40.997578 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:40.998289 17228 tablet_replica.cc:333] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046: stopping tablet replica
I20260709 13:16:40.999229 17228 raft_consensus.cc:2243] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:40.999828 17228 raft_consensus.cc:2272] T 8689559b839645aabf233f9e8cc5eb30 P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.001778 17228 tablet_replica.cc:333] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046: stopping tablet replica
I20260709 13:16:41.002292 17228 raft_consensus.cc:2243] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:41.002954 17228 raft_consensus.cc:2272] T 47fdf35a90f843a1ab32251380b08878 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.005255 17228 tablet_replica.cc:333] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046: stopping tablet replica
I20260709 13:16:41.005864 17228 raft_consensus.cc:2243] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:41.006420 17228 raft_consensus.cc:2272] T 950593dd09ed479d9b1aeba327bb8bb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.008450 17228 tablet_replica.cc:333] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046: stopping tablet replica
I20260709 13:16:41.008983 17228 raft_consensus.cc:2243] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:41.009395 17228 raft_consensus.cc:2272] T 29f7e8fb9f094838938c0f00c71f3939 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:41.009526 17475 consensus_peers.cc:597] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 -> Peer 7188a99172d54e4a914928679d6a4110 (127.16.211.1:41659): Couldn't send request to peer 7188a99172d54e4a914928679d6a4110. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:41659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:41.011377 17228 tablet_replica.cc:333] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046: stopping tablet replica
I20260709 13:16:41.011798 17228 raft_consensus.cc:2243] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:41.012419 17228 raft_consensus.cc:2272] T 772809c7a4184e28883b791067023ca9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.013823 17228 tablet_replica.cc:333] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046: stopping tablet replica
I20260709 13:16:41.014308 17228 raft_consensus.cc:2243] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:41.014654 17228 raft_consensus.cc:2272] T d650567aabb8413192eb4cb8957096c9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.016109 17228 tablet_replica.cc:333] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046: stopping tablet replica
I20260709 13:16:41.016510 17228 raft_consensus.cc:2243] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:41.017110 17228 raft_consensus.cc:2272] T bd145685f4e14bd9b8aab4eeeadfabbb P ba6a72526a7c40f5aa8b1953b90e8046 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.019537 17228 tablet_replica.cc:333] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046: stopping tablet replica
I20260709 13:16:41.019986 17228 raft_consensus.cc:2243] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:41.020381 17228 raft_consensus.cc:2272] T 6ed6587fd8ee4aa69030f634efd3ccb9 P ba6a72526a7c40f5aa8b1953b90e8046 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.021991 17228 tablet_replica.cc:333] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046: stopping tablet replica
I20260709 13:16:41.022410 17228 raft_consensus.cc:2243] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:41.022779 17228 raft_consensus.cc:2272] T c5f43626049d4665b1fee1e27f2c37ff P ba6a72526a7c40f5aa8b1953b90e8046 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.049528 17228 tablet_server.cc:196] TabletServer@127.16.211.3:0 shutdown complete.
I20260709 13:16:41.065650 17228 master.cc:562] Master@127.16.211.62:35885 shutting down...
I20260709 13:16:41.265864 17228 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:41.266439 17228 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.266717 17228 tablet_replica.cc:333] T 00000000000000000000000000000000 P 892e29c22784418280232426087e2357: stopping tablet replica
I20260709 13:16:41.286079 17228 master.cc:584] Master@127.16.211.62:35885 shutdown complete.
7188a99172d54e4a914928679d6a4110  4
ba6a72526a7c40f5aa8b1953b90e8046  1
bb4637970e724b0598289a3e2a2a1c21  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12596 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:16:41.326438 17228 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.211.62:42815
I20260709 13:16:41.327481 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:41.332626 17727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:41.333964 17728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:41.334553 17730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:41.335287 17228 server_base.cc:1061] running on GCE node
I20260709 13:16:41.336164 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:41.336369 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:41.336566 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603001336552 us; error 0 us; skew 500 ppm
I20260709 13:16:41.337165 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:41.339629 17228 webserver.cc:533] Webserver started at http://127.16.211.62:38659/ using document root <none> and password file <none>
I20260709 13:16:41.340143 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:41.340328 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:41.340607 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:41.341694 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/master-0-root/instance:
uuid: "fb9ff79f6fe94a8f813a6ab4b59e27c0"
format_stamp: "Formatted at 2026-07-09 13:16:41 on dist-test-slave-96c3"
I20260709 13:16:41.345803 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:16:41.348946 17735 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:41.349644 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:41.350009 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/master-0-root
uuid: "fb9ff79f6fe94a8f813a6ab4b59e27c0"
format_stamp: "Formatted at 2026-07-09 13:16:41 on dist-test-slave-96c3"
I20260709 13:16:41.350292 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:41.372164 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:41.373476 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:41.411343 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.62:42815
I20260709 13:16:41.411466 17786 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.62:42815 every 8 connection(s)
I20260709 13:16:41.415148 17787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.424119 17787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0: Bootstrap starting.
I20260709 13:16:41.429168 17787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:41.434839 17787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0: No bootstrap required, opened a new log
I20260709 13:16:41.436795 17787 raft_consensus.cc:359] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb9ff79f6fe94a8f813a6ab4b59e27c0" member_type: VOTER }
I20260709 13:16:41.437253 17787 raft_consensus.cc:385] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:41.437489 17787 raft_consensus.cc:740] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb9ff79f6fe94a8f813a6ab4b59e27c0, State: Initialized, Role: FOLLOWER
I20260709 13:16:41.438143 17787 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb9ff79f6fe94a8f813a6ab4b59e27c0" member_type: VOTER }
I20260709 13:16:41.438581 17787 raft_consensus.cc:399] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:41.438813 17787 raft_consensus.cc:493] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:41.439108 17787 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:41.442866 17787 raft_consensus.cc:515] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb9ff79f6fe94a8f813a6ab4b59e27c0" member_type: VOTER }
I20260709 13:16:41.443382 17787 leader_election.cc:304] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb9ff79f6fe94a8f813a6ab4b59e27c0; no voters: 
I20260709 13:16:41.444517 17787 leader_election.cc:290] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:41.444908 17790 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:41.446190 17790 raft_consensus.cc:697] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [term 1 LEADER]: Becoming Leader. State: Replica: fb9ff79f6fe94a8f813a6ab4b59e27c0, State: Running, Role: LEADER
I20260709 13:16:41.446767 17790 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb9ff79f6fe94a8f813a6ab4b59e27c0" member_type: VOTER }
I20260709 13:16:41.447278 17787 sys_catalog.cc:565] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:41.451193 17791 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb9ff79f6fe94a8f813a6ab4b59e27c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb9ff79f6fe94a8f813a6ab4b59e27c0" member_type: VOTER } }
I20260709 13:16:41.451922 17791 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:41.451458 17792 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb9ff79f6fe94a8f813a6ab4b59e27c0. Latest consensus state: current_term: 1 leader_uuid: "fb9ff79f6fe94a8f813a6ab4b59e27c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb9ff79f6fe94a8f813a6ab4b59e27c0" member_type: VOTER } }
I20260709 13:16:41.452548 17792 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:41.455756 17797 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:41.463792 17797 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:41.466003 17228 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:41.472373 17797 catalog_manager.cc:1383] Generated new cluster ID: 73414b4bfa2244618fd159ca4648c042
I20260709 13:16:41.472627 17797 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:41.492611 17797 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:41.493759 17797 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:41.514793 17797 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0: Generated new TSK 0
I20260709 13:16:41.515403 17797 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:41.532124 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:41.538159 17808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:41.539350 17809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:41.541237 17811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:41.541687 17228 server_base.cc:1061] running on GCE node
I20260709 13:16:41.542740 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:41.542929 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:41.543151 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603001543116 us; error 0 us; skew 500 ppm
I20260709 13:16:41.543653 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:41.545822 17228 webserver.cc:533] Webserver started at http://127.16.211.1:44609/ using document root <none> and password file <none>
I20260709 13:16:41.546353 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:41.546542 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:41.546806 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:41.547799 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-0-root/instance:
uuid: "79c7e34f43da4949800f838cf1aa1149"
format_stamp: "Formatted at 2026-07-09 13:16:41 on dist-test-slave-96c3"
I20260709 13:16:41.552095 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:16:41.555301 17816 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:41.556131 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260709 13:16:41.556421 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-0-root
uuid: "79c7e34f43da4949800f838cf1aa1149"
format_stamp: "Formatted at 2026-07-09 13:16:41 on dist-test-slave-96c3"
I20260709 13:16:41.556702 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:41.568279 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:41.569497 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:41.571041 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:41.573154 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:41.573382 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:41.573618 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:41.573805 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:41.614907 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.1:39249
I20260709 13:16:41.615007 17878 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.1:39249 every 8 connection(s)
I20260709 13:16:41.619750 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:41.627421 17883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:41.630196 17884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:41.631724 17886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:41.631837 17228 server_base.cc:1061] running on GCE node
I20260709 13:16:41.633327 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:41.633584 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:41.633787 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603001633769 us; error 0 us; skew 500 ppm
I20260709 13:16:41.634421 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:41.636104 17879 heartbeater.cc:344] Connected to a master server at 127.16.211.62:42815
I20260709 13:16:41.636435 17879 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:41.637105 17879 heartbeater.cc:507] Master 127.16.211.62:42815 requested a full tablet report, sending...
I20260709 13:16:41.637199 17228 webserver.cc:533] Webserver started at http://127.16.211.2:46015/ using document root <none> and password file <none>
I20260709 13:16:41.637758 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:41.637980 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:41.638283 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:41.639200 17752 ts_manager.cc:194] Registered new tserver with Master: 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249)
I20260709 13:16:41.639472 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-1-root/instance:
uuid: "18e6abd847bb427a92efa25a61fca866"
format_stamp: "Formatted at 2026-07-09 13:16:41 on dist-test-slave-96c3"
I20260709 13:16:41.640934 17752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35674
I20260709 13:16:41.644119 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:16:41.647264 17891 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:41.648082 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:41.648315 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-1-root
uuid: "18e6abd847bb427a92efa25a61fca866"
format_stamp: "Formatted at 2026-07-09 13:16:41 on dist-test-slave-96c3"
I20260709 13:16:41.648625 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:41.657477 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:41.658702 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:41.660003 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:41.662274 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:41.662495 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:41.662719 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:41.662882 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:41.701140 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.2:41965
I20260709 13:16:41.701238 17953 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.2:41965 every 8 connection(s)
I20260709 13:16:41.705792 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:41.712690 17957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:41.713621 17958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:41.717427 17954 heartbeater.cc:344] Connected to a master server at 127.16.211.62:42815
W20260709 13:16:41.717490 17960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:41.717619 17228 server_base.cc:1061] running on GCE node
I20260709 13:16:41.717937 17954 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:41.718681 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:16:41.718783 17954 heartbeater.cc:507] Master 127.16.211.62:42815 requested a full tablet report, sending...
W20260709 13:16:41.718907 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:41.719192 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603001719172 us; error 0 us; skew 500 ppm
I20260709 13:16:41.719852 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:41.721160 17752 ts_manager.cc:194] Registered new tserver with Master: 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:41.722573 17228 webserver.cc:533] Webserver started at http://127.16.211.3:44503/ using document root <none> and password file <none>
I20260709 13:16:41.722980 17752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35688
I20260709 13:16:41.723230 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:41.723486 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:41.723789 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:41.724953 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-2-root/instance:
uuid: "8902aafcd54343cca010105dc6f8f055"
format_stamp: "Formatted at 2026-07-09 13:16:41 on dist-test-slave-96c3"
I20260709 13:16:41.729167 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:16:41.732298 17965 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:41.733006 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:41.733291 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-2-root
uuid: "8902aafcd54343cca010105dc6f8f055"
format_stamp: "Formatted at 2026-07-09 13:16:41 on dist-test-slave-96c3"
I20260709 13:16:41.733552 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602988568269-17228-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:41.774569 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:41.775764 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:41.777256 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:41.779392 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:41.779615 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:41.779868 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:41.780040 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:41.820243 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.3:45207
I20260709 13:16:41.820338 18027 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.3:45207 every 8 connection(s)
I20260709 13:16:41.833617 18028 heartbeater.cc:344] Connected to a master server at 127.16.211.62:42815
I20260709 13:16:41.834002 18028 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:41.834700 18028 heartbeater.cc:507] Master 127.16.211.62:42815 requested a full tablet report, sending...
I20260709 13:16:41.836573 17752 ts_manager.cc:194] Registered new tserver with Master: 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:41.836696 17228 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013407693s
I20260709 13:16:41.838335 17752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35698
I20260709 13:16:41.867154 17752 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35708:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:41.870019 17752 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:41.943559 17991 tablet_service.cc:1511] Processing CreateTablet for tablet c7ac494747714c929ae2d94913b4d3ee (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:41.945305 17991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7ac494747714c929ae2d94913b4d3ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.945039 17992 tablet_service.cc:1511] Processing CreateTablet for tablet aea747ae0627415cad2ca2e9f9df8446 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:41.946488 17992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aea747ae0627415cad2ca2e9f9df8446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.947683 17990 tablet_service.cc:1511] Processing CreateTablet for tablet 1326d45eaf4a4426a88cc079d8a62bac (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:41.948500 17989 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9853061943442992e3a638abad3b4b (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:41.949015 17990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1326d45eaf4a4426a88cc079d8a62bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.950106 17989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9853061943442992e3a638abad3b4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.940821 17993 tablet_service.cc:1511] Processing CreateTablet for tablet f658c93391a74919b2be60cf4ce779c3 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:41.953382 17988 tablet_service.cc:1511] Processing CreateTablet for tablet c3f2b69339dc403487ce637c94239ab0 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:41.953739 17841 tablet_service.cc:1511] Processing CreateTablet for tablet 1326d45eaf4a4426a88cc079d8a62bac (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:41.954300 17840 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9853061943442992e3a638abad3b4b (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:41.955049 17841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1326d45eaf4a4426a88cc079d8a62bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.955610 17993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f658c93391a74919b2be60cf4ce779c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.957338 17988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f2b69339dc403487ce637c94239ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.957008 17839 tablet_service.cc:1511] Processing CreateTablet for tablet c3f2b69339dc403487ce637c94239ab0 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:41.958433 17839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f2b69339dc403487ce637c94239ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.959161 17843 tablet_service.cc:1511] Processing CreateTablet for tablet aea747ae0627415cad2ca2e9f9df8446 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:41.960434 17843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aea747ae0627415cad2ca2e9f9df8446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.962327 17987 tablet_service.cc:1511] Processing CreateTablet for tablet f44101c3904f4c48985e55190b876a92 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:41.963112 17844 tablet_service.cc:1511] Processing CreateTablet for tablet f658c93391a74919b2be60cf4ce779c3 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:41.963784 17987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44101c3904f4c48985e55190b876a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.962821 17840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9853061943442992e3a638abad3b4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.966205 17842 tablet_service.cc:1511] Processing CreateTablet for tablet c7ac494747714c929ae2d94913b4d3ee (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:41.968513 17838 tablet_service.cc:1511] Processing CreateTablet for tablet f44101c3904f4c48985e55190b876a92 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:41.970278 17986 tablet_service.cc:1511] Processing CreateTablet for tablet 49d557587fbd4b129a73669206a5fecf (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:41.971522 17844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f658c93391a74919b2be60cf4ce779c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.971618 17986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d557587fbd4b129a73669206a5fecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.972265 17842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7ac494747714c929ae2d94913b4d3ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.980062 17837 tablet_service.cc:1511] Processing CreateTablet for tablet 49d557587fbd4b129a73669206a5fecf (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:41.981129 17838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44101c3904f4c48985e55190b876a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.982933 17836 tablet_service.cc:1511] Processing CreateTablet for tablet fbef844084784d53b5554df1aa742420 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:41.984310 17837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d557587fbd4b129a73669206a5fecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.990341 17919 tablet_service.cc:1511] Processing CreateTablet for tablet f658c93391a74919b2be60cf4ce779c3 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:41.991658 17919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f658c93391a74919b2be60cf4ce779c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.993842 17836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbef844084784d53b5554df1aa742420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:41.997272 17916 tablet_service.cc:1511] Processing CreateTablet for tablet 1326d45eaf4a4426a88cc079d8a62bac (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:41.997486 17912 tablet_service.cc:1511] Processing CreateTablet for tablet 49d557587fbd4b129a73669206a5fecf (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:41.998639 17916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1326d45eaf4a4426a88cc079d8a62bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.001786 17911 tablet_service.cc:1511] Processing CreateTablet for tablet fbef844084784d53b5554df1aa742420 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:42.004114 17915 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9853061943442992e3a638abad3b4b (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:42.004230 17913 tablet_service.cc:1511] Processing CreateTablet for tablet f44101c3904f4c48985e55190b876a92 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:42.008023 17914 tablet_service.cc:1511] Processing CreateTablet for tablet c3f2b69339dc403487ce637c94239ab0 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:42.009644 17917 tablet_service.cc:1511] Processing CreateTablet for tablet c7ac494747714c929ae2d94913b4d3ee (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:42.012445 17985 tablet_service.cc:1511] Processing CreateTablet for tablet fbef844084784d53b5554df1aa742420 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:42.013958 17985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbef844084784d53b5554df1aa742420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.019340 17918 tablet_service.cc:1511] Processing CreateTablet for tablet aea747ae0627415cad2ca2e9f9df8446 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:42.023149 17912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d557587fbd4b129a73669206a5fecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.034446 17835 tablet_service.cc:1511] Processing CreateTablet for tablet 9f68c8681a1f42e6add0dc1c12edff78 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:42.035660 17835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f68c8681a1f42e6add0dc1c12edff78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.039786 17910 tablet_service.cc:1511] Processing CreateTablet for tablet 9f68c8681a1f42e6add0dc1c12edff78 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:42.046653 17914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f2b69339dc403487ce637c94239ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.048420 17910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f68c8681a1f42e6add0dc1c12edff78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.049075 17918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aea747ae0627415cad2ca2e9f9df8446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.050132 17911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbef844084784d53b5554df1aa742420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.052193 17917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7ac494747714c929ae2d94913b4d3ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.062789 17915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9853061943442992e3a638abad3b4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.064154 17913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44101c3904f4c48985e55190b876a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.056473 18043 tablet_bootstrap.cc:492] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149: Bootstrap starting.
I20260709 13:16:42.094521 17993 tablet_service.cc:1511] Processing CreateTablet for tablet 9f68c8681a1f42e6add0dc1c12edff78 (DEFAULT_TABLE table=test-workload [id=3ef0dbd7b5574c9289325b5200dc40b5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:42.095794 17993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f68c8681a1f42e6add0dc1c12edff78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.115226 18045 tablet_bootstrap.cc:492] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866: Bootstrap starting.
I20260709 13:16:42.124584 18044 tablet_bootstrap.cc:492] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055: Bootstrap starting.
I20260709 13:16:42.132939 18043 tablet_bootstrap.cc:654] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.152971 18045 tablet_bootstrap.cc:654] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.158814 18043 tablet_bootstrap.cc:492] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149: No bootstrap required, opened a new log
I20260709 13:16:42.159504 18043 ts_tablet_manager.cc:1403] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149: Time spent bootstrapping tablet: real 0.105s	user 0.009s	sys 0.009s
I20260709 13:16:42.161310 18044 tablet_bootstrap.cc:654] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.162796 18043 raft_consensus.cc:359] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.163704 18043 raft_consensus.cc:385] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.164165 18043 raft_consensus.cc:740] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.165162 18043 consensus_queue.cc:260] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.168182 18043 ts_tablet_manager.cc:1434] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:42.168713 18044 tablet_bootstrap.cc:492] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055: No bootstrap required, opened a new log
I20260709 13:16:42.168934 17879 heartbeater.cc:499] Master 127.16.211.62:42815 was elected leader, sending a full tablet report...
I20260709 13:16:42.169147 18044 ts_tablet_manager.cc:1403] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.008s
I20260709 13:16:42.169198 18045 tablet_bootstrap.cc:492] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866: No bootstrap required, opened a new log
I20260709 13:16:42.169306 18043 tablet_bootstrap.cc:492] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149: Bootstrap starting.
I20260709 13:16:42.169775 18045 ts_tablet_manager.cc:1403] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.004s
I20260709 13:16:42.172024 18044 raft_consensus.cc:359] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.172729 18044 raft_consensus.cc:385] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.173099 18044 raft_consensus.cc:740] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.174052 18044 consensus_queue.cc:260] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.176394 18028 heartbeater.cc:499] Master 127.16.211.62:42815 was elected leader, sending a full tablet report...
I20260709 13:16:42.177165 18044 ts_tablet_manager.cc:1434] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:42.178280 18044 tablet_bootstrap.cc:492] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055: Bootstrap starting.
I20260709 13:16:42.180300 18043 tablet_bootstrap.cc:654] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.184881 18044 tablet_bootstrap.cc:654] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.185953 18043 tablet_bootstrap.cc:492] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149: No bootstrap required, opened a new log
I20260709 13:16:42.186447 18043 ts_tablet_manager.cc:1403] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:16:42.172580 18045 raft_consensus.cc:359] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.187660 18045 raft_consensus.cc:385] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.188035 18045 raft_consensus.cc:740] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.188800 18045 consensus_queue.cc:260] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.189424 18043 raft_consensus.cc:359] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.190287 18043 raft_consensus.cc:385] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.190644 18043 raft_consensus.cc:740] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.190843 18044 tablet_bootstrap.cc:492] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055: No bootstrap required, opened a new log
I20260709 13:16:42.191258 17954 heartbeater.cc:499] Master 127.16.211.62:42815 was elected leader, sending a full tablet report...
I20260709 13:16:42.191396 18044 ts_tablet_manager.cc:1403] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:16:42.191676 18043 consensus_queue.cc:260] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.193814 18043 ts_tablet_manager.cc:1434] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:42.194802 18043 tablet_bootstrap.cc:492] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149: Bootstrap starting.
I20260709 13:16:42.200233 18044 raft_consensus.cc:359] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:42.201092 18044 raft_consensus.cc:385] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.201450 18044 raft_consensus.cc:740] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.202015 18043 tablet_bootstrap.cc:654] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.202458 18044 consensus_queue.cc:260] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:42.204783 18044 ts_tablet_manager.cc:1434] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:16:42.205768 18044 tablet_bootstrap.cc:492] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055: Bootstrap starting.
I20260709 13:16:42.207229 18045 ts_tablet_manager.cc:1434] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:16:42.208287 18045 tablet_bootstrap.cc:492] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866: Bootstrap starting.
I20260709 13:16:42.208508 18043 tablet_bootstrap.cc:492] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149: No bootstrap required, opened a new log
I20260709 13:16:42.209046 18043 ts_tablet_manager.cc:1403] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:16:42.212246 18043 raft_consensus.cc:359] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.213025 18043 raft_consensus.cc:385] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.213366 18043 raft_consensus.cc:740] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.214180 18043 consensus_queue.cc:260] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.215075 18045 tablet_bootstrap.cc:654] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.215842 18044 tablet_bootstrap.cc:654] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.216531 18043 ts_tablet_manager.cc:1434] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:16:42.217645 18043 tablet_bootstrap.cc:492] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149: Bootstrap starting.
I20260709 13:16:42.230692 18043 tablet_bootstrap.cc:654] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.241070 18044 tablet_bootstrap.cc:492] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055: No bootstrap required, opened a new log
I20260709 13:16:42.241750 18044 ts_tablet_manager.cc:1403] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.008s
I20260709 13:16:42.246007 18044 raft_consensus.cc:359] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.247064 18044 raft_consensus.cc:385] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.247500 18044 raft_consensus.cc:740] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.248656 18044 consensus_queue.cc:260] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.252035 18044 ts_tablet_manager.cc:1434] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:16:42.253409 18044 tablet_bootstrap.cc:492] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055: Bootstrap starting.
I20260709 13:16:42.262877 18044 tablet_bootstrap.cc:654] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.279452 18044 tablet_bootstrap.cc:492] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055: No bootstrap required, opened a new log
I20260709 13:16:42.280100 18044 ts_tablet_manager.cc:1403] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.012s
I20260709 13:16:42.283557 18044 raft_consensus.cc:359] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.284315 18044 raft_consensus.cc:385] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.284641 18043 tablet_bootstrap.cc:492] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149: No bootstrap required, opened a new log
I20260709 13:16:42.284641 18044 raft_consensus.cc:740] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.285271 18043 ts_tablet_manager.cc:1403] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149: Time spent bootstrapping tablet: real 0.068s	user 0.024s	sys 0.027s
I20260709 13:16:42.285348 18045 tablet_bootstrap.cc:492] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866: No bootstrap required, opened a new log
I20260709 13:16:42.285867 18045 ts_tablet_manager.cc:1403] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.033s
I20260709 13:16:42.285621 18044 consensus_queue.cc:260] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.288082 18044 ts_tablet_manager.cc:1434] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:42.288452 18043 raft_consensus.cc:359] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:42.289075 18044 tablet_bootstrap.cc:492] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055: Bootstrap starting.
I20260709 13:16:42.289211 18043 raft_consensus.cc:385] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.289577 18043 raft_consensus.cc:740] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.289876 18045 raft_consensus.cc:359] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:42.290609 18045 raft_consensus.cc:385] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.290972 18045 raft_consensus.cc:740] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.290488 18043 consensus_queue.cc:260] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:42.291792 18045 consensus_queue.cc:260] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:42.292969 18043 ts_tablet_manager.cc:1434] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:16:42.293973 18043 tablet_bootstrap.cc:492] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149: Bootstrap starting.
I20260709 13:16:42.296270 18049 raft_consensus.cc:493] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.296773 18049 raft_consensus.cc:515] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.298821 18045 ts_tablet_manager.cc:1434] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:16:42.299753 18045 tablet_bootstrap.cc:492] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866: Bootstrap starting.
I20260709 13:16:42.301122 18043 tablet_bootstrap.cc:654] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.301414 18049 leader_election.cc:290] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.306586 18045 tablet_bootstrap.cc:654] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.313437 18044 tablet_bootstrap.cc:654] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.325711 18045 tablet_bootstrap.cc:492] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866: No bootstrap required, opened a new log
I20260709 13:16:42.326165 18045 ts_tablet_manager.cc:1403] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.015s
I20260709 13:16:42.329133 18045 raft_consensus.cc:359] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.329847 18045 raft_consensus.cc:385] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.330199 18045 raft_consensus.cc:740] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.331053 18045 consensus_queue.cc:260] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.331434 18050 raft_consensus.cc:493] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.332113 18050 raft_consensus.cc:515] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:42.335769 18045 ts_tablet_manager.cc:1434] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:42.336747 18045 tablet_bootstrap.cc:492] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866: Bootstrap starting.
I20260709 13:16:42.338587 18050 leader_election.cc:290] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:42.338925 18049 raft_consensus.cc:493] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.339488 18049 raft_consensus.cc:515] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.346287 18045 tablet_bootstrap.cc:654] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.346449 18043 tablet_bootstrap.cc:492] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149: No bootstrap required, opened a new log
I20260709 13:16:42.346449 18049 leader_election.cc:290] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.347047 18043 ts_tablet_manager.cc:1403] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.034s
I20260709 13:16:42.350891 18043 raft_consensus.cc:359] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.351852 18043 raft_consensus.cc:385] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.354305 18043 raft_consensus.cc:740] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.355221 18043 consensus_queue.cc:260] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.358131 18043 ts_tablet_manager.cc:1434] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:16:42.359995 18045 tablet_bootstrap.cc:492] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866: No bootstrap required, opened a new log
I20260709 13:16:42.360723 18045 ts_tablet_manager.cc:1403] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:16:42.363870 18045 raft_consensus.cc:359] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.364552 18045 raft_consensus.cc:385] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.364681 18043 tablet_bootstrap.cc:492] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149: Bootstrap starting.
I20260709 13:16:42.364887 18045 raft_consensus.cc:740] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.365983 18045 consensus_queue.cc:260] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.372732 18045 ts_tablet_manager.cc:1434] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:16:42.372802 18043 tablet_bootstrap.cc:654] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.373802 18045 tablet_bootstrap.cc:492] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866: Bootstrap starting.
I20260709 13:16:42.381564 18045 tablet_bootstrap.cc:654] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.391806 18049 raft_consensus.cc:493] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.392553 18049 raft_consensus.cc:515] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.395447 18049 leader_election.cc:290] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.401551 17854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149" is_pre_election: true
I20260709 13:16:42.402158 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d557587fbd4b129a73669206a5fecf" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055" is_pre_election: true
I20260709 13:16:42.402364 17854 raft_consensus.cc:2468] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 0.
I20260709 13:16:42.403002 18003 raft_consensus.cc:2468] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 0.
I20260709 13:16:42.403888 17969 leader_election.cc:304] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:42.404521 18002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7ac494747714c929ae2d94913b4d3ee" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055" is_pre_election: true
I20260709 13:16:42.404798 18050 raft_consensus.cc:2804] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.405267 18050 raft_consensus.cc:493] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.405385 18002 raft_consensus.cc:2468] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 0.
I20260709 13:16:42.405655 18050 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.409199 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055" is_pre_election: true
I20260709 13:16:42.411141 17818 leader_election.cc:304] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:42.411988 18049 raft_consensus.cc:2804] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.412374 18049 raft_consensus.cc:493] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.412729 18049 raft_consensus.cc:3060] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.413416 18050 raft_consensus.cc:515] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:42.417143 17854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:42.417730 17854 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.418282 17818 leader_election.cc:304] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:42.418998 18053 raft_consensus.cc:493] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.419587 18053 raft_consensus.cc:515] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.421356 18049 raft_consensus.cc:515] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.423491 18049 leader_election.cc:290] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 election: Requested vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.424027 18049 raft_consensus.cc:2804] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.424399 18049 raft_consensus.cc:493] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.424773 18049 raft_consensus.cc:3060] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.424913 17854 raft_consensus.cc:2468] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 1.
I20260709 13:16:42.426302 17969 leader_election.cc:304] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:42.427153 18053 leader_election.cc:290] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.433512 18050 leader_election.cc:290] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:42.434271 18050 raft_consensus.cc:2804] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.434877 18050 raft_consensus.cc:697] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Becoming Leader. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Running, Role: LEADER
I20260709 13:16:42.436407 18043 tablet_bootstrap.cc:492] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149: No bootstrap required, opened a new log
I20260709 13:16:42.437048 18043 ts_tablet_manager.cc:1403] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149: Time spent bootstrapping tablet: real 0.078s	user 0.040s	sys 0.020s
I20260709 13:16:42.439334 18070 raft_consensus.cc:493] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.439952 18070 raft_consensus.cc:515] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
W20260709 13:16:42.440264 17818 leader_election.cc:343] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.441362 18045 tablet_bootstrap.cc:492] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866: No bootstrap required, opened a new log
I20260709 13:16:42.441979 18045 ts_tablet_manager.cc:1403] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.029s
I20260709 13:16:42.441398 18043 raft_consensus.cc:359] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.442354 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d557587fbd4b129a73669206a5fecf" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:42.443683 18003 raft_consensus.cc:3060] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.444140 18044 tablet_bootstrap.cc:492] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055: No bootstrap required, opened a new log
I20260709 13:16:42.444653 18044 ts_tablet_manager.cc:1403] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055: Time spent bootstrapping tablet: real 0.156s	user 0.013s	sys 0.036s
I20260709 13:16:42.445322 18045 raft_consensus.cc:359] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.446214 18045 raft_consensus.cc:385] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.446557 18045 raft_consensus.cc:740] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.447397 18050 consensus_queue.cc:237] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:42.447417 18045 consensus_queue.cc:260] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.450628 18045 ts_tablet_manager.cc:1434] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:16:42.450451 18044 raft_consensus.cc:359] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.451288 18044 raft_consensus.cc:385] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.451649 18045 tablet_bootstrap.cc:492] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866: Bootstrap starting.
I20260709 13:16:42.451624 18044 raft_consensus.cc:740] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.453758 18003 raft_consensus.cc:2468] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 1.
I20260709 13:16:42.455729 17818 leader_election.cc:304] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:42.458240 18049 raft_consensus.cc:515] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.461009 18049 leader_election.cc:290] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 election: Requested vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.443691 18043 raft_consensus.cc:385] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:16:42.462023 17800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:42.462419 18043 raft_consensus.cc:740] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.462428 18045 tablet_bootstrap.cc:654] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.463454 18043 consensus_queue.cc:260] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.466162 18043 ts_tablet_manager.cc:1434] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:16:42.463958 18070 leader_election.cc:290] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.469534 18043 tablet_bootstrap.cc:492] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149: Bootstrap starting.
I20260709 13:16:42.461704 18049 raft_consensus.cc:2804] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.470289 18049 raft_consensus.cc:697] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Becoming Leader. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:42.471262 18049 consensus_queue.cc:237] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.476089 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7ac494747714c929ae2d94913b4d3ee" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:42.476809 18003 raft_consensus.cc:3060] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.468964 18044 consensus_queue.cc:260] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.477298 17929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866" is_pre_election: true
I20260709 13:16:42.478384 17929 raft_consensus.cc:2468] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 0.
I20260709 13:16:42.479197 18044 ts_tablet_manager.cc:1434] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.004s
I20260709 13:16:42.480221 18044 tablet_bootstrap.cc:492] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055: Bootstrap starting.
I20260709 13:16:42.480424 17929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:42.481206 17929 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.482344 18043 tablet_bootstrap.cc:654] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.484436 18003 raft_consensus.cc:2468] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 1.
I20260709 13:16:42.487757 17928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d557587fbd4b129a73669206a5fecf" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866" is_pre_election: true
I20260709 13:16:42.488122 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055" is_pre_election: true
I20260709 13:16:42.488446 17928 raft_consensus.cc:2468] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 0.
I20260709 13:16:42.490136 17818 leader_election.cc:304] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
W20260709 13:16:42.491248 17818 leader_election.cc:343] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.491714 17927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866" is_pre_election: true
I20260709 13:16:42.492667 18070 raft_consensus.cc:493] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.491731 18044 tablet_bootstrap.cc:654] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.492976 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d557587fbd4b129a73669206a5fecf" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:42.493211 18070 raft_consensus.cc:515] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.494423 17924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866" is_pre_election: true
I20260709 13:16:42.495579 18070 leader_election.cc:290] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.495937 17929 raft_consensus.cc:2468] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 1.
I20260709 13:16:42.496089 17925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7ac494747714c929ae2d94913b4d3ee" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:42.496248 18070 raft_consensus.cc:2804] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.496852 18070 raft_consensus.cc:697] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Becoming Leader. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:42.495611 18072 raft_consensus.cc:493] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.493669 17926 raft_consensus.cc:3060] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.498119 18072 raft_consensus.cc:515] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.499233 18043 tablet_bootstrap.cc:492] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149: No bootstrap required, opened a new log
I20260709 13:16:42.499794 18043 ts_tablet_manager.cc:1403] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.005s
I20260709 13:16:42.500618 18072 leader_election.cc:290] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:42.497591 17928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7ac494747714c929ae2d94913b4d3ee" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866" is_pre_election: true
I20260709 13:16:42.503332 18043 raft_consensus.cc:359] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.504070 18043 raft_consensus.cc:385] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.504397 18043 raft_consensus.cc:740] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.506031 17928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44101c3904f4c48985e55190b876a92" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866" is_pre_election: true
I20260709 13:16:42.506594 17928 raft_consensus.cc:2468] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 0.
I20260709 13:16:42.506739 17854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44101c3904f4c48985e55190b876a92" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149" is_pre_election: true
W20260709 13:16:42.506690 17818 leader_election.cc:343] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.508591 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea747ae0627415cad2ca2e9f9df8446" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055" is_pre_election: true
I20260709 13:16:42.509073 17818 leader_election.cc:304] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149; no voters: 18e6abd847bb427a92efa25a61fca866, 8902aafcd54343cca010105dc6f8f055
I20260709 13:16:42.508792 18043 consensus_queue.cc:260] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.509995 17854 raft_consensus.cc:2468] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 0.
I20260709 13:16:42.508594 17967 leader_election.cc:304] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:42.511632 18074 raft_consensus.cc:2749] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:42.512465 18050 raft_consensus.cc:2804] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.511952 17928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea747ae0627415cad2ca2e9f9df8446" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866" is_pre_election: true
I20260709 13:16:42.513092 18050 raft_consensus.cc:493] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.513365 17928 raft_consensus.cc:2468] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 0.
I20260709 13:16:42.513576 18050 raft_consensus.cc:3060] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.522532 17854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44101c3904f4c48985e55190b876a92" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149" is_pre_election: true
I20260709 13:16:42.514816 17926 raft_consensus.cc:2468] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 1.
I20260709 13:16:42.523506 17854 raft_consensus.cc:2468] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 0.
I20260709 13:16:42.497864 18070 consensus_queue.cc:237] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
W20260709 13:16:42.525141 17818 leader_election.cc:343] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.525277 17895 leader_election.cc:304] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149; no voters: 
I20260709 13:16:42.525565 17818 leader_election.cc:304] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149; no voters: 18e6abd847bb427a92efa25a61fca866, 8902aafcd54343cca010105dc6f8f055
I20260709 13:16:42.527064 18053 raft_consensus.cc:2804] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.527994 18074 raft_consensus.cc:2749] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:42.528136 18053 raft_consensus.cc:493] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.528534 18053 raft_consensus.cc:3060] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:42.528716 17818 leader_election.cc:343] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.530826 18044 tablet_bootstrap.cc:492] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055: No bootstrap required, opened a new log
I20260709 13:16:42.531492 18044 ts_tablet_manager.cc:1403] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.001s
I20260709 13:16:42.507455 17751 catalog_manager.cc:5697] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8902aafcd54343cca010105dc6f8f055 (127.16.211.3). New cstate: current_term: 1 leader_uuid: "8902aafcd54343cca010105dc6f8f055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.536986 18044 raft_consensus.cc:359] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.537782 18044 raft_consensus.cc:385] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.538113 18044 raft_consensus.cc:740] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Initialized, Role: FOLLOWER
W20260709 13:16:42.538990 17818 leader_election.cc:343] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.541368 18044 consensus_queue.cc:260] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.542078 17818 leader_election.cc:304] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149; no voters: 
I20260709 13:16:42.543798 18044 ts_tablet_manager.cc:1434] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
W20260709 13:16:42.543720 17818 leader_election.cc:343] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.540498 18043 ts_tablet_manager.cc:1434] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149: Time spent starting tablet: real 0.040s	user 0.013s	sys 0.009s
I20260709 13:16:42.544883 18072 raft_consensus.cc:493] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.545881 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44101c3904f4c48985e55190b876a92" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055" is_pre_election: true
I20260709 13:16:42.546130 18043 tablet_bootstrap.cc:492] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149: Bootstrap starting.
I20260709 13:16:42.546046 18072 raft_consensus.cc:515] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.547456 18050 raft_consensus.cc:515] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.548177 18072 leader_election.cc:290] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:42.548563 18003 raft_consensus.cc:2393] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18e6abd847bb427a92efa25a61fca866 in current term 1: Already voted for candidate 8902aafcd54343cca010105dc6f8f055 in this term.
I20260709 13:16:42.549196 18079 raft_consensus.cc:2804] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.549253 17854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149" is_pre_election: true
I20260709 13:16:42.549692 18079 raft_consensus.cc:493] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.545789 18044 tablet_bootstrap.cc:492] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055: Bootstrap starting.
I20260709 13:16:42.550036 17854 raft_consensus.cc:2468] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 0.
I20260709 13:16:42.545049 18053 raft_consensus.cc:515] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.551826 17750 catalog_manager.cc:5697] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "79c7e34f43da4949800f838cf1aa1149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.550096 18079 raft_consensus.cc:3060] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.550081 18045 tablet_bootstrap.cc:492] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866: No bootstrap required, opened a new log
I20260709 13:16:42.551496 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866" is_pre_election: true
I20260709 13:16:42.556963 18053 leader_election.cc:290] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.556933 17853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44101c3904f4c48985e55190b876a92" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:42.558466 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44101c3904f4c48985e55190b876a92" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:42.558579 17853 raft_consensus.cc:3060] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.559234 18003 raft_consensus.cc:2393] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18e6abd847bb427a92efa25a61fca866 in current term 1: Already voted for candidate 8902aafcd54343cca010105dc6f8f055 in this term.
I20260709 13:16:42.560509 18045 ts_tablet_manager.cc:1403] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.039s
I20260709 13:16:42.558499 17969 leader_election.cc:304] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:42.563338 18072 raft_consensus.cc:2804] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.563675 18043 tablet_bootstrap.cc:654] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:42.563336 17967 leader_election.cc:343] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.563551 18045 raft_consensus.cc:359] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.564409 18072 raft_consensus.cc:493] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.564841 18045 raft_consensus.cc:385] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.564972 18072 raft_consensus.cc:3060] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.565182 18045 raft_consensus.cc:740] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.566371 18045 consensus_queue.cc:260] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.569011 18045 ts_tablet_manager.cc:1434] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:16:42.570017 18045 tablet_bootstrap.cc:492] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866: Bootstrap starting.
I20260709 13:16:42.575002 18072 raft_consensus.cc:515] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.580252 18050 leader_election.cc:290] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:42.580678 17854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44101c3904f4c48985e55190b876a92" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:42.581772 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44101c3904f4c48985e55190b876a92" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:42.582043 17853 raft_consensus.cc:2468] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 1.
I20260709 13:16:42.582952 17926 raft_consensus.cc:2393] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8902aafcd54343cca010105dc6f8f055 in current term 1: Already voted for candidate 18e6abd847bb427a92efa25a61fca866 in this term.
I20260709 13:16:42.585083 17967 leader_election.cc:304] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8902aafcd54343cca010105dc6f8f055; no voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149
I20260709 13:16:42.585209 17895 leader_election.cc:304] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149; no voters: 8902aafcd54343cca010105dc6f8f055
I20260709 13:16:42.586872 18050 raft_consensus.cc:2749] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:42.586952 18053 raft_consensus.cc:2804] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.588481 18045 tablet_bootstrap.cc:654] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.602342 18044 tablet_bootstrap.cc:654] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.606968 18053 raft_consensus.cc:697] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 1 LEADER]: Becoming Leader. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Running, Role: LEADER
I20260709 13:16:42.607954 18072 leader_election.cc:290] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:42.608067 18053 consensus_queue.cc:237] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.608647 17853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:42.608989 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:42.609359 17853 raft_consensus.cc:3060] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:42.610387 17967 leader_election.cc:343] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.618250 17853 raft_consensus.cc:2468] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 1.
I20260709 13:16:42.618782 18045 tablet_bootstrap.cc:492] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866: No bootstrap required, opened a new log
I20260709 13:16:42.622833 18044 tablet_bootstrap.cc:492] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055: No bootstrap required, opened a new log
I20260709 13:16:42.627562 18044 ts_tablet_manager.cc:1403] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.007s
I20260709 13:16:42.628490 17969 leader_election.cc:304] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 18e6abd847bb427a92efa25a61fca866
I20260709 13:16:42.629998 18072 raft_consensus.cc:2804] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.630451 18072 raft_consensus.cc:697] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Becoming Leader. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Running, Role: LEADER
I20260709 13:16:42.630990 18044 raft_consensus.cc:359] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.631767 18044 raft_consensus.cc:385] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.626543 18079 raft_consensus.cc:515] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.632115 18044 raft_consensus.cc:740] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.631562 18072 consensus_queue.cc:237] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.633090 18044 consensus_queue.cc:260] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.634814 18045 ts_tablet_manager.cc:1403] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.003s
I20260709 13:16:42.635191 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea747ae0627415cad2ca2e9f9df8446" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:42.635819 17926 raft_consensus.cc:3060] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.638000 18045 raft_consensus.cc:359] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.638778 18045 raft_consensus.cc:385] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.639113 18045 raft_consensus.cc:740] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.642426 18044 ts_tablet_manager.cc:1434] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:16:42.643530 18044 tablet_bootstrap.cc:492] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055: Bootstrap starting.
I20260709 13:16:42.644340 17926 raft_consensus.cc:2468] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 1.
I20260709 13:16:42.646387 18053 raft_consensus.cc:493] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.646929 18053 raft_consensus.cc:515] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.647562 18043 tablet_bootstrap.cc:492] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149: No bootstrap required, opened a new log
I20260709 13:16:42.648021 18043 ts_tablet_manager.cc:1403] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.004s
I20260709 13:16:42.648779 17752 catalog_manager.cc:5697] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18e6abd847bb427a92efa25a61fca866 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "18e6abd847bb427a92efa25a61fca866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.650858 18079 leader_election.cc:290] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 election: Requested vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.639914 18045 consensus_queue.cc:260] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.651279 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbef844084784d53b5554df1aa742420" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055" is_pre_election: true
I20260709 13:16:42.653467 18045 ts_tablet_manager.cc:1434] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
W20260709 13:16:42.654553 17893 leader_election.cc:343] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.655274 18043 raft_consensus.cc:359] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.656033 18043 raft_consensus.cc:385] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.656261 18043 raft_consensus.cc:740] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.655447 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aea747ae0627415cad2ca2e9f9df8446" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:42.657001 18003 raft_consensus.cc:3060] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.657603 18043 consensus_queue.cc:260] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.657002 18045 tablet_bootstrap.cc:492] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866: Bootstrap starting.
I20260709 13:16:42.659497 17818 leader_election.cc:304] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149; no voters: 
I20260709 13:16:42.660328 18079 raft_consensus.cc:2804] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.660805 18079 raft_consensus.cc:697] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Becoming Leader. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:42.662681 18043 ts_tablet_manager.cc:1434] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:16:42.663684 18043 tablet_bootstrap.cc:492] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149: Bootstrap starting.
I20260709 13:16:42.664374 18079 consensus_queue.cc:237] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.650218 18053 leader_election.cc:290] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.661033 17853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbef844084784d53b5554df1aa742420" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149" is_pre_election: true
I20260709 13:16:42.668612 17853 raft_consensus.cc:2468] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 0.
I20260709 13:16:42.669958 17895 leader_election.cc:304] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149; no voters: 8902aafcd54343cca010105dc6f8f055
I20260709 13:16:42.671144 18053 raft_consensus.cc:2804] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.671528 18053 raft_consensus.cc:493] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.671923 18053 raft_consensus.cc:3060] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.673390 18043 tablet_bootstrap.cc:654] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.673635 18003 raft_consensus.cc:2468] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 1.
I20260709 13:16:42.681973 18045 tablet_bootstrap.cc:654] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.683409 18053 raft_consensus.cc:515] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.678594 18044 tablet_bootstrap.cc:654] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.698160 17853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbef844084784d53b5554df1aa742420" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:42.698817 17853 raft_consensus.cc:3060] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.699158 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbef844084784d53b5554df1aa742420" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055"
W20260709 13:16:42.700649 17893 leader_election.cc:343] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.698097 18053 leader_election.cc:290] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.714632 18045 tablet_bootstrap.cc:492] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866: No bootstrap required, opened a new log
I20260709 13:16:42.715121 18045 ts_tablet_manager.cc:1403] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.004s
I20260709 13:16:42.718099 18045 raft_consensus.cc:359] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.718875 18045 raft_consensus.cc:385] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.719192 18045 raft_consensus.cc:740] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.720160 18045 consensus_queue.cc:260] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.722771 18045 ts_tablet_manager.cc:1434] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:42.723783 18045 tablet_bootstrap.cc:492] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866: Bootstrap starting.
I20260709 13:16:42.724987 17853 raft_consensus.cc:2468] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 1.
I20260709 13:16:42.725598 18043 tablet_bootstrap.cc:492] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149: No bootstrap required, opened a new log
I20260709 13:16:42.726167 18043 ts_tablet_manager.cc:1403] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.030s
I20260709 13:16:42.728204 17895 leader_election.cc:304] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149; no voters: 8902aafcd54343cca010105dc6f8f055
I20260709 13:16:42.729439 18053 raft_consensus.cc:2804] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.729317 18043 raft_consensus.cc:359] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.730123 18045 tablet_bootstrap.cc:654] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.730065 18053 raft_consensus.cc:697] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [term 1 LEADER]: Becoming Leader. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Running, Role: LEADER
I20260709 13:16:42.730108 18043 raft_consensus.cc:385] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.730728 18043 raft_consensus.cc:740] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.731226 18053 consensus_queue.cc:237] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.731676 18043 consensus_queue.cc:260] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.734202 18043 ts_tablet_manager.cc:1434] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:42.735220 18083 raft_consensus.cc:493] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.735930 18083 raft_consensus.cc:515] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.736524 17750 catalog_manager.cc:5697] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8902aafcd54343cca010105dc6f8f055 (127.16.211.3). New cstate: current_term: 1 leader_uuid: "8902aafcd54343cca010105dc6f8f055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.738399 18043 tablet_bootstrap.cc:492] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149: Bootstrap starting.
I20260709 13:16:42.739367 18083 leader_election.cc:290] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.741657 17854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149" is_pre_election: true
I20260709 13:16:42.742640 17854 raft_consensus.cc:2468] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 0.
I20260709 13:16:42.745015 18043 tablet_bootstrap.cc:654] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.744859 17895 leader_election.cc:304] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149; no voters: 
I20260709 13:16:42.749542 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055" is_pre_election: true
I20260709 13:16:42.749907 18045 tablet_bootstrap.cc:492] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866: No bootstrap required, opened a new log
I20260709 13:16:42.750394 18045 ts_tablet_manager.cc:1403] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.015s
I20260709 13:16:42.750443 18044 tablet_bootstrap.cc:492] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055: No bootstrap required, opened a new log
W20260709 13:16:42.750946 17893 leader_election.cc:343] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:42.751127 18044 ts_tablet_manager.cc:1403] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.000s
I20260709 13:16:42.752230 18083 raft_consensus.cc:493] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.751375 17752 catalog_manager.cc:5697] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "79c7e34f43da4949800f838cf1aa1149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.752720 18083 raft_consensus.cc:515] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.753350 18045 raft_consensus.cc:359] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.754081 18045 raft_consensus.cc:385] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.754458 18045 raft_consensus.cc:740] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.753537 17752 catalog_manager.cc:5697] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "79c7e34f43da4949800f838cf1aa1149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.757354 18044 raft_consensus.cc:359] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.758219 18044 raft_consensus.cc:385] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.758757 18044 raft_consensus.cc:740] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.758374 18045 consensus_queue.cc:260] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.760718 18053 raft_consensus.cc:2804] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.761097 18053 raft_consensus.cc:493] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.761456 18053 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.762557 18083 leader_election.cc:290] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.763752 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7ac494747714c929ae2d94913b4d3ee" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055" is_pre_election: true
I20260709 13:16:42.764640 18003 raft_consensus.cc:2393] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18e6abd847bb427a92efa25a61fca866 in current term 1: Already voted for candidate 79c7e34f43da4949800f838cf1aa1149 in this term.
I20260709 13:16:42.759655 18044 consensus_queue.cc:260] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.776194 18044 ts_tablet_manager.cc:1434] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:16:42.777314 18044 tablet_bootstrap.cc:492] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055: Bootstrap starting.
I20260709 13:16:42.778988 17750 catalog_manager.cc:5697] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18e6abd847bb427a92efa25a61fca866 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "18e6abd847bb427a92efa25a61fca866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.795874 18053 raft_consensus.cc:515] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.797091 18044 tablet_bootstrap.cc:654] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.800652 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:42.801486 18003 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.804039 18053 leader_election.cc:290] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:42.805223 18045 ts_tablet_manager.cc:1434] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.024s
I20260709 13:16:42.806207 18045 tablet_bootstrap.cc:492] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866: Bootstrap starting.
W20260709 13:16:42.808369 17895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 60723.8us
I20260709 13:16:42.810532 17853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7ac494747714c929ae2d94913b4d3ee" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149" is_pre_election: true
I20260709 13:16:42.811354 18003 raft_consensus.cc:2468] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 1.
I20260709 13:16:42.811820 18045 tablet_bootstrap.cc:654] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.813462 18043 tablet_bootstrap.cc:492] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149: No bootstrap required, opened a new log
I20260709 13:16:42.813954 18043 ts_tablet_manager.cc:1403] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.035s
I20260709 13:16:42.814277 17893 leader_election.cc:304] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:42.817521 18043 raft_consensus.cc:359] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.818555 18043 raft_consensus.cc:385] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.818945 18043 raft_consensus.cc:740] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.821066 17853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:42.821700 17853 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.823030 18044 tablet_bootstrap.cc:492] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055: No bootstrap required, opened a new log
I20260709 13:16:42.823508 18044 ts_tablet_manager.cc:1403] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.005s
I20260709 13:16:42.826467 18044 raft_consensus.cc:359] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.827169 18044 raft_consensus.cc:385] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.828725 18044 raft_consensus.cc:740] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.829471 17853 raft_consensus.cc:2468] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 1.
I20260709 13:16:42.830169 18044 consensus_queue.cc:260] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.830936 17895 leader_election.cc:304] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866; no voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055
I20260709 13:16:42.832409 18044 ts_tablet_manager.cc:1434] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:42.832862 18043 consensus_queue.cc:260] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.833366 18044 tablet_bootstrap.cc:492] T fbef844084784d53b5554df1aa742420 P 8902aafcd54343cca010105dc6f8f055: Bootstrap starting.
I20260709 13:16:42.835172 18043 ts_tablet_manager.cc:1434] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:16:42.839175 18044 tablet_bootstrap.cc:654] T fbef844084784d53b5554df1aa742420 P 8902aafcd54343cca010105dc6f8f055: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.839653 18045 tablet_bootstrap.cc:492] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866: No bootstrap required, opened a new log
I20260709 13:16:42.840178 18045 ts_tablet_manager.cc:1403] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.013s
I20260709 13:16:42.842669 18053 raft_consensus.cc:2804] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.843482 18100 raft_consensus.cc:3060] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.844296 18045 raft_consensus.cc:359] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.845336 18045 raft_consensus.cc:385] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.845763 18045 raft_consensus.cc:740] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.846793 18045 consensus_queue.cc:260] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.849668 18045 ts_tablet_manager.cc:1434] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:16:42.851140 18044 tablet_bootstrap.cc:492] T fbef844084784d53b5554df1aa742420 P 8902aafcd54343cca010105dc6f8f055: No bootstrap required, opened a new log
I20260709 13:16:42.851572 18044 ts_tablet_manager.cc:1403] T fbef844084784d53b5554df1aa742420 P 8902aafcd54343cca010105dc6f8f055: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 13:16:42.852026 18100 raft_consensus.cc:2749] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:42.853771 18044 raft_consensus.cc:359] T fbef844084784d53b5554df1aa742420 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.854498 18044 raft_consensus.cc:385] T fbef844084784d53b5554df1aa742420 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.854789 18044 raft_consensus.cc:740] T fbef844084784d53b5554df1aa742420 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.855479 18044 consensus_queue.cc:260] T fbef844084784d53b5554df1aa742420 P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.857116 18044 ts_tablet_manager.cc:1434] T fbef844084784d53b5554df1aa742420 P 8902aafcd54343cca010105dc6f8f055: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:16:42.854086 18053 raft_consensus.cc:697] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 1 LEADER]: Becoming Leader. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Running, Role: LEADER
I20260709 13:16:42.858111 18053 consensus_queue.cc:237] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.869863 17752 catalog_manager.cc:5697] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18e6abd847bb427a92efa25a61fca866 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "18e6abd847bb427a92efa25a61fca866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.873720 18072 raft_consensus.cc:493] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.874208 18072 raft_consensus.cc:515] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.876322 18072 leader_election.cc:290] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:42.877017 17853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f2b69339dc403487ce637c94239ab0" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149" is_pre_election: true
I20260709 13:16:42.877619 17853 raft_consensus.cc:2468] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 0.
I20260709 13:16:42.878857 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f2b69339dc403487ce637c94239ab0" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866" is_pre_election: true
I20260709 13:16:42.879364 17926 raft_consensus.cc:2468] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 0.
I20260709 13:16:42.879576 17969 leader_election.cc:304] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:42.880425 18072 raft_consensus.cc:2804] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:42.880805 18072 raft_consensus.cc:493] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.881134 18072 raft_consensus.cc:3060] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.886184 18072 raft_consensus.cc:515] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.887846 18072 leader_election.cc:290] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:42.888624 17853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f2b69339dc403487ce637c94239ab0" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:42.888898 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f2b69339dc403487ce637c94239ab0" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:42.889112 17853 raft_consensus.cc:3060] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.889454 17926 raft_consensus.cc:3060] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.893594 17853 raft_consensus.cc:2468] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 1.
I20260709 13:16:42.894001 17926 raft_consensus.cc:2468] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 1.
I20260709 13:16:42.894634 17969 leader_election.cc:304] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:42.895295 18072 raft_consensus.cc:2804] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.895795 18072 raft_consensus.cc:697] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Becoming Leader. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Running, Role: LEADER
I20260709 13:16:42.896550 18072 consensus_queue.cc:237] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:42.903250 17752 catalog_manager.cc:5697] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8902aafcd54343cca010105dc6f8f055 (127.16.211.3). New cstate: current_term: 1 leader_uuid: "8902aafcd54343cca010105dc6f8f055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.936951 18079 consensus_queue.cc:1048] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:42.946717 18072 consensus_queue.cc:1048] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:42.949683 18070 consensus_queue.cc:1048] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:42.964695 18072 consensus_queue.cc:1048] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:42.982401 18070 consensus_queue.cc:1048] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:42.993486 18079 consensus_queue.cc:1048] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.058008 18079 raft_consensus.cc:493] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.058539 18079 raft_consensus.cc:515] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.060312 18079 leader_election.cc:290] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:43.061105 17928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f68c8681a1f42e6add0dc1c12edff78" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866" is_pre_election: true
I20260709 13:16:43.061295 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f68c8681a1f42e6add0dc1c12edff78" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055" is_pre_election: true
I20260709 13:16:43.061772 17928 raft_consensus.cc:2468] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 0.
I20260709 13:16:43.061894 18003 raft_consensus.cc:2468] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 0.
I20260709 13:16:43.062894 17818 leader_election.cc:304] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:43.063454 18079 raft_consensus.cc:2804] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:43.063743 18079 raft_consensus.cc:493] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.064105 18079 raft_consensus.cc:3060] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.068837 18079 raft_consensus.cc:515] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.070537 18079 leader_election.cc:290] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 election: Requested vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:43.071452 17928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f68c8681a1f42e6add0dc1c12edff78" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:43.071843 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f68c8681a1f42e6add0dc1c12edff78" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:43.072110 17928 raft_consensus.cc:3060] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.072430 18003 raft_consensus.cc:3060] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.079603 18003 raft_consensus.cc:2468] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 1.
I20260709 13:16:43.079603 17928 raft_consensus.cc:2468] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 1.
I20260709 13:16:43.080962 17818 leader_election.cc:304] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149; no voters: 
I20260709 13:16:43.081625 18079 raft_consensus.cc:2804] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:43.082082 18079 raft_consensus.cc:697] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Becoming Leader. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:43.082820 18079 consensus_queue.cc:237] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.088799 18070 consensus_queue.cc:1048] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.090797 17928 raft_consensus.cc:3060] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.091528 17751 catalog_manager.cc:5697] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "79c7e34f43da4949800f838cf1aa1149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.100533 18079 consensus_queue.cc:1048] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.111546 18072 consensus_queue.cc:1048] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.122584 18112 consensus_queue.cc:1048] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.139221 18003 raft_consensus.cc:3060] T fbef844084784d53b5554df1aa742420 P 8902aafcd54343cca010105dc6f8f055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.144047 18053 consensus_queue.cc:1048] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.145713 18053 consensus_queue.cc:1048] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.184446 18097 consensus_queue.cc:1048] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.195755 18053 consensus_queue.cc:1048] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.324371 18112 consensus_queue.cc:1048] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.337443 18112 consensus_queue.cc:1048] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.343485 18100 consensus_queue.cc:1048] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:43.360679 18083 consensus_queue.cc:1048] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.378338 18002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3"
dest_uuid: "8902aafcd54343cca010105dc6f8f055"
mode: GRACEFUL
new_leader_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:59150
I20260709 13:16:43.378968 18002 raft_consensus.cc:606] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Received request to transfer leadership to TS 79c7e34f43da4949800f838cf1aa1149
I20260709 13:16:43.389530 18002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac"
dest_uuid: "8902aafcd54343cca010105dc6f8f055"
mode: GRACEFUL
new_leader_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:59150
I20260709 13:16:43.390085 18002 raft_consensus.cc:606] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Received request to transfer leadership to TS 79c7e34f43da4949800f838cf1aa1149
I20260709 13:16:43.402179 17928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d9853061943442992e3a638abad3b4b"
dest_uuid: "18e6abd847bb427a92efa25a61fca866"
mode: GRACEFUL
new_leader_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:37070
I20260709 13:16:43.402702 17928 raft_consensus.cc:606] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 1 LEADER]: Received request to transfer leadership to TS 79c7e34f43da4949800f838cf1aa1149
I20260709 13:16:43.407985 18002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3f2b69339dc403487ce637c94239ab0"
dest_uuid: "8902aafcd54343cca010105dc6f8f055"
mode: GRACEFUL
new_leader_uuid: "18e6abd847bb427a92efa25a61fca866"
 from {username='slave'} at 127.0.0.1:59150
I20260709 13:16:43.408607 18002 raft_consensus.cc:606] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Received request to transfer leadership to TS 18e6abd847bb427a92efa25a61fca866
I20260709 13:16:43.423568 17853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d557587fbd4b129a73669206a5fecf"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
mode: GRACEFUL
new_leader_uuid: "18e6abd847bb427a92efa25a61fca866"
 from {username='slave'} at 127.0.0.1:42930
I20260709 13:16:43.424206 17853 raft_consensus.cc:606] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Received request to transfer leadership to TS 18e6abd847bb427a92efa25a61fca866
I20260709 13:16:43.433172 17853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f68c8681a1f42e6add0dc1c12edff78"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
mode: GRACEFUL
new_leader_uuid: "8902aafcd54343cca010105dc6f8f055"
 from {username='slave'} at 127.0.0.1:42930
I20260709 13:16:43.433881 17853 raft_consensus.cc:606] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Received request to transfer leadership to TS 8902aafcd54343cca010105dc6f8f055
I20260709 13:16:43.559337 18050 raft_consensus.cc:993] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055: : Instructing follower 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:43.559767 18112 raft_consensus.cc:1081] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Signalling peer 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:43.561252 17853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:42910
I20260709 13:16:43.561728 17853 raft_consensus.cc:493] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.562016 17853 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.566454 17853 raft_consensus.cc:515] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:43.567956 17853 leader_election.cc:290] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 2 election: Requested vote from peers 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:43.568910 18002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:43.569164 17928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:43.569510 18002 raft_consensus.cc:3055] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:43.569654 17928 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.569856 18002 raft_consensus.cc:740] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Running, Role: LEADER
I20260709 13:16:43.570706 18002 consensus_queue.cc:260] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:43.571887 18002 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.576546 17928 raft_consensus.cc:2468] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 2.
I20260709 13:16:43.577860 17818 leader_election.cc:304] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149; no voters: 
I20260709 13:16:43.578668 18049 raft_consensus.cc:2804] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:43.578804 18002 raft_consensus.cc:2468] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 2.
I20260709 13:16:43.579205 18049 raft_consensus.cc:697] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Becoming Leader. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:43.580013 18049 consensus_queue.cc:237] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:43.586422 17748 catalog_manager.cc:5697] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 reported cstate change: term changed from 1 to 2, leader changed from 8902aafcd54343cca010105dc6f8f055 (127.16.211.3) to 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "79c7e34f43da4949800f838cf1aa1149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.612098 18070 consensus_queue.cc:1048] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.618839 18049 raft_consensus.cc:993] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149: : Instructing follower 8902aafcd54343cca010105dc6f8f055 to start an election
I20260709 13:16:43.619369 18079 raft_consensus.cc:1081] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Signalling peer 8902aafcd54343cca010105dc6f8f055 to start an election
I20260709 13:16:43.621505 18003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f68c8681a1f42e6add0dc1c12edff78"
dest_uuid: "8902aafcd54343cca010105dc6f8f055"
 from {username='slave'} at 127.0.0.1:59132
I20260709 13:16:43.622279 18003 raft_consensus.cc:493] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.622726 18003 raft_consensus.cc:3060] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.625943 18070 consensus_queue.cc:1048] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:43.630699 18003 raft_consensus.cc:515] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.633003 18003 leader_election.cc:290] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 2 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:43.635808 17853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f68c8681a1f42e6add0dc1c12edff78" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:43.636363 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f68c8681a1f42e6add0dc1c12edff78" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:43.636915 17926 raft_consensus.cc:3060] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.636392 17853 raft_consensus.cc:3055] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:43.641907 17853 raft_consensus.cc:740] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:43.642836 17853 consensus_queue.cc:260] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.643435 17926 raft_consensus.cc:2468] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 2.
I20260709 13:16:43.644201 17853 raft_consensus.cc:3060] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.644465 17967 leader_election.cc:304] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:43.645269 18112 raft_consensus.cc:2804] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:43.645761 18112 raft_consensus.cc:697] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [term 2 LEADER]: Becoming Leader. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Running, Role: LEADER
I20260709 13:16:43.646571 18112 consensus_queue.cc:237] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.651084 17853 raft_consensus.cc:2468] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 2.
I20260709 13:16:43.654873 17751 catalog_manager.cc:5697] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 reported cstate change: term changed from 1 to 2, leader changed from 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1) to 8902aafcd54343cca010105dc6f8f055 (127.16.211.3). New cstate: current_term: 2 leader_uuid: "8902aafcd54343cca010105dc6f8f055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:43.738924 18050 raft_consensus.cc:993] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055: : Instructing follower 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:43.739481 18112 raft_consensus.cc:1081] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Signalling peer 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:43.740980 17853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:42910
I20260709 13:16:43.741492 17853 raft_consensus.cc:493] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.741838 17853 raft_consensus.cc:3060] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.746371 17853 raft_consensus.cc:515] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.747843 17853 leader_election.cc:290] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 2 election: Requested vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:43.748687 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:43.748996 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:43.749253 17926 raft_consensus.cc:3060] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.749562 18003 raft_consensus.cc:3055] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:43.749864 18003 raft_consensus.cc:740] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Running, Role: LEADER
I20260709 13:16:43.750644 18003 consensus_queue.cc:260] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.751579 18003 raft_consensus.cc:3060] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.754119 17926 raft_consensus.cc:2468] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 2.
I20260709 13:16:43.755080 17818 leader_election.cc:304] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149; no voters: 
I20260709 13:16:43.755710 18079 raft_consensus.cc:2804] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:43.756166 18079 raft_consensus.cc:697] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Becoming Leader. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:43.756337 18003 raft_consensus.cc:2468] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 2.
I20260709 13:16:43.756984 18079 consensus_queue.cc:237] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.763561 17751 catalog_manager.cc:5697] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 reported cstate change: term changed from 1 to 2, leader changed from 8902aafcd54343cca010105dc6f8f055 (127.16.211.3) to 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "79c7e34f43da4949800f838cf1aa1149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.866413 18112 raft_consensus.cc:993] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055: : Instructing follower 18e6abd847bb427a92efa25a61fca866 to start an election
I20260709 13:16:43.866925 18050 raft_consensus.cc:1081] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Signalling peer 18e6abd847bb427a92efa25a61fca866 to start an election
I20260709 13:16:43.868306 17926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3f2b69339dc403487ce637c94239ab0"
dest_uuid: "18e6abd847bb427a92efa25a61fca866"
 from {username='slave'} at 127.0.0.1:37068
I20260709 13:16:43.868763 17926 raft_consensus.cc:493] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.869053 17926 raft_consensus.cc:3060] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.873904 17926 raft_consensus.cc:515] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.875581 17926 leader_election.cc:290] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 2 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:43.876307 17853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f2b69339dc403487ce637c94239ab0" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:43.876941 17853 raft_consensus.cc:3060] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.876828 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f2b69339dc403487ce637c94239ab0" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:43.877565 18003 raft_consensus.cc:3055] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:43.878043 18003 raft_consensus.cc:740] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Running, Role: LEADER
I20260709 13:16:43.878722 18003 consensus_queue.cc:260] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.879573 18003 raft_consensus.cc:3060] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.882328 17853 raft_consensus.cc:2468] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 2.
I20260709 13:16:43.883579 17895 leader_election.cc:304] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149; no voters: 
I20260709 13:16:43.884207 18003 raft_consensus.cc:2468] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 2.
I20260709 13:16:43.884348 18083 raft_consensus.cc:2804] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:43.884941 18083 raft_consensus.cc:697] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 2 LEADER]: Becoming Leader. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Running, Role: LEADER
I20260709 13:16:43.885807 18083 consensus_queue.cc:237] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.892313 17751 catalog_manager.cc:5697] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 reported cstate change: term changed from 1 to 2, leader changed from 8902aafcd54343cca010105dc6f8f055 (127.16.211.3) to 18e6abd847bb427a92efa25a61fca866 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "18e6abd847bb427a92efa25a61fca866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.919023 18097 raft_consensus.cc:993] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866: : Instructing follower 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:43.919446 18083 raft_consensus.cc:1081] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 1 LEADER]: Signalling peer 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:43.921060 17853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d9853061943442992e3a638abad3b4b"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:42922
I20260709 13:16:43.921599 17853 raft_consensus.cc:493] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.921978 17853 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.927277 17853 raft_consensus.cc:515] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.929136 17853 leader_election.cc:290] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 2 election: Requested vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:43.929872 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:43.930228 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:43.930433 17926 raft_consensus.cc:3055] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:43.930768 17926 raft_consensus.cc:740] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Running, Role: LEADER
I20260709 13:16:43.930820 18003 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.931550 17926 consensus_queue.cc:260] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.932528 17926 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.936611 18003 raft_consensus.cc:2468] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 2.
I20260709 13:16:43.937306 17926 raft_consensus.cc:2468] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 2.
I20260709 13:16:43.937789 17818 leader_election.cc:304] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:43.938555 18079 raft_consensus.cc:2804] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:43.939038 18079 raft_consensus.cc:697] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Becoming Leader. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:43.939736 18079 consensus_queue.cc:237] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.946151 17751 catalog_manager.cc:5697] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 reported cstate change: term changed from 1 to 2, leader changed from 18e6abd847bb427a92efa25a61fca866 (127.16.211.2) to 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "79c7e34f43da4949800f838cf1aa1149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.969988 18070 raft_consensus.cc:993] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149: : Instructing follower 18e6abd847bb427a92efa25a61fca866 to start an election
I20260709 13:16:43.970409 18070 raft_consensus.cc:1081] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Signalling peer 18e6abd847bb427a92efa25a61fca866 to start an election
I20260709 13:16:43.971802 17926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49d557587fbd4b129a73669206a5fecf"
dest_uuid: "18e6abd847bb427a92efa25a61fca866"
 from {username='slave'} at 127.0.0.1:37066
I20260709 13:16:43.972335 17926 raft_consensus.cc:493] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.972687 17926 raft_consensus.cc:3060] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.977744 17926 raft_consensus.cc:515] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.979605 17926 leader_election.cc:290] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 2 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:43.980540 17853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d557587fbd4b129a73669206a5fecf" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:43.980669 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d557587fbd4b129a73669206a5fecf" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:43.981173 17853 raft_consensus.cc:3055] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:43.981264 18003 raft_consensus.cc:3060] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.981474 17853 raft_consensus.cc:740] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:43.982282 17853 consensus_queue.cc:260] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.983150 17853 raft_consensus.cc:3060] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.988087 17853 raft_consensus.cc:2468] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 2.
I20260709 13:16:43.988091 18003 raft_consensus.cc:2468] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 2.
I20260709 13:16:43.989293 17893 leader_election.cc:304] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:43.990104 18083 raft_consensus.cc:2804] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:43.990808 18083 raft_consensus.cc:697] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 2 LEADER]: Becoming Leader. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Running, Role: LEADER
I20260709 13:16:43.991623 18083 consensus_queue.cc:237] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:43.997967 17751 catalog_manager.cc:5697] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 reported cstate change: term changed from 1 to 2, leader changed from 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1) to 18e6abd847bb427a92efa25a61fca866 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "18e6abd847bb427a92efa25a61fca866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.062781 18003 raft_consensus.cc:1275] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.064271 18070 consensus_queue.cc:1048] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:44.075707 17926 raft_consensus.cc:1275] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.077418 18079 consensus_queue.cc:1048] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:44.203307 17853 raft_consensus.cc:1275] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Refusing update from remote peer 8902aafcd54343cca010105dc6f8f055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.204571 18050 consensus_queue.cc:1048] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:44.211239 17926 raft_consensus.cc:1275] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Refusing update from remote peer 8902aafcd54343cca010105dc6f8f055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.212815 18072 consensus_queue.cc:1048] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:44.222486 17926 raft_consensus.cc:1275] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.223758 18070 consensus_queue.cc:1048] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:44.232448 18003 raft_consensus.cc:1275] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.233961 18070 consensus_queue.cc:1048] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:44.349377 18003 raft_consensus.cc:1275] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Refusing update from remote peer 18e6abd847bb427a92efa25a61fca866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.350776 18097 consensus_queue.cc:1048] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:44.358688 17853 raft_consensus.cc:1275] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Refusing update from remote peer 18e6abd847bb427a92efa25a61fca866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.360483 18097 consensus_queue.cc:1048] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:44.384630 17853 raft_consensus.cc:1275] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Refusing update from remote peer 18e6abd847bb427a92efa25a61fca866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.385823 18097 consensus_queue.cc:1048] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:44.394091 18003 raft_consensus.cc:1275] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Refusing update from remote peer 18e6abd847bb427a92efa25a61fca866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.396309 18083 consensus_queue.cc:1048] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:44.441278 18002 raft_consensus.cc:1275] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.442529 18070 consensus_queue.cc:1048] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:44.450732 17926 raft_consensus.cc:1275] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.453037 18079 consensus_queue.cc:1048] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:46.466331 17228 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:16:46.467108 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:46.484413 17853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d9853061943442992e3a638abad3b4b"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
mode: GRACEFUL
new_leader_uuid: "8902aafcd54343cca010105dc6f8f055"
 from {username='slave'} at 127.0.0.1:37870
I20260709 13:16:46.484915 17853 raft_consensus.cc:606] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Received request to transfer leadership to TS 8902aafcd54343cca010105dc6f8f055
I20260709 13:16:46.487236 17853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
mode: GRACEFUL
new_leader_uuid: "8902aafcd54343cca010105dc6f8f055"
 from {username='slave'} at 127.0.0.1:37870
I20260709 13:16:46.487703 17853 raft_consensus.cc:606] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Received request to transfer leadership to TS 8902aafcd54343cca010105dc6f8f055
I20260709 13:16:46.488710 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:46.489123 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:46.605389 18079 raft_consensus.cc:993] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149: : Instructing follower 8902aafcd54343cca010105dc6f8f055 to start an election
I20260709 13:16:46.606115 18150 raft_consensus.cc:1081] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Signalling peer 8902aafcd54343cca010105dc6f8f055 to start an election
I20260709 13:16:46.608091 18002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d9853061943442992e3a638abad3b4b"
dest_uuid: "8902aafcd54343cca010105dc6f8f055"
 from {username='slave'} at 127.0.0.1:59132
I20260709 13:16:46.608570 18002 raft_consensus.cc:493] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:46.608932 18002 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.613380 18002 raft_consensus.cc:515] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:46.614962 18002 leader_election.cc:290] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 3 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:46.615959 17853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:46.616065 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:46.616423 17853 raft_consensus.cc:3055] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:46.616745 17853 raft_consensus.cc:740] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:46.616726 17926 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.617621 17853 consensus_queue.cc:260] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:46.618510 17853 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.622247 17926 raft_consensus.cc:2468] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 3.
I20260709 13:16:46.622588 17853 raft_consensus.cc:2468] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 3.
I20260709 13:16:46.623597 17967 leader_election.cc:304] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:46.624886 18072 raft_consensus.cc:2804] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:46.626152 18150 raft_consensus.cc:993] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149: : Instructing follower 8902aafcd54343cca010105dc6f8f055 to start an election
I20260709 13:16:46.626039 18072 raft_consensus.cc:697] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 3 LEADER]: Becoming Leader. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Running, Role: LEADER
I20260709 13:16:46.626719 18150 raft_consensus.cc:1081] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Signalling peer 8902aafcd54343cca010105dc6f8f055 to start an election
I20260709 13:16:46.627167 18072 consensus_queue.cc:237] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:46.628414 18002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3"
dest_uuid: "8902aafcd54343cca010105dc6f8f055"
 from {username='slave'} at 127.0.0.1:59132
I20260709 13:16:46.629041 18002 raft_consensus.cc:493] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:46.629472 18002 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.635208 18002 raft_consensus.cc:515] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:46.635156 17748 catalog_manager.cc:5697] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 reported cstate change: term changed from 2 to 3, leader changed from 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1) to 8902aafcd54343cca010105dc6f8f055 (127.16.211.3). New cstate: current_term: 3 leader_uuid: "8902aafcd54343cca010105dc6f8f055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.637195 18002 leader_election.cc:290] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 3 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:46.638077 17853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:46.638463 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:46.638818 17853 raft_consensus.cc:3055] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:46.639151 17853 raft_consensus.cc:740] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:46.639106 17926 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.639842 17853 consensus_queue.cc:260] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:46.640779 17853 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.646243 17853 raft_consensus.cc:2468] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 3.
I20260709 13:16:46.647425 17969 leader_election.cc:304] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:46.648216 18072 raft_consensus.cc:2804] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:46.648785 18072 raft_consensus.cc:697] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 3 LEADER]: Becoming Leader. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Running, Role: LEADER
I20260709 13:16:46.648656 17926 raft_consensus.cc:2468] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 3.
I20260709 13:16:46.649829 18072 consensus_queue.cc:237] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:46.658422 17748 catalog_manager.cc:5697] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 reported cstate change: term changed from 2 to 3, leader changed from 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1) to 8902aafcd54343cca010105dc6f8f055 (127.16.211.3). New cstate: current_term: 3 leader_uuid: "8902aafcd54343cca010105dc6f8f055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.080056 17926 raft_consensus.cc:1275] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Refusing update from remote peer 8902aafcd54343cca010105dc6f8f055: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:47.081202 18072 consensus_queue.cc:1048] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:47.089763 17853 raft_consensus.cc:1275] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Refusing update from remote peer 8902aafcd54343cca010105dc6f8f055: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:47.091336 18160 consensus_queue.cc:1048] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:47.196048 17926 raft_consensus.cc:1275] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Refusing update from remote peer 8902aafcd54343cca010105dc6f8f055: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:47.197237 18151 consensus_queue.cc:1048] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:47.204843 17853 raft_consensus.cc:1275] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Refusing update from remote peer 8902aafcd54343cca010105dc6f8f055: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:47.207300 18160 consensus_queue.cc:1048] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:47.489811 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:47.499680 18002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3"
dest_uuid: "8902aafcd54343cca010105dc6f8f055"
mode: GRACEFUL
new_leader_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:59150
I20260709 13:16:47.500182 18002 raft_consensus.cc:606] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 3 LEADER]: Received request to transfer leadership to TS 79c7e34f43da4949800f838cf1aa1149
I20260709 13:16:47.512004 18002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d9853061943442992e3a638abad3b4b"
dest_uuid: "8902aafcd54343cca010105dc6f8f055"
mode: GRACEFUL
new_leader_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:59150
I20260709 13:16:47.512490 18002 raft_consensus.cc:606] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 3 LEADER]: Received request to transfer leadership to TS 79c7e34f43da4949800f838cf1aa1149
I20260709 13:16:47.517380 17926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3f2b69339dc403487ce637c94239ab0"
dest_uuid: "18e6abd847bb427a92efa25a61fca866"
mode: GRACEFUL
new_leader_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:37070
I20260709 13:16:47.517942 17926 raft_consensus.cc:606] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 2 LEADER]: Received request to transfer leadership to TS 79c7e34f43da4949800f838cf1aa1149
I20260709 13:16:47.522622 17926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f44101c3904f4c48985e55190b876a92"
dest_uuid: "18e6abd847bb427a92efa25a61fca866"
mode: GRACEFUL
new_leader_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:37070
I20260709 13:16:47.523097 17926 raft_consensus.cc:606] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 1 LEADER]: Received request to transfer leadership to TS 79c7e34f43da4949800f838cf1aa1149
I20260709 13:16:47.528319 17926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d557587fbd4b129a73669206a5fecf"
dest_uuid: "18e6abd847bb427a92efa25a61fca866"
mode: GRACEFUL
new_leader_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:37070
I20260709 13:16:47.528785 17926 raft_consensus.cc:606] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 2 LEADER]: Received request to transfer leadership to TS 79c7e34f43da4949800f838cf1aa1149
I20260709 13:16:47.601392 18072 raft_consensus.cc:993] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055: : Instructing follower 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:47.601843 18160 raft_consensus.cc:1081] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 3 LEADER]: Signalling peer 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:47.603299 17854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:42910
I20260709 13:16:47.603883 17854 raft_consensus.cc:493] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:47.604239 17854 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.610044 17854 raft_consensus.cc:515] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:47.611979 17854 leader_election.cc:290] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 4 election: Requested vote from peers 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:47.612624 18002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:47.612907 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:47.613227 18002 raft_consensus.cc:3055] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:47.613384 17926 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.613605 18002 raft_consensus.cc:740] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Running, Role: LEADER
I20260709 13:16:47.614421 18002 consensus_queue.cc:260] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:47.615352 18002 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.617626 17926 raft_consensus.cc:2468] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 4.
I20260709 13:16:47.618577 17818 leader_election.cc:304] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149; no voters: 
I20260709 13:16:47.619221 18150 raft_consensus.cc:2804] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:47.620150 18150 raft_consensus.cc:697] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 4 LEADER]: Becoming Leader. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:47.620183 18002 raft_consensus.cc:2468] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 4.
I20260709 13:16:47.620929 18150 consensus_queue.cc:237] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:47.626869 17751 catalog_manager.cc:5697] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 reported cstate change: term changed from 3 to 4, leader changed from 8902aafcd54343cca010105dc6f8f055 (127.16.211.3) to 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1). New cstate: current_term: 4 leader_uuid: "79c7e34f43da4949800f838cf1aa1149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.692374 18072 raft_consensus.cc:993] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055: : Instructing follower 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:47.692770 18160 raft_consensus.cc:1081] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 3 LEADER]: Signalling peer 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:47.694265 17854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d9853061943442992e3a638abad3b4b"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:42910
I20260709 13:16:47.694727 17854 raft_consensus.cc:493] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:47.695046 17854 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.699782 17854 raft_consensus.cc:515] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:47.701220 17854 leader_election.cc:290] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 4 election: Requested vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:47.702013 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:47.702205 18002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:47.702549 17926 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.702699 18002 raft_consensus.cc:3055] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:47.703047 18002 raft_consensus.cc:740] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Running, Role: LEADER
I20260709 13:16:47.703688 18002 consensus_queue.cc:260] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:47.704663 18002 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.707762 18166 raft_consensus.cc:993] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866: : Instructing follower 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:47.708112 17926 raft_consensus.cc:2468] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 4.
I20260709 13:16:47.708259 18143 raft_consensus.cc:1081] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 2 LEADER]: Signalling peer 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:47.709172 17818 leader_election.cc:304] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 79c7e34f43da4949800f838cf1aa1149; no voters: 
I20260709 13:16:47.709896 18150 raft_consensus.cc:2804] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:47.710036 17854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49d557587fbd4b129a73669206a5fecf"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:42922
I20260709 13:16:47.710438 18150 raft_consensus.cc:697] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 4 LEADER]: Becoming Leader. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:47.710695 17854 raft_consensus.cc:493] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:47.711114 17854 raft_consensus.cc:3060] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.710969 18002 raft_consensus.cc:2468] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 4.
I20260709 13:16:47.711335 18150 consensus_queue.cc:237] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:47.716686 17854 raft_consensus.cc:515] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:47.717175 17751 catalog_manager.cc:5697] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 reported cstate change: term changed from 3 to 4, leader changed from 8902aafcd54343cca010105dc6f8f055 (127.16.211.3) to 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1). New cstate: current_term: 4 leader_uuid: "79c7e34f43da4949800f838cf1aa1149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.718449 17854 leader_election.cc:290] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 3 election: Requested vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:47.719074 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d557587fbd4b129a73669206a5fecf" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:47.719565 17926 raft_consensus.cc:3055] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:47.719558 18002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d557587fbd4b129a73669206a5fecf" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:47.719977 17926 raft_consensus.cc:740] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Running, Role: LEADER
I20260709 13:16:47.720315 18002 raft_consensus.cc:3060] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.720696 17926 consensus_queue.cc:260] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:47.721805 17926 raft_consensus.cc:3060] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.726308 18002 raft_consensus.cc:2468] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 3.
I20260709 13:16:47.727087 17926 raft_consensus.cc:2468] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 3.
I20260709 13:16:47.727319 17818 leader_election.cc:304] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:47.728082 18150 raft_consensus.cc:2804] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:47.728484 18150 raft_consensus.cc:697] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 3 LEADER]: Becoming Leader. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:47.729189 18150 consensus_queue.cc:237] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:47.735332 17751 catalog_manager.cc:5697] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 reported cstate change: term changed from 2 to 3, leader changed from 18e6abd847bb427a92efa25a61fca866 (127.16.211.2) to 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "79c7e34f43da4949800f838cf1aa1149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.769433 18166 raft_consensus.cc:993] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866: : Instructing follower 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:47.769929 18143 raft_consensus.cc:1081] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 2 LEADER]: Signalling peer 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:47.771217 17854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3f2b69339dc403487ce637c94239ab0"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:42922
I20260709 13:16:47.771623 17854 raft_consensus.cc:493] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:47.771855 17854 raft_consensus.cc:3060] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.778666 17854 raft_consensus.cc:515] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:47.780907 17854 leader_election.cc:290] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 3 election: Requested vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:47.781605 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f2b69339dc403487ce637c94239ab0" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:47.782033 18002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f2b69339dc403487ce637c94239ab0" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:47.782161 17926 raft_consensus.cc:3055] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:47.782552 17926 raft_consensus.cc:740] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Running, Role: LEADER
I20260709 13:16:47.782604 18002 raft_consensus.cc:3060] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.783360 17926 consensus_queue.cc:260] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:47.784447 17926 raft_consensus.cc:3060] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.788816 18002 raft_consensus.cc:2468] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 3.
I20260709 13:16:47.789861 17818 leader_election.cc:304] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:47.790184 17926 raft_consensus.cc:2468] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 3.
I20260709 13:16:47.790709 18150 raft_consensus.cc:2804] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:47.791271 18150 raft_consensus.cc:697] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 3 LEADER]: Becoming Leader. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:47.792053 18150 consensus_queue.cc:237] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:47.798578 17751 catalog_manager.cc:5697] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 reported cstate change: term changed from 2 to 3, leader changed from 18e6abd847bb427a92efa25a61fca866 (127.16.211.2) to 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "79c7e34f43da4949800f838cf1aa1149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.978193 18166 raft_consensus.cc:993] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866: : Instructing follower 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:47.978626 18143 raft_consensus.cc:1081] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 1 LEADER]: Signalling peer 79c7e34f43da4949800f838cf1aa1149 to start an election
I20260709 13:16:47.980165 17854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f44101c3904f4c48985e55190b876a92"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
 from {username='slave'} at 127.0.0.1:42922
I20260709 13:16:47.980778 17854 raft_consensus.cc:493] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:47.981109 17854 raft_consensus.cc:3060] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.986019 17854 raft_consensus.cc:515] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:47.987648 17854 leader_election.cc:290] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 2 election: Requested vote from peers 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:47.988413 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44101c3904f4c48985e55190b876a92" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:47.988627 18002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44101c3904f4c48985e55190b876a92" candidate_uuid: "79c7e34f43da4949800f838cf1aa1149" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:47.989006 17926 raft_consensus.cc:3055] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:47.989193 18002 raft_consensus.cc:3060] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.989360 17926 raft_consensus.cc:740] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Running, Role: LEADER
I20260709 13:16:47.990125 17926 consensus_queue.cc:260] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:47.991004 17926 raft_consensus.cc:3060] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.993307 18002 raft_consensus.cc:2468] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 2.
I20260709 13:16:47.994256 17818 leader_election.cc:304] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c7e34f43da4949800f838cf1aa1149, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:47.994916 18150 raft_consensus.cc:2804] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:47.995296 18150 raft_consensus.cc:697] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Becoming Leader. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:47.995314 17926 raft_consensus.cc:2468] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c7e34f43da4949800f838cf1aa1149 in term 2.
I20260709 13:16:47.996215 18150 consensus_queue.cc:237] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:48.002738 17751 catalog_manager.cc:5697] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 reported cstate change: term changed from 1 to 2, leader changed from 18e6abd847bb427a92efa25a61fca866 (127.16.211.2) to 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "79c7e34f43da4949800f838cf1aa1149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.026510 17926 raft_consensus.cc:1275] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 4 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:48.027769 18150 consensus_queue.cc:1048] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:48.037217 18002 raft_consensus.cc:1275] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 4 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:48.039009 18167 consensus_queue.cc:1048] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:48.235366 17926 raft_consensus.cc:1275] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 4 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:48.236701 18167 consensus_queue.cc:1048] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:48.244536 18002 raft_consensus.cc:1275] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 4 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:48.245846 18150 consensus_queue.cc:1048] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:48.264607 18002 raft_consensus.cc:1275] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:48.265906 18150 consensus_queue.cc:1048] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:48.273808 17926 raft_consensus.cc:1275] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:48.275974 18167 consensus_queue.cc:1048] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:48.350975 17926 raft_consensus.cc:1275] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:48.352373 18167 consensus_queue.cc:1048] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:48.360046 18002 raft_consensus.cc:1275] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:48.362027 18167 consensus_queue.cc:1048] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:48.436527 17926 raft_consensus.cc:1275] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.437597 18167 consensus_queue.cc:1048] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:48.447494 18002 raft_consensus.cc:1275] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Refusing update from remote peer 79c7e34f43da4949800f838cf1aa1149: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.448673 18150 consensus_queue.cc:1048] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:50.535794 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:50.543874 17854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
mode: GRACEFUL
new_leader_uuid: "8902aafcd54343cca010105dc6f8f055"
 from {username='slave'} at 127.0.0.1:37870
I20260709 13:16:50.544569 17854 raft_consensus.cc:606] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Received request to transfer leadership to TS 8902aafcd54343cca010105dc6f8f055
I20260709 13:16:50.547190 17854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d9853061943442992e3a638abad3b4b"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
mode: GRACEFUL
new_leader_uuid: "8902aafcd54343cca010105dc6f8f055"
 from {username='slave'} at 127.0.0.1:37870
I20260709 13:16:50.547623 17854 raft_consensus.cc:606] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 4 LEADER]: Received request to transfer leadership to TS 8902aafcd54343cca010105dc6f8f055
I20260709 13:16:50.549844 17854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f44101c3904f4c48985e55190b876a92"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
mode: GRACEFUL
new_leader_uuid: "18e6abd847bb427a92efa25a61fca866"
 from {username='slave'} at 127.0.0.1:37870
I20260709 13:16:50.550354 17854 raft_consensus.cc:606] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Received request to transfer leadership to TS 18e6abd847bb427a92efa25a61fca866
I20260709 13:16:50.552621 17854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3"
dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
mode: GRACEFUL
new_leader_uuid: "18e6abd847bb427a92efa25a61fca866"
 from {username='slave'} at 127.0.0.1:37870
I20260709 13:16:50.553122 17854 raft_consensus.cc:606] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 4 LEADER]: Received request to transfer leadership to TS 18e6abd847bb427a92efa25a61fca866
I20260709 13:16:50.554237 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:50.554823 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:50.736094 18150 raft_consensus.cc:993] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149: : Instructing follower 8902aafcd54343cca010105dc6f8f055 to start an election
I20260709 13:16:50.736697 18189 raft_consensus.cc:1081] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Signalling peer 8902aafcd54343cca010105dc6f8f055 to start an election
I20260709 13:16:50.738263 18003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac"
dest_uuid: "8902aafcd54343cca010105dc6f8f055"
 from {username='slave'} at 127.0.0.1:59132
I20260709 13:16:50.738732 18003 raft_consensus.cc:493] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:50.739029 18003 raft_consensus.cc:3060] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.744328 18003 raft_consensus.cc:515] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:50.746094 18003 leader_election.cc:290] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 3 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:50.747459 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:50.747287 17854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1326d45eaf4a4426a88cc079d8a62bac" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:50.747988 17926 raft_consensus.cc:3060] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.748076 17854 raft_consensus.cc:3055] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:50.748540 17854 raft_consensus.cc:740] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:50.749364 17854 consensus_queue.cc:260] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:50.750590 17854 raft_consensus.cc:3060] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.753033 17926 raft_consensus.cc:2468] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 3.
I20260709 13:16:50.754194 17967 leader_election.cc:304] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:50.755035 18188 raft_consensus.cc:2804] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:50.756080 18188 raft_consensus.cc:697] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 3 LEADER]: Becoming Leader. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Running, Role: LEADER
I20260709 13:16:50.757288 17854 raft_consensus.cc:2468] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 3.
I20260709 13:16:50.757380 18188 consensus_queue.cc:237] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:50.764892 17748 catalog_manager.cc:5697] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 reported cstate change: term changed from 2 to 3, leader changed from 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1) to 8902aafcd54343cca010105dc6f8f055 (127.16.211.3). New cstate: current_term: 3 leader_uuid: "8902aafcd54343cca010105dc6f8f055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.778579 18189 raft_consensus.cc:993] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149: : Instructing follower 18e6abd847bb427a92efa25a61fca866 to start an election
I20260709 13:16:50.779534 18150 raft_consensus.cc:1081] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 4 LEADER]: Signalling peer 18e6abd847bb427a92efa25a61fca866 to start an election
I20260709 13:16:50.781538 17926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3"
dest_uuid: "18e6abd847bb427a92efa25a61fca866"
 from {username='slave'} at 127.0.0.1:37066
I20260709 13:16:50.782141 17926 raft_consensus.cc:493] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:50.782462 17926 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.787103 17926 raft_consensus.cc:515] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:50.788836 17926 leader_election.cc:290] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 5 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:50.789599 17854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:50.789934 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658c93391a74919b2be60cf4ce779c3" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:50.790498 17854 raft_consensus.cc:3055] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:50.790685 18003 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.790822 17854 raft_consensus.cc:740] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:50.791582 17854 consensus_queue.cc:260] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:50.792526 17854 raft_consensus.cc:3060] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.795593 18003 raft_consensus.cc:2468] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 5.
I20260709 13:16:50.796991 17893 leader_election.cc:304] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:50.798040 18187 raft_consensus.cc:2804] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:50.798188 17854 raft_consensus.cc:2468] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 5.
I20260709 13:16:50.799546 18187 raft_consensus.cc:697] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 5 LEADER]: Becoming Leader. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Running, Role: LEADER
I20260709 13:16:50.800493 18196 raft_consensus.cc:993] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149: : Instructing follower 8902aafcd54343cca010105dc6f8f055 to start an election
I20260709 13:16:50.801101 18196 raft_consensus.cc:1081] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 4 LEADER]: Signalling peer 8902aafcd54343cca010105dc6f8f055 to start an election
I20260709 13:16:50.800563 18187 consensus_queue.cc:237] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } }
I20260709 13:16:50.802742 18003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d9853061943442992e3a638abad3b4b"
dest_uuid: "8902aafcd54343cca010105dc6f8f055"
 from {username='slave'} at 127.0.0.1:59132
I20260709 13:16:50.803375 18003 raft_consensus.cc:493] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:50.803676 18003 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.807969 17748 catalog_manager.cc:5697] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 reported cstate change: term changed from 4 to 5, leader changed from 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1) to 18e6abd847bb427a92efa25a61fca866 (127.16.211.2). New cstate: current_term: 5 leader_uuid: "18e6abd847bb427a92efa25a61fca866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.809062 18003 raft_consensus.cc:515] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:50.811311 18003 leader_election.cc:290] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 5 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965)
I20260709 13:16:50.811623 17854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:50.811825 17926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9853061943442992e3a638abad3b4b" candidate_uuid: "8902aafcd54343cca010105dc6f8f055" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "18e6abd847bb427a92efa25a61fca866"
I20260709 13:16:50.812218 17854 raft_consensus.cc:3055] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:50.812286 17926 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.812608 17854 raft_consensus.cc:740] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:50.813541 17854 consensus_queue.cc:260] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:50.814882 17854 raft_consensus.cc:3060] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.820043 17926 raft_consensus.cc:2468] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 5.
I20260709 13:16:50.821122 17967 leader_election.cc:304] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:50.821853 18188 raft_consensus.cc:2804] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:50.822357 18188 raft_consensus.cc:697] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 5 LEADER]: Becoming Leader. State: Replica: 8902aafcd54343cca010105dc6f8f055, State: Running, Role: LEADER
I20260709 13:16:50.823216 18188 consensus_queue.cc:237] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:50.825143 17854 raft_consensus.cc:2468] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8902aafcd54343cca010105dc6f8f055 in term 5.
I20260709 13:16:50.830808 17748 catalog_manager.cc:5697] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 reported cstate change: term changed from 4 to 5, leader changed from 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1) to 8902aafcd54343cca010105dc6f8f055 (127.16.211.3). New cstate: current_term: 5 leader_uuid: "8902aafcd54343cca010105dc6f8f055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.941944 18150 raft_consensus.cc:993] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149: : Instructing follower 18e6abd847bb427a92efa25a61fca866 to start an election
I20260709 13:16:50.942423 18196 raft_consensus.cc:1081] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Signalling peer 18e6abd847bb427a92efa25a61fca866 to start an election
I20260709 13:16:50.943902 17926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f44101c3904f4c48985e55190b876a92"
dest_uuid: "18e6abd847bb427a92efa25a61fca866"
 from {username='slave'} at 127.0.0.1:37066
I20260709 13:16:50.944455 17926 raft_consensus.cc:493] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:50.944705 17926 raft_consensus.cc:3060] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.949121 17926 raft_consensus.cc:515] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:50.950969 17926 leader_election.cc:290] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 3 election: Requested vote from peers 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1:39249), 8902aafcd54343cca010105dc6f8f055 (127.16.211.3:45207)
I20260709 13:16:50.951799 17854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44101c3904f4c48985e55190b876a92" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79c7e34f43da4949800f838cf1aa1149"
I20260709 13:16:50.952021 18003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44101c3904f4c48985e55190b876a92" candidate_uuid: "18e6abd847bb427a92efa25a61fca866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8902aafcd54343cca010105dc6f8f055"
I20260709 13:16:50.952404 17854 raft_consensus.cc:3055] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:50.952554 18003 raft_consensus.cc:3060] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.952769 17854 raft_consensus.cc:740] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79c7e34f43da4949800f838cf1aa1149, State: Running, Role: LEADER
I20260709 13:16:50.953577 17854 consensus_queue.cc:260] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:50.954844 17854 raft_consensus.cc:3060] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.958978 18003 raft_consensus.cc:2468] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 3.
I20260709 13:16:50.960043 17893 leader_election.cc:304] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e6abd847bb427a92efa25a61fca866, 8902aafcd54343cca010105dc6f8f055; no voters: 
I20260709 13:16:50.960759 18187 raft_consensus.cc:2804] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:50.961264 18187 raft_consensus.cc:697] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 3 LEADER]: Becoming Leader. State: Replica: 18e6abd847bb427a92efa25a61fca866, State: Running, Role: LEADER
I20260709 13:16:50.961234 17854 raft_consensus.cc:2468] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e6abd847bb427a92efa25a61fca866 in term 3.
I20260709 13:16:50.962265 18187 consensus_queue.cc:237] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } }
I20260709 13:16:50.969755 17748 catalog_manager.cc:5697] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 reported cstate change: term changed from 2 to 3, leader changed from 79c7e34f43da4949800f838cf1aa1149 (127.16.211.1) to 18e6abd847bb427a92efa25a61fca866 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "18e6abd847bb427a92efa25a61fca866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.209573 17926 raft_consensus.cc:1275] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Refusing update from remote peer 8902aafcd54343cca010105dc6f8f055: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:51.210832 18188 consensus_queue.cc:1048] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:51.225883 17854 raft_consensus.cc:1275] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Refusing update from remote peer 8902aafcd54343cca010105dc6f8f055: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:51.227262 18204 consensus_queue.cc:1048] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:51.294041 18003 raft_consensus.cc:1275] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 5 FOLLOWER]: Refusing update from remote peer 18e6abd847bb427a92efa25a61fca866: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:51.295403 17854 raft_consensus.cc:1275] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 5 FOLLOWER]: Refusing update from remote peer 18e6abd847bb427a92efa25a61fca866: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:51.295290 18187 consensus_queue.cc:1048] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:51.296658 18187 consensus_queue.cc:1048] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:51.299299 17926 raft_consensus.cc:1275] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 5 FOLLOWER]: Refusing update from remote peer 8902aafcd54343cca010105dc6f8f055: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:51.310250 18188 consensus_queue.cc:1048] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18e6abd847bb427a92efa25a61fca866" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 41965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:51.320502 17854 raft_consensus.cc:1275] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 5 FOLLOWER]: Refusing update from remote peer 8902aafcd54343cca010105dc6f8f055: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:51.322003 18190 consensus_queue.cc:1048] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:51.478480 17854 raft_consensus.cc:1275] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Refusing update from remote peer 18e6abd847bb427a92efa25a61fca866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:51.479645 18209 consensus_queue.cc:1048] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79c7e34f43da4949800f838cf1aa1149" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:51.487679 18003 raft_consensus.cc:1275] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Refusing update from remote peer 18e6abd847bb427a92efa25a61fca866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:51.489161 18209 consensus_queue.cc:1048] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8902aafcd54343cca010105dc6f8f055" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:51.555681 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:51.562475 17228 tablet_server.cc:179] TabletServer@127.16.211.1:0 shutting down...
I20260709 13:16:51.602408 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:51.603086 17228 tablet_replica.cc:333] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149: stopping tablet replica
I20260709 13:16:51.603657 17228 raft_consensus.cc:2243] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:51.604411 17228 raft_consensus.cc:2272] T c3f2b69339dc403487ce637c94239ab0 P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.606308 17228 tablet_replica.cc:333] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149: stopping tablet replica
I20260709 13:16:51.606798 17228 raft_consensus.cc:2243] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.607204 17228 raft_consensus.cc:2272] T fbef844084784d53b5554df1aa742420 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.608933 17228 tablet_replica.cc:333] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149: stopping tablet replica
I20260709 13:16:51.609452 17228 raft_consensus.cc:2243] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.609777 17228 raft_consensus.cc:2272] T f44101c3904f4c48985e55190b876a92 P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.612401 17228 tablet_replica.cc:333] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149: stopping tablet replica
I20260709 13:16:51.612846 17228 raft_consensus.cc:2243] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:51.613497 17228 raft_consensus.cc:2272] T aea747ae0627415cad2ca2e9f9df8446 P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.615032 17228 tablet_replica.cc:333] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149: stopping tablet replica
I20260709 13:16:51.615456 17228 raft_consensus.cc:2243] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:51.616084 17228 raft_consensus.cc:2272] T c7ac494747714c929ae2d94913b4d3ee P 79c7e34f43da4949800f838cf1aa1149 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.617637 17228 tablet_replica.cc:333] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149: stopping tablet replica
I20260709 13:16:51.618254 17228 raft_consensus.cc:2243] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.618752 17228 raft_consensus.cc:2272] T 6d9853061943442992e3a638abad3b4b P 79c7e34f43da4949800f838cf1aa1149 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.621232 17228 tablet_replica.cc:333] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149: stopping tablet replica
I20260709 13:16:51.621765 17228 raft_consensus.cc:2243] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.622288 17228 raft_consensus.cc:2272] T 1326d45eaf4a4426a88cc079d8a62bac P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.624794 17228 tablet_replica.cc:333] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149: stopping tablet replica
I20260709 13:16:51.625428 17228 raft_consensus.cc:2243] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.625761 17228 raft_consensus.cc:2272] T f658c93391a74919b2be60cf4ce779c3 P 79c7e34f43da4949800f838cf1aa1149 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.627687 17228 tablet_replica.cc:333] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149: stopping tablet replica
I20260709 13:16:51.628084 17228 raft_consensus.cc:2243] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.628432 17228 raft_consensus.cc:2272] T 9f68c8681a1f42e6add0dc1c12edff78 P 79c7e34f43da4949800f838cf1aa1149 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.629868 17228 tablet_replica.cc:333] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149: stopping tablet replica
I20260709 13:16:51.630307 17228 raft_consensus.cc:2243] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:51.631073 17228 raft_consensus.cc:2272] T 49d557587fbd4b129a73669206a5fecf P 79c7e34f43da4949800f838cf1aa1149 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.660502 17228 tablet_server.cc:196] TabletServer@127.16.211.1:0 shutdown complete.
I20260709 13:16:51.682498 17228 tablet_server.cc:179] TabletServer@127.16.211.2:0 shutting down...
I20260709 13:16:51.707036 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:51.707783 17228 tablet_replica.cc:333] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866: stopping tablet replica
I20260709 13:16:51.708297 17228 raft_consensus.cc:2243] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.708685 17228 raft_consensus.cc:2272] T 1326d45eaf4a4426a88cc079d8a62bac P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.710901 17228 tablet_replica.cc:333] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866: stopping tablet replica
I20260709 13:16:51.711370 17228 raft_consensus.cc:2243] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.711776 17228 raft_consensus.cc:2272] T 6d9853061943442992e3a638abad3b4b P 18e6abd847bb427a92efa25a61fca866 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.713632 17228 tablet_replica.cc:333] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866: stopping tablet replica
I20260709 13:16:51.714205 17228 raft_consensus.cc:2243] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.714550 17228 raft_consensus.cc:2272] T c7ac494747714c929ae2d94913b4d3ee P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.716132 17228 tablet_replica.cc:333] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866: stopping tablet replica
I20260709 13:16:51.716558 17228 raft_consensus.cc:2243] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.716890 17228 raft_consensus.cc:2272] T c3f2b69339dc403487ce637c94239ab0 P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.718454 17228 tablet_replica.cc:333] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866: stopping tablet replica
I20260709 13:16:51.718924 17228 raft_consensus.cc:2243] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:51.719586 17228 raft_consensus.cc:2272] T f44101c3904f4c48985e55190b876a92 P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.721421 17228 tablet_replica.cc:333] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866: stopping tablet replica
I20260709 13:16:51.721858 17228 raft_consensus.cc:2243] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:51.722559 17228 raft_consensus.cc:2272] T fbef844084784d53b5554df1aa742420 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.724071 17228 tablet_replica.cc:333] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866: stopping tablet replica
I20260709 13:16:51.724466 17228 raft_consensus.cc:2243] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.724817 17228 raft_consensus.cc:2272] T 9f68c8681a1f42e6add0dc1c12edff78 P 18e6abd847bb427a92efa25a61fca866 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.726598 17228 tablet_replica.cc:333] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866: stopping tablet replica
I20260709 13:16:51.727032 17228 raft_consensus.cc:2243] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.727372 17228 raft_consensus.cc:2272] T 49d557587fbd4b129a73669206a5fecf P 18e6abd847bb427a92efa25a61fca866 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.728852 17228 tablet_replica.cc:333] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866: stopping tablet replica
I20260709 13:16:51.729249 17228 raft_consensus.cc:2243] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:16:51.730044 17228 raft_consensus.cc:2272] T f658c93391a74919b2be60cf4ce779c3 P 18e6abd847bb427a92efa25a61fca866 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.731925 17228 tablet_replica.cc:333] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866: stopping tablet replica
I20260709 13:16:51.732301 17228 raft_consensus.cc:2243] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.732615 17228 raft_consensus.cc:2272] T aea747ae0627415cad2ca2e9f9df8446 P 18e6abd847bb427a92efa25a61fca866 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.760910 17228 tablet_server.cc:196] TabletServer@127.16.211.2:0 shutdown complete.
W20260709 13:16:51.766497 17967 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.211.2:41965: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20260709 13:16:51.770131 17967 consensus_peers.cc:597] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 -> Peer 18e6abd847bb427a92efa25a61fca866 (127.16.211.2:41965): Couldn't send request to peer 18e6abd847bb427a92efa25a61fca866. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:41965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:51.780193 17228 tablet_server.cc:179] TabletServer@127.16.211.3:0 shutting down...
I20260709 13:16:51.804368 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:51.805123 17228 tablet_replica.cc:333] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055: stopping tablet replica
I20260709 13:16:51.805766 17228 raft_consensus.cc:2243] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.806318 17228 raft_consensus.cc:2272] T aea747ae0627415cad2ca2e9f9df8446 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.808066 17228 tablet_replica.cc:333] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055: stopping tablet replica
I20260709 13:16:51.808601 17228 raft_consensus.cc:2243] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:51.809365 17228 raft_consensus.cc:2272] T 1326d45eaf4a4426a88cc079d8a62bac P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.811499 17228 tablet_replica.cc:333] T fbef844084784d53b5554df1aa742420 P 8902aafcd54343cca010105dc6f8f055: stopping tablet replica
I20260709 13:16:51.812064 17228 raft_consensus.cc:2243] T fbef844084784d53b5554df1aa742420 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.812469 17228 raft_consensus.cc:2272] T fbef844084784d53b5554df1aa742420 P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.814185 17228 tablet_replica.cc:333] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055: stopping tablet replica
I20260709 13:16:51.814659 17228 raft_consensus.cc:2243] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.815070 17228 raft_consensus.cc:2272] T f44101c3904f4c48985e55190b876a92 P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.817055 17228 tablet_replica.cc:333] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055: stopping tablet replica
I20260709 13:16:51.817549 17228 raft_consensus.cc:2243] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.818017 17228 raft_consensus.cc:2272] T c3f2b69339dc403487ce637c94239ab0 P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.819837 17228 tablet_replica.cc:333] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055: stopping tablet replica
I20260709 13:16:51.820339 17228 raft_consensus.cc:2243] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:16:51.821106 17228 raft_consensus.cc:2272] T 6d9853061943442992e3a638abad3b4b P 8902aafcd54343cca010105dc6f8f055 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.822956 17228 tablet_replica.cc:333] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055: stopping tablet replica
I20260709 13:16:51.823424 17228 raft_consensus.cc:2243] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.823827 17228 raft_consensus.cc:2272] T c7ac494747714c929ae2d94913b4d3ee P 8902aafcd54343cca010105dc6f8f055 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.825413 17228 tablet_replica.cc:333] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055: stopping tablet replica
I20260709 13:16:51.825870 17228 raft_consensus.cc:2243] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:51.826618 17228 raft_consensus.cc:2272] T 9f68c8681a1f42e6add0dc1c12edff78 P 8902aafcd54343cca010105dc6f8f055 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.828070 17228 tablet_replica.cc:333] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055: stopping tablet replica
I20260709 13:16:51.828529 17228 raft_consensus.cc:2243] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.828907 17228 raft_consensus.cc:2272] T 49d557587fbd4b129a73669206a5fecf P 8902aafcd54343cca010105dc6f8f055 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.830475 17228 tablet_replica.cc:333] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055: stopping tablet replica
I20260709 13:16:51.830900 17228 raft_consensus.cc:2243] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.831302 17228 raft_consensus.cc:2272] T f658c93391a74919b2be60cf4ce779c3 P 8902aafcd54343cca010105dc6f8f055 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.857996 17228 tablet_server.cc:196] TabletServer@127.16.211.3:0 shutdown complete.
I20260709 13:16:51.875634 17228 master.cc:562] Master@127.16.211.62:42815 shutting down...
I20260709 13:16:51.894425 17228 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:51.894889 17228 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.895146 17228 tablet_replica.cc:333] T 00000000000000000000000000000000 P fb9ff79f6fe94a8f813a6ab4b59e27c0: stopping tablet replica
I20260709 13:16:51.915982 17228 master.cc:584] Master@127.16.211.62:42815 shutdown complete.
18e6abd847bb427a92efa25a61fca866  4
79c7e34f43da4949800f838cf1aa1149  5
8902aafcd54343cca010105dc6f8f055  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10628 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:16:51.954638 17228 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.211.62:40381
I20260709 13:16:51.955744 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:51.961409 18217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:51.962056 18218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:51.962785 18220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:51.963992 17228 server_base.cc:1061] running on GCE node
I20260709 13:16:51.964893 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:51.965065 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:51.965258 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603011965222 us; error 0 us; skew 500 ppm
I20260709 13:16:51.965783 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:51.968039 17228 webserver.cc:533] Webserver started at http://127.16.211.62:37801/ using document root <none> and password file <none>
I20260709 13:16:51.968490 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:51.968672 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:51.968959 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:51.970089 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/master-0-root/instance:
uuid: "ea3145ed28eb426e9222df0873a0b8d5"
format_stamp: "Formatted at 2026-07-09 13:16:51 on dist-test-slave-96c3"
I20260709 13:16:51.974300 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:16:51.977419 18225 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:51.978179 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:16:51.978466 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/master-0-root
uuid: "ea3145ed28eb426e9222df0873a0b8d5"
format_stamp: "Formatted at 2026-07-09 13:16:51 on dist-test-slave-96c3"
I20260709 13:16:51.978716 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:51.998497 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:51.999676 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:52.040508 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.62:40381
I20260709 13:16:52.040609 18276 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.62:40381 every 8 connection(s)
I20260709 13:16:52.044533 18277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.054201 18277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: Bootstrap starting.
I20260709 13:16:52.058638 18277 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.062736 18277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: No bootstrap required, opened a new log
I20260709 13:16:52.064826 18277 raft_consensus.cc:359] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea3145ed28eb426e9222df0873a0b8d5" member_type: VOTER }
I20260709 13:16:52.065187 18277 raft_consensus.cc:385] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.065466 18277 raft_consensus.cc:740] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3145ed28eb426e9222df0873a0b8d5, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.066041 18277 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea3145ed28eb426e9222df0873a0b8d5" member_type: VOTER }
I20260709 13:16:52.066497 18277 raft_consensus.cc:399] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:52.066701 18277 raft_consensus.cc:493] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:52.066999 18277 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.071060 18277 raft_consensus.cc:515] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea3145ed28eb426e9222df0873a0b8d5" member_type: VOTER }
I20260709 13:16:52.071563 18277 leader_election.cc:304] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea3145ed28eb426e9222df0873a0b8d5; no voters: 
I20260709 13:16:52.072669 18277 leader_election.cc:290] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:52.073105 18280 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.074383 18280 raft_consensus.cc:697] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [term 1 LEADER]: Becoming Leader. State: Replica: ea3145ed28eb426e9222df0873a0b8d5, State: Running, Role: LEADER
I20260709 13:16:52.075174 18280 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea3145ed28eb426e9222df0873a0b8d5" member_type: VOTER }
I20260709 13:16:52.075752 18277 sys_catalog.cc:565] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:52.079701 18281 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea3145ed28eb426e9222df0873a0b8d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea3145ed28eb426e9222df0873a0b8d5" member_type: VOTER } }
I20260709 13:16:52.079885 18282 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea3145ed28eb426e9222df0873a0b8d5. Latest consensus state: current_term: 1 leader_uuid: "ea3145ed28eb426e9222df0873a0b8d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea3145ed28eb426e9222df0873a0b8d5" member_type: VOTER } }
I20260709 13:16:52.080293 18281 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:52.080334 18282 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:52.083380 18286 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:52.091195 18286 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:52.092161 17228 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:52.099673 18286 catalog_manager.cc:1383] Generated new cluster ID: 9561a1e7e63c4b71b858444e1dbf3349
I20260709 13:16:52.099967 18286 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:52.133668 18286 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:52.134894 18286 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:52.145896 18286 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: Generated new TSK 0
I20260709 13:16:52.146461 18286 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:52.158725 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:52.164759 18298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:52.166167 18299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:52.167932 18301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:52.168144 17228 server_base.cc:1061] running on GCE node
I20260709 13:16:52.169057 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:52.169245 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:52.169371 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603012169360 us; error 0 us; skew 500 ppm
I20260709 13:16:52.169863 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:52.172179 17228 webserver.cc:533] Webserver started at http://127.16.211.1:35675/ using document root <none> and password file <none>
I20260709 13:16:52.172672 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:52.172832 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:52.173045 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:52.174101 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/instance:
uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
format_stamp: "Formatted at 2026-07-09 13:16:52 on dist-test-slave-96c3"
I20260709 13:16:52.178494 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:16:52.181694 18306 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:52.182511 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:16:52.182822 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root
uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
format_stamp: "Formatted at 2026-07-09 13:16:52 on dist-test-slave-96c3"
I20260709 13:16:52.183076 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:52.203511 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:52.204772 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:52.206285 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:52.208504 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:52.208771 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:52.209030 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:52.209221 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:52.251576 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.1:37809
I20260709 13:16:52.251677 18368 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.1:37809 every 8 connection(s)
I20260709 13:16:52.258039 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:52.267596 18373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:52.269867 18374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:52.271337 18376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:52.273331 17228 server_base.cc:1061] running on GCE node
I20260709 13:16:52.275004 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:52.275274 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:52.275494 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603012275476 us; error 0 us; skew 500 ppm
I20260709 13:16:52.275633 18369 heartbeater.cc:344] Connected to a master server at 127.16.211.62:40381
I20260709 13:16:52.275983 18369 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:52.276221 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:52.276872 18369 heartbeater.cc:507] Master 127.16.211.62:40381 requested a full tablet report, sending...
I20260709 13:16:52.279235 17228 webserver.cc:533] Webserver started at http://127.16.211.2:43681/ using document root <none> and password file <none>
I20260709 13:16:52.279606 18242 ts_manager.cc:194] Registered new tserver with Master: d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:16:52.279929 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:52.280218 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:52.280593 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:52.281682 18242 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42278
I20260709 13:16:52.282372 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/instance:
uuid: "20e06cff39b649c48d342b7431135303"
format_stamp: "Formatted at 2026-07-09 13:16:52 on dist-test-slave-96c3"
I20260709 13:16:52.288324 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:16:52.292148 18381 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:52.292994 17228 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:16:52.293314 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root
uuid: "20e06cff39b649c48d342b7431135303"
format_stamp: "Formatted at 2026-07-09 13:16:52 on dist-test-slave-96c3"
I20260709 13:16:52.293615 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:52.337869 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:52.339097 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:52.340579 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:52.342741 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:52.342962 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:52.343201 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:52.343379 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:52.382560 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.2:42251
I20260709 13:16:52.382694 18443 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.2:42251 every 8 connection(s)
I20260709 13:16:52.387269 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:52.394291 18447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:52.396533 18448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:52.398494 17228 server_base.cc:1061] running on GCE node
W20260709 13:16:52.398517 18450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:52.399995 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:52.400283 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:52.400265 18444 heartbeater.cc:344] Connected to a master server at 127.16.211.62:40381
I20260709 13:16:52.400646 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603012400622 us; error 0 us; skew 500 ppm
I20260709 13:16:52.400765 18444 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:52.401324 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:52.401551 18444 heartbeater.cc:507] Master 127.16.211.62:40381 requested a full tablet report, sending...
I20260709 13:16:52.403939 18242 ts_manager.cc:194] Registered new tserver with Master: 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:52.404187 17228 webserver.cc:533] Webserver started at http://127.16.211.3:33781/ using document root <none> and password file <none>
I20260709 13:16:52.404870 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:52.405121 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:52.405457 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:52.405839 18242 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42284
I20260709 13:16:52.407122 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/instance:
uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
format_stamp: "Formatted at 2026-07-09 13:16:52 on dist-test-slave-96c3"
I20260709 13:16:52.412096 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:16:52.415273 18455 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:52.416003 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:16:52.416287 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root
uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
format_stamp: "Formatted at 2026-07-09 13:16:52 on dist-test-slave-96c3"
I20260709 13:16:52.416580 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:52.428611 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:52.429684 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:52.431135 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:52.433269 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:52.433498 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:52.433743 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:52.433915 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:52.472703 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.3:43125
I20260709 13:16:52.472797 18517 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.3:43125 every 8 connection(s)
I20260709 13:16:52.487067 18518 heartbeater.cc:344] Connected to a master server at 127.16.211.62:40381
I20260709 13:16:52.487440 18518 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:52.488198 18518 heartbeater.cc:507] Master 127.16.211.62:40381 requested a full tablet report, sending...
I20260709 13:16:52.490242 18242 ts_manager.cc:194] Registered new tserver with Master: 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:52.491183 17228 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015539362s
I20260709 13:16:52.491580 18242 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42292
I20260709 13:16:52.516382 18242 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42304:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:52.522689 18242 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:52.715022 18408 tablet_service.cc:1511] Processing CreateTablet for tablet 35d61c75b589420ab4319c7a05b2b72b (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:52.716593 18408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d61c75b589420ab4319c7a05b2b72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.713637 18409 tablet_service.cc:1511] Processing CreateTablet for tablet e0c142ad00b14613a8e3623c478ebdaf (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:52.723304 18409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c142ad00b14613a8e3623c478ebdaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.726438 18407 tablet_service.cc:1511] Processing CreateTablet for tablet 9560de944c37467eb1e18d5627ed0fd9 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:52.727852 18407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9560de944c37467eb1e18d5627ed0fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.730976 18406 tablet_service.cc:1511] Processing CreateTablet for tablet 36d775fb4ae54c3ab8335a03e2ad44f4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:52.732344 18406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d775fb4ae54c3ab8335a03e2ad44f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.732983 18483 tablet_service.cc:1511] Processing CreateTablet for tablet e0c142ad00b14613a8e3623c478ebdaf (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:52.734292 18483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c142ad00b14613a8e3623c478ebdaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.735015 18479 tablet_service.cc:1511] Processing CreateTablet for tablet 102530a9a2f94c3492b2af9e95b376f6 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:52.735114 18405 tablet_service.cc:1511] Processing CreateTablet for tablet 102530a9a2f94c3492b2af9e95b376f6 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:52.736335 18479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102530a9a2f94c3492b2af9e95b376f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.736434 18405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102530a9a2f94c3492b2af9e95b376f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.739133 18482 tablet_service.cc:1511] Processing CreateTablet for tablet 35d61c75b589420ab4319c7a05b2b72b (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:52.740509 18482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d61c75b589420ab4319c7a05b2b72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.743165 18481 tablet_service.cc:1511] Processing CreateTablet for tablet 9560de944c37467eb1e18d5627ed0fd9 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:52.744444 18481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9560de944c37467eb1e18d5627ed0fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.747072 18480 tablet_service.cc:1511] Processing CreateTablet for tablet 36d775fb4ae54c3ab8335a03e2ad44f4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:52.748397 18480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d775fb4ae54c3ab8335a03e2ad44f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.754302 18404 tablet_service.cc:1511] Processing CreateTablet for tablet ac1699feafbd4621b7b7a28933b59fec (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:52.756202 18404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac1699feafbd4621b7b7a28933b59fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.776476 18533 tablet_bootstrap.cc:492] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:52.778679 18403 tablet_service.cc:1511] Processing CreateTablet for tablet 11ec555240a9486fad41ffb02e94fd9c (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:52.779279 18478 tablet_service.cc:1511] Processing CreateTablet for tablet 11ec555240a9486fad41ffb02e94fd9c (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:52.780146 18403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ec555240a9486fad41ffb02e94fd9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.780584 18478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ec555240a9486fad41ffb02e94fd9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.783639 18477 tablet_service.cc:1511] Processing CreateTablet for tablet 2b12e68055d54f32b4b3e7d0d0c76af4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:52.783916 18402 tablet_service.cc:1511] Processing CreateTablet for tablet 2b12e68055d54f32b4b3e7d0d0c76af4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:52.784909 18477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b12e68055d54f32b4b3e7d0d0c76af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.785218 18402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b12e68055d54f32b4b3e7d0d0c76af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.787909 18476 tablet_service.cc:1511] Processing CreateTablet for tablet f0f6372354b84d0ea884a3478b3dfd98 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:52.788429 18400 tablet_service.cc:1511] Processing CreateTablet for tablet 41082fa41d05470eb1937d1997399fa4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:52.789254 18476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f6372354b84d0ea884a3478b3dfd98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.791059 18401 tablet_service.cc:1511] Processing CreateTablet for tablet f0f6372354b84d0ea884a3478b3dfd98 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:52.789784 18400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41082fa41d05470eb1937d1997399fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.794476 18401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f6372354b84d0ea884a3478b3dfd98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.808629 18334 tablet_service.cc:1511] Processing CreateTablet for tablet e0c142ad00b14613a8e3623c478ebdaf (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:52.809158 18483 tablet_service.cc:1511] Processing CreateTablet for tablet 41082fa41d05470eb1937d1997399fa4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:52.810019 18334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c142ad00b14613a8e3623c478ebdaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.809624 18481 tablet_service.cc:1511] Processing CreateTablet for tablet ac1699feafbd4621b7b7a28933b59fec (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:52.810510 18483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41082fa41d05470eb1937d1997399fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.811232 18481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac1699feafbd4621b7b7a28933b59fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.811367 18533 tablet_bootstrap.cc:654] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.826058 18482 tablet_service.cc:1511] Processing CreateTablet for tablet b972754511104f898e9cbc171aa6c170 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:52.827798 18482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b972754511104f898e9cbc171aa6c170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.835717 18333 tablet_service.cc:1511] Processing CreateTablet for tablet 35d61c75b589420ab4319c7a05b2b72b (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:52.837123 18333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d61c75b589420ab4319c7a05b2b72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.838056 18408 tablet_service.cc:1511] Processing CreateTablet for tablet 77cd16981fa049aaaa881bdeacda2fc3 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:52.838709 18332 tablet_service.cc:1511] Processing CreateTablet for tablet 9560de944c37467eb1e18d5627ed0fd9 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:52.838722 18327 tablet_service.cc:1511] Processing CreateTablet for tablet 2b12e68055d54f32b4b3e7d0d0c76af4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:52.839323 18408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cd16981fa049aaaa881bdeacda2fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.840205 18332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9560de944c37467eb1e18d5627ed0fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.840858 18327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b12e68055d54f32b4b3e7d0d0c76af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.842360 18331 tablet_service.cc:1511] Processing CreateTablet for tablet 36d775fb4ae54c3ab8335a03e2ad44f4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:52.843724 18331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d775fb4ae54c3ab8335a03e2ad44f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.847034 18330 tablet_service.cc:1511] Processing CreateTablet for tablet 102530a9a2f94c3492b2af9e95b376f6 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:52.848364 18330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102530a9a2f94c3492b2af9e95b376f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.849466 18480 tablet_service.cc:1511] Processing CreateTablet for tablet 77cd16981fa049aaaa881bdeacda2fc3 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:52.850802 18480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cd16981fa049aaaa881bdeacda2fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.851148 18329 tablet_service.cc:1511] Processing CreateTablet for tablet ac1699feafbd4621b7b7a28933b59fec (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:52.851574 18325 tablet_service.cc:1511] Processing CreateTablet for tablet 41082fa41d05470eb1937d1997399fa4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:52.852501 18329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac1699feafbd4621b7b7a28933b59fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.853067 18325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41082fa41d05470eb1937d1997399fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.854585 18328 tablet_service.cc:1511] Processing CreateTablet for tablet 11ec555240a9486fad41ffb02e94fd9c (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:52.855962 18328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ec555240a9486fad41ffb02e94fd9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.857875 18409 tablet_service.cc:1511] Processing CreateTablet for tablet c88b963fb1b740418ee335cb0fe83049 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:52.859167 18409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88b963fb1b740418ee335cb0fe83049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.859073 18326 tablet_service.cc:1511] Processing CreateTablet for tablet f0f6372354b84d0ea884a3478b3dfd98 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:52.860423 18326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f6372354b84d0ea884a3478b3dfd98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.860289 18475 tablet_service.cc:1511] Processing CreateTablet for tablet c88b963fb1b740418ee335cb0fe83049 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:52.861959 18475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88b963fb1b740418ee335cb0fe83049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.877878 18404 tablet_service.cc:1511] Processing CreateTablet for tablet 06fc3d36b088480ab5fb6ac2a5600252 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:52.879200 18404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fc3d36b088480ab5fb6ac2a5600252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.889719 18477 tablet_service.cc:1511] Processing CreateTablet for tablet 06fc3d36b088480ab5fb6ac2a5600252 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:52.891119 18477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fc3d36b088480ab5fb6ac2a5600252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.892546 18407 tablet_service.cc:1511] Processing CreateTablet for tablet b972754511104f898e9cbc171aa6c170 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:52.893813 18407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b972754511104f898e9cbc171aa6c170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.911957 18533 tablet_bootstrap.cc:492] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:52.912494 18533 ts_tablet_manager.cc:1403] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.005s
I20260709 13:16:52.915103 18534 tablet_bootstrap.cc:492] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:52.916023 18409 tablet_service.cc:1511] Processing CreateTablet for tablet bb654ec8beb54a539b5b6b44aa5181c3 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:52.917327 18409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb654ec8beb54a539b5b6b44aa5181c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.923590 18475 tablet_service.cc:1511] Processing CreateTablet for tablet bb654ec8beb54a539b5b6b44aa5181c3 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:52.924872 18475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb654ec8beb54a539b5b6b44aa5181c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.939095 18533 raft_consensus.cc:359] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } }
I20260709 13:16:52.939868 18533 raft_consensus.cc:385] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.940150 18533 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.941011 18533 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } }
I20260709 13:16:52.941282 18479 tablet_service.cc:1511] Processing CreateTablet for tablet 6419a332888d490f92e43b717ff1edd4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:52.943136 18408 tablet_service.cc:1511] Processing CreateTablet for tablet 6419a332888d490f92e43b717ff1edd4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:52.945026 18408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6419a332888d490f92e43b717ff1edd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.947196 18479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6419a332888d490f92e43b717ff1edd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.950428 18477 tablet_service.cc:1511] Processing CreateTablet for tablet f59be45893c741da9dfbf367c31f3851 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:52.944119 18536 tablet_bootstrap.cc:492] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:52.951743 18477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f59be45893c741da9dfbf367c31f3851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.966673 18444 heartbeater.cc:499] Master 127.16.211.62:40381 was elected leader, sending a full tablet report...
I20260709 13:16:52.970331 18404 tablet_service.cc:1511] Processing CreateTablet for tablet f59be45893c741da9dfbf367c31f3851 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:52.970585 18334 tablet_service.cc:1511] Processing CreateTablet for tablet b972754511104f898e9cbc171aa6c170 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:52.971673 18404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f59be45893c741da9dfbf367c31f3851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.971845 18334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b972754511104f898e9cbc171aa6c170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.976202 18325 tablet_service.cc:1511] Processing CreateTablet for tablet 77cd16981fa049aaaa881bdeacda2fc3 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:52.977481 18325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cd16981fa049aaaa881bdeacda2fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.981617 18480 tablet_service.cc:1511] Processing CreateTablet for tablet 132f50d25c404b83b0bafe5445c572e9 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:52.981755 18327 tablet_service.cc:1511] Processing CreateTablet for tablet c88b963fb1b740418ee335cb0fe83049 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:52.982944 18480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132f50d25c404b83b0bafe5445c572e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.983052 18327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88b963fb1b740418ee335cb0fe83049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.983469 18536 tablet_bootstrap.cc:654] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.983376 18402 tablet_service.cc:1511] Processing CreateTablet for tablet f9e75d2ac4114e428bf95ddfa6245037 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:52.984659 18402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e75d2ac4114e428bf95ddfa6245037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.957867 18534 tablet_bootstrap.cc:654] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.966665 18538 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.987039 18538 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } }
I20260709 13:16:52.987460 18329 tablet_service.cc:1511] Processing CreateTablet for tablet 06fc3d36b088480ab5fb6ac2a5600252 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:52.988821 18329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fc3d36b088480ab5fb6ac2a5600252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:52.989750 18403 tablet_service.cc:1511] Processing CreateTablet for tablet 132f50d25c404b83b0bafe5445c572e9 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:52.994838 18538 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:16:52.992681 18326 tablet_service.cc:1511] Processing CreateTablet for tablet bb654ec8beb54a539b5b6b44aa5181c3 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:52.996269 18326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb654ec8beb54a539b5b6b44aa5181c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.000700 18403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132f50d25c404b83b0bafe5445c572e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.002279 18482 tablet_service.cc:1511] Processing CreateTablet for tablet f9e75d2ac4114e428bf95ddfa6245037 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:53.003554 18482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e75d2ac4114e428bf95ddfa6245037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.014891 18481 tablet_service.cc:1511] Processing CreateTablet for tablet f99562a3c70c43d2b33161d483871d6c (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:53.015614 18331 tablet_service.cc:1511] Processing CreateTablet for tablet 6419a332888d490f92e43b717ff1edd4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:53.016289 18481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99562a3c70c43d2b33161d483871d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.016866 18331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6419a332888d490f92e43b717ff1edd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.019012 18328 tablet_service.cc:1511] Processing CreateTablet for tablet f59be45893c741da9dfbf367c31f3851 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:53.020392 18328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f59be45893c741da9dfbf367c31f3851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.023936 18332 tablet_service.cc:1511] Processing CreateTablet for tablet 132f50d25c404b83b0bafe5445c572e9 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:53.025182 18332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132f50d25c404b83b0bafe5445c572e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.051677 18475 tablet_service.cc:1511] Processing CreateTablet for tablet f9697a1f706e47fa9c62306b225e97fa (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:53.053066 18475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9697a1f706e47fa9c62306b225e97fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.073652 18333 tablet_service.cc:1511] Processing CreateTablet for tablet f99562a3c70c43d2b33161d483871d6c (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:53.075027 18333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99562a3c70c43d2b33161d483871d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.070668 18330 tablet_service.cc:1511] Processing CreateTablet for tablet f9e75d2ac4114e428bf95ddfa6245037 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:53.077667 18330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e75d2ac4114e428bf95ddfa6245037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.080368 18331 tablet_service.cc:1511] Processing CreateTablet for tablet f9697a1f706e47fa9c62306b225e97fa (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:53.081646 18331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9697a1f706e47fa9c62306b225e97fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.083118 18332 tablet_service.cc:1511] Processing CreateTablet for tablet b1c3d9691e854ee98b2b7d81f868c727 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:53.086427 18533 ts_tablet_manager.cc:1434] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.174s	user 0.006s	sys 0.003s
I20260709 13:16:53.086753 18332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c3d9691e854ee98b2b7d81f868c727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.087369 18533 tablet_bootstrap.cc:492] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:53.108620 18404 tablet_service.cc:1511] Processing CreateTablet for tablet f9697a1f706e47fa9c62306b225e97fa (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:53.109990 18404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9697a1f706e47fa9c62306b225e97fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.115042 18533 tablet_bootstrap.cc:654] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.122871 18407 tablet_service.cc:1511] Processing CreateTablet for tablet f99562a3c70c43d2b33161d483871d6c (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:53.124209 18407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99562a3c70c43d2b33161d483871d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.140352 18536 tablet_bootstrap.cc:492] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:53.140901 18536 ts_tablet_manager.cc:1403] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.202s	user 0.037s	sys 0.037s
W20260709 13:16:53.143644 18228 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 63612.4us
I20260709 13:16:53.143904 18536 raft_consensus.cc:359] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } }
I20260709 13:16:53.144662 18536 raft_consensus.cc:385] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.144950 18536 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.145794 18536 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } }
W20260709 13:16:53.150305 18226 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 57657us
I20260709 13:16:53.151269 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:16:53.153400 18382 leader_election.cc:343] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:53.154238 18290 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:53.155810 18534 tablet_bootstrap.cc:492] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:53.156450 18534 ts_tablet_manager.cc:1403] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.242s	user 0.007s	sys 0.011s
I20260709 13:16:53.160542 18534 raft_consensus.cc:359] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.161305 18534 raft_consensus.cc:385] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.161599 18534 raft_consensus.cc:740] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.161814 18408 tablet_service.cc:1511] Processing CreateTablet for tablet c3024cea1b1847929dd26f32197f9067 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:53.162354 18534 consensus_queue.cc:260] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.163120 18408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3024cea1b1847929dd26f32197f9067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.169139 18331 tablet_service.cc:1511] Processing CreateTablet for tablet c3024cea1b1847929dd26f32197f9067 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:53.170537 18331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3024cea1b1847929dd26f32197f9067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.171913 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:53.172577 18344 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:53.173976 18384 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:53.175135 18538 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.175478 18538 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.175796 18538 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.176960 18369 heartbeater.cc:499] Master 127.16.211.62:40381 was elected leader, sending a full tablet report...
I20260709 13:16:53.169139 18402 tablet_service.cc:1511] Processing CreateTablet for tablet b1c3d9691e854ee98b2b7d81f868c727 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:53.183354 18402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c3d9691e854ee98b2b7d81f868c727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.185827 18518 heartbeater.cc:499] Master 127.16.211.62:40381 was elected leader, sending a full tablet report...
I20260709 13:16:53.192164 18480 tablet_service.cc:1511] Processing CreateTablet for tablet c3024cea1b1847929dd26f32197f9067 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:53.193531 18480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3024cea1b1847929dd26f32197f9067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.195748 18536 ts_tablet_manager.cc:1434] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.015s
I20260709 13:16:53.196738 18536 tablet_bootstrap.cc:492] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:53.196976 18400 tablet_service.cc:1511] Processing CreateTablet for tablet 218ede86207640ab99622c70bae54d07 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:53.198197 18400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218ede86207640ab99622c70bae54d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.192226 18538 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } }
I20260709 13:16:53.204259 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:53.206111 18481 tablet_service.cc:1511] Processing CreateTablet for tablet 218ede86207640ab99622c70bae54d07 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:53.207355 18481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218ede86207640ab99622c70bae54d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.207515 18534 ts_tablet_manager.cc:1434] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.005s
I20260709 13:16:53.207966 18482 tablet_service.cc:1511] Processing CreateTablet for tablet b1c3d9691e854ee98b2b7d81f868c727 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:53.208796 18534 tablet_bootstrap.cc:492] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:53.209174 18482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c3d9691e854ee98b2b7d81f868c727. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:53.211283 18382 leader_election.cc:343] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.211905 18533 tablet_bootstrap.cc:492] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:53.212383 18533 ts_tablet_manager.cc:1403] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.125s	user 0.005s	sys 0.004s
I20260709 13:16:53.212636 18408 tablet_service.cc:1511] Processing CreateTablet for tablet beb1497b39de4cbbaf75d8c82f903278 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:53.213966 18408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb1497b39de4cbbaf75d8c82f903278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.218307 18534 tablet_bootstrap.cc:654] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.220914 18536 tablet_bootstrap.cc:654] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.221401 18477 tablet_service.cc:1511] Processing CreateTablet for tablet beb1497b39de4cbbaf75d8c82f903278 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:53.222967 18477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb1497b39de4cbbaf75d8c82f903278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.231323 18533 raft_consensus.cc:359] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.232092 18533 raft_consensus.cc:385] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.239398 18538 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:16:53.240566 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:53.241355 18344 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.242033 18545 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.232417 18533 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.242643 18545 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.246847 18330 tablet_service.cc:1511] Processing CreateTablet for tablet 218ede86207640ab99622c70bae54d07 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:53.250017 18330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218ede86207640ab99622c70bae54d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.219035 18327 tablet_service.cc:1511] Processing CreateTablet for tablet beb1497b39de4cbbaf75d8c82f903278 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:53.253300 18333 tablet_service.cc:1511] Processing CreateTablet for tablet b8b55a3ba07d4097b2da619afcf80e3f (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:53.254101 18533 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.267989 18333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b55a3ba07d4097b2da619afcf80e3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.270205 18327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb1497b39de4cbbaf75d8c82f903278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.273617 18344 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:53.264721 18545 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:53.288424 18533 ts_tablet_manager.cc:1434] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.076s	user 0.010s	sys 0.002s
I20260709 13:16:53.289463 18533 tablet_bootstrap.cc:492] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:53.300063 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:16:53.301496 18458 leader_election.cc:343] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.311483 18384 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:53.314709 18328 tablet_service.cc:1511] Processing CreateTablet for tablet bf69de9977524f43803f402f2cfed3d4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:53.318751 18538 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.319024 18328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf69de9977524f43803f402f2cfed3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.319249 18538 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:53.320070 18538 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } }
I20260709 13:16:53.321005 18533 tablet_bootstrap.cc:654] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.323031 18404 tablet_service.cc:1511] Processing CreateTablet for tablet b8b55a3ba07d4097b2da619afcf80e3f (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:53.324340 18404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b55a3ba07d4097b2da619afcf80e3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.324659 18407 tablet_service.cc:1511] Processing CreateTablet for tablet bf69de9977524f43803f402f2cfed3d4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:53.325824 18407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf69de9977524f43803f402f2cfed3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.317337 18480 tablet_service.cc:1511] Processing CreateTablet for tablet b8b55a3ba07d4097b2da619afcf80e3f (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:53.330631 18480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b55a3ba07d4097b2da619afcf80e3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.348860 18536 tablet_bootstrap.cc:492] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:53.350390 18536 ts_tablet_manager.cc:1403] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.154s	user 0.037s	sys 0.012s
I20260709 13:16:53.351346 18481 tablet_service.cc:1511] Processing CreateTablet for tablet bf69de9977524f43803f402f2cfed3d4 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:53.352741 18481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf69de9977524f43803f402f2cfed3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.353819 18477 tablet_service.cc:1511] Processing CreateTablet for tablet fcca3d62b9ee4ee98c16e7e079d076b7 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:53.356189 18330 tablet_service.cc:1511] Processing CreateTablet for tablet 479d13df82394c22b38ff5fd8a8b5931 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:53.357360 18330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479d13df82394c22b38ff5fd8a8b5931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.357293 18482 tablet_service.cc:1511] Processing CreateTablet for tablet 479d13df82394c22b38ff5fd8a8b5931 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:53.360841 18400 tablet_service.cc:1511] Processing CreateTablet for tablet fcca3d62b9ee4ee98c16e7e079d076b7 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:53.362093 18400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcca3d62b9ee4ee98c16e7e079d076b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.353183 18536 raft_consensus.cc:359] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.366906 18331 tablet_service.cc:1511] Processing CreateTablet for tablet b5d50aacd9894a6ca1895dbf30df38dc (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:53.367288 18536 raft_consensus.cc:385] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.368161 18331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d50aacd9894a6ca1895dbf30df38dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.368434 18536 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.370199 18477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcca3d62b9ee4ee98c16e7e079d076b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.370913 18482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479d13df82394c22b38ff5fd8a8b5931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.372092 18534 tablet_bootstrap.cc:492] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:53.372577 18534 ts_tablet_manager.cc:1403] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.164s	user 0.009s	sys 0.023s
I20260709 13:16:53.374653 18402 tablet_service.cc:1511] Processing CreateTablet for tablet b5d50aacd9894a6ca1895dbf30df38dc (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:53.375952 18402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d50aacd9894a6ca1895dbf30df38dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.379879 18475 tablet_service.cc:1511] Processing CreateTablet for tablet b5d50aacd9894a6ca1895dbf30df38dc (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:53.381150 18475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d50aacd9894a6ca1895dbf30df38dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.385447 18536 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.388391 18536 ts_tablet_manager.cc:1434] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.003s
I20260709 13:16:53.389353 18536 tablet_bootstrap.cc:492] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:53.386317 18534 raft_consensus.cc:359] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.390282 18534 raft_consensus.cc:385] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.375504 18242 catalog_manager.cc:5697] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.390611 18534 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.391960 18483 tablet_service.cc:1511] Processing CreateTablet for tablet fe80371fdcc94f38a7f06b90e411d03c (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:53.393175 18483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe80371fdcc94f38a7f06b90e411d03c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.395232 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:53.397122 18479 tablet_service.cc:1511] Processing CreateTablet for tablet d4511f72b2b34e4d82124396a41054ca (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:53.398342 18479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4511f72b2b34e4d82124396a41054ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.398191 18534 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.399994 18327 tablet_service.cc:1511] Processing CreateTablet for tablet fcca3d62b9ee4ee98c16e7e079d076b7 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:53.401728 18404 tablet_service.cc:1511] Processing CreateTablet for tablet fe80371fdcc94f38a7f06b90e411d03c (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:53.402937 18404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe80371fdcc94f38a7f06b90e411d03c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.402767 18476 tablet_service.cc:1511] Processing CreateTablet for tablet 3b2a2d7b65c646deb16cdddec208645e (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:53.403937 18476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b2a2d7b65c646deb16cdddec208645e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.407531 18326 tablet_service.cc:1511] Processing CreateTablet for tablet d4511f72b2b34e4d82124396a41054ca (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:53.408761 18326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4511f72b2b34e4d82124396a41054ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.411213 18478 tablet_service.cc:1511] Processing CreateTablet for tablet b176e8c616ab4b039f2e48b14549f43b (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:53.412405 18478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b176e8c616ab4b039f2e48b14549f43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.413969 18534 ts_tablet_manager.cc:1434] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.041s	user 0.001s	sys 0.009s
I20260709 13:16:53.415426 18544 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.415892 18544 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.417676 18474 tablet_service.cc:1511] Processing CreateTablet for tablet 9986bcf770bb42549bfb7d77ec66768b (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:53.419345 18474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9986bcf770bb42549bfb7d77ec66768b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.419427 18534 tablet_bootstrap.cc:492] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:53.422397 18544 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:53.424515 18536 tablet_bootstrap.cc:654] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.436689 18327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcca3d62b9ee4ee98c16e7e079d076b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.437852 18538 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:53.438306 18457 leader_election.cc:343] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.438463 18538 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.439003 18457 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:53.440495 18538 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:53.441097 18545 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.442137 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:16:53.443504 18382 leader_election.cc:343] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.453814 18534 tablet_bootstrap.cc:654] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.478289 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:53.482996 18407 tablet_service.cc:1511] Processing CreateTablet for tablet 479d13df82394c22b38ff5fd8a8b5931 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:53.484802 18407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479d13df82394c22b38ff5fd8a8b5931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.431103 18333 tablet_service.cc:1511] Processing CreateTablet for tablet fe80371fdcc94f38a7f06b90e411d03c (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:53.485901 18408 tablet_service.cc:1511] Processing CreateTablet for tablet d4511f72b2b34e4d82124396a41054ca (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:53.487607 18408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4511f72b2b34e4d82124396a41054ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.486527 18333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe80371fdcc94f38a7f06b90e411d03c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:53.483410 18384 leader_election.cc:343] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.505515 18479 tablet_service.cc:1511] Processing CreateTablet for tablet e1bc6fb6380b4ad7b0907976d075d20e (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:53.506583 18481 tablet_service.cc:1511] Processing CreateTablet for tablet 64f9a8403ec74b85bc4a3ff12e5f686a (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:53.517606 18479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1bc6fb6380b4ad7b0907976d075d20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.508736 18533 tablet_bootstrap.cc:492] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:53.513708 18384 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:53.514034 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:53.520182 18538 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:53.520213 18308 leader_election.cc:343] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.521390 18533 ts_tablet_manager.cc:1403] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.232s	user 0.017s	sys 0.025s
I20260709 13:16:53.518779 18481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f9a8403ec74b85bc4a3ff12e5f686a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.559648 18400 tablet_service.cc:1511] Processing CreateTablet for tablet 3b2a2d7b65c646deb16cdddec208645e (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:53.561187 18400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b2a2d7b65c646deb16cdddec208645e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.563203 18403 tablet_service.cc:1511] Processing CreateTablet for tablet b176e8c616ab4b039f2e48b14549f43b (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:53.566006 18533 raft_consensus.cc:359] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.582365 18534 tablet_bootstrap.cc:492] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:53.583456 18534 ts_tablet_manager.cc:1403] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.164s	user 0.015s	sys 0.013s
I20260709 13:16:53.689641 18403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b176e8c616ab4b039f2e48b14549f43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.764510 18545 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.765054 18545 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.767107 18545 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:53.774657 18401 tablet_service.cc:1511] Processing CreateTablet for tablet 9986bcf770bb42549bfb7d77ec66768b (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:53.776013 18401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9986bcf770bb42549bfb7d77ec66768b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.799325 18478 tablet_service.cc:1511] Processing CreateTablet for tablet 66d70af6941f4d469682dabf08926fc9 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:53.800194 18483 tablet_service.cc:1511] Processing CreateTablet for tablet c860bd12a6124270ba17146fea662e3b (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:53.800736 18478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d70af6941f4d469682dabf08926fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.800510 18476 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb2cd7aaa1d4bd3866023ef0cbae974 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:53.801537 18483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c860bd12a6124270ba17146fea662e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.802119 18476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb2cd7aaa1d4bd3866023ef0cbae974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.802614 18479 tablet_service.cc:1511] Processing CreateTablet for tablet 1f56f24cb8c042b4bbdc442e02acaefc (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:53.803822 18479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f56f24cb8c042b4bbdc442e02acaefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.804098 18477 tablet_service.cc:1511] Processing CreateTablet for tablet 8b55cf48798a4468ae4b6aa4a26a477f (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:53.805519 18477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b55cf48798a4468ae4b6aa4a26a477f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.580472 18533 raft_consensus.cc:385] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.820616 18533 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.823048 18533 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.823122 18333 tablet_service.cc:1511] Processing CreateTablet for tablet 3b2a2d7b65c646deb16cdddec208645e (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:53.831727 18333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b2a2d7b65c646deb16cdddec208645e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.829768 18331 tablet_service.cc:1511] Processing CreateTablet for tablet b176e8c616ab4b039f2e48b14549f43b (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:53.834789 18331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b176e8c616ab4b039f2e48b14549f43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.839954 18401 tablet_service.cc:1511] Processing CreateTablet for tablet 64f9a8403ec74b85bc4a3ff12e5f686a (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:53.841279 18401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f9a8403ec74b85bc4a3ff12e5f686a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.841773 18400 tablet_service.cc:1511] Processing CreateTablet for tablet 66d70af6941f4d469682dabf08926fc9 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:53.842784 18400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d70af6941f4d469682dabf08926fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.846808 18405 tablet_service.cc:1511] Processing CreateTablet for tablet c860bd12a6124270ba17146fea662e3b (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:53.848099 18405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c860bd12a6124270ba17146fea662e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.850939 18409 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb2cd7aaa1d4bd3866023ef0cbae974 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:53.852177 18409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb2cd7aaa1d4bd3866023ef0cbae974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.854940 18403 tablet_service.cc:1511] Processing CreateTablet for tablet 8b55cf48798a4468ae4b6aa4a26a477f (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:53.856201 18403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b55cf48798a4468ae4b6aa4a26a477f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.859205 18402 tablet_service.cc:1511] Processing CreateTablet for tablet e1bc6fb6380b4ad7b0907976d075d20e (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:53.860301 18533 ts_tablet_manager.cc:1434] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.339s	user 0.007s	sys 0.004s
I20260709 13:16:53.860636 18402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1bc6fb6380b4ad7b0907976d075d20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.860494 18483 tablet_service.cc:1511] Processing CreateTablet for tablet 04eef32e6eb14221811a03f4940ae121 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:53.861331 18533 tablet_bootstrap.cc:492] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:53.861070 18480 tablet_service.cc:1511] Processing CreateTablet for tablet 02f16ac6b95a48868f83cdf22debb207 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:53.861716 18483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04eef32e6eb14221811a03f4940ae121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.862301 18480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f16ac6b95a48868f83cdf22debb207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.865891 18478 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8c1407aa1e47808dbc2b1bc02c81a3 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:53.867156 18478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8c1407aa1e47808dbc2b1bc02c81a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.866854 18481 tablet_service.cc:1511] Processing CreateTablet for tablet f5da9c99398d461ba6b04325cb5faf48 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:53.867516 18404 tablet_service.cc:1511] Processing CreateTablet for tablet 1f56f24cb8c042b4bbdc442e02acaefc (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:53.868023 18481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5da9c99398d461ba6b04325cb5faf48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.868696 18404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f56f24cb8c042b4bbdc442e02acaefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.871090 18406 tablet_service.cc:1511] Processing CreateTablet for tablet 02f16ac6b95a48868f83cdf22debb207 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:53.872665 18406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f16ac6b95a48868f83cdf22debb207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.876310 18476 tablet_service.cc:1511] Processing CreateTablet for tablet 839ba6300c764efc8e880c80a27079b2 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:53.877995 18476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839ba6300c764efc8e880c80a27079b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.878427 18400 tablet_service.cc:1511] Processing CreateTablet for tablet 04eef32e6eb14221811a03f4940ae121 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:16:53.889279 18382 consensus_peers.cc:597] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:53.897130 18327 tablet_service.cc:1511] Processing CreateTablet for tablet 9986bcf770bb42549bfb7d77ec66768b (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:53.898859 18327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9986bcf770bb42549bfb7d77ec66768b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.906009 18401 tablet_service.cc:1511] Processing CreateTablet for tablet f5da9c99398d461ba6b04325cb5faf48 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:53.932579 18330 tablet_service.cc:1511] Processing CreateTablet for tablet e1bc6fb6380b4ad7b0907976d075d20e (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:53.933149 18328 tablet_service.cc:1511] Processing CreateTablet for tablet 64f9a8403ec74b85bc4a3ff12e5f686a (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:53.934037 18330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1bc6fb6380b4ad7b0907976d075d20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.934618 18328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f9a8403ec74b85bc4a3ff12e5f686a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.935341 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:53.935650 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:16:53.936857 18307 leader_election.cc:343] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.937301 18307 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:16:53.938480 18458 leader_election.cc:343] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.942777 18536 tablet_bootstrap.cc:492] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:53.943298 18536 ts_tablet_manager.cc:1403] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.554s	user 0.005s	sys 0.018s
I20260709 13:16:53.951628 18474 tablet_service.cc:1511] Processing CreateTablet for tablet 97efddba551a406f8d4427488fc22c5c (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:53.953044 18474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97efddba551a406f8d4427488fc22c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.879976 18400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04eef32e6eb14221811a03f4940ae121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.957823 18538 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:16:53.966472 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:53.970310 18401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5da9c99398d461ba6b04325cb5faf48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.979506 18326 tablet_service.cc:1511] Processing CreateTablet for tablet 66d70af6941f4d469682dabf08926fc9 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:53.981151 18326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d70af6941f4d469682dabf08926fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.971489 18560 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.981091 18536 raft_consensus.cc:359] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:53.982618 18536 raft_consensus.cc:385] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.983599 18334 tablet_service.cc:1511] Processing CreateTablet for tablet 8b55cf48798a4468ae4b6aa4a26a477f (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:53.984493 18536 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.984926 18334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b55cf48798a4468ae4b6aa4a26a477f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.987322 18332 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb2cd7aaa1d4bd3866023ef0cbae974 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:53.988510 18332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb2cd7aaa1d4bd3866023ef0cbae974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.971733 18331 tablet_service.cc:1511] Processing CreateTablet for tablet 1f56f24cb8c042b4bbdc442e02acaefc (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:53.971911 18408 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8c1407aa1e47808dbc2b1bc02c81a3 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:53.972484 18533 tablet_bootstrap.cc:654] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.992961 18329 tablet_service.cc:1511] Processing CreateTablet for tablet c860bd12a6124270ba17146fea662e3b (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:53.993355 18408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8c1407aa1e47808dbc2b1bc02c81a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.994179 18329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c860bd12a6124270ba17146fea662e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:53.988097 18536 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.002226 18331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f56f24cb8c042b4bbdc442e02acaefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.006529 18325 tablet_service.cc:1511] Processing CreateTablet for tablet 02f16ac6b95a48868f83cdf22debb207 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:54.008170 18325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f16ac6b95a48868f83cdf22debb207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.017020 18534 raft_consensus.cc:359] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.029533 18536 ts_tablet_manager.cc:1434] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.001s
W20260709 13:16:54.030920 18457 leader_election.cc:343] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.031368 18457 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:54.032114 18545 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.037976 18402 tablet_service.cc:1511] Processing CreateTablet for tablet 97efddba551a406f8d4427488fc22c5c (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:54.039230 18402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97efddba551a406f8d4427488fc22c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.040771 18481 tablet_service.cc:1511] Processing CreateTablet for tablet 21b9264b0a434b79b6292c2ed23bbae0 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:54.042069 18481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b9264b0a434b79b6292c2ed23bbae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.043248 18477 tablet_service.cc:1511] Processing CreateTablet for tablet 9088f88404fe42cd909dc0c66c1c0c17 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:54.044550 18477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9088f88404fe42cd909dc0c66c1c0c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.053079 18333 tablet_service.cc:1511] Processing CreateTablet for tablet f5da9c99398d461ba6b04325cb5faf48 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:54.068712 18533 tablet_bootstrap.cc:492] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:54.069365 18533 ts_tablet_manager.cc:1403] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.208s	user 0.020s	sys 0.001s
I20260709 13:16:54.029868 18534 raft_consensus.cc:385] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.070171 18534 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.070946 18534 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.071372 18330 tablet_service.cc:1511] Processing CreateTablet for tablet 97efddba551a406f8d4427488fc22c5c (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:54.073082 18534 ts_tablet_manager.cc:1434] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.489s	user 0.007s	sys 0.001s
I20260709 13:16:54.072726 18533 raft_consensus.cc:359] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.073678 18533 raft_consensus.cc:385] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.074016 18533 raft_consensus.cc:740] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.074822 18533 consensus_queue.cc:260] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.080935 18480 tablet_service.cc:1511] Processing CreateTablet for tablet f1a6e60961c64b469cf1a97767887e79 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:54.082259 18480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a6e60961c64b469cf1a97767887e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.089607 18534 tablet_bootstrap.cc:492] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:54.085438 18478 tablet_service.cc:1511] Processing CreateTablet for tablet 88ca5739563d4349a7b7a6c70d81e653 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:54.090519 18478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ca5739563d4349a7b7a6c70d81e653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.090370 18483 tablet_service.cc:1511] Processing CreateTablet for tablet 36dd573a999e4211a80fa3aeb1b2dbd2 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:54.091796 18483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36dd573a999e4211a80fa3aeb1b2dbd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.087765 18536 tablet_bootstrap.cc:492] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:54.090441 18476 tablet_service.cc:1511] Processing CreateTablet for tablet b532a06bf55a4b9b892b97bd8376715a (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:54.100723 18476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b532a06bf55a4b9b892b97bd8376715a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.102401 18533 ts_tablet_manager.cc:1434] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.004s
I20260709 13:16:54.104877 18330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97efddba551a406f8d4427488fc22c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.112061 18333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5da9c99398d461ba6b04325cb5faf48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.120491 18403 tablet_service.cc:1511] Processing CreateTablet for tablet b532a06bf55a4b9b892b97bd8376715a (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:54.121829 18403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b532a06bf55a4b9b892b97bd8376715a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.124411 18405 tablet_service.cc:1511] Processing CreateTablet for tablet 5069a3aa86984fcd93f4fb63a92ef8cd (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:54.125617 18405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5069a3aa86984fcd93f4fb63a92ef8cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.093402 18407 tablet_service.cc:1511] Processing CreateTablet for tablet 839ba6300c764efc8e880c80a27079b2 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:54.126813 18402 tablet_service.cc:1511] Processing CreateTablet for tablet 21b9264b0a434b79b6292c2ed23bbae0 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:54.131970 18328 tablet_service.cc:1511] Processing CreateTablet for tablet 9088f88404fe42cd909dc0c66c1c0c17 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:54.133970 18474 tablet_service.cc:1511] Processing CreateTablet for tablet 5069a3aa86984fcd93f4fb63a92ef8cd (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:54.135212 18474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5069a3aa86984fcd93f4fb63a92ef8cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.143386 18326 tablet_service.cc:1511] Processing CreateTablet for tablet 04eef32e6eb14221811a03f4940ae121 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:54.147660 18404 tablet_service.cc:1511] Processing CreateTablet for tablet 88ca5739563d4349a7b7a6c70d81e653 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:54.160797 18407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839ba6300c764efc8e880c80a27079b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.150815 18401 tablet_service.cc:1511] Processing CreateTablet for tablet 9088f88404fe42cd909dc0c66c1c0c17 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:54.162405 18534 tablet_bootstrap.cc:654] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.157075 18333 tablet_service.cc:1511] Processing CreateTablet for tablet 4f8c1407aa1e47808dbc2b1bc02c81a3 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:54.162828 18334 tablet_service.cc:1511] Processing CreateTablet for tablet b532a06bf55a4b9b892b97bd8376715a (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:16:54.157676 18290 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:54.157884 18328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9088f88404fe42cd909dc0c66c1c0c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.148115 18403 tablet_service.cc:1511] Processing CreateTablet for tablet f1a6e60961c64b469cf1a97767887e79 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:54.161602 18404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ca5739563d4349a7b7a6c70d81e653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.165351 18333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8c1407aa1e47808dbc2b1bc02c81a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.160807 18329 tablet_service.cc:1511] Processing CreateTablet for tablet 839ba6300c764efc8e880c80a27079b2 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:54.166806 18326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04eef32e6eb14221811a03f4940ae121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.166872 18401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9088f88404fe42cd909dc0c66c1c0c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.167392 18332 tablet_service.cc:1511] Processing CreateTablet for tablet 21b9264b0a434b79b6292c2ed23bbae0 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:54.168886 18332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b9264b0a434b79b6292c2ed23bbae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.158775 18536 tablet_bootstrap.cc:654] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.168896 18402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b9264b0a434b79b6292c2ed23bbae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.174675 18327 tablet_service.cc:1511] Processing CreateTablet for tablet f1a6e60961c64b469cf1a97767887e79 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:54.175863 18327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a6e60961c64b469cf1a97767887e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.178938 18533 tablet_bootstrap.cc:492] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:54.184281 18329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839ba6300c764efc8e880c80a27079b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.188694 18403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a6e60961c64b469cf1a97767887e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.191165 18409 tablet_service.cc:1511] Processing CreateTablet for tablet 36dd573a999e4211a80fa3aeb1b2dbd2 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:54.188830 18334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b532a06bf55a4b9b892b97bd8376715a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:54.242108 18228 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 78072.5us
I20260709 13:16:54.246907 18333 tablet_service.cc:1511] Processing CreateTablet for tablet 88ca5739563d4349a7b7a6c70d81e653 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:54.248355 18333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ca5739563d4349a7b7a6c70d81e653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.249764 18325 tablet_service.cc:1511] Processing CreateTablet for tablet 36dd573a999e4211a80fa3aeb1b2dbd2 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:54.252390 18545 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.253037 18538 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.252882 18545 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.253532 18538 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.264688 18545 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:54.266651 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:54.268416 18481 tablet_service.cc:1511] Processing CreateTablet for tablet 4139afe4ea2b4938821aa26d4c12e6ab (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:54.269513 18481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4139afe4ea2b4938821aa26d4c12e6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.269824 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:54.270457 18419 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:54.271637 18457 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:16:54.272418 18545 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.272737 18545 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.273036 18545 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.269513 18325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36dd573a999e4211a80fa3aeb1b2dbd2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:54.278524 18458 leader_election.cc:343] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.282567 18409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36dd573a999e4211a80fa3aeb1b2dbd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.294520 18406 tablet_service.cc:1511] Processing CreateTablet for tablet 069e2e1b4c714f01a2bc3ad59e3618f1 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:54.299083 18477 tablet_service.cc:1511] Processing CreateTablet for tablet b1734a6c318d4e6ba6b65fd828d4fe66 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:54.301898 18481 tablet_service.cc:1511] Processing CreateTablet for tablet 069e2e1b4c714f01a2bc3ad59e3618f1 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:54.303536 18481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069e2e1b4c714f01a2bc3ad59e3618f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.310339 18560 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.312662 18560 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.313081 18479 tablet_service.cc:1511] Processing CreateTablet for tablet b345033a56994fff90990b7d03324074 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:54.314740 18560 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:54.315512 18406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069e2e1b4c714f01a2bc3ad59e3618f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.316668 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:16:54.318823 18308 leader_election.cc:343] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.319092 18534 tablet_bootstrap.cc:492] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:54.319619 18534 ts_tablet_manager.cc:1403] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.243s	user 0.019s	sys 0.001s
I20260709 13:16:54.322324 18408 tablet_service.cc:1511] Processing CreateTablet for tablet b1734a6c318d4e6ba6b65fd828d4fe66 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:54.323606 18408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1734a6c318d4e6ba6b65fd828d4fe66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.326278 18405 tablet_service.cc:1511] Processing CreateTablet for tablet b345033a56994fff90990b7d03324074 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:54.327970 18405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b345033a56994fff90990b7d03324074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.330868 18477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1734a6c318d4e6ba6b65fd828d4fe66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.330681 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:16:54.331987 18307 leader_election.cc:343] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.332494 18307 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:54.332945 18400 tablet_service.cc:1511] Processing CreateTablet for tablet 4139afe4ea2b4938821aa26d4c12e6ab (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:54.334865 18400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4139afe4ea2b4938821aa26d4c12e6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.337461 18564 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.338225 18564 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.341408 18479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b345033a56994fff90990b7d03324074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.385908 18560 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:54.386757 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 54814.9us
I20260709 13:16:54.387324 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:16:54.387506 18226 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 50741.7us
W20260709 13:16:54.388760 18384 leader_election.cc:343] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.390125 18564 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:54.390857 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:54.399209 18493 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:54.391939 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:54.401401 18382 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:16:54.402840 18565 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.402685 18545 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.403224 18565 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.403604 18565 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.404955 18545 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:16:54.406203 18384 leader_election.cc:343] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.409843 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:54.410430 18419 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.414783 18533 tablet_bootstrap.cc:654] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.395182 18534 raft_consensus.cc:359] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } }
I20260709 13:16:54.423816 18565 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.427610 18536 tablet_bootstrap.cc:492] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:54.430389 18333 tablet_service.cc:1511] Processing CreateTablet for tablet b1734a6c318d4e6ba6b65fd828d4fe66 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:54.432461 18333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1734a6c318d4e6ba6b65fd828d4fe66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.432678 18536 ts_tablet_manager.cc:1403] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.356s	user 0.019s	sys 0.006s
I20260709 13:16:54.435401 18536 raft_consensus.cc:359] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.436074 18536 raft_consensus.cc:385] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.436370 18536 raft_consensus.cc:740] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.437166 18536 consensus_queue.cc:260] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.439555 18536 ts_tablet_manager.cc:1434] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:54.440526 18536 tablet_bootstrap.cc:492] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:54.431991 18534 raft_consensus.cc:385] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.454170 18534 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.455076 18419 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:54.454977 18534 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } }
I20260709 13:16:54.455441 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:54.456214 18457 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:16:54.454210 18538 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:16:54.457784 18382 leader_election.cc:343] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.458250 18382 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:54.459072 18545 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.459306 18538 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.463541 18333 tablet_service.cc:1511] Processing CreateTablet for tablet 069e2e1b4c714f01a2bc3ad59e3618f1 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:54.468343 18545 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:16:54.469242 18545 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.470880 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:54.473568 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:54.474153 18493 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.475525 18534 ts_tablet_manager.cc:1434] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.156s	user 0.006s	sys 0.012s
I20260709 13:16:54.476073 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:54.476732 18534 tablet_bootstrap.cc:492] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
W20260709 13:16:54.478180 18384 leader_election.cc:343] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:54.478798 18227 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 57238us
I20260709 13:16:54.479409 18334 tablet_service.cc:1511] Processing CreateTablet for tablet b345033a56994fff90990b7d03324074 (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:54.480602 18334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b345033a56994fff90990b7d03324074. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:54.483475 18458 leader_election.cc:343] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.477515 18330 tablet_service.cc:1511] Processing CreateTablet for tablet 4139afe4ea2b4938821aa26d4c12e6ab (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:54.486420 18493 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:54.487528 18382 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:54.488376 18538 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.488835 18538 raft_consensus.cc:697] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:54.489674 18538 consensus_queue.cc:237] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.490938 18330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4139afe4ea2b4938821aa26d4c12e6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.491051 18328 tablet_service.cc:1511] Processing CreateTablet for tablet 5069a3aa86984fcd93f4fb63a92ef8cd (DEFAULT_TABLE table=test-workload [id=bd0ea25089a54c03b540612819c80898]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:54.492282 18328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5069a3aa86984fcd93f4fb63a92ef8cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.493137 18536 tablet_bootstrap.cc:654] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.494236 18333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069e2e1b4c714f01a2bc3ad59e3618f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.459733 18565 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:54.504413 18533 tablet_bootstrap.cc:492] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:54.504834 18533 ts_tablet_manager.cc:1403] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.397s	user 0.014s	sys 0.010s
I20260709 13:16:54.508910 18533 raft_consensus.cc:359] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.509601 18533 raft_consensus.cc:385] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.509881 18533 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.521541 18242 catalog_manager.cc:5697] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.539386 18533 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.541644 18534 tablet_bootstrap.cc:654] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.542734 18533 ts_tablet_manager.cc:1434] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:16:54.544116 18533 tablet_bootstrap.cc:492] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:54.557682 18241 catalog_manager.cc:5697] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.575337 18533 tablet_bootstrap.cc:654] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.575657 18536 tablet_bootstrap.cc:492] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:54.575847 18534 tablet_bootstrap.cc:492] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:54.576169 18536 ts_tablet_manager.cc:1403] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.136s	user 0.008s	sys 0.021s
I20260709 13:16:54.576260 18534 ts_tablet_manager.cc:1403] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.005s
I20260709 13:16:54.579228 18534 raft_consensus.cc:359] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.579372 18536 raft_consensus.cc:359] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.580036 18534 raft_consensus.cc:385] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.580178 18536 raft_consensus.cc:385] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.580480 18536 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.581374 18536 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.580371 18534 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.582608 18534 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.584772 18534 ts_tablet_manager.cc:1434] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:16:54.585686 18534 tablet_bootstrap.cc:492] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:54.587738 18536 ts_tablet_manager.cc:1434] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:16:54.588712 18536 tablet_bootstrap.cc:492] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:54.592965 18534 tablet_bootstrap.cc:654] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.594945 18571 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.595444 18571 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.597057 18533 tablet_bootstrap.cc:492] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:54.597659 18533 ts_tablet_manager.cc:1403] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.013s
I20260709 13:16:54.599821 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:54.600852 18533 raft_consensus.cc:359] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.601583 18533 raft_consensus.cc:385] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.601696 18571 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:54.601907 18533 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
W20260709 13:16:54.601593 18307 leader_election.cc:343] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.602643 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:54.603057 18533 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:16:54.602164 18273 debug-util.cc:398] Leaking SignalData structure 0x7b0800038f60 after lost signal to thread 17231
W20260709 13:16:54.604086 18308 leader_election.cc:343] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:54.605058 18273 debug-util.cc:398] Leaking SignalData structure 0x7b0800034600 after lost signal to thread 18276
I20260709 13:16:54.604764 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:54.605314 18533 ts_tablet_manager.cc:1434] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 13:16:54.606168 18273 debug-util.cc:398] Leaking SignalData structure 0x7b08000dd480 after lost signal to thread 18368
I20260709 13:16:54.606283 18533 tablet_bootstrap.cc:492] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:54.606204 18571 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.603602 18536 tablet_bootstrap.cc:654] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:54.607281 18273 debug-util.cc:398] Leaking SignalData structure 0x7b08001350a0 after lost signal to thread 18443
W20260709 13:16:54.608273 18273 debug-util.cc:398] Leaking SignalData structure 0x7b08000e8fc0 after lost signal to thread 18517
I20260709 13:16:54.613063 18533 tablet_bootstrap.cc:654] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.613899 18534 tablet_bootstrap.cc:492] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:54.614403 18534 ts_tablet_manager.cc:1403] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.003s
I20260709 13:16:54.617832 18534 raft_consensus.cc:359] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.618613 18534 raft_consensus.cc:385] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.618906 18534 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.619634 18534 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.620132 18536 tablet_bootstrap.cc:492] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:54.620579 18536 ts_tablet_manager.cc:1403] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.002s
I20260709 13:16:54.622067 18534 ts_tablet_manager.cc:1434] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:16:54.623031 18534 tablet_bootstrap.cc:492] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:54.623508 18536 raft_consensus.cc:359] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.624205 18536 raft_consensus.cc:385] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.624475 18536 raft_consensus.cc:740] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.625372 18536 consensus_queue.cc:260] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.628003 18536 ts_tablet_manager.cc:1434] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:16:54.628969 18536 tablet_bootstrap.cc:492] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:54.629820 18534 tablet_bootstrap.cc:654] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.636430 18536 tablet_bootstrap.cc:654] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.643265 18534 tablet_bootstrap.cc:492] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:54.643903 18534 ts_tablet_manager.cc:1403] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.010s
I20260709 13:16:54.647145 18536 tablet_bootstrap.cc:492] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:54.646934 18534 raft_consensus.cc:359] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.647595 18536 ts_tablet_manager.cc:1403] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.009s
I20260709 13:16:54.647647 18534 raft_consensus.cc:385] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.648144 18534 raft_consensus.cc:740] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.648931 18534 consensus_queue.cc:260] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.650800 18536 raft_consensus.cc:359] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.651499 18536 raft_consensus.cc:385] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.651789 18536 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.652632 18536 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.653695 18534 ts_tablet_manager.cc:1434] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:16:54.654877 18534 tablet_bootstrap.cc:492] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:54.657953 18536 ts_tablet_manager.cc:1434] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:16:54.659001 18536 tablet_bootstrap.cc:492] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:54.661068 18534 tablet_bootstrap.cc:654] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.666039 18536 tablet_bootstrap.cc:654] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.671978 18533 tablet_bootstrap.cc:492] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:54.672313 18534 tablet_bootstrap.cc:492] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:54.672482 18533 ts_tablet_manager.cc:1403] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.028s
I20260709 13:16:54.672797 18534 ts_tablet_manager.cc:1403] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.011s
I20260709 13:16:54.676085 18534 raft_consensus.cc:359] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.676975 18534 raft_consensus.cc:385] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.677368 18534 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.678536 18534 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.680255 18533 raft_consensus.cc:359] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.681299 18533 raft_consensus.cc:385] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.681692 18533 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.682583 18533 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.685158 18545 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.685637 18545 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } }
I20260709 13:16:54.687707 18545 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:16:54.691036 18534 ts_tablet_manager.cc:1434] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:16:54.692265 18534 tablet_bootstrap.cc:492] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:54.692829 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:54.695858 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:54.685134 18533 ts_tablet_manager.cc:1434] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:16:54.697410 18457 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:54.698081 18533 tablet_bootstrap.cc:492] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:54.700150 18545 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.702862 18534 tablet_bootstrap.cc:654] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.706339 18536 tablet_bootstrap.cc:492] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:54.706986 18536 ts_tablet_manager.cc:1403] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.027s
I20260709 13:16:54.712019 18533 tablet_bootstrap.cc:654] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.713064 18534 tablet_bootstrap.cc:492] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:54.713671 18534 ts_tablet_manager.cc:1403] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 13:16:54.712694 18536 raft_consensus.cc:359] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.714105 18536 raft_consensus.cc:385] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.714437 18536 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.715158 18536 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.717521 18536 ts_tablet_manager.cc:1434] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:16:54.718165 18534 raft_consensus.cc:359] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.718869 18534 raft_consensus.cc:385] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.719235 18534 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.719942 18534 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.724820 18533 tablet_bootstrap.cc:492] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:54.725317 18533 ts_tablet_manager.cc:1403] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.004s
I20260709 13:16:54.727838 18533 raft_consensus.cc:359] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.728652 18533 raft_consensus.cc:385] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.729031 18533 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.729988 18534 ts_tablet_manager.cc:1434] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:16:54.729846 18533 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.735694 18536 tablet_bootstrap.cc:492] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:54.738003 18534 tablet_bootstrap.cc:492] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:54.741724 18536 tablet_bootstrap.cc:654] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.741847 18533 ts_tablet_manager.cc:1434] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:16:54.744277 18534 tablet_bootstrap.cc:654] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.751802 18533 tablet_bootstrap.cc:492] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:54.753849 18536 tablet_bootstrap.cc:492] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:54.754313 18536 ts_tablet_manager.cc:1403] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:16:54.755462 18534 tablet_bootstrap.cc:492] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:54.755914 18534 ts_tablet_manager.cc:1403] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.002s
I20260709 13:16:54.756840 18536 raft_consensus.cc:359] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.757480 18536 raft_consensus.cc:385] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.757730 18536 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.758261 18533 tablet_bootstrap.cc:654] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.758589 18534 raft_consensus.cc:359] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.758598 18536 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.759544 18534 raft_consensus.cc:385] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.759865 18534 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.760656 18534 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.768585 18534 ts_tablet_manager.cc:1434] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:16:54.769518 18534 tablet_bootstrap.cc:492] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:54.772750 18536 ts_tablet_manager.cc:1434] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:16:54.773123 18565 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.773553 18565 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.775517 18565 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:54.778082 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:54.778724 18344 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:54.779630 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:54.779997 18545 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.780234 18493 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:54.780519 18545 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.781248 18572 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.781723 18572 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.782335 18384 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:54.782737 18545 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:54.783710 18572 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:54.783800 18538 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.784176 18538 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.784480 18538 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.784909 18536 tablet_bootstrap.cc:492] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:54.785552 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:54.786201 18343 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:54.787930 18458 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:54.788163 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:54.788740 18344 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:54.789657 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:54.789870 18545 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.790357 18545 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.790899 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:54.791577 18418 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
W20260709 13:16:54.793042 18457 leader_election.cc:343] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.793429 18493 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.794158 18536 tablet_bootstrap.cc:654] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.795548 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:16:54.796876 18457 leader_election.cc:343] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.797421 18572 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.797883 18572 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.798332 18572 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.801123 18534 tablet_bootstrap.cc:654] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.802554 18568 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.803114 18568 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.805249 18568 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:54.805960 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:54.806077 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:54.806510 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:54.806766 18343 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:54.807209 18492 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:54.808051 18384 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:54.808936 18568 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.809283 18568 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.809626 18568 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.810420 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:54.812546 18538 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.797444 18545 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:54.813750 18545 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.817250 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:54.817171 18568 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.817968 18492 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.817457 18545 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.818738 18545 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.823012 18536 tablet_bootstrap.cc:492] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:54.815394 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:54.823504 18536 ts_tablet_manager.cc:1403] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.008s
I20260709 13:16:54.823611 18344 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.826473 18536 raft_consensus.cc:359] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.827176 18536 raft_consensus.cc:385] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.827461 18536 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.828191 18536 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.832903 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:54.833456 18343 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.834829 18568 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:54.836503 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:54.837142 18491 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.839620 18534 tablet_bootstrap.cc:492] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:54.840076 18534 ts_tablet_manager.cc:1403] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.002s
I20260709 13:16:54.842931 18343 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:54.842900 18534 raft_consensus.cc:359] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.843744 18534 raft_consensus.cc:385] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.844038 18534 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.844223 18384 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:54.845000 18565 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.844730 18534 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.845180 18538 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:54.845513 18565 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:54.846563 18536 ts_tablet_manager.cc:1434] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:16:54.846336 18565 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.847831 18536 tablet_bootstrap.cc:492] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:54.848115 18572 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.850719 18533 tablet_bootstrap.cc:492] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:54.851168 18533 ts_tablet_manager.cc:1403] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.009s
I20260709 13:16:54.852974 18492 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:54.860389 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:54.860984 18418 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.862375 18491 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:54.863075 18344 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:54.864228 18384 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:54.864658 18560 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.865387 18533 raft_consensus.cc:359] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.865412 18534 ts_tablet_manager.cc:1434] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.009s
I20260709 13:16:54.865899 18533 raft_consensus.cc:385] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.866192 18533 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.867179 18534 tablet_bootstrap.cc:492] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:54.867435 18533 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.870597 18536 tablet_bootstrap.cc:654] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.871578 18533 ts_tablet_manager.cc:1434] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:16:54.859553 18572 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:54.865258 18571 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.879616 18571 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.868268 18568 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.878756 18418 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:54.865077 18560 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.882385 18568 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:54.883216 18568 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.883682 18560 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:54.884712 18457 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:16:54.883579 18533 tablet_bootstrap.cc:492] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
W20260709 13:16:54.870925 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 65082.5us
I20260709 13:16:54.886937 18534 tablet_bootstrap.cc:654] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.884516 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:54.891004 18536 tablet_bootstrap.cc:492] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:54.891485 18536 ts_tablet_manager.cc:1403] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.004s
I20260709 13:16:54.893566 18545 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.894119 18418 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 1: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:16:54.894897 18595 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.895012 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:54.895495 18595 raft_consensus.cc:697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:16:54.896371 18595 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:16:54.897315 18308 leader_election.cc:343] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.899703 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:54.900079 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:54.900854 18571 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:16:54.901193 18457 leader_election.cc:343] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.900854 18344 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.902554 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:54.904151 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:54.904772 18492 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:54.899326 18239 catalog_manager.cc:5697] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:54.906041 18458 leader_election.cc:343] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.906490 18458 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:54.900398 18545 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:54.911131 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:54.899106 18536 raft_consensus.cc:359] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.912998 18536 raft_consensus.cc:385] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.913419 18536 raft_consensus.cc:740] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.915199 18536 consensus_queue.cc:260] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.916404 18307 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:54.911525 18572 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.922330 18533 tablet_bootstrap.cc:654] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.924095 18560 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.916404 18343 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.932271 18536 ts_tablet_manager.cc:1434] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260709 13:16:54.933427 18536 tablet_bootstrap.cc:492] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:54.939638 18560 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.943166 18344 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:54.941789 18343 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:54.949397 18534 tablet_bootstrap.cc:492] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:54.949851 18534 ts_tablet_manager.cc:1403] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.083s	user 0.027s	sys 0.010s
I20260709 13:16:54.952715 18534 raft_consensus.cc:359] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.953362 18534 raft_consensus.cc:385] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.953617 18534 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.945098 18307 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:54.954317 18536 tablet_bootstrap.cc:654] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.954253 18534 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.956421 18534 ts_tablet_manager.cc:1434] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:54.957269 18534 tablet_bootstrap.cc:492] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:54.962003 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:54.962965 18595 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.963572 18595 raft_consensus.cc:697] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:16:54.963500 18572 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.964535 18595 consensus_queue.cc:237] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.981590 18560 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.982126 18560 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.982524 18560 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.985986 18533 tablet_bootstrap.cc:492] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:54.986477 18533 ts_tablet_manager.cc:1403] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.003s
I20260709 13:16:54.985107 18241 catalog_manager.cc:5697] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.989764 18534 tablet_bootstrap.cc:654] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.991405 18533 raft_consensus.cc:359] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:54.992043 18533 raft_consensus.cc:385] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.992331 18533 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.996881 18533 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.001050 18533 ts_tablet_manager.cc:1434] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:16:55.001933 18533 tablet_bootstrap.cc:492] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:55.002523 18534 tablet_bootstrap.cc:492] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:55.002966 18534 ts_tablet_manager.cc:1403] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 13:16:55.006300 18534 raft_consensus.cc:359] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.007043 18534 raft_consensus.cc:385] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.007364 18534 raft_consensus.cc:740] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.008176 18534 consensus_queue.cc:260] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.014165 18534 ts_tablet_manager.cc:1434] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:16:55.014709 18572 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:55.015808 18534 tablet_bootstrap.cc:492] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:55.016258 18572 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.016812 18572 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.020489 18533 tablet_bootstrap.cc:654] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.023253 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.024401 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:16:55.024823 18458 leader_election.cc:343] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.025053 18418 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:55.025883 18572 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:55.026938 18457 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:55.028290 18572 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.028677 18572 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.029044 18572 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.045094 18343 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.029124 18534 tablet_bootstrap.cc:654] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.048640 18536 tablet_bootstrap.cc:492] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:55.048998 18536 ts_tablet_manager.cc:1403] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.000s
I20260709 13:16:55.052526 18536 raft_consensus.cc:359] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.053217 18536 raft_consensus.cc:385] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.053484 18536 raft_consensus.cc:740] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.054221 18536 consensus_queue.cc:260] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.049585 18560 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.058130 18568 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.058591 18568 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.057967 18572 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.062427 18568 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.063973 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.064276 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:55.064641 18493 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
W20260709 13:16:55.065845 18458 leader_election.cc:343] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.066013 18382 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:16:55.068414 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:55.069016 18418 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.073757 18533 tablet_bootstrap.cc:492] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:55.074342 18533 ts_tablet_manager.cc:1403] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.005s
I20260709 13:16:55.079941 18565 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.089016 18565 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.098569 18565 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.074573 18572 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:55.077288 18568 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.086098 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:55.089473 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.110549 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.106554 18568 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.111148 18493 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:55.111443 18568 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.111577 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.112252 18342 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:55.112401 18382 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:16:55.111075 18308 leader_election.cc:343] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.115489 18565 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.119145 18533 raft_consensus.cc:359] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.122144 18565 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.121613 18534 tablet_bootstrap.cc:492] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
W20260709 13:16:55.117846 18384 leader_election.cc:343] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.122610 18565 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.122225 18533 raft_consensus.cc:385] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.123618 18533 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.120157 18536 ts_tablet_manager.cc:1434] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.013s
I20260709 13:16:55.124413 18538 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.124531 18242 catalog_manager.cc:5697] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.126350 18536 tablet_bootstrap.cc:492] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:55.126204 18242 catalog_manager.cc:5697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.126683 18571 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.127116 18534 ts_tablet_manager.cc:1403] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.112s	user 0.027s	sys 0.016s
I20260709 13:16:55.127439 18571 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.129123 18418 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:55.129550 18560 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.131790 18457 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:55.132989 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:55.135013 18492 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.136205 18595 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.136662 18595 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:16:55.137526 18595 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.138036 18596 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.138511 18596 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.140357 18596 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:55.133634 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.134078 18571 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.141970 18533 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.144462 18538 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.144920 18538 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.145669 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:55.147189 18308 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:55.147579 18565 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.141856 18568 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.151224 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.148193 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.152156 18565 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.151999 18568 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.155323 18565 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.148892 18538 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.168227 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:55.168815 18490 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.152928 18560 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:55.173934 18571 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.175997 18571 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:16:55.163734 18382 leader_election.cc:343] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.184352 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:16:55.158352 18458 leader_election.cc:343] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:55.197252 18457 leader_election.cc:343] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.197832 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.198947 18534 raft_consensus.cc:359] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.199599 18534 raft_consensus.cc:385] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.199847 18534 raft_consensus.cc:740] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.194003 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:55.204077 18533 ts_tablet_manager.cc:1434] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.129s	user 0.021s	sys 0.025s
I20260709 13:16:55.203711 18534 consensus_queue.cc:260] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.205502 18533 tablet_bootstrap.cc:492] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
W20260709 13:16:55.200403 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 44094.6us
I20260709 13:16:55.206620 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:55.210263 18457 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:55.206734 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:55.214017 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.214278 18342 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:55.215055 18384 leader_election.cc:343] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.215512 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:16:55.215898 18307 leader_election.cc:343] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:55.216634 18384 leader_election.cc:343] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.206898 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:16:55.208611 18290 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:55.205592 18491 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.218576 18534 ts_tablet_manager.cc:1434] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.091s	user 0.004s	sys 0.003s
I20260709 13:16:55.221354 18534 tablet_bootstrap.cc:492] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
W20260709 13:16:55.222666 18308 leader_election.cc:343] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.223656 18560 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.223662 18308 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:55.218115 18595 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.212632 18571 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.224283 18560 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.226135 18614 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.219893 18565 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.231545 18560 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.232388 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:55.233008 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.233597 18489 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:55.234404 18492 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
W20260709 13:16:55.234414 18308 leader_election.cc:343] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.238279 18490 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:55.239571 18382 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:16:55.240536 18568 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.241079 18568 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:55.241254 18342 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:55.242017 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:55.242970 18571 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.243496 18571 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.244498 18571 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.242012 18568 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.246199 18307 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:55.247502 18560 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.248127 18560 raft_consensus.cc:697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:16:55.249298 18565 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.249184 18560 consensus_queue.cc:237] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.246939 18242 catalog_manager.cc:5697] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.253531 18534 tablet_bootstrap.cc:654] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.263135 18536 tablet_bootstrap.cc:654] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.250456 18491 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:55.269455 18565 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:55.283190 18382 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:55.284313 18568 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.299661 18533 tablet_bootstrap.cc:654] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.285166 18568 raft_consensus.cc:697] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:55.305720 18536 tablet_bootstrap.cc:492] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:55.278664 18571 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.309780 18536 ts_tablet_manager.cc:1403] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.184s	user 0.023s	sys 0.028s
I20260709 13:16:55.317580 18536 raft_consensus.cc:359] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.320302 18536 raft_consensus.cc:385] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.320627 18536 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.321377 18536 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.323415 18534 tablet_bootstrap.cc:492] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:55.323874 18534 ts_tablet_manager.cc:1403] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.003s
I20260709 13:16:55.325418 18571 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.325368 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:55.326473 18534 raft_consensus.cc:359] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:16:55.327080 18308 leader_election.cc:343] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.327359 18534 raft_consensus.cc:385] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.327662 18534 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.328262 18534 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.327967 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:55.329504 18491 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.331382 18534 ts_tablet_manager.cc:1434] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:55.332224 18534 tablet_bootstrap.cc:492] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:55.334944 18536 ts_tablet_manager.cc:1434] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:16:55.285094 18239 catalog_manager.cc:5697] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.335861 18536 tablet_bootstrap.cc:492] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:55.343194 18491 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:55.348251 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:55.348470 18538 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.350132 18560 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.350715 18560 raft_consensus.cc:697] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:16:55.346275 18568 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.351610 18560 consensus_queue.cc:237] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.353588 18534 tablet_bootstrap.cc:654] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.350165 18618 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:16:55.370326 18533 tablet_bootstrap.cc:492] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:55.370854 18533 ts_tablet_manager.cc:1403] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.166s	user 0.013s	sys 0.009s
I20260709 13:16:55.373945 18242 catalog_manager.cc:5697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.373431 18533 raft_consensus.cc:359] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.376914 18533 raft_consensus.cc:385] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.377234 18533 raft_consensus.cc:740] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.387315 18533 consensus_queue.cc:260] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.396243 18536 tablet_bootstrap.cc:654] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.397420 18534 tablet_bootstrap.cc:492] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:55.397889 18534 ts_tablet_manager.cc:1403] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.002s
I20260709 13:16:55.400449 18595 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.401746 18534 raft_consensus.cc:359] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.402432 18534 raft_consensus.cc:385] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.402679 18534 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.403321 18534 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.405192 18534 ts_tablet_manager.cc:1434] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.001s
I20260709 13:16:55.406244 18239 catalog_manager.cc:5697] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:55.408174 18457 consensus_peers.cc:597] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.408529 18534 tablet_bootstrap.cc:492] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:55.411584 18536 tablet_bootstrap.cc:492] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:55.412091 18536 ts_tablet_manager.cc:1403] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.000s
I20260709 13:16:55.414304 18534 tablet_bootstrap.cc:654] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.414386 18596 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.414871 18536 raft_consensus.cc:359] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.415706 18536 raft_consensus.cc:385] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.416078 18536 raft_consensus.cc:740] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.417032 18536 consensus_queue.cc:260] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.419414 18536 ts_tablet_manager.cc:1434] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:55.419606 18533 ts_tablet_manager.cc:1434] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.002s
I20260709 13:16:55.420362 18536 tablet_bootstrap.cc:492] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:55.420588 18533 tablet_bootstrap.cc:492] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:55.428612 18595 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.429140 18595 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.438969 18568 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.439534 18568 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.441946 18568 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.446763 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.447623 18344 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:55.445850 18536 tablet_bootstrap.cc:654] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.450778 18595 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:55.450385 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:55.452567 18419 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:55.453444 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:55.454720 18538 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.454644 18457 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:16:55.455181 18538 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.455583 18538 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.455749 18572 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.456290 18572 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.456699 18572 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.458149 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.458865 18344 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:55.466470 18560 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.464859 18240 catalog_manager.cc:5697] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.467121 18560 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.471853 18572 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.477543 18568 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.478106 18568 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.478446 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:55.478927 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.479518 18493 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:55.480099 18560 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:16:55.479995 18308 leader_election.cc:343] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.473968 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.488098 18572 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:55.488795 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.492445 18493 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 1: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:16:55.492707 18307 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:55.493203 18538 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.483218 18568 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.489583 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:55.494413 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:55.494884 18419 raft_consensus.cc:2393] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 1: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:16:55.494988 18342 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.496320 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:55.496888 18560 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.497321 18560 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.473695 18595 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:16:55.497736 18560 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.489502 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.500137 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:55.500178 18491 raft_consensus.cc:2393] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 1: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:16:55.502183 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:55.504631 18342 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:55.505483 18538 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.505802 18458 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:55.506717 18595 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.507187 18595 raft_consensus.cc:697] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:16:55.509317 18560 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.513382 18384 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:55.516103 18568 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.517220 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:55.518101 18560 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.521608 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:55.515961 18618 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:16:55.523072 18308 leader_election.cc:343] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.523262 18491 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.514111 18595 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.533383 18568 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.543177 18536 tablet_bootstrap.cc:492] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:55.543635 18536 ts_tablet_manager.cc:1403] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.018s
I20260709 13:16:55.545475 18491 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:55.546085 18536 raft_consensus.cc:359] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.546759 18536 raft_consensus.cc:385] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.547031 18536 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.547600 18307 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:55.548849 18560 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.549362 18560 raft_consensus.cc:697] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:16:55.549660 18534 tablet_bootstrap.cc:492] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:55.549103 18536 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.550145 18534 ts_tablet_manager.cc:1403] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.144s	user 0.028s	sys 0.007s
I20260709 13:16:55.550930 18533 tablet_bootstrap.cc:654] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.550271 18560 consensus_queue.cc:237] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.552023 18536 ts_tablet_manager.cc:1434] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:55.552903 18536 tablet_bootstrap.cc:492] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:55.553426 18534 raft_consensus.cc:359] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.554190 18534 raft_consensus.cc:385] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.554476 18534 raft_consensus.cc:740] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.563686 18241 catalog_manager.cc:5697] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.567145 18534 consensus_queue.cc:260] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.567545 18614 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.568815 18614 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.574038 18534 ts_tablet_manager.cc:1434] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:16:55.575047 18534 tablet_bootstrap.cc:492] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:55.575616 18536 tablet_bootstrap.cc:654] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.575590 18614 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.614434 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:16:55.616878 18308 leader_election.cc:343] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.618801 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.624765 18534 tablet_bootstrap.cc:654] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:55.625166 18307 leader_election.cc:343] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.625635 18307 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:55.633740 18560 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.640529 18568 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:55.650328 18560 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:55.651286 18241 catalog_manager.cc:5697] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.660702 18572 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.661156 18533 tablet_bootstrap.cc:492] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:55.661603 18533 ts_tablet_manager.cc:1403] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.241s	user 0.010s	sys 0.012s
I20260709 13:16:55.664237 18533 raft_consensus.cc:359] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.664897 18533 raft_consensus.cc:385] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.665153 18533 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.673866 18343 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.674144 18533 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.676548 18533 ts_tablet_manager.cc:1434] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:16:55.677397 18533 tablet_bootstrap.cc:492] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:55.684062 18572 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.685226 18536 tablet_bootstrap.cc:492] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:55.685755 18536 ts_tablet_manager.cc:1403] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.133s	user 0.022s	sys 0.027s
I20260709 13:16:55.693531 18536 raft_consensus.cc:359] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.694199 18536 raft_consensus.cc:385] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.694480 18536 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.695101 18536 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.698226 18533 tablet_bootstrap.cc:654] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.699488 18536 ts_tablet_manager.cc:1434] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:16:55.700265 18536 tablet_bootstrap.cc:492] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:55.714481 18614 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.727843 18617 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.735296 18534 tablet_bootstrap.cc:492] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:55.735781 18534 ts_tablet_manager.cc:1403] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.161s	user 0.024s	sys 0.003s
I20260709 13:16:55.738337 18534 raft_consensus.cc:359] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.738966 18534 raft_consensus.cc:385] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.741772 18533 tablet_bootstrap.cc:492] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:55.742270 18533 ts_tablet_manager.cc:1403] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.005s
I20260709 13:16:55.745007 18536 tablet_bootstrap.cc:654] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.744765 18533 raft_consensus.cc:359] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.746827 18534 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.747749 18534 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.745441 18533 raft_consensus.cc:385] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.750218 18533 raft_consensus.cc:740] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.750896 18534 ts_tablet_manager.cc:1434] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:16:55.751884 18534 tablet_bootstrap.cc:492] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:55.756803 18534 tablet_bootstrap.cc:654] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.758158 18533 consensus_queue.cc:260] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.759752 18536 tablet_bootstrap.cc:492] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:55.760483 18533 ts_tablet_manager.cc:1434] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:16:55.760648 18536 ts_tablet_manager.cc:1403] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.001s
I20260709 13:16:55.761389 18533 tablet_bootstrap.cc:492] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:55.763113 18536 raft_consensus.cc:359] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.763763 18536 raft_consensus.cc:385] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.764043 18536 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.765041 18536 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.767330 18536 ts_tablet_manager.cc:1434] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:16:55.768268 18536 tablet_bootstrap.cc:492] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:55.769323 18533 tablet_bootstrap.cc:654] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.776209 18536 tablet_bootstrap.cc:654] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.781811 18533 tablet_bootstrap.cc:492] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:55.782310 18533 ts_tablet_manager.cc:1403] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.000s
I20260709 13:16:55.785008 18533 raft_consensus.cc:359] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.785641 18533 raft_consensus.cc:385] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.785907 18533 raft_consensus.cc:740] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.786674 18533 consensus_queue.cc:260] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.788642 18533 ts_tablet_manager.cc:1434] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:55.789491 18533 tablet_bootstrap.cc:492] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:55.790966 18534 tablet_bootstrap.cc:492] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:55.791429 18534 ts_tablet_manager.cc:1403] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.004s
I20260709 13:16:55.795212 18533 tablet_bootstrap.cc:654] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.797883 18536 tablet_bootstrap.cc:492] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:55.798401 18536 ts_tablet_manager.cc:1403] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.001s
I20260709 13:16:55.799027 18534 raft_consensus.cc:359] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.799816 18534 raft_consensus.cc:385] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.800143 18534 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.801052 18534 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.801687 18536 raft_consensus.cc:359] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.802455 18536 raft_consensus.cc:385] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.802711 18536 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.803290 18536 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.805770 18536 ts_tablet_manager.cc:1434] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:16:55.803836 18534 ts_tablet_manager.cc:1434] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:16:55.808707 18534 tablet_bootstrap.cc:492] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:55.821627 18536 tablet_bootstrap.cc:492] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:55.823061 18533 tablet_bootstrap.cc:492] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:55.823508 18533 ts_tablet_manager.cc:1403] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.006s
I20260709 13:16:55.825745 18534 tablet_bootstrap.cc:654] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.826119 18533 raft_consensus.cc:359] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.826879 18533 raft_consensus.cc:385] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.827137 18533 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.827733 18533 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.829608 18533 ts_tablet_manager.cc:1434] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:16:55.830471 18533 tablet_bootstrap.cc:492] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:55.831671 18536 tablet_bootstrap.cc:654] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.834559 18572 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.835039 18572 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.836912 18533 tablet_bootstrap.cc:654] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.837227 18572 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:55.842609 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:55.843330 18418 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:55.844455 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.845111 18343 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:55.846460 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:16:55.849370 18384 consensus_peers.cc:597] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:55.849771 18533 tablet_bootstrap.cc:492] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:55.850371 18533 ts_tablet_manager.cc:1403] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 13:16:55.852566 18536 tablet_bootstrap.cc:492] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:55.853053 18536 ts_tablet_manager.cc:1403] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.014s
I20260709 13:16:55.852602 18533 raft_consensus.cc:359] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.853345 18533 raft_consensus.cc:385] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.853628 18533 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.854135 18418 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.854317 18533 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.855597 18536 raft_consensus.cc:359] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.856197 18536 raft_consensus.cc:385] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.856444 18536 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.856545 18533 ts_tablet_manager.cc:1434] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:55.857069 18536 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.857529 18533 tablet_bootstrap.cc:492] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:55.859790 18595 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.860193 18595 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.860540 18595 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.862247 18536 ts_tablet_manager.cc:1434] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:16:55.863127 18536 tablet_bootstrap.cc:492] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:55.863188 18538 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.863710 18538 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.867234 18533 tablet_bootstrap.cc:654] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.867823 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.868510 18491 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:55.869414 18536 tablet_bootstrap.cc:654] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.870357 18382 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:16:55.871215 18565 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.872560 18565 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.872942 18565 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.873265 18565 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.874521 18614 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.880961 18536 tablet_bootstrap.cc:492] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:55.881189 18533 tablet_bootstrap.cc:492] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:55.881412 18536 ts_tablet_manager.cc:1403] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.011s
I20260709 13:16:55.881546 18533 ts_tablet_manager.cc:1403] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.004s
I20260709 13:16:55.882171 18596 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.882668 18596 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.883939 18536 raft_consensus.cc:359] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.884183 18533 raft_consensus.cc:359] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.884588 18536 raft_consensus.cc:385] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.884886 18533 raft_consensus.cc:385] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.884910 18536 raft_consensus.cc:740] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.885478 18533 raft_consensus.cc:740] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.885844 18536 consensus_queue.cc:260] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.886817 18560 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.886871 18533 consensus_queue.cc:260] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.887323 18560 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.889277 18571 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.889724 18571 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.890797 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:55.891744 18571 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.889282 18560 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:16:55.892547 18308 leader_election.cc:343] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.893332 18533 ts_tablet_manager.cc:1434] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:16:55.893386 18617 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.894263 18533 tablet_bootstrap.cc:492] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:55.893937 18617 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.895992 18617 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.896950 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:55.898308 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.900491 18533 tablet_bootstrap.cc:654] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.900561 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.901485 18343 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:55.902601 18536 ts_tablet_manager.cc:1434] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:16:55.903493 18536 tablet_bootstrap.cc:492] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:55.898911 18492 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:55.908454 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.908958 18382 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:16:55.910135 18568 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.910491 18568 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.910835 18568 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.884735 18596 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:55.865751 18538 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.916817 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.916990 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:16:55.917748 18458 leader_election.cc:343] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.917938 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:16:55.918192 18384 leader_election.cc:343] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.919296 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.920338 18307 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:16:55.922483 18307 leader_election.cc:343] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.922940 18307 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:55.924178 18614 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.925171 18560 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.929154 18617 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.929795 18617 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.932533 18617 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.933199 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.933866 18343 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:55.933995 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.935078 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:16:55.935674 18382 leader_election.cc:343] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.936640 18617 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.937107 18617 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.937569 18617 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.943908 18618 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.944568 18618 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.948786 18618 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.950177 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.950613 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.950961 18492 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 1: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:16:55.952179 18382 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:55.953680 18618 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.955845 18595 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.958961 18595 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:55.960474 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:55.961246 18343 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.975811 18538 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.982326 18538 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.984831 18538 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:55.985975 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:55.986263 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:55.987704 18384 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:55.988529 18618 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.988981 18560 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.989122 18538 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:55.984012 18617 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:55.992372 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:55.992944 18344 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.993590 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:16:55.994875 18382 leader_election.cc:343] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.994838 18343 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:55.998407 18617 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:56.001405 18617 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.001864 18617 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.005625 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:56.006546 18595 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.006623 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:56.006927 18560 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.007181 18595 raft_consensus.cc:697] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:16:56.008073 18595 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.008846 18596 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.009725 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:56.002451 18568 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.016242 18419 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 1: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:16:56.014858 18382 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:56.021654 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:56.022543 18416 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.020373 18538 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:56.015587 18617 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:56.058521 18596 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.059079 18596 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.060590 18344 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:56.061980 18565 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.064077 18565 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:56.152773 18533 tablet_bootstrap.cc:492] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:56.153149 18534 tablet_bootstrap.cc:492] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:56.153270 18533 ts_tablet_manager.cc:1403] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.259s	user 0.019s	sys 0.000s
I20260709 13:16:56.153597 18534 ts_tablet_manager.cc:1403] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.345s	user 0.009s	sys 0.013s
I20260709 13:16:56.159469 18536 tablet_bootstrap.cc:654] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.160045 18533 raft_consensus.cc:359] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.161394 18533 raft_consensus.cc:385] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.161615 18533 raft_consensus.cc:740] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.153187 18568 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:56.166064 18533 consensus_queue.cc:260] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.169808 18534 raft_consensus.cc:359] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.170410 18534 raft_consensus.cc:385] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.170683 18534 raft_consensus.cc:740] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.165786 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:56.162123 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:56.175817 18661 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.176364 18661 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.172056 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:56.178145 18490 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.179205 18661 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:56.182617 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:56.182968 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:56.173908 18491 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.184724 18534 consensus_queue.cc:260] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.185634 18533 ts_tablet_manager.cc:1434] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:16:56.186543 18533 tablet_bootstrap.cc:492] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:56.172746 18596 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:56.183554 18344 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:56.186308 18614 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:16:56.188284 18490 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:56.194759 18382 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:16:56.197623 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:56.198897 18344 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.049775 18457 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:16:56.199913 18458 leader_election.cc:343] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.200477 18538 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.200594 18534 ts_tablet_manager.cc:1434] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.001s
I20260709 13:16:56.200667 18458 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:56.201007 18538 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:56.201854 18416 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:56.201820 18538 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.192279 18565 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.223558 18565 raft_consensus.cc:697] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:56.222182 18661 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:56.231734 18534 tablet_bootstrap.cc:492] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:56.226967 18596 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:56.233392 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:56.231564 18661 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.235647 18661 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.226009 18565 consensus_queue.cc:237] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:16:56.230643 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 194627us
I20260709 13:16:56.250159 18491 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:56.306106 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:56.289582 18416 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.288818 18344 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:56.318737 18533 tablet_bootstrap.cc:654] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.307498 18596 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.326099 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:56.329110 18382 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:16:56.345093 18596 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:16:56.357797 18384 leader_election.cc:343] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.359241 18538 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:16:56.357842 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 44569.2us
W20260709 13:16:56.366139 18669 log.cc:927] Time spent T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:16:56.367511 18538 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:56.367924 18534 tablet_bootstrap.cc:654] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.374976 18536 tablet_bootstrap.cc:492] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:56.375574 18536 ts_tablet_manager.cc:1403] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.472s	user 0.008s	sys 0.009s
I20260709 13:16:56.372922 18596 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:56.385418 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:56.386150 18344 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:56.394802 18538 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.389760 18661 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.400238 18458 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:56.401320 18596 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:56.401746 18596 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.402129 18596 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.433183 18670 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.433837 18670 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:16:56.440296 18290 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:56.440995 18536 raft_consensus.cc:359] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.441866 18536 raft_consensus.cc:385] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.442210 18536 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.451661 18239 catalog_manager.cc:5697] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.455623 18534 tablet_bootstrap.cc:492] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:56.456116 18534 ts_tablet_manager.cc:1403] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.225s	user 0.011s	sys 0.014s
I20260709 13:16:56.458669 18534 raft_consensus.cc:359] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.459372 18534 raft_consensus.cc:385] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.459635 18534 raft_consensus.cc:740] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.460271 18534 consensus_queue.cc:260] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:16:56.453287 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 50817.5us
I20260709 13:16:56.462335 18534 ts_tablet_manager.cc:1434] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
W20260709 13:16:56.462909 18457 leader_election.cc:343] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.463302 18534 tablet_bootstrap.cc:492] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:56.463343 18457 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:16:56.464618 18457 leader_election.cc:343] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.466985 18660 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:56.474792 18661 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:56.478211 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:56.470249 18536 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.478838 18343 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:56.482015 18341 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.480551 18596 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.489930 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:56.490499 18343 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.469758 18595 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:16:56.493453 18536 ts_tablet_manager.cc:1434] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 13:16:56.495023 18536 tablet_bootstrap.cc:492] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:56.490726 18670 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:56.490805 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:56.498095 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:56.501435 18491 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 1: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:16:56.502004 18419 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:56.491194 18384 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:56.530777 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:56.531642 18344 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.540272 18533 tablet_bootstrap.cc:492] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:56.540874 18533 ts_tablet_manager.cc:1403] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.355s	user 0.041s	sys 0.013s
I20260709 13:16:56.542835 18678 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:56.543220 18678 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.542048 18595 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:16:56.544277 18678 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.544981 18534 tablet_bootstrap.cc:654] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.544507 18533 raft_consensus.cc:359] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.545814 18533 raft_consensus.cc:385] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.546236 18533 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.544813 18596 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:56.559052 18343 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:56.558764 18533 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:16:56.545724 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 54621.1us
I20260709 13:16:56.562350 18458 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:56.562930 18533 ts_tablet_manager.cc:1434] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:16:56.564080 18533 tablet_bootstrap.cc:492] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:56.565415 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:56.565577 18660 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.566956 18660 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:16:56.567778 18660 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.571609 18534 tablet_bootstrap.cc:492] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:56.572046 18534 ts_tablet_manager.cc:1403] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.008s
I20260709 13:16:56.573431 18344 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:56.574745 18458 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:56.575695 18572 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.576290 18536 tablet_bootstrap.cc:654] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.576177 18572 raft_consensus.cc:697] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:16:56.577123 18572 consensus_queue.cc:237] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.594273 18536 tablet_bootstrap.cc:492] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:56.594760 18536 ts_tablet_manager.cc:1403] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.010s
I20260709 13:16:56.598696 18533 tablet_bootstrap.cc:654] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.589959 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:16:56.590023 18457 leader_election.cc:343] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.592340 18678 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.607460 18534 raft_consensus.cc:359] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.608179 18534 raft_consensus.cc:385] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.608455 18534 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.614538 18534 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.622951 18419 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 1: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:16:56.634660 18534 ts_tablet_manager.cc:1434] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.006s
I20260709 13:16:56.645495 18534 tablet_bootstrap.cc:492] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:56.650946 18536 raft_consensus.cc:359] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.651696 18536 raft_consensus.cc:385] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.651919 18536 raft_consensus.cc:740] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.656577 18536 consensus_queue.cc:260] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.659401 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:56.659404 18595 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:56.660606 18344 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 1: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:16:56.663771 18678 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:56.663671 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:56.666282 18534 tablet_bootstrap.cc:654] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.666365 18384 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:56.668418 18538 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:56.669463 18538 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.673774 18536 ts_tablet_manager.cc:1434] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.078s	user 0.003s	sys 0.003s
I20260709 13:16:56.674607 18533 tablet_bootstrap.cc:492] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:56.675084 18533 ts_tablet_manager.cc:1403] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.111s	user 0.016s	sys 0.001s
I20260709 13:16:56.675575 18536 tablet_bootstrap.cc:492] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:56.685285 18533 raft_consensus.cc:359] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.686062 18533 raft_consensus.cc:385] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.686373 18533 raft_consensus.cc:740] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.687178 18533 consensus_queue.cc:260] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.689741 18533 ts_tablet_manager.cc:1434] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:16:56.690804 18533 tablet_bootstrap.cc:492] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:56.691362 18493 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.701120 18536 tablet_bootstrap.cc:654] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.702729 18595 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.703019 18534 tablet_bootstrap.cc:492] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:56.703483 18534 ts_tablet_manager.cc:1403] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.024s
I20260709 13:16:56.703219 18595 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.705444 18595 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:56.706010 18534 raft_consensus.cc:359] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.706732 18534 raft_consensus.cc:385] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.706694 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:56.707151 18534 raft_consensus.cc:740] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.707109 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:56.707796 18341 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:56.707921 18534 consensus_queue.cc:260] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.709426 18458 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:16:56.710245 18457 leader_election.cc:343] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.710393 18534 ts_tablet_manager.cc:1434] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:56.711282 18534 tablet_bootstrap.cc:492] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:56.711410 18596 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:56.711750 18596 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.712081 18596 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.712805 18533 tablet_bootstrap.cc:654] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.715010 18660 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.715487 18660 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.717731 18534 tablet_bootstrap.cc:654] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.726673 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:56.728312 18534 tablet_bootstrap.cc:492] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
W20260709 13:16:56.728250 18458 leader_election.cc:343] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.728674 18533 tablet_bootstrap.cc:492] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:56.728500 18678 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.729025 18534 ts_tablet_manager.cc:1403] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 13:16:56.730036 18533 ts_tablet_manager.cc:1403] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.004s
I20260709 13:16:56.731645 18534 raft_consensus.cc:359] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.732285 18534 raft_consensus.cc:385] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.732569 18534 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.732688 18536 tablet_bootstrap.cc:492] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:56.733142 18536 ts_tablet_manager.cc:1403] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.058s	user 0.005s	sys 0.007s
I20260709 13:16:56.732991 18533 raft_consensus.cc:359] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.733196 18534 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.734102 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:56.733711 18533 raft_consensus.cc:385] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.735131 18533 raft_consensus.cc:740] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.735672 18534 ts_tablet_manager.cc:1434] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:16:56.735817 18536 raft_consensus.cc:359] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.736567 18534 tablet_bootstrap.cc:492] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:56.735872 18533 consensus_queue.cc:260] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.737421 18419 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:56.733006 18660 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:56.739333 18560 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.739822 18560 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.740648 18533 ts_tablet_manager.cc:1434] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:16:56.741614 18533 tablet_bootstrap.cc:492] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:56.742262 18560 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:56.742678 18534 tablet_bootstrap.cc:654] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.743616 18536 raft_consensus.cc:385] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.743961 18536 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.744661 18536 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.746227 18536 ts_tablet_manager.cc:1434] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 13:16:56.746695 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:56.747189 18536 tablet_bootstrap.cc:492] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:56.748073 18533 tablet_bootstrap.cc:654] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.756878 18457 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:56.758543 18595 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:56.758958 18595 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.759290 18595 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.761193 18536 tablet_bootstrap.cc:654] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.765722 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:56.767679 18307 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:56.769124 18560 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:56.777318 18536 tablet_bootstrap.cc:492] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:56.777854 18536 ts_tablet_manager.cc:1403] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.004s
I20260709 13:16:56.779481 18533 tablet_bootstrap.cc:492] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:56.779976 18533 ts_tablet_manager.cc:1403] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.000s
I20260709 13:16:56.781075 18536 raft_consensus.cc:359] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.781744 18536 raft_consensus.cc:385] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.782037 18536 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.782671 18536 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.782868 18533 raft_consensus.cc:359] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.783665 18533 raft_consensus.cc:385] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.783986 18533 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.785135 18536 ts_tablet_manager.cc:1434] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:56.784822 18533 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.785426 18538 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.786121 18536 tablet_bootstrap.cc:492] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:56.792544 18595 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.795011 18596 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.795710 18533 ts_tablet_manager.cc:1434] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:16:56.795390 18242 catalog_manager.cc:5697] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.797233 18533 tablet_bootstrap.cc:492] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:56.797178 18242 catalog_manager.cc:5697] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.792189 18536 tablet_bootstrap.cc:654] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.799396 18242 catalog_manager.cc:5697] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.800689 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:56.801260 18341 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.802752 18595 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:56.808473 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:56.809036 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:56.820432 18419 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:56.810092 18458 leader_election.cc:343] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.828150 18341 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:56.829162 18344 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.829349 18458 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:56.831084 18660 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.831593 18660 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:16:56.809391 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:56.832453 18660 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.833179 18416 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.834160 18560 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.834988 18533 tablet_bootstrap.cc:654] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.834628 18560 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.805833 18596 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:56.844053 18239 catalog_manager.cc:5697] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.846038 18560 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:56.846354 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:56.846417 18239 catalog_manager.cc:5697] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:56.848562 18308 leader_election.cc:343] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.849300 18416 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:56.852236 18536 tablet_bootstrap.cc:492] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:56.852692 18536 ts_tablet_manager.cc:1403] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.006s
I20260709 13:16:56.853462 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:56.854127 18490 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:56.855844 18533 tablet_bootstrap.cc:492] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:56.855772 18307 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:56.856421 18533 ts_tablet_manager.cc:1403] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.004s
I20260709 13:16:56.856554 18560 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:56.856959 18560 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.857290 18560 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.852703 18419 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:56.866740 18533 raft_consensus.cc:359] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.871418 18533 raft_consensus.cc:385] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.871697 18533 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.872294 18533 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.876408 18536 raft_consensus.cc:359] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.876701 18457 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:56.877120 18536 raft_consensus.cc:385] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.877394 18536 raft_consensus.cc:740] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.878034 18536 consensus_queue.cc:260] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.880017 18536 ts_tablet_manager.cc:1434] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:16:56.880815 18536 tablet_bootstrap.cc:492] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:56.882654 18241 catalog_manager.cc:5697] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.884106 18660 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.885058 18660 raft_consensus.cc:697] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:16:56.885555 18533 ts_tablet_manager.cc:1434] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.001s
I20260709 13:16:56.894305 18533 tablet_bootstrap.cc:492] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:56.896196 18568 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:56.907116 18534 tablet_bootstrap.cc:492] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:56.890516 18660 consensus_queue.cc:237] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.892627 18536 tablet_bootstrap.cc:654] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.885949 18571 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.907629 18534 ts_tablet_manager.cc:1403] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.171s	user 0.031s	sys 0.021s
I20260709 13:16:56.907756 18571 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.908313 18533 tablet_bootstrap.cc:654] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.912050 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:56.912279 18571 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:56.888818 18560 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.912916 18419 raft_consensus.cc:2393] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 1: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:16:56.912130 18534 raft_consensus.cc:359] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.914228 18534 raft_consensus.cc:385] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.914523 18534 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.918035 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:56.918569 18490 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.919999 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:56.920619 18419 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.922188 18568 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.922611 18568 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.924590 18568 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:56.924031 18241 catalog_manager.cc:5697] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.925405 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:56.925997 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:56.926134 18341 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:56.926587 18493 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:56.927450 18384 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:56.928110 18534 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.928704 18568 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:56.928970 18490 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:56.930163 18307 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:56.929056 18568 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.930482 18534 ts_tablet_manager.cc:1434] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.004s
I20260709 13:16:56.930845 18568 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.931021 18571 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.931450 18534 tablet_bootstrap.cc:492] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:56.931643 18571 raft_consensus.cc:697] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:16:56.932478 18571 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.935671 18560 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:56.936615 18678 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.938213 18534 tablet_bootstrap.cc:654] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.946246 18536 tablet_bootstrap.cc:492] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:56.946689 18678 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:56.946704 18536 ts_tablet_manager.cc:1403] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.066s	user 0.005s	sys 0.008s
I20260709 13:16:56.954317 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:56.958506 18307 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:56.959748 18560 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.980540 18534 tablet_bootstrap.cc:492] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:56.981158 18534 ts_tablet_manager.cc:1403] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.004s
I20260709 13:16:56.981086 18536 raft_consensus.cc:359] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.983779 18536 raft_consensus.cc:385] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.984195 18536 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.985039 18536 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:56.995144 18536 ts_tablet_manager.cc:1434] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:16:56.996297 18536 tablet_bootstrap.cc:492] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:57.004153 18571 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.996301 18560 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.007180 18571 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.008757 18419 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:57.015803 18660 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.018211 18568 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.024451 18670 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.025182 18670 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.028020 18670 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.031956 18568 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.037706 18534 raft_consensus.cc:359] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.038533 18534 raft_consensus.cc:385] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.039165 18534 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.039932 18534 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.043126 18534 ts_tablet_manager.cc:1434] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.003s
I20260709 13:16:57.043814 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:57.044473 18339 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.044097 18534 tablet_bootstrap.cc:492] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:57.045112 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:16:57.047057 18308 leader_election.cc:343] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.050227 18533 tablet_bootstrap.cc:492] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:57.050645 18533 ts_tablet_manager.cc:1403] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.157s	user 0.013s	sys 0.019s
I20260709 13:16:57.052857 18560 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.052912 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:57.053385 18560 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.053824 18491 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.056496 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:57.057142 18419 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:57.058235 18308 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:57.059051 18614 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.059401 18614 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.059713 18614 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.060006 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:57.060596 18493 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:57.061658 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:16:57.051710 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:57.066100 18678 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.066476 18678 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.067633 18678 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.069711 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:57.070429 18492 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:57.072448 18242 catalog_manager.cc:5697] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.080327 18533 raft_consensus.cc:359] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.080415 18678 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.081660 18533 raft_consensus.cc:385] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.077171 18614 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.082067 18533 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.087777 18340 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 1: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:16:57.066780 18571 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.093480 18339 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:57.103897 18384 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:57.104825 18538 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.105311 18538 raft_consensus.cc:697] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:57.097116 18560 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.107509 18678 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.107071 18538 consensus_queue.cc:237] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.108947 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:57.109563 18492 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.110433 18534 tablet_bootstrap.cc:654] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.098510 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:57.112746 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:57.113500 18536 tablet_bootstrap.cc:654] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.117484 18660 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.118322 18492 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:57.110968 18493 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:57.113711 18533 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.125169 18307 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:57.126075 18571 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.126489 18571 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.126852 18571 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.129472 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:57.130573 18419 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 1: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:16:57.131212 18533 ts_tablet_manager.cc:1434] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.080s	user 0.015s	sys 0.011s
I20260709 13:16:57.132264 18533 tablet_bootstrap.cc:492] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:57.139672 18534 tablet_bootstrap.cc:492] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:57.140093 18534 ts_tablet_manager.cc:1403] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.014s
I20260709 13:16:57.145843 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:57.145740 18534 raft_consensus.cc:359] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.146459 18534 raft_consensus.cc:385] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.146718 18534 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.146749 18678 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.116578 18491 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:57.147418 18534 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.147365 18678 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:57.152536 18678 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.153702 18614 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.157325 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:57.158133 18491 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 1: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:16:57.159073 18307 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:57.150259 18571 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.162456 18419 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.162814 18560 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.162650 18242 catalog_manager.cc:5697] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.170485 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:57.171229 18571 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.170836 18534 ts_tablet_manager.cc:1434] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
W20260709 13:16:57.171981 18308 leader_election.cc:343] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.201423 18534 tablet_bootstrap.cc:492] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:57.191478 18595 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.207170 18595 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.209064 18596 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.211319 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:57.211337 18533 tablet_bootstrap.cc:654] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.173722 18660 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:16:57.213743 18595 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:16:57.214469 18458 leader_election.cc:343] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.172117 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:57.231863 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:57.222788 18491 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:57.247386 18457 leader_election.cc:343] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.247840 18457 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:57.248570 18660 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.254490 18536 tablet_bootstrap.cc:492] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:57.254947 18536 ts_tablet_manager.cc:1403] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.259s	user 0.020s	sys 0.010s
I20260709 13:16:57.255945 18534 tablet_bootstrap.cc:654] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.272080 18536 raft_consensus.cc:359] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.272790 18536 raft_consensus.cc:385] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.273046 18536 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.276473 18242 catalog_manager.cc:5697] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.280820 18596 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.279086 18536 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.275008 18491 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:57.290303 18534 tablet_bootstrap.cc:492] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:57.290805 18534 ts_tablet_manager.cc:1403] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.000s
I20260709 13:16:57.293278 18533 tablet_bootstrap.cc:492] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:57.293699 18533 ts_tablet_manager.cc:1403] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.162s	user 0.008s	sys 0.004s
I20260709 13:16:57.293743 18307 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:57.295101 18536 ts_tablet_manager.cc:1434] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260709 13:16:57.295969 18536 tablet_bootstrap.cc:492] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:57.297093 18571 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.298300 18571 raft_consensus.cc:697] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:16:57.298873 18534 raft_consensus.cc:359] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.299526 18534 raft_consensus.cc:385] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.299165 18571 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.299801 18534 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.300545 18534 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.310281 18534 ts_tablet_manager.cc:1434] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:16:57.311292 18534 tablet_bootstrap.cc:492] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:57.315734 18533 raft_consensus.cc:359] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.316457 18533 raft_consensus.cc:385] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.316758 18533 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.317389 18533 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.322492 18533 ts_tablet_manager.cc:1434] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:16:57.323390 18533 tablet_bootstrap.cc:492] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:57.323451 18660 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.327867 18660 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:57.346143 18239 catalog_manager.cc:5697] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.349818 18571 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.363521 18534 tablet_bootstrap.cc:654] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.377161 18661 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:57.404349 18571 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.405037 18571 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.412737 18536 tablet_bootstrap.cc:654] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.422974 18571 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.425701 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:57.426069 18660 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.426548 18660 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.428721 18660 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:16:57.436647 18307 leader_election.cc:343] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.437150 18533 tablet_bootstrap.cc:654] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.449573 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:57.454823 18536 tablet_bootstrap.cc:492] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:57.455266 18536 ts_tablet_manager.cc:1403] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.160s	user 0.015s	sys 0.006s
W20260709 13:16:57.455816 18458 leader_election.cc:343] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.455874 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:16:57.460359 18457 leader_election.cc:343] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.460796 18457 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:57.458920 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:57.461874 18660 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.462152 18417 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:57.463236 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:57.464329 18571 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.464691 18571 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.465061 18571 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.470422 18534 tablet_bootstrap.cc:492] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:57.473136 18534 ts_tablet_manager.cc:1403] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.162s	user 0.013s	sys 0.011s
I20260709 13:16:57.471709 18536 raft_consensus.cc:359] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.474041 18536 raft_consensus.cc:385] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.474325 18536 raft_consensus.cc:740] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.474926 18536 consensus_queue.cc:260] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.477267 18536 ts_tablet_manager.cc:1434] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:16:57.481149 18536 tablet_bootstrap.cc:492] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:57.482682 18560 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.512463 18534 raft_consensus.cc:359] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.513206 18534 raft_consensus.cc:385] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.513489 18534 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.514142 18534 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.515345 18568 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.497808 18571 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.516398 18536 tablet_bootstrap.cc:654] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.519317 18571 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.521984 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:57.527019 18417 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.529656 18534 ts_tablet_manager.cc:1434] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:16:57.530697 18534 tablet_bootstrap.cc:492] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:57.534628 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:16:57.535989 18307 leader_election.cc:343] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.538177 18417 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:57.543849 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:57.544646 18571 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.545370 18533 tablet_bootstrap.cc:492] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:57.545706 18533 ts_tablet_manager.cc:1403] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.223s	user 0.018s	sys 0.026s
I20260709 13:16:57.546000 18571 raft_consensus.cc:697] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:16:57.548147 18571 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.549736 18533 raft_consensus.cc:359] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.550551 18533 raft_consensus.cc:385] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.550913 18533 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.551637 18533 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.561714 18533 ts_tablet_manager.cc:1434] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:16:57.577391 18533 tablet_bootstrap.cc:492] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
W20260709 13:16:57.576390 18290 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:57.580252 18678 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:57.583837 18533 tablet_bootstrap.cc:654] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.589318 18536 tablet_bootstrap.cc:492] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:57.590888 18536 ts_tablet_manager.cc:1403] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.009s
I20260709 13:16:57.590955 18670 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.599558 18536 raft_consensus.cc:359] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.600265 18536 raft_consensus.cc:385] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.600560 18536 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.602941 18534 tablet_bootstrap.cc:654] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.603996 18536 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.606069 18536 ts_tablet_manager.cc:1434] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:16:57.606945 18536 tablet_bootstrap.cc:492] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:57.612700 18536 tablet_bootstrap.cc:654] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.612720 18242 catalog_manager.cc:5697] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.638724 18534 tablet_bootstrap.cc:492] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:57.639169 18534 ts_tablet_manager.cc:1403] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.109s	user 0.009s	sys 0.003s
I20260709 13:16:57.642993 18571 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.643486 18571 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.645463 18571 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.650197 18660 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.650645 18533 tablet_bootstrap.cc:492] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:57.651106 18533 ts_tablet_manager.cc:1403] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.005s
I20260709 13:16:57.653281 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:57.650682 18660 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.655262 18534 raft_consensus.cc:359] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.655921 18534 raft_consensus.cc:385] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.656004 18660 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:57.655579 18533 raft_consensus.cc:359] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.656574 18533 raft_consensus.cc:385] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.656860 18533 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.657038 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:57.657881 18536 tablet_bootstrap.cc:492] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:57.658336 18536 ts_tablet_manager.cc:1403] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.006s
I20260709 13:16:57.658721 18538 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.658984 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:16:57.660393 18458 leader_election.cc:343] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.660919 18536 raft_consensus.cc:359] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.661298 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:57.661576 18536 raft_consensus.cc:385] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.656244 18534 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.661854 18536 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.662364 18534 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.662489 18536 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.664528 18534 ts_tablet_manager.cc:1434] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:16:57.665393 18536 ts_tablet_manager.cc:1434] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:16:57.665156 18533 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.667199 18533 ts_tablet_manager.cc:1434] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
W20260709 13:16:57.667815 18457 leader_election.cc:343] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:57.668092 18307 leader_election.cc:343] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.668226 18457 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:57.669404 18596 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.671736 18417 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:57.676818 18308 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:57.677963 18571 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.678315 18571 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.678638 18571 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.679554 18536 tablet_bootstrap.cc:492] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:57.680693 18614 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.681115 18614 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.682984 18614 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.684345 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:16:57.685773 18307 leader_election.cc:343] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.687506 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:57.687970 18533 tablet_bootstrap.cc:492] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
W20260709 13:16:57.688804 18308 leader_election.cc:343] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.689235 18308 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:57.690239 18614 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.690961 18534 tablet_bootstrap.cc:492] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:57.692474 18571 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.695590 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:57.695927 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:57.696453 18417 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.696743 18571 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:16:57.696830 18307 leader_election.cc:343] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.702858 18536 tablet_bootstrap.cc:654] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.704689 18533 tablet_bootstrap.cc:654] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.707851 18417 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:57.707223 18534 tablet_bootstrap.cc:654] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.710144 18308 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:57.711004 18571 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.711477 18571 raft_consensus.cc:697] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:16:57.712277 18571 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.714303 18536 tablet_bootstrap.cc:492] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:57.715205 18536 ts_tablet_manager.cc:1403] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.004s
I20260709 13:16:57.717741 18536 raft_consensus.cc:359] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.719547 18536 raft_consensus.cc:385] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.719836 18536 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.720448 18536 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.721938 18536 ts_tablet_manager.cc:1434] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:57.724174 18536 tablet_bootstrap.cc:492] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:57.724434 18538 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.724639 18534 tablet_bootstrap.cc:492] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:57.725190 18534 ts_tablet_manager.cc:1403] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.005s
I20260709 13:16:57.724896 18538 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.729444 18538 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.729647 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:57.729794 18534 raft_consensus.cc:359] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.730479 18493 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 1: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:16:57.730726 18533 tablet_bootstrap.cc:492] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:57.731087 18534 raft_consensus.cc:385] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.731633 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:57.732549 18536 tablet_bootstrap.cc:654] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.731698 18533 ts_tablet_manager.cc:1403] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.007s
I20260709 13:16:57.733325 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:57.734325 18538 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.736915 18533 raft_consensus.cc:359] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.737646 18533 raft_consensus.cc:385] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.732251 18534 raft_consensus.cc:740] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.738056 18533 raft_consensus.cc:740] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.738427 18534 consensus_queue.cc:260] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.740453 18534 ts_tablet_manager.cc:1434] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.003s
I20260709 13:16:57.741551 18534 tablet_bootstrap.cc:492] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:57.741796 18239 catalog_manager.cc:5697] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.747278 18534 tablet_bootstrap.cc:654] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.748407 18538 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.750417 18536 tablet_bootstrap.cc:492] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:57.754148 18536 ts_tablet_manager.cc:1403] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.008s
I20260709 13:16:57.756820 18536 raft_consensus.cc:359] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.757472 18536 raft_consensus.cc:385] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.757738 18536 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.758366 18536 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.761052 18536 ts_tablet_manager.cc:1434] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:57.762228 18536 tablet_bootstrap.cc:492] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:57.769100 18571 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.769742 18571 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.772338 18571 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.773388 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:57.774314 18536 tablet_bootstrap.cc:654] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.773978 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:16:57.775848 18308 leader_election.cc:343] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.774039 18491 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:57.787206 18307 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:57.789345 18614 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.789834 18614 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.738850 18533 consensus_queue.cc:260] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.790222 18614 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.802273 18571 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.802513 18536 tablet_bootstrap.cc:492] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:57.803143 18536 ts_tablet_manager.cc:1403] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.009s
I20260709 13:16:57.802886 18571 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.807000 18536 raft_consensus.cc:359] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.807926 18536 raft_consensus.cc:385] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.808382 18571 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.809566 18596 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.810184 18596 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.810537 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:57.811388 18493 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:57.812520 18596 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:57.808248 18536 raft_consensus.cc:740] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.813964 18536 consensus_queue.cc:260] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.817035 18307 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:57.818523 18560 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.818941 18560 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.819610 18560 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.823547 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:57.836829 18536 ts_tablet_manager.cc:1434] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:16:57.838718 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:57.839795 18414 raft_consensus.cc:2393] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 1: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:16:57.840415 18571 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.849694 18755 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:57.851107 18457 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:57.851423 18536 tablet_bootstrap.cc:492] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:57.852958 18661 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.870357 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:57.879555 18536 tablet_bootstrap.cc:654] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:57.879527 18308 leader_election.cc:343] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.883085 18560 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.891646 18536 tablet_bootstrap.cc:492] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:57.910275 18536 ts_tablet_manager.cc:1403] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.000s
I20260709 13:16:57.892992 18533 ts_tablet_manager.cc:1434] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.159s	user 0.003s	sys 0.003s
I20260709 13:16:57.915656 18533 tablet_bootstrap.cc:492] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:57.913655 18536 raft_consensus.cc:359] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.919656 18536 raft_consensus.cc:385] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.919938 18536 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.865751 18614 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.925982 18536 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:57.928720 18536 ts_tablet_manager.cc:1434] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:16:57.928644 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:57.929749 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:16:57.930640 18308 leader_election.cc:343] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:57.931466 18308 leader_election.cc:343] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.932636 18560 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.934017 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:57.934774 18491 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.945031 18536 tablet_bootstrap.cc:492] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:57.897732 18661 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.954787 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:57.955526 18493 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.978062 18754 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:57.982463 18493 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:57.984258 18307 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:57.953727 18614 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:57.985142 18754 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.989092 18754 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:16:57.980039 18491 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:57.989948 18754 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.008134 18307 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:58.008523 18534 tablet_bootstrap.cc:492] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:58.009027 18534 ts_tablet_manager.cc:1403] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.268s	user 0.058s	sys 0.100s
I20260709 13:16:58.008934 18614 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.009526 18614 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:16:58.010658 18614 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.019034 18534 raft_consensus.cc:359] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.019866 18534 raft_consensus.cc:385] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.020143 18534 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.020771 18534 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.022571 18534 ts_tablet_manager.cc:1434] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:16:58.023692 18534 tablet_bootstrap.cc:492] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:58.027658 18533 tablet_bootstrap.cc:654] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.029716 18534 tablet_bootstrap.cc:654] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.031271 18571 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.032866 18536 tablet_bootstrap.cc:654] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.057994 18533 tablet_bootstrap.cc:492] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:58.058444 18533 ts_tablet_manager.cc:1403] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.143s	user 0.008s	sys 0.005s
I20260709 13:16:58.063025 18536 tablet_bootstrap.cc:492] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:58.063436 18536 ts_tablet_manager.cc:1403] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.000s
I20260709 13:16:58.062402 18239 catalog_manager.cc:5697] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.070540 18536 raft_consensus.cc:359] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.072604 18533 raft_consensus.cc:359] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.073221 18536 raft_consensus.cc:385] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.073756 18536 raft_consensus.cc:740] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.074473 18536 consensus_queue.cc:260] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.073221 18533 raft_consensus.cc:385] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.076967 18533 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.078737 18536 ts_tablet_manager.cc:1434] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:16:58.079710 18536 tablet_bootstrap.cc:492] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:58.077725 18533 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.087071 18533 ts_tablet_manager.cc:1434] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:16:58.088038 18533 tablet_bootstrap.cc:492] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:58.095160 18536 tablet_bootstrap.cc:654] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.106853 18534 tablet_bootstrap.cc:492] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:58.106573 18241 catalog_manager.cc:5697] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.107754 18534 ts_tablet_manager.cc:1403] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.084s	user 0.021s	sys 0.041s
I20260709 13:16:58.110278 18534 raft_consensus.cc:359] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.110903 18534 raft_consensus.cc:385] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.111162 18534 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.111805 18534 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.112692 18533 tablet_bootstrap.cc:654] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.114100 18534 ts_tablet_manager.cc:1434] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:58.114984 18534 tablet_bootstrap.cc:492] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:58.117305 18536 tablet_bootstrap.cc:492] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:58.117794 18536 ts_tablet_manager.cc:1403] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.002s
I20260709 13:16:58.120609 18534 tablet_bootstrap.cc:654] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.120738 18536 raft_consensus.cc:359] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.121527 18536 raft_consensus.cc:385] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.121806 18536 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.125784 18536 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.129982 18533 tablet_bootstrap.cc:492] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:58.130466 18533 ts_tablet_manager.cc:1403] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.007s
I20260709 13:16:58.136943 18534 tablet_bootstrap.cc:492] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:58.137501 18534 ts_tablet_manager.cc:1403] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 13:16:58.139338 18536 ts_tablet_manager.cc:1434] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:16:58.139911 18754 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.140334 18534 raft_consensus.cc:359] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.140426 18754 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.141185 18534 raft_consensus.cc:385] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.141569 18534 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.141064 18533 raft_consensus.cc:359] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.142304 18533 raft_consensus.cc:385] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.142611 18533 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.142565 18534 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.144461 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:58.145586 18491 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:58.147540 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:58.149154 18534 ts_tablet_manager.cc:1434] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:16:58.150166 18534 tablet_bootstrap.cc:492] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:58.151091 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:58.142795 18754 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.152014 18754 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.152405 18754 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.152794 18754 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.157299 18534 tablet_bootstrap.cc:654] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.140383 18536 tablet_bootstrap.cc:492] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:58.166824 18533 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.169971 18560 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.170702 18560 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.172307 18414 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:58.174028 18560 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.179031 18661 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.179533 18661 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.181679 18661 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:58.179939 18533 ts_tablet_manager.cc:1434] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 13:16:58.182808 18533 tablet_bootstrap.cc:492] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:58.184283 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:58.184369 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:58.185432 18754 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:16:58.187250 18457 leader_election.cc:343] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.188062 18754 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:16:58.189518 18307 leader_election.cc:343] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.190568 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:58.190758 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:58.191198 18339 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:58.191300 18417 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.192529 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:58.194332 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:58.194840 18491 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.198441 18568 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.199021 18568 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.202260 18417 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:58.203359 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:58.203919 18344 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:58.206122 18384 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:58.208638 18678 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.209004 18678 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:58.209184 18308 leader_election.cc:343] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.209728 18308 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:58.209344 18678 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.210562 18754 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:58.211587 18458 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:58.212978 18660 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.213341 18660 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.213639 18568 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.213672 18660 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.215132 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:16:58.217253 18382 leader_election.cc:343] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.219121 18534 tablet_bootstrap.cc:492] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:58.219520 18534 ts_tablet_manager.cc:1403] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.017s
I20260709 13:16:58.222990 18308 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:58.224422 18754 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.224869 18754 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:16:58.225481 18754 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.229377 18660 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.233213 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:58.236109 18491 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:58.239053 18344 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.242060 18533 tablet_bootstrap.cc:654] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.245848 18678 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.249511 18536 tablet_bootstrap.cc:654] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.251760 18344 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:58.252262 18242 catalog_manager.cc:5697] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.253252 18458 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:58.254110 18661 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.254567 18661 raft_consensus.cc:697] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:16:58.255350 18661 consensus_queue.cc:237] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.255828 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:16:58.257004 18457 leader_election.cc:343] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.256916 18560 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.257753 18660 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:58.262550 18534 raft_consensus.cc:359] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.263296 18534 raft_consensus.cc:385] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.263574 18534 raft_consensus.cc:740] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.264891 18754 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.266347 18678 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.268292 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:58.270136 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:58.279824 18339 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.265494 18754 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.281517 18533 tablet_bootstrap.cc:492] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:58.281997 18533 ts_tablet_manager.cc:1403] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.099s	user 0.005s	sys 0.008s
I20260709 13:16:58.283181 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:58.283567 18754 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.283833 18417 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:58.284605 18533 raft_consensus.cc:359] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.285262 18533 raft_consensus.cc:385] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.285553 18533 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.285822 18308 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:58.286229 18533 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.287482 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:58.288100 18493 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:58.289808 18754 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.290210 18754 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.290549 18754 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.293316 18339 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:58.295071 18533 ts_tablet_manager.cc:1434] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:16:58.293732 18239 catalog_manager.cc:5697] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:58.295956 18533 tablet_bootstrap.cc:492] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:58.297885 18384 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:58.299017 18678 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.299482 18678 raft_consensus.cc:697] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:58.300311 18678 consensus_queue.cc:237] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.302205 18533 tablet_bootstrap.cc:654] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.308640 18493 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.326182 18534 consensus_queue.cc:260] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.328626 18754 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.330102 18491 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.331593 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:58.331634 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:58.332234 18492 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.332290 18419 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.332818 18534 ts_tablet_manager.cc:1434] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.113s	user 0.000s	sys 0.010s
I20260709 13:16:58.333719 18534 tablet_bootstrap.cc:492] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:58.338003 18536 tablet_bootstrap.cc:492] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:58.338792 18419 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:58.339387 18492 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:58.339736 18536 ts_tablet_manager.cc:1403] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.200s	user 0.007s	sys 0.013s
I20260709 13:16:58.340418 18307 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:58.341701 18571 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.342187 18571 raft_consensus.cc:697] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:16:58.342583 18536 raft_consensus.cc:359] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.343297 18536 raft_consensus.cc:385] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.342942 18571 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.343575 18536 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.345329 18536 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.346025 18614 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.346917 18536 ts_tablet_manager.cc:1434] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:58.347714 18536 tablet_bootstrap.cc:492] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:58.328924 18242 catalog_manager.cc:5697] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.351549 18754 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.357172 18491 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:58.358006 18596 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.358449 18596 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.364120 18596 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:58.364352 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:58.365018 18339 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:58.365774 18533 tablet_bootstrap.cc:492] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:58.366240 18533 ts_tablet_manager.cc:1403] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.070s	user 0.021s	sys 0.004s
I20260709 13:16:58.366096 18458 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:58.366902 18596 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:58.367275 18596 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.367657 18596 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.368906 18533 raft_consensus.cc:359] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.368703 18239 catalog_manager.cc:5697] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.369552 18533 raft_consensus.cc:385] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.370428 18533 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.371069 18533 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.371869 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:58.373309 18533 ts_tablet_manager.cc:1434] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:16:58.378629 18534 tablet_bootstrap.cc:654] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.379233 18596 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.381846 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:58.382014 18596 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:58.382424 18339 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.384572 18536 tablet_bootstrap.cc:654] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.386309 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:58.387112 18533 tablet_bootstrap.cc:492] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:58.389514 18339 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:16:58.390708 18458 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:58.391628 18596 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:58.392786 18596 raft_consensus.cc:697] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:16:58.393460 18533 tablet_bootstrap.cc:654] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.393575 18596 consensus_queue.cc:237] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.402840 18534 tablet_bootstrap.cc:492] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:58.403400 18534 ts_tablet_manager.cc:1403] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.000s
I20260709 13:16:58.407353 18534 raft_consensus.cc:359] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.408214 18534 raft_consensus.cc:385] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.408540 18534 raft_consensus.cc:740] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.409351 18534 consensus_queue.cc:260] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.414927 18534 ts_tablet_manager.cc:1434] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:16:58.414526 18242 catalog_manager.cc:5697] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 2 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:58.416991 18534 tablet_bootstrap.cc:492] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:58.426767 18534 tablet_bootstrap.cc:654] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.440083 18571 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.440618 18571 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.442625 18571 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.444051 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:16:58.446498 18308 leader_election.cc:343] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.450809 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:58.454557 18536 tablet_bootstrap.cc:492] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:58.455173 18536 ts_tablet_manager.cc:1403] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.108s	user 0.014s	sys 0.000s
W20260709 13:16:58.456488 18307 leader_election.cc:343] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.457059 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:58.458264 18571 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:58.461591 18536 raft_consensus.cc:359] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.462453 18536 raft_consensus.cc:385] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.462738 18536 raft_consensus.cc:740] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.463591 18536 consensus_queue.cc:260] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.464632 18534 tablet_bootstrap.cc:492] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:58.465068 18534 ts_tablet_manager.cc:1403] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.000s
I20260709 13:16:58.465695 18536 ts_tablet_manager.cc:1434] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:16:58.467033 18536 tablet_bootstrap.cc:492] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:58.467383 18534 raft_consensus.cc:359] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.468009 18534 raft_consensus.cc:385] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.468240 18534 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.468945 18534 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.470755 18533 tablet_bootstrap.cc:492] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:58.471475 18533 ts_tablet_manager.cc:1403] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.097s	user 0.028s	sys 0.030s
I20260709 13:16:58.473348 18536 tablet_bootstrap.cc:654] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.474455 18533 raft_consensus.cc:359] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.475162 18533 raft_consensus.cc:385] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.475466 18533 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.476132 18533 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.477039 18617 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.477521 18617 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.479496 18617 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.480026 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:58.481714 18533 ts_tablet_manager.cc:1434] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:16:58.483215 18533 tablet_bootstrap.cc:492] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:58.483831 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:58.484829 18492 raft_consensus.cc:2393] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 1: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:16:58.486531 18382 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:58.487632 18617 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.487768 18536 tablet_bootstrap.cc:492] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:58.488209 18536 ts_tablet_manager.cc:1403] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 13:16:58.492251 18536 raft_consensus.cc:359] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.492951 18536 raft_consensus.cc:385] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.493203 18536 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.497944 18536 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.498564 18533 tablet_bootstrap.cc:654] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.500562 18536 ts_tablet_manager.cc:1434] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:16:58.502141 18536 tablet_bootstrap.cc:492] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:58.516844 18617 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:58.520339 18533 tablet_bootstrap.cc:492] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:58.521034 18533 ts_tablet_manager.cc:1403] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.003s
I20260709 13:16:58.523252 18534 ts_tablet_manager.cc:1434] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.000s
I20260709 13:16:58.524263 18533 raft_consensus.cc:359] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.526721 18533 raft_consensus.cc:385] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.528189 18533 raft_consensus.cc:740] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.527894 18534 tablet_bootstrap.cc:492] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:58.530143 18533 consensus_queue.cc:260] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.530731 18536 tablet_bootstrap.cc:654] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.536599 18534 tablet_bootstrap.cc:654] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.537331 18533 ts_tablet_manager.cc:1434] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:16:58.538621 18533 tablet_bootstrap.cc:492] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:58.543958 18533 tablet_bootstrap.cc:654] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.550439 18534 tablet_bootstrap.cc:492] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:58.550887 18534 ts_tablet_manager.cc:1403] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:16:58.557118 18756 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.572185 18536 tablet_bootstrap.cc:492] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:58.572623 18536 ts_tablet_manager.cc:1403] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.009s
I20260709 13:16:58.577268 18617 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.577512 18308 consensus_peers.cc:597] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:58.577808 18617 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.580034 18617 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.582616 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:58.583666 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:58.584224 18491 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:16:58.585325 18382 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:16:58.585963 18384 leader_election.cc:343] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.586859 18617 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.587294 18617 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.587638 18617 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.595283 18536 raft_consensus.cc:359] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.595683 18617 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.596045 18536 raft_consensus.cc:385] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.596370 18536 raft_consensus.cc:740] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.597020 18536 consensus_queue.cc:260] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.598929 18533 tablet_bootstrap.cc:492] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:58.599327 18533 ts_tablet_manager.cc:1403] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.020s
I20260709 13:16:58.601907 18536 ts_tablet_manager.cc:1434] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:16:58.601797 18533 raft_consensus.cc:359] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.602463 18533 raft_consensus.cc:385] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.602721 18533 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.603299 18533 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.605221 18533 ts_tablet_manager.cc:1434] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:58.595124 18534 raft_consensus.cc:359] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.606119 18534 raft_consensus.cc:385] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.606374 18534 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.606969 18534 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.608805 18534 ts_tablet_manager.cc:1434] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.058s	user 0.004s	sys 0.000s
I20260709 13:16:58.609640 18534 tablet_bootstrap.cc:492] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:58.612030 18533 tablet_bootstrap.cc:492] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:58.616544 18571 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.618454 18571 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.621685 18536 tablet_bootstrap.cc:492] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:58.627957 18534 tablet_bootstrap.cc:654] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.625797 18533 tablet_bootstrap.cc:654] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.640964 18617 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.641660 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:16:58.643093 18384 leader_election.cc:343] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.644181 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:58.644840 18493 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.648975 18536 tablet_bootstrap.cc:654] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.650978 18534 tablet_bootstrap.cc:492] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:58.651409 18534 ts_tablet_manager.cc:1403] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 13:16:58.663414 18534 raft_consensus.cc:359] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.664112 18534 raft_consensus.cc:385] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.664379 18534 raft_consensus.cc:740] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.665544 18536 tablet_bootstrap.cc:492] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:58.666550 18536 ts_tablet_manager.cc:1403] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 13:16:58.666267 18534 consensus_queue.cc:260] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.669512 18533 tablet_bootstrap.cc:492] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:58.669986 18533 ts_tablet_manager.cc:1403] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.002s
I20260709 13:16:58.669545 18534 ts_tablet_manager.cc:1434] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:16:58.672540 18533 raft_consensus.cc:359] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.673159 18534 tablet_bootstrap.cc:492] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:58.673205 18533 raft_consensus.cc:385] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.673627 18533 raft_consensus.cc:740] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.674270 18533 consensus_queue.cc:260] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.677309 18536 raft_consensus.cc:359] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.678038 18536 raft_consensus.cc:385] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.678349 18536 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.678452 18571 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.678944 18571 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.679164 18536 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.681537 18536 ts_tablet_manager.cc:1434] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 13:16:58.681792 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:58.682466 18417 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:58.682694 18536 tablet_bootstrap.cc:492] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:58.682819 18571 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.683697 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:58.684293 18492 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:58.685096 18533 ts_tablet_manager.cc:1434] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:16:58.685518 18307 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:58.686112 18533 tablet_bootstrap.cc:492] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:58.686318 18571 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.687461 18571 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.687779 18571 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.677655 18493 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:16:58.693420 18382 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:58.696002 18678 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.695990 18571 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.697227 18678 raft_consensus.cc:697] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:58.698300 18571 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.698182 18678 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.699687 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:58.700256 18493 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.702404 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:58.703024 18417 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.703433 18533 tablet_bootstrap.cc:654] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.712980 18536 tablet_bootstrap.cc:654] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.717686 18534 tablet_bootstrap.cc:654] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.723042 18493 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:58.728042 18417 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:16:58.729308 18307 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:58.733793 18756 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.734277 18756 raft_consensus.cc:697] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:16:58.735044 18756 consensus_queue.cc:237] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.742972 18754 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.743466 18754 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.739735 18571 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.754240 18754 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.756035 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:58.756888 18417 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:58.759835 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:58.763059 18339 raft_consensus.cc:1240] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:58.763463 18308 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:16:58.765836 18307 leader_election.cc:343] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.764770 18560 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.770395 18560 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.770891 18560 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.773939 18678 consensus_queue.cc:1059] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:58.775316 18678 raft_consensus.cc:3055] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:58.775655 18678 raft_consensus.cc:740] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:16:58.775849 18417 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.776484 18678 consensus_queue.cc:260] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.792177 18536 tablet_bootstrap.cc:492] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:58.797559 18536 ts_tablet_manager.cc:1403] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.011s
I20260709 13:16:58.777081 18239 catalog_manager.cc:5697] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.802548 18678 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.804533 18571 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.822400 18536 raft_consensus.cc:359] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.823164 18536 raft_consensus.cc:385] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.823788 18533 tablet_bootstrap.cc:492] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:58.836282 18533 ts_tablet_manager.cc:1403] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.022s
I20260709 13:16:58.837802 18536 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.840641 18660 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.843120 18534 tablet_bootstrap.cc:492] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:58.843748 18534 ts_tablet_manager.cc:1403] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.172s	user 0.028s	sys 0.004s
I20260709 13:16:58.845337 18536 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.849509 18414 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:16:58.849949 18414 pending_rounds.cc:85] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 0
I20260709 13:16:58.850239 18414 pending_rounds.cc:107] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:16:58.850517 18414 raft_consensus.cc:2889] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:58.854007 18536 ts_tablet_manager.cc:1434] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:16:58.854916 18536 tablet_bootstrap.cc:492] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:58.854768 18242 catalog_manager.cc:5697] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.844831 18560 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.867319 18614 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.867702 18661 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.868297 18661 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.895915 18533 raft_consensus.cc:359] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.896670 18533 raft_consensus.cc:385] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.896983 18533 raft_consensus.cc:740] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.898211 18533 consensus_queue.cc:260] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.902516 18533 ts_tablet_manager.cc:1434] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.001s
I20260709 13:16:58.901628 18661 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:58.907734 18560 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:58.907624 18534 raft_consensus.cc:359] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.908355 18534 raft_consensus.cc:385] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.908581 18534 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.908927 18536 tablet_bootstrap.cc:654] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.909060 18534 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.910656 18534 ts_tablet_manager.cc:1434] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:16:58.911340 18534 tablet_bootstrap.cc:492] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:58.914777 18536 tablet_bootstrap.cc:492] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:58.965160 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:16:58.959316 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 87069.4us
I20260709 13:16:58.970413 18756 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:58.966734 18415 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.975301 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:58.976365 18344 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:58.978053 18756 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.959256 18596 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.978806 18756 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.979414 18596 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.986508 18806 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.987962 18806 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:58.993100 18533 tablet_bootstrap.cc:492] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:59.004160 18756 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:59.006598 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:59.018013 18596 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:59.022825 18806 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:59.023671 18571 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.024190 18571 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.024793 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:59.028692 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:59.028890 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:59.033457 18806 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:59.025691 18413 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
W20260709 13:16:59.032858 18290 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:59.047338 18342 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:16:59.040391 18571 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:59.049067 18534 tablet_bootstrap.cc:654] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.050351 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:59.056351 18614 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.056955 18614 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:16:59.058333 18457 leader_election.cc:343] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.059187 18614 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:59.060570 18596 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.061203 18596 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.064925 18596 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:16:59.066460 18457 leader_election.cc:343] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.068125 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:16:59.068483 18308 leader_election.cc:343] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.074153 18754 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.074720 18754 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.075053 18533 tablet_bootstrap.cc:654] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.077286 18754 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:59.077795 18536 ts_tablet_manager.cc:1403] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.217s	user 0.014s	sys 0.000s
I20260709 13:16:59.082763 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:59.086321 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:59.090703 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:59.092828 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:59.094115 18806 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.094584 18806 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.094926 18806 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.098532 18415 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
W20260709 13:16:59.104472 18457 leader_election.cc:343] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:59.106922 18308 leader_election.cc:343] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:59.110379 18308 leader_election.cc:343] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:59.110493 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 44913us
I20260709 13:16:59.111425 18308 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:16:59.112344 18614 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.114197 18802 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.113286 18660 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:59.116158 18614 raft_consensus.cc:697] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:16:59.118070 18614 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.115171 18802 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.130082 18536 raft_consensus.cc:359] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.130944 18536 raft_consensus.cc:385] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.131254 18536 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
W20260709 13:16:59.140595 18458 leader_election.cc:343] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.224423 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:16:59.227138 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 86568.8us
I20260709 13:16:59.227409 18536 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.230177 18571 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.134847 18417 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.230620 18571 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.229346 18660 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.241319 18344 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.200451 18242 catalog_manager.cc:5697] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.243671 18571 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:59.246481 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:59.248402 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:59.248664 18754 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.234030 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:59.143005 18805 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.094s
I20260709 13:16:59.250497 18536 ts_tablet_manager.cc:1434] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.172s	user 0.008s	sys 0.000s
I20260709 13:16:59.136090 18802 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:59.137673 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:59.258767 18534 tablet_bootstrap.cc:492] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:59.260723 18534 ts_tablet_manager.cc:1403] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.350s	user 0.022s	sys 0.023s
I20260709 13:16:59.157264 18806 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.262708 18536 tablet_bootstrap.cc:492] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:59.262848 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:59.267970 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:59.269816 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:59.270668 18489 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:16:59.274252 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:59.419040 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:59.409193 18534 raft_consensus.cc:359] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.421304 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:59.315692 18678 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.108s
I20260709 13:16:59.423372 18534 raft_consensus.cc:385] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.423687 18534 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.423772 18340 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:59.281025 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:59.424427 18534 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.424623 18344 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:16:59.425251 18493 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 1: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:16:59.351091 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:59.339020 18533 tablet_bootstrap.cc:492] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:59.440172 18533 ts_tablet_manager.cc:1403] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.448s	user 0.019s	sys 0.021s
I20260709 13:16:59.287102 18806 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:59.442560 18418 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.300261 18382 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:59.452153 18678 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:59.294649 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 46963.2us
W20260709 13:16:59.453080 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 157102us
W20260709 13:16:59.455044 18308 leader_election.cc:343] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.455837 18536 tablet_bootstrap.cc:654] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.460295 18534 ts_tablet_manager.cc:1434] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.199s	user 0.022s	sys 0.027s
I20260709 13:16:59.461453 18534 tablet_bootstrap.cc:492] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:59.453020 18533 raft_consensus.cc:359] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.465631 18533 raft_consensus.cc:385] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.465903 18533 raft_consensus.cc:740] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.468204 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:59.468792 18344 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.473038 18533 consensus_queue.cc:260] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.475653 18533 ts_tablet_manager.cc:1434] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:16:59.477706 18344 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:59.494951 18533 tablet_bootstrap.cc:492] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:59.484503 18418 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:59.493536 18660 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.506856 18660 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.511760 18660 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:59.520906 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:59.524494 18538 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:59.534595 18805 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.535027 18805 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.535379 18805 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.538141 18457 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:16:59.544147 18534 tablet_bootstrap.cc:654] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.575623 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:59.547336 18536 tablet_bootstrap.cc:492] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:59.578450 18536 ts_tablet_manager.cc:1403] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.327s	user 0.035s	sys 0.019s
I20260709 13:16:59.578889 18417 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 1: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:16:59.579459 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 58627.7us
I20260709 13:16:59.580245 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:59.580852 18805 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.583853 18596 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.546862 18661 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.584690 18596 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.600234 18533 tablet_bootstrap.cc:654] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.594592 18596 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.611979 18536 raft_consensus.cc:359] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.612751 18536 raft_consensus.cc:385] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.613173 18536 raft_consensus.cc:740] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.589048 18661 raft_consensus.cc:697] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:16:59.588316 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 63074.6us
I20260709 13:16:59.613831 18536 consensus_queue.cc:260] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.623400 18805 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:59.624439 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:16:59.626454 18457 leader_election.cc:343] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.625358 18678 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.627105 18678 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.634261 18536 ts_tablet_manager.cc:1434] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:16:59.635166 18678 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:59.635939 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:16:59.637686 18384 leader_election.cc:343] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.639735 18614 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.641692 18614 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.644325 18614 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:59.650322 18661 consensus_queue.cc:237] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.651082 18815 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:16:59.659837 18536 tablet_bootstrap.cc:492] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:59.668803 18534 tablet_bootstrap.cc:492] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:59.669279 18534 ts_tablet_manager.cc:1403] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.208s	user 0.012s	sys 0.030s
I20260709 13:16:59.672188 18534 raft_consensus.cc:359] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.674358 18534 raft_consensus.cc:385] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.674585 18534 raft_consensus.cc:740] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
W20260709 13:16:59.678174 18307 leader_election.cc:343] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.680256 18534 consensus_queue.cc:260] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.684005 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:16:59.685454 18307 leader_election.cc:343] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:59.686264 18308 leader_election.cc:343] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.687053 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:59.687899 18307 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:16:59.689321 18307 leader_election.cc:343] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.689683 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:59.690485 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:16:59.691206 18307 leader_election.cc:343] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.691504 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:59.665820 18596 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.694502 18614 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.703429 18560 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.704412 18824 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.705765 18614 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.706183 18614 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.710289 18307 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:59.711264 18827 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.712327 18756 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.713428 18824 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:59.717449 18533 tablet_bootstrap.cc:492] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:59.717929 18533 ts_tablet_manager.cc:1403] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.223s	user 0.015s	sys 0.006s
I20260709 13:16:59.719499 18493 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.722154 18533 raft_consensus.cc:359] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.722836 18533 raft_consensus.cc:385] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.723098 18533 raft_consensus.cc:740] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.723765 18533 consensus_queue.cc:260] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.725239 18533 ts_tablet_manager.cc:1434] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.000s
I20260709 13:16:59.728837 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:16:59.729333 18614 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.734166 18614 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:59.732251 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:59.735499 18596 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:16:59.735445 18382 leader_election.cc:343] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.736255 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:16:59.737859 18534 ts_tablet_manager.cc:1434] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
W20260709 13:16:59.738462 18457 leader_election.cc:343] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.738195 18382 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:59.739574 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:16:59.731228 18241 catalog_manager.cc:5697] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.740792 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:59.742367 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:16:59.747556 18344 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 1: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:16:59.744632 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:16:59.744869 18756 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.748075 18341 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.748395 18490 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 1: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:16:59.750521 18534 tablet_bootstrap.cc:492] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
W20260709 13:16:59.744061 18307 leader_election.cc:343] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:59.746194 18308 leader_election.cc:343] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.746541 18536 tablet_bootstrap.cc:654] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.753409 18307 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:59.755970 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:59.746910 18533 tablet_bootstrap.cc:492] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:59.756919 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:59.757710 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:59.758538 18617 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.759963 18660 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.760269 18560 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.759011 18614 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.762866 18823 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.767261 18341 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:16:59.772418 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:16:59.773404 18823 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.773849 18823 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:16:59.774672 18823 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.795384 18533 tablet_bootstrap.cc:654] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.812733 18534 tablet_bootstrap.cc:654] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.813719 18242 catalog_manager.cc:5697] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.830946 18536 tablet_bootstrap.cc:492] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:59.831626 18536 ts_tablet_manager.cc:1403] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.173s	user 0.014s	sys 0.000s
I20260709 13:16:59.834875 18536 raft_consensus.cc:359] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.835855 18536 raft_consensus.cc:385] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.836257 18536 raft_consensus.cc:740] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.838578 18536 consensus_queue.cc:260] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.845186 18534 tablet_bootstrap.cc:492] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:59.845180 18536 ts_tablet_manager.cc:1434] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:16:59.846758 18536 tablet_bootstrap.cc:492] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:59.847103 18533 tablet_bootstrap.cc:492] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:59.847774 18533 ts_tablet_manager.cc:1403] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.109s	user 0.027s	sys 0.009s
I20260709 13:16:59.850838 18533 raft_consensus.cc:359] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.851481 18533 raft_consensus.cc:385] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.851783 18533 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.852407 18533 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.854583 18533 ts_tablet_manager.cc:1434] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:16:59.847090 18534 ts_tablet_manager.cc:1403] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.097s	user 0.020s	sys 0.010s
I20260709 13:16:59.857182 18536 tablet_bootstrap.cc:654] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.857118 18534 raft_consensus.cc:359] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.857810 18534 raft_consensus.cc:385] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.858100 18534 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.859467 18533 tablet_bootstrap.cc:492] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:59.865025 18534 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.867240 18534 ts_tablet_manager.cc:1434] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:16:59.868278 18534 tablet_bootstrap.cc:492] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:59.868813 18536 tablet_bootstrap.cc:492] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:59.869282 18536 ts_tablet_manager.cc:1403] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 13:16:59.871819 18536 raft_consensus.cc:359] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.872553 18536 raft_consensus.cc:385] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.872860 18536 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.873772 18534 tablet_bootstrap.cc:654] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.873487 18536 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.876170 18614 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.876602 18614 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.877403 18536 ts_tablet_manager.cc:1434] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:16:59.874614 18533 tablet_bootstrap.cc:654] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.882203 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:59.882669 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:16:59.883975 18307 leader_election.cc:343] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:59.884642 18308 leader_election.cc:343] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.885017 18308 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:16:59.885285 18536 tablet_bootstrap.cc:492] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:59.891204 18827 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.893888 18536 tablet_bootstrap.cc:654] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.899062 18614 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:16:59.921897 18533 tablet_bootstrap.cc:492] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:59.922410 18533 ts_tablet_manager.cc:1403] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.008s
I20260709 13:16:59.923993 18534 tablet_bootstrap.cc:492] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:59.924405 18534 ts_tablet_manager.cc:1403] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.016s
I20260709 13:16:59.925055 18533 raft_consensus.cc:359] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.925733 18533 raft_consensus.cc:385] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.926017 18533 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.926869 18533 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.927793 18534 raft_consensus.cc:359] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.928361 18536 tablet_bootstrap.cc:492] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:59.928471 18534 raft_consensus.cc:385] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.928966 18534 raft_consensus.cc:740] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.929109 18536 ts_tablet_manager.cc:1403] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.015s
I20260709 13:16:59.929200 18533 ts_tablet_manager.cc:1434] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:59.929682 18534 consensus_queue.cc:260] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.931372 18533 tablet_bootstrap.cc:492] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:16:59.932042 18536 raft_consensus.cc:359] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.932744 18536 raft_consensus.cc:385] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.933070 18536 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.933682 18536 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.931892 18534 ts_tablet_manager.cc:1434] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 13:16:59.936025 18534 tablet_bootstrap.cc:492] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:16:59.940191 18536 ts_tablet_manager.cc:1434] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:16:59.941306 18536 tablet_bootstrap.cc:492] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:59.942268 18534 tablet_bootstrap.cc:654] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.945402 18823 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.947602 18823 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.950099 18823 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:16:59.951427 18536 tablet_bootstrap.cc:654] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.953811 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:16:59.955586 18458 leader_election.cc:343] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.956091 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:16:59.946193 18533 tablet_bootstrap.cc:654] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:59.957513 18457 leader_election.cc:343] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.957950 18457 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:16:59.958946 18809 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.961015 18536 tablet_bootstrap.cc:492] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:16:59.961440 18536 ts_tablet_manager.cc:1403] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.002s
I20260709 13:16:59.964105 18536 raft_consensus.cc:359] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.964912 18536 raft_consensus.cc:385] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.965523 18536 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.966310 18536 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.979054 18534 tablet_bootstrap.cc:492] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:16:59.979635 18534 ts_tablet_manager.cc:1403] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.008s
I20260709 13:16:59.980796 18536 ts_tablet_manager.cc:1434] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:16:59.981873 18536 tablet_bootstrap.cc:492] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:16:59.983268 18534 raft_consensus.cc:359] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.984011 18534 raft_consensus.cc:385] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.984876 18534 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.985868 18534 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.988544 18536 tablet_bootstrap.cc:654] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.993072 18533 tablet_bootstrap.cc:492] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:16:59.993564 18533 ts_tablet_manager.cc:1403] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.007s
I20260709 13:16:59.996444 18533 raft_consensus.cc:359] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:16:59.997193 18533 raft_consensus.cc:385] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.997536 18533 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.001026 18534 ts_tablet_manager.cc:1434] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:16:59.998387 18533 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.003576 18533 ts_tablet_manager.cc:1434] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:17:00.008800 18533 tablet_bootstrap.cc:492] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:00.009718 18534 tablet_bootstrap.cc:492] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:17:00.025460 18534 tablet_bootstrap.cc:654] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.039923 18533 tablet_bootstrap.cc:654] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.047737 18533 tablet_bootstrap.cc:492] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:00.048377 18533 ts_tablet_manager.cc:1403] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.000s
I20260709 13:17:00.051644 18533 raft_consensus.cc:359] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.052556 18533 raft_consensus.cc:385] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.052901 18533 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.053686 18533 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.055212 18533 ts_tablet_manager.cc:1434] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:00.055819 18534 tablet_bootstrap.cc:492] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:00.056138 18533 tablet_bootstrap.cc:492] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:00.056295 18534 ts_tablet_manager.cc:1403] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.001s
I20260709 13:17:00.059180 18534 raft_consensus.cc:359] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.059803 18534 raft_consensus.cc:385] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.060055 18534 raft_consensus.cc:740] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.060887 18534 consensus_queue.cc:260] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.063230 18534 ts_tablet_manager.cc:1434] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:00.068715 18534 tablet_bootstrap.cc:492] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:17:00.075387 18533 tablet_bootstrap.cc:654] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.075680 18617 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.076195 18617 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.078049 18534 tablet_bootstrap.cc:654] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.082744 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:00.079018 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:17:00.089775 18384 leader_election.cc:343] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.092768 18534 tablet_bootstrap.cc:492] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:00.093263 18534 ts_tablet_manager.cc:1403] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.004s
W20260709 13:17:00.095683 18382 leader_election.cc:343] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.096207 18382 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:00.096921 18538 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:00.096719 18534 raft_consensus.cc:359] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.081329 18617 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.110880 18534 raft_consensus.cc:385] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.111317 18534 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.112660 18534 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.115638 18534 ts_tablet_manager.cc:1434] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.005s
I20260709 13:17:00.117616 18534 tablet_bootstrap.cc:492] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:17:00.123270 18617 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.123797 18617 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.126375 18617 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.127028 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:00.127764 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:00.128409 18344 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:17:00.129961 18534 tablet_bootstrap.cc:654] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.151543 18560 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.152029 18560 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.127805 18493 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:17:00.156316 18809 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.156828 18809 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.157243 18827 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.157716 18827 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.159930 18809 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:00.163055 18827 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.167821 18534 tablet_bootstrap.cc:492] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:00.168380 18534 ts_tablet_manager.cc:1403] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.003s
I20260709 13:17:00.171283 18534 raft_consensus.cc:359] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.171882 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:00.172084 18534 raft_consensus.cc:385] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.172492 18534 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
W20260709 13:17:00.173448 18308 leader_election.cc:343] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.178122 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:00.178826 18341 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:17:00.180914 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:00.181823 18809 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.181895 18661 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:00.182508 18661 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.182433 18809 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.183066 18661 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.184959 18809 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:00.173285 18534 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.149478 18823 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:00.190048 18614 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.190353 18617 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.190595 18614 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.188057 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:00.191030 18617 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.193332 18614 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.193610 18617 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.135042 18384 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:00.196138 18534 ts_tablet_manager.cc:1434] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:17:00.202301 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:17:00.198963 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 63995.9us
I20260709 13:17:00.199753 18617 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:00.197886 18661 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.200475 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:00.204659 18617 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.204914 18493 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:17:00.205248 18617 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.206012 18382 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:00.205163 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:00.207816 18341 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:17:00.207984 18538 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:00.208556 18538 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.208994 18538 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.211020 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:00.212589 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:17:00.215917 18457 leader_election.cc:343] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.217687 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:00.218721 18560 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:00.219727 18457 leader_election.cc:343] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.220791 18661 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:00.222126 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:17:00.222733 18308 leader_election.cc:343] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.226163 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:00.228263 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:00.229007 18342 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.233081 18617 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:00.236433 18308 leader_election.cc:343] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.222886 18538 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.241221 18538 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.235390 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:00.238564 18342 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:17:00.242220 18493 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:17:00.243211 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:00.243871 18490 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.223399 18534 tablet_bootstrap.cc:492] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:17:00.257107 18536 tablet_bootstrap.cc:492] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:17:00.257711 18490 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:17:00.258009 18536 ts_tablet_manager.cc:1403] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.276s	user 0.061s	sys 0.134s
I20260709 13:17:00.259096 18382 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:00.259886 18538 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:00.260385 18538 raft_consensus.cc:697] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:17:00.260179 18457 leader_election.cc:343] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.261161 18538 consensus_queue.cc:237] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.263149 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:00.264358 18344 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.266181 18533 tablet_bootstrap.cc:492] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:00.266696 18533 ts_tablet_manager.cc:1403] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.211s	user 0.074s	sys 0.088s
W20260709 13:17:00.268383 18458 leader_election.cc:343] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.268949 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:00.270763 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:00.271245 18596 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:00.276757 18534 tablet_bootstrap.cc:654] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.274279 18678 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.300968 18344 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
W20260709 13:17:00.306493 18307 leader_election.cc:343] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.273679 18596 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:17:00.308915 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:00.311419 18536 raft_consensus.cc:359] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.312109 18536 raft_consensus.cc:385] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.312361 18536 raft_consensus.cc:740] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.313058 18536 consensus_queue.cc:260] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.313548 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:00.315927 18827 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:00.313583 18617 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.319649 18533 raft_consensus.cc:359] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:00.320297 18290 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:00.320327 18533 raft_consensus.cc:385] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.321272 18533 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.317553 18827 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:00.283010 18678 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.332007 18533 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.335706 18536 ts_tablet_manager.cc:1434] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
W20260709 13:17:00.337702 18307 leader_election.cc:343] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.324023 18827 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.339752 18307 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:00.342384 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:00.331656 18809 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.343590 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:00.344153 18493 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.348222 18533 ts_tablet_manager.cc:1434] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.002s
I20260709 13:17:00.341892 18827 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.339850 18617 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.353520 18536 tablet_bootstrap.cc:492] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:17:00.345625 18851 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:00.359010 18533 tablet_bootstrap.cc:492] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:00.346269 18809 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.370067 18809 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:00.360764 18660 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:00.353247 18617 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.385349 18660 raft_consensus.cc:697] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:00.388985 18660 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.385108 18823 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:17:00.402922 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:00.407341 18617 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.411314 18493 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:17:00.404803 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:00.405329 18343 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:17:00.417729 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:00.418332 18344 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.419044 18536 tablet_bootstrap.cc:654] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.419643 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:00.421567 18809 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:00.427531 18344 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:17:00.427737 18382 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:00.427750 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:00.429885 18852 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:00.430421 18852 raft_consensus.cc:697] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:00.431183 18852 consensus_queue.cc:237] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.431819 18678 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.429757 18493 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:17:00.422308 18809 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:00.441299 18457 leader_election.cc:343] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.442356 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:00.441692 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:00.445516 18534 tablet_bootstrap.cc:492] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:00.446007 18534 ts_tablet_manager.cc:1403] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.223s	user 0.015s	sys 0.007s
I20260709 13:17:00.446326 18241 catalog_manager.cc:5697] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.450202 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:00.452097 18533 tablet_bootstrap.cc:654] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.441797 18809 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.447593 18678 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:00.460988 18860 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.461200 18678 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.461614 18678 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.461540 18860 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.463821 18827 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.469471 18678 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.491195 18678 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.495373 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:00.496229 18860 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.490868 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:00.502251 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:17:00.503408 18308 leader_election.cc:343] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:00.504097 18308 leader_election.cc:343] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.509819 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:00.511317 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:00.512009 18488 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:17:00.511842 18534 raft_consensus.cc:359] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.514408 18534 raft_consensus.cc:385] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.514665 18534 raft_consensus.cc:740] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.515383 18534 consensus_queue.cc:260] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.513141 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:00.516252 18384 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:00.518415 18617 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:00.523430 18534 ts_tablet_manager.cc:1434] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.000s
I20260709 13:17:00.517506 18827 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.526499 18534 tablet_bootstrap.cc:492] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:17:00.528337 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:00.529103 18491 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.529130 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:00.529690 18489 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:00.572268 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 56130.7us
W20260709 13:17:00.572857 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 43801.6us
W20260709 13:17:00.573241 18384 leader_election.cc:343] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.575238 18860 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:00.575637 18860 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.575973 18860 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.578876 18533 tablet_bootstrap.cc:492] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:00.579618 18533 ts_tablet_manager.cc:1403] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.225s	user 0.018s	sys 0.009s
W20260709 13:17:00.578989 18384 leader_election.cc:343] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.581823 18419 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.586405 18536 tablet_bootstrap.cc:492] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:17:00.586916 18536 ts_tablet_manager.cc:1403] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.239s	user 0.010s	sys 0.008s
I20260709 13:17:00.591789 18242 catalog_manager.cc:5697] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.609740 18536 raft_consensus.cc:359] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.611699 18536 raft_consensus.cc:385] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.613929 18491 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:00.633736 18536 raft_consensus.cc:740] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.635195 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:00.617937 18860 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.620314 18809 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.636133 18536 consensus_queue.cc:260] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.640553 18827 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:00.643002 18533 raft_consensus.cc:359] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.644070 18533 raft_consensus.cc:385] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.644345 18533 raft_consensus.cc:740] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.645248 18533 consensus_queue.cc:260] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.648381 18533 ts_tablet_manager.cc:1434] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.001s
I20260709 13:17:00.649282 18533 tablet_bootstrap.cc:492] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:00.650566 18855 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.653321 18534 tablet_bootstrap.cc:654] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.653725 18536 ts_tablet_manager.cc:1434] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.001s
I20260709 13:17:00.657100 18536 tablet_bootstrap.cc:492] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:17:00.653664 18827 raft_consensus.cc:697] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:00.658885 18827 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.661335 18617 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.676353 18809 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:00.703349 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:00.704806 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:00.705476 18339 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.706275 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:00.706482 18860 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.708997 18489 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
W20260709 13:17:00.711467 18308 leader_election.cc:343] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.711541 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:00.715158 18533 tablet_bootstrap.cc:654] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.716696 18852 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:00.717170 18852 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:00.718514 18852 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:00.732909 18457 leader_election.cc:343] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:00.761323 18678 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.762004 18678 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.768081 18678 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.765136 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:00.773934 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:00.774647 18491 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 1: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:00.781131 18536 tablet_bootstrap.cc:654] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.790350 18678 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:00.778635 18489 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.803463 18534 tablet_bootstrap.cc:492] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:00.804222 18534 ts_tablet_manager.cc:1403] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.278s	user 0.036s	sys 0.018s
I20260709 13:17:00.806231 18533 tablet_bootstrap.cc:492] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:00.806841 18533 ts_tablet_manager.cc:1403] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.158s	user 0.016s	sys 0.013s
I20260709 13:17:00.809105 18339 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:17:00.819052 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:00.819715 18858 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:00.820176 18858 raft_consensus.cc:697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:00.808390 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:00.821952 18858 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.828908 18341 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 1: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:17:00.834861 18384 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:00.836635 18678 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.857848 18416 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.863225 18489 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:00.864987 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:00.870802 18242 catalog_manager.cc:5697] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.879633 18678 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:00.878750 18853 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.881294 18853 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.881983 18536 tablet_bootstrap.cc:492] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:17:00.882409 18536 ts_tablet_manager.cc:1403] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.226s	user 0.018s	sys 0.003s
I20260709 13:17:00.884963 18853 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.886852 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:00.890597 18491 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:17:00.892168 18307 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:00.894264 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:00.870194 18827 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:00.894850 18419 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:17:00.897177 18533 raft_consensus.cc:359] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.898798 18533 raft_consensus.cc:385] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.899191 18533 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.901458 18533 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.896436 18853 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:00.912515 18853 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.913038 18853 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.897408 18827 raft_consensus.cc:697] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:00.920310 18827 consensus_queue.cc:237] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.924381 18534 raft_consensus.cc:359] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.926803 18536 raft_consensus.cc:359] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.927425 18536 raft_consensus.cc:385] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.927676 18536 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.928244 18534 raft_consensus.cc:385] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.928694 18534 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.928272 18536 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.929378 18534 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.931437 18534 ts_tablet_manager.cc:1434] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.127s	user 0.006s	sys 0.001s
I20260709 13:17:00.932441 18534 tablet_bootstrap.cc:492] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:17:00.936354 18809 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.945977 18533 ts_tablet_manager.cc:1434] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.139s	user 0.010s	sys 0.000s
I20260709 13:17:00.949187 18823 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:17:00.964824 18538 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.965502 18538 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:00.970363 18536 ts_tablet_manager.cc:1434] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.002s
I20260709 13:17:00.971484 18536 tablet_bootstrap.cc:492] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:17:00.934041 18890 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:17:00.976110 18533 tablet_bootstrap.cc:492] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:00.991657 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:00.992508 18536 tablet_bootstrap.cc:654] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.993359 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:00.994176 18342 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 1: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:00.993340 18538 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:00.995512 18534 tablet_bootstrap.cc:654] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.999826 18242 catalog_manager.cc:5697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.984185 18853 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.012104 18853 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:01.014546 18384 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:01.016342 18538 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.030329 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:01.030696 18538 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:01.031095 18489 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.034493 18533 tablet_bootstrap.cc:654] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.038439 18858 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.039121 18858 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.045431 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:01.046288 18418 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.080103 18242 catalog_manager.cc:5697] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.109586 18238 catalog_manager.cc:5697] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.204113 18489 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:01.226794 18536 tablet_bootstrap.cc:492] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
W20260709 13:17:01.226372 18894 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.188s	user 0.019s	sys 0.053s
I20260709 13:17:01.244292 18536 ts_tablet_manager.cc:1403] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.273s	user 0.024s	sys 0.043s
I20260709 13:17:01.247443 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:01.251045 18342 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:17:01.253693 18534 tablet_bootstrap.cc:492] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:01.254185 18534 ts_tablet_manager.cc:1403] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.322s	user 0.029s	sys 0.059s
I20260709 13:17:01.262208 18858 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:17:01.273074 18308 consensus_peers.cc:597] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:01.262559 18238 catalog_manager.cc:5697] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.277391 18418 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:01.310740 18534 raft_consensus.cc:359] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.311575 18534 raft_consensus.cc:385] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.311856 18534 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.316179 18534 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.325778 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:01.320075 18308 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:01.329272 18860 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:01.350716 18536 raft_consensus.cc:359] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.353744 18536 raft_consensus.cc:385] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.329337 18853 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.354390 18853 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.354972 18536 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.355607 18536 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.356324 18853 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:01.366111 18534 ts_tablet_manager.cc:1434] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.112s	user 0.006s	sys 0.002s
I20260709 13:17:01.374071 18533 tablet_bootstrap.cc:492] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:01.374567 18533 ts_tablet_manager.cc:1403] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.418s	user 0.018s	sys 0.018s
I20260709 13:17:01.381732 18536 ts_tablet_manager.cc:1434] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.131s	user 0.005s	sys 0.005s
I20260709 13:17:01.368718 18809 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:01.388183 18534 tablet_bootstrap.cc:492] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:17:01.386054 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:01.390882 18414 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:17:01.392593 18308 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:01.384549 18809 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.393572 18809 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.399176 18533 raft_consensus.cc:359] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.399909 18533 raft_consensus.cc:385] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.400173 18533 raft_consensus.cc:740] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.400806 18533 consensus_queue.cc:260] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.422387 18536 tablet_bootstrap.cc:492] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:17:01.426462 18853 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:01.426893 18853 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.428002 18853 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.430599 18534 tablet_bootstrap.cc:654] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.433126 18902 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.427325 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:01.446040 18533 ts_tablet_manager.cc:1434] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.006s
I20260709 13:17:01.444279 18902 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.446992 18852 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:01.386175 18860 raft_consensus.cc:697] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:01.450850 18902 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:01.453478 18384 consensus_peers.cc:597] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:01.454170 18854 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:17:01.454082 18827 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:01.457197 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:01.457857 18414 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:01.461756 18875 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:17:01.459533 18308 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:17:01.462770 18290 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:01.464560 18533 tablet_bootstrap.cc:492] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:01.466712 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:01.467538 18851 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:01.467912 18851 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.468262 18851 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.468892 18414 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:01.496644 18307 leader_election.cc:343] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:01.495433 18457 leader_election.cc:343] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.480263 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:01.499904 18490 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
W20260709 13:17:01.524050 18370 tablet.cc:2406] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:01.546271 18899 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.546777 18899 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.523171 18855 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:17:01.612548 18809 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.500504 18860 consensus_queue.cc:237] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.629127 18536 tablet_bootstrap.cc:654] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:01.629989 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 101559us
I20260709 13:17:01.653926 18538 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.654497 18538 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.656651 18538 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:01.601300 18901 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.059s
I20260709 13:17:01.659777 18560 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:01.671983 18533 tablet_bootstrap.cc:654] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:01.619928 18853 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.736266 18809 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:17:01.761363 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 160197us
I20260709 13:17:01.760871 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:01.766157 18534 tablet_bootstrap.cc:492] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:01.786119 18534 ts_tablet_manager.cc:1403] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.403s	user 0.010s	sys 0.011s
I20260709 13:17:01.789794 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:01.790989 18905 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.789492 18851 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.791688 18905 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.793812 18905 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:01.795109 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:01.795893 18411 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.802253 18853 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:01.808857 18533 tablet_bootstrap.cc:492] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:01.809351 18533 ts_tablet_manager.cc:1403] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.345s	user 0.027s	sys 0.047s
I20260709 13:17:01.793812 18851 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:01.809508 18411 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:01.810621 18308 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:01.810802 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:01.811873 18419 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.813184 18489 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:17:01.817010 18899 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:01.824942 18534 raft_consensus.cc:359] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.825618 18534 raft_consensus.cc:385] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.825812 18534 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.826570 18534 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.827876 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:01.814420 18853 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:01.848789 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:01.849406 18344 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:01.854178 18419 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:01.859661 18308 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:01.864714 18534 ts_tablet_manager.cc:1434] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
I20260709 13:17:01.867852 18900 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:01.857254 18853 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:01.869576 18382 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:01.872102 18538 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:01.872445 18538 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:01.872781 18538 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.876911 18344 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:17:01.882529 18533 raft_consensus.cc:359] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.883472 18533 raft_consensus.cc:385] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.883800 18533 raft_consensus.cc:740] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.896318 18533 consensus_queue.cc:260] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.899017 18533 ts_tablet_manager.cc:1434] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.004s
I20260709 13:17:01.896500 18538 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.905877 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:01.911698 18533 tablet_bootstrap.cc:492] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:01.914188 18538 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:01.899478 18900 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:01.926812 18536 tablet_bootstrap.cc:492] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:17:01.927517 18536 ts_tablet_manager.cc:1403] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.505s	user 0.060s	sys 0.068s
I20260709 13:17:01.915763 18857 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:01.918653 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:01.921689 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:01.938210 18857 raft_consensus.cc:697] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:17:01.940465 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 55751.3us
I20260709 13:17:01.914950 18853 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:01.945430 18458 leader_election.cc:343] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:01.944008 18900 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.946098 18413 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:01.959161 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:01.961206 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:01.963610 18536 raft_consensus.cc:359] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:01.964552 18536 raft_consensus.cc:385] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:01.964910 18536 raft_consensus.cc:740] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:17:01.976759 18536 consensus_queue.cc:260] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:02.038164 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 79484.7us
I20260709 13:17:02.067384 18921 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.068280 18921 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.064491 18875 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.080924 18536 ts_tablet_manager.cc:1434] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.153s	user 0.007s	sys 0.009s
I20260709 13:17:01.979185 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:02.051163 18922 consensus_queue.cc:1059] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:17:02.085219 18921 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:02.088256 18484 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.088860 18533 tablet_bootstrap.cc:654] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:02.096055 18536 tablet_bootstrap.cc:492] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:17:02.099159 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:02.098006 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:01.976197 18857 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.089797 18875 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.123202 18875 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:17:02.134651 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 52002.5us
W20260709 13:17:02.137024 18457 leader_election.cc:343] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:02.141108 18457 leader_election.cc:343] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.141539 18457 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:02.142375 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:02.145421 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:02.146139 18534 tablet_bootstrap.cc:492] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:17:02.165388 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:02.164198 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:02.167747 18596 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.168206 18596 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.169047 18900 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:02.150084 18875 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:02.170176 18307 leader_election.cc:343] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.173072 18596 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:02.178711 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:02.179844 18922 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.161898 18484 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:02.180316 18922 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:02.183643 18307 leader_election.cc:343] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:02.186084 18457 leader_election.cc:343] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.203334 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:17:02.207059 18458 leader_election.cc:343] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.207487 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:02.208232 18335 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:02.208482 18875 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:02.276465 18928 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.333793 18384 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:02.328332 18918 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.335646 18922 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:02.337186 18891 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:02.277329 18928 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.334859 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:02.338752 18918 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.396154 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:17:02.399837 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 184730us
W20260709 13:17:02.400494 18457 leader_election.cc:343] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.406051 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:02.411250 18534 tablet_bootstrap.cc:654] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:02.416917 18458 leader_election.cc:343] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.417433 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:02.428643 18928 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:02.426172 18858 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:02.435009 18918 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:02.439071 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:02.447817 18382 leader_election.cc:343] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:02.449285 18930 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:17:02.451668 18536 tablet_bootstrap.cc:654] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:02.455075 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:02.455528 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:02.457280 18851 raft_consensus.cc:3055] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:02.457674 18851 raft_consensus.cc:740] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:02.462417 18241 catalog_manager.cc:5697] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:02.464912 18384 leader_election.cc:343] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.465385 18384 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:02.468045 18533 tablet_bootstrap.cc:492] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:02.468477 18533 ts_tablet_manager.cc:1403] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.564s	user 0.009s	sys 0.008s
I20260709 13:17:02.481127 18533 raft_consensus.cc:359] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.481844 18533 raft_consensus.cc:385] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:02.482149 18533 raft_consensus.cc:740] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:02.482005 18851 consensus_queue.cc:260] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.482856 18533 consensus_queue.cc:260] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:02.483249 18307 leader_election.cc:343] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.485857 18899 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:02.489156 18308 leader_election.cc:343] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.490302 18308 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:17:02.491638 18307 leader_election.cc:343] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:02.492233 18307 consensus_peers.cc:597] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:02.490291 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:02.483299 18851 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:02.506862 18533 ts_tablet_manager.cc:1434] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.004s
I20260709 13:17:02.512017 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:02.512640 18417 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:17:02.514734 18411 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:02.494145 18921 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:02.516999 18534 tablet_bootstrap.cc:492] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:02.494164 18918 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:02.527079 18534 ts_tablet_manager.cc:1403] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.381s	user 0.008s	sys 0.009s
I20260709 13:17:02.533201 18533 tablet_bootstrap.cc:492] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:02.547887 18534 raft_consensus.cc:359] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.548612 18534 raft_consensus.cc:385] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:02.549104 18534 raft_consensus.cc:740] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
W20260709 13:17:02.587756 18308 leader_election.cc:343] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.588204 18308 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:02.589103 18912 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:02.591566 18485 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:17:02.595665 18457 consensus_peers.cc:597] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:02.622772 18290 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:02.635234 18536 tablet_bootstrap.cc:492] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:17:02.636255 18536 ts_tablet_manager.cc:1403] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.545s	user 0.018s	sys 0.037s
I20260709 13:17:02.632340 18308 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:02.637625 18534 consensus_queue.cc:260] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.638893 18900 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:02.642863 18900 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.643198 18900 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:02.656265 18900 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.658299 18900 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:02.658958 18900 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:02.663331 18533 tablet_bootstrap.cc:654] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:02.664721 18536 raft_consensus.cc:359] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.665581 18536 raft_consensus.cc:385] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:02.665884 18536 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:17:02.666632 18536 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.671520 18536 ts_tablet_manager.cc:1434] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:17:02.672461 18536 tablet_bootstrap.cc:492] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:17:02.672927 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:02.673494 18485 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:02.676860 18851 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:02.678663 18536 tablet_bootstrap.cc:654] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:02.682207 18901 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.691161 18536 tablet_bootstrap.cc:492] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:17:02.693895 18536 ts_tablet_manager.cc:1403] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:17:02.695873 18534 ts_tablet_manager.cc:1434] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.168s	user 0.009s	sys 0.004s
I20260709 13:17:02.696956 18534 tablet_bootstrap.cc:492] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:17:02.708798 18485 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:02.712692 18533 tablet_bootstrap.cc:492] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:02.713163 18533 ts_tablet_manager.cc:1403] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.180s	user 0.023s	sys 0.024s
I20260709 13:17:02.714474 18534 tablet_bootstrap.cc:654] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:02.716199 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:02.716903 18860 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:02.717360 18860 raft_consensus.cc:697] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:02.718173 18860 consensus_queue.cc:237] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.725217 18536 raft_consensus.cc:359] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.725999 18536 raft_consensus.cc:385] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:02.726270 18536 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:17:02.726996 18536 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.732508 18931 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.734064 18533 raft_consensus.cc:359] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.735905 18533 raft_consensus.cc:385] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:02.736198 18533 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:02.732930 18536 ts_tablet_manager.cc:1434] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 13:17:02.737659 18533 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.738984 18536 tablet_bootstrap.cc:492] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:17:02.740056 18533 ts_tablet_manager.cc:1434] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 13:17:02.744438 18536 tablet_bootstrap.cc:654] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:02.748816 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:02.749416 18412 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:02.755476 18412 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:02.756258 18534 tablet_bootstrap.cc:492] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:02.756618 18536 tablet_bootstrap.cc:492] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:17:02.756734 18534 ts_tablet_manager.cc:1403] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.003s
I20260709 13:17:02.757052 18536 ts_tablet_manager.cc:1403] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.006s
I20260709 13:17:02.759682 18534 raft_consensus.cc:359] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.760422 18534 raft_consensus.cc:385] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:02.760726 18534 raft_consensus.cc:740] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:02.761611 18536 raft_consensus.cc:359] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.762352 18536 raft_consensus.cc:385] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:02.762650 18536 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:17:02.761361 18534 consensus_queue.cc:260] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.762744 18900 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:02.763299 18536 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.764937 18534 ts_tablet_manager.cc:1434] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:17:02.764992 18536 ts_tablet_manager.cc:1434] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:02.766012 18534 tablet_bootstrap.cc:492] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:17:02.766957 18536 tablet_bootstrap.cc:492] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:17:02.768746 18533 tablet_bootstrap.cc:492] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:02.772706 18534 tablet_bootstrap.cc:654] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:02.782348 18922 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.782857 18922 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.784861 18922 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:02.788444 18533 tablet_bootstrap.cc:654] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:02.794569 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:02.799218 18307 leader_election.cc:343] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.810931 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:02.812115 18536 tablet_bootstrap.cc:654] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:02.816233 18308 leader_election.cc:343] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.816682 18308 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:02.817454 18922 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:02.818292 18534 tablet_bootstrap.cc:492] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:02.818893 18534 ts_tablet_manager.cc:1403] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.015s
I20260709 13:17:02.831413 18533 tablet_bootstrap.cc:492] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:02.831842 18533 ts_tablet_manager.cc:1403] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.011s
I20260709 13:17:02.833133 18901 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.837754 18536 tablet_bootstrap.cc:492] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:17:02.838188 18536 ts_tablet_manager.cc:1403] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.005s
I20260709 13:17:02.834425 18901 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.841142 18533 raft_consensus.cc:359] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.841833 18533 raft_consensus.cc:385] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:02.842144 18533 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:02.847720 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:17:02.856628 18308 leader_election.cc:343] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.854831 18534 raft_consensus.cc:359] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.857668 18534 raft_consensus.cc:385] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:02.857869 18534 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:02.858320 18901 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:02.858489 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:02.858621 18534 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.859154 18485 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
I20260709 13:17:02.860324 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:02.860702 18534 ts_tablet_manager.cc:1434] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:17:02.862109 18534 tablet_bootstrap.cc:492] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:17:02.862149 18902 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:02.862610 18902 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.862953 18902 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:02.866142 18931 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.866603 18931 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.868589 18931 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:02.870085 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:02.870848 18536 raft_consensus.cc:359] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.871447 18536 raft_consensus.cc:385] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:02.871694 18536 raft_consensus.cc:740] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:17:02.872304 18536 consensus_queue.cc:260] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.873799 18242 catalog_manager.cc:5697] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:02.874716 18536 ts_tablet_manager.cc:1434] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.002s
I20260709 13:17:02.875682 18536 tablet_bootstrap.cc:492] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:17:02.876754 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:02.876328 18901 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.879047 18457 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:02.878768 18901 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.879873 18931 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:02.881296 18533 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.882107 18901 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:02.883066 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:02.882079 18902 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.882403 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:02.885255 18485 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 0.
W20260709 13:17:02.885520 18308 leader_election.cc:343] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.887188 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:02.890437 18901 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:02.890852 18901 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.891242 18901 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:02.892284 18533 ts_tablet_manager.cc:1434] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.060s	user 0.002s	sys 0.008s
I20260709 13:17:02.893484 18533 tablet_bootstrap.cc:492] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:02.895799 18534 tablet_bootstrap.cc:654] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:02.898633 18536 tablet_bootstrap.cc:654] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:02.901316 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:02.905172 18485 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:02.905942 18533 tablet_bootstrap.cc:654] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:02.901316 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:02.903313 18902 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:02.906635 18918 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.908622 18918 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.909454 18534 tablet_bootstrap.cc:492] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:02.909909 18534 ts_tablet_manager.cc:1403] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.000s
W20260709 13:17:02.911232 18308 leader_election.cc:343] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.914991 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:02.915733 18484 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:17:02.917328 18382 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:02.918102 18852 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:02.918522 18852 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.918393 18534 raft_consensus.cc:359] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.918896 18852 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:02.919111 18534 raft_consensus.cc:385] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:02.919394 18534 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:02.920046 18534 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.921586 18901 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.925688 18931 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.926232 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:02.926280 18931 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:02.927932 18384 leader_election.cc:343] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.922433 18534 ts_tablet_manager.cc:1434] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:17:02.928910 18485 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:02.934248 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:02.920354 18918 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:02.935428 18457 leader_election.cc:343] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.928934 18931 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:02.934725 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:17:02.943325 18308 leader_election.cc:343] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.950114 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:02.938680 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:02.956591 18336 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
I20260709 13:17:02.964779 18918 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.965569 18918 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.969380 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:02.970201 18336 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:17:02.971200 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:02.971992 18678 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:02.972321 18678 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.972630 18678 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:02.972677 18458 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:02.974697 18490 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:02.979344 18678 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:02.980155 18534 tablet_bootstrap.cc:492] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:17:02.984539 18678 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:02.979640 18902 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:02.991935 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:02.979179 18918 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:02.994552 18382 leader_election.cc:343] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:02.982050 18905 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:03.000722 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:02.998778 18905 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.999501 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:03.005704 18533 tablet_bootstrap.cc:492] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:03.015092 18533 ts_tablet_manager.cc:1403] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.003s
I20260709 13:17:03.002028 18489 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:02.998358 18902 raft_consensus.cc:697] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:02.986555 18901 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:03.003690 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:03.005712 18852 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.014639 18905 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.017072 18336 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.022101 18533 raft_consensus.cc:359] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.022811 18533 raft_consensus.cc:385] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:03.023059 18533 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:03.023674 18533 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.024124 18536 tablet_bootstrap.cc:492] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:17:03.024600 18536 ts_tablet_manager.cc:1403] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.149s	user 0.031s	sys 0.026s
W20260709 13:17:03.025365 18382 leader_election.cc:343] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:03.027012 18852 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:03.027520 18336 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:17:03.033872 18536 raft_consensus.cc:359] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.048297 18536 raft_consensus.cc:385] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:03.028254 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:03.048754 18536 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:17:03.048518 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:03.049486 18538 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:03.049460 18536 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.050418 18538 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:03.051167 18538 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.033416 18905 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.050426 18335 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.035257 18533 ts_tablet_manager.cc:1434] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:17:03.058154 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:03.058806 18493 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.063072 18905 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:03.063263 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:17:03.064558 18457 leader_election.cc:343] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:03.065177 18534 tablet_bootstrap.cc:654] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:03.065930 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:03.066488 18336 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.071077 18533 tablet_bootstrap.cc:492] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:03.030283 18902 consensus_queue.cc:237] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.077123 18493 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:17:03.078470 18382 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:03.082271 18918 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.086305 18538 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:03.087119 18538 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:03.086608 18918 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.090180 18918 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:03.068151 18489 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:03.093519 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:03.092391 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:03.096310 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:03.094527 18538 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.096292 18489 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:17:03.101076 18242 catalog_manager.cc:5697] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:17:03.170710 18533 tablet_bootstrap.cc:654] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:03.171543 18242 catalog_manager.cc:5697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 2, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:17:03.178571 18382 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:03.179210 18678 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:03.179533 18678 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.179841 18678 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.103410 18860 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:03.106259 18341 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 0.
I20260709 13:17:03.183135 18335 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:17:03.218412 18678 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.224805 18678 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:03.227631 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:03.229245 18493 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.197714 18860 raft_consensus.cc:697] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:03.236069 18336 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:17:03.236450 18534 tablet_bootstrap.cc:492] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:03.237023 18534 ts_tablet_manager.cc:1403] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.299s	user 0.015s	sys 0.026s
I20260709 13:17:03.239902 18534 raft_consensus.cc:359] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.240631 18534 raft_consensus.cc:385] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:03.240955 18534 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:03.255710 18536 ts_tablet_manager.cc:1434] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.231s	user 0.016s	sys 0.003s
I20260709 13:17:03.221321 18900 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.268414 18493 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:17:03.271173 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:03.271497 18382 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:03.271793 18341 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.272572 18918 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:03.272217 18900 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.273070 18918 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:03.273874 18918 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.275408 18900 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:03.285126 18536 tablet_bootstrap.cc:492] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Bootstrap starting.
I20260709 13:17:03.293589 18534 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.304730 18534 ts_tablet_manager.cc:1434] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.067s	user 0.012s	sys 0.000s
I20260709 13:17:03.260466 18860 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.323179 18341 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:17:03.323071 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:03.356984 18534 tablet_bootstrap.cc:492] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
W20260709 13:17:03.367570 18308 leader_election.cc:343] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:03.370777 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 181292us
I20260709 13:17:03.309475 18900 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.061s
I20260709 13:17:03.385958 18533 tablet_bootstrap.cc:492] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:03.386461 18533 ts_tablet_manager.cc:1403] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.317s	user 0.038s	sys 0.027s
I20260709 13:17:03.383247 18901 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:17:03.399600 18533 raft_consensus.cc:359] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.400250 18533 raft_consensus.cc:385] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:03.400508 18533 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:03.402489 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:03.402034 18533 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.415360 18458 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:03.417048 18533 ts_tablet_manager.cc:1434] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:17:03.419562 18905 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:03.420230 18905 raft_consensus.cc:697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:03.421655 18905 consensus_queue.cc:237] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.429566 18931 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.430365 18931 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.433285 18931 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:03.442194 18536 tablet_bootstrap.cc:654] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:03.454260 18533 tablet_bootstrap.cc:492] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:03.457115 18534 tablet_bootstrap.cc:654] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:03.453070 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:17:03.462625 18307 leader_election.cc:343] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:03.463131 18307 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:03.465582 18902 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:03.480520 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:03.481361 18336 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 1: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:17:03.484648 18458 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:03.490151 18241 catalog_manager.cc:5697] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.500902 18241 catalog_manager.cc:5697] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.488108 18975 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.506246 18414 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.510340 18901 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:03.530689 18536 tablet_bootstrap.cc:492] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: No bootstrap required, opened a new log
I20260709 13:17:03.531296 18536 ts_tablet_manager.cc:1403] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent bootstrapping tablet: real 0.265s	user 0.012s	sys 0.012s
I20260709 13:17:03.543210 18975 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:03.543437 18678 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:03.546814 18533 tablet_bootstrap.cc:654] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:03.541045 18536 raft_consensus.cc:359] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.550230 18536 raft_consensus.cc:385] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:03.550668 18536 raft_consensus.cc:740] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Initialized, Role: FOLLOWER
I20260709 13:17:03.551496 18536 consensus_queue.cc:260] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.557986 18534 tablet_bootstrap.cc:492] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:03.558040 18536 ts_tablet_manager.cc:1434] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 13:17:03.558856 18534 ts_tablet_manager.cc:1403] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.202s	user 0.012s	sys 0.005s
I20260709 13:17:03.571323 18969 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.571986 18969 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.574304 18918 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:03.576800 18860 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:03.580077 18969 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:03.581705 18242 catalog_manager.cc:5697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:03.583887 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:03.583811 18534 raft_consensus.cc:359] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.584656 18534 raft_consensus.cc:385] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:03.584937 18534 raft_consensus.cc:740] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:03.586090 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:03.586089 18534 consensus_queue.cc:260] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.588424 18384 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:03.598110 18969 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:03.614986 18534 ts_tablet_manager.cc:1434] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.001s
I20260709 13:17:03.634001 18534 tablet_bootstrap.cc:492] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Bootstrap starting.
I20260709 13:17:03.643596 18678 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:03.670958 18238 catalog_manager.cc:5697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.673357 18238 catalog_manager.cc:5697] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.708534 18238 catalog_manager.cc:5697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.723140 18910 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.723971 18910 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.727246 18910 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:03.727540 18534 tablet_bootstrap.cc:654] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:03.728775 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:03.729432 18340 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
W20260709 13:17:03.730532 18290 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:03.730661 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:03.731822 18910 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:03.732367 18910 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.732864 18910 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.744967 18910 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.746066 18242 catalog_manager.cc:5697] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.747830 18910 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:03.749526 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:03.750120 18340 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.749770 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:03.750686 18414 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.759967 18414 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:17:03.766247 18457 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:03.768224 18910 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:03.768898 18910 raft_consensus.cc:697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:03.770251 18910 consensus_queue.cc:237] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.771711 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:17:03.781071 18308 consensus_peers.cc:597] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:03.785934 18678 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:03.790110 18410 raft_consensus.cc:2376] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1. Re-sending same reply.
I20260709 13:17:03.794571 18533 tablet_bootstrap.cc:492] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:03.795161 18533 ts_tablet_manager.cc:1403] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.355s	user 0.056s	sys 0.044s
I20260709 13:17:03.797726 18340 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:17:03.802192 18533 raft_consensus.cc:359] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.802930 18533 raft_consensus.cc:385] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:03.803218 18533 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:03.803802 18533 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.816224 18902 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:17:03.805903 18533 ts_tablet_manager.cc:1434] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:17:03.826294 18533 tablet_bootstrap.cc:492] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:03.826948 18534 tablet_bootstrap.cc:492] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: No bootstrap required, opened a new log
I20260709 13:17:03.830822 18533 tablet_bootstrap.cc:654] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:03.831723 18534 ts_tablet_manager.cc:1403] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent bootstrapping tablet: real 0.209s	user 0.012s	sys 0.000s
W20260709 13:17:03.834223 18308 consensus_peers.cc:597] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:03.855628 18534 raft_consensus.cc:359] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.856761 18534 raft_consensus.cc:385] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:03.857402 18534 raft_consensus.cc:740] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Initialized, Role: FOLLOWER
I20260709 13:17:03.858150 18534 consensus_queue.cc:260] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.860227 18534 ts_tablet_manager.cc:1434] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:17:03.863981 18533 tablet_bootstrap.cc:492] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:03.864452 18533 ts_tablet_manager.cc:1403] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.014s
I20260709 13:17:03.880282 18860 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.880906 18860 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.883756 18860 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:03.885856 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:03.889673 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:03.880136 18533 raft_consensus.cc:359] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.890450 18410 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:03.890658 18533 raft_consensus.cc:385] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:03.891003 18533 raft_consensus.cc:740] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:03.890333 18238 catalog_manager.cc:5697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:03.891907 18308 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:03.891681 18533 consensus_queue.cc:260] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.894446 18533 ts_tablet_manager.cc:1434] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 13:17:03.895470 18533 tablet_bootstrap.cc:492] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:03.903849 18678 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:03.905419 18533 tablet_bootstrap.cc:654] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:03.893369 18860 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:03.906356 18860 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.906786 18860 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.916546 18678 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:03.920634 18860 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.921162 18918 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.921702 18918 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.923702 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:03.924352 18410 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.928740 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:03.929320 18910 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:03.923818 18918 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:03.929877 18910 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.930490 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:03.932065 18910 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:03.932961 18382 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:03.933564 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:03.934465 18918 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:03.936436 18410 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:03.939271 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:03.940016 18336 raft_consensus.cc:2368] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 2. Current term is 3.
I20260709 13:17:03.941279 18308 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:03.942183 18901 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:03.942653 18901 raft_consensus.cc:697] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:03.943681 18901 consensus_queue.cc:237] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.947754 18411 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:03.949169 18975 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:03.951407 18458 leader_election.cc:400] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 2. Current term is 3.
I20260709 13:17:03.951682 18458 leader_election.cc:403] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:03.952847 18975 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.967201 18975 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 2. Current term is 3.
I20260709 13:17:03.974838 18860 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:03.974184 18975 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:03.977543 18910 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.981339 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:03.983987 18910 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.988386 18490 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:03.992848 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:03.994387 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:03.995086 18340 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 0.
W20260709 13:17:03.998391 18457 leader_election.cc:343] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:04.003778 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:04.006419 18910 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:04.011843 18905 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:04.012287 18905 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.012641 18905 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:04.021289 18905 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:03.967216 18533 tablet_bootstrap.cc:492] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:04.035821 18533 ts_tablet_manager.cc:1403] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.004s
I20260709 13:17:04.036952 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:17:04.038165 18457 leader_election.cc:343] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:04.044718 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:04.045362 18336 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:04.047995 18240 catalog_manager.cc:5697] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:04.052012 18905 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:04.053326 18533 raft_consensus.cc:359] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:04.053848 18533 raft_consensus.cc:385] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:04.054154 18533 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:04.054906 18533 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:04.056774 18533 ts_tablet_manager.cc:1434] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:17:04.057753 18533 tablet_bootstrap.cc:492] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:04.063804 18533 tablet_bootstrap.cc:654] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:04.070482 18336 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:17:04.087349 18411 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:04.093815 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:04.094635 18975 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:04.095274 18975 raft_consensus.cc:697] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:04.096066 18975 consensus_queue.cc:237] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:04.131228 18238 catalog_manager.cc:5697] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:04.142976 18533 tablet_bootstrap.cc:492] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:04.143532 18533 ts_tablet_manager.cc:1403] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.014s
I20260709 13:17:04.146369 18533 raft_consensus.cc:359] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:04.147104 18533 raft_consensus.cc:385] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:04.147405 18533 raft_consensus.cc:740] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:04.148077 18533 consensus_queue.cc:260] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:04.154029 18533 ts_tablet_manager.cc:1434] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:17:04.154971 18533 tablet_bootstrap.cc:492] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Bootstrap starting.
I20260709 13:17:04.163015 18975 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:04.163698 18533 tablet_bootstrap.cc:654] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:04.189177 18975 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:04.226518 18533 tablet_bootstrap.cc:492] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: No bootstrap required, opened a new log
I20260709 13:17:04.227065 18533 ts_tablet_manager.cc:1403] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Time spent bootstrapping tablet: real 0.072s	user 0.029s	sys 0.022s
I20260709 13:17:04.229736 18533 raft_consensus.cc:359] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:04.230600 18533 raft_consensus.cc:385] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:04.230935 18533 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Initialized, Role: FOLLOWER
I20260709 13:17:04.231564 18533 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:04.233520 18533 ts_tablet_manager.cc:1434] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:17:04.266822 18852 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.267414 18852 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:04.270414 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:04.270925 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:04.269825 18852 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:04.272549 18382 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:04.273241 18852 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:04.325351 18490 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:04.326768 18899 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:04.332296 18411 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:04.337746 18410 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:04.339666 18860 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:04.361675 18410 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:04.578002 18852 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.578536 18852 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:04.580613 18852 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:04.581257 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:04.581997 18336 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 1: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:04.581972 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:04.583483 18382 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:04.584163 18918 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:04.590600 18918 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:04.619766 18910 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:04.668097 18971 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:05.238198 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:05.281852 19016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:05.284914 19017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:05.292030 17228 server_base.cc:1061] running on GCE node
W20260709 13:17:05.292474 19019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:05.293768 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:05.294106 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:05.294345 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603025294295 us; error 0 us; skew 500 ppm
I20260709 13:17:05.294888 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:05.298010 17228 webserver.cc:533] Webserver started at http://127.16.211.4:37141/ using document root <none> and password file <none>
I20260709 13:17:05.298610 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:05.298830 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:05.299197 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:05.300572 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-3-root/instance:
uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
format_stamp: "Formatted at 2026-07-09 13:17:05 on dist-test-slave-96c3"
I20260709 13:17:05.307462 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.007s
I20260709 13:17:05.310982 19024 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:05.312086 17228 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:05.312482 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-3-root
uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
format_stamp: "Formatted at 2026-07-09 13:17:05 on dist-test-slave-96c3"
I20260709 13:17:05.312848 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:05.328675 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:05.331287 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:05.335791 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:05.339484 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:05.339720 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:05.339980 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:05.340175 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:05.421743 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.4:45611
I20260709 13:17:05.421847 19086 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.4:45611 every 8 connection(s)
I20260709 13:17:05.432410 17228 auto_leader_rebalancer-test.cc:384] add a tserver: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:05.448711 19087 heartbeater.cc:344] Connected to a master server at 127.16.211.62:40381
I20260709 13:17:05.449208 19087 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:05.450037 19087 heartbeater.cc:507] Master 127.16.211.62:40381 requested a full tablet report, sending...
I20260709 13:17:05.452651 18241 ts_manager.cc:194] Registered new tserver with Master: 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:05.454748 18241 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54880
I20260709 13:17:05.932339 18336 consensus_queue.cc:237] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:05.948582 18490 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:05.957340 18899 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:05.973352 18309 consensus_peers.cc:597] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6419a332888d490f92e43b717ff1edd4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:05.997495 19098 raft_consensus.cc:2955] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.001308 18488 raft_consensus.cc:2955] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.009353 18411 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:06.010848 19094 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:06.026357 18241 catalog_manager.cc:5697] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.038775 18411 raft_consensus.cc:2955] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.055359 18410 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:06.088070 18488 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:06.089525 18918 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:06.101195 18336 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:06.106482 18969 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:06.116274 18969 raft_consensus.cc:2955] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.122413 18488 raft_consensus.cc:2955] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.141966 18410 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:06.143699 18241 catalog_manager.cc:5697] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.153126 18488 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:06.145756 18384 consensus_peers.cc:597] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c88b963fb1b740418ee335cb0fe83049. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.154678 18918 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:06.156952 18338 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:06.157290 18336 raft_consensus.cc:2955] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.161538 18969 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:06.164227 18384 consensus_peers.cc:597] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f59be45893c741da9dfbf367c31f3851. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.190904 19101 raft_consensus.cc:2955] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.198298 18488 raft_consensus.cc:2955] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.202157 18340 raft_consensus.cc:2955] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.214927 18241 catalog_manager.cc:5697] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:06.210412 18337 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:17:06.257094 18309 consensus_peers.cc:597] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b2a2d7b65c646deb16cdddec208645e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.258703 18490 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:06.260138 19094 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:06.261777 18411 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:06.263083 18899 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:06.269901 19094 raft_consensus.cc:2955] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.271677 18488 raft_consensus.cc:2955] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.277211 18411 raft_consensus.cc:2955] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:06.291671 18241 catalog_manager.cc:5697] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:06.338044 19119 ts_tablet_manager.cc:933] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:06.350296 19119 tablet_copy_client.cc:323] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:06.377526 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet 6419a332888d490f92e43b717ff1edd4 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:06.378216 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet 6419a332888d490f92e43b717ff1edd4 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-6419a332888d490f92e43b717ff1edd4
I20260709 13:17:06.393649 18354 tablet_copy_source_session.cc:215] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:06.399195 19119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6419a332888d490f92e43b717ff1edd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:06.415464 19119 tablet_copy_client.cc:806] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:06.416158 19119 tablet_copy_client.cc:670] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:06.420255 19119 tablet_copy_client.cc:538] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:06.427229 19119 tablet_bootstrap.cc:492] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:06.457403 19087 heartbeater.cc:499] Master 127.16.211.62:40381 was elected leader, sending a full tablet report...
I20260709 13:17:06.542832 19123 ts_tablet_manager.cc:933] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:06.553120 19123 tablet_copy_client.cc:323] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:06.579007 18429 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet c88b963fb1b740418ee335cb0fe83049 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:06.579857 18429 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet c88b963fb1b740418ee335cb0fe83049 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-c88b963fb1b740418ee335cb0fe83049
W20260709 13:17:06.621871 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 45811.4us
I20260709 13:17:06.638515 18429 tablet_copy_source_session.cc:215] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:06.684510 19126 ts_tablet_manager.cc:933] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:06.706354 19123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88b963fb1b740418ee335cb0fe83049. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:06.711972 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 70327.1us
I20260709 13:17:06.733489 19123 tablet_copy_client.cc:806] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:06.734201 19123 tablet_copy_client.cc:670] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:06.789119 19119 tablet_bootstrap.cc:492] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:06.792403 19123 tablet_copy_client.cc:538] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:06.792804 19119 tablet_bootstrap.cc:492] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:06.793504 19119 ts_tablet_manager.cc:1403] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.366s	user 0.071s	sys 0.161s
I20260709 13:17:06.802495 19123 tablet_bootstrap.cc:492] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:06.814421 19119 raft_consensus.cc:359] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:06.815327 19119 raft_consensus.cc:740] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:06.815987 19119 consensus_queue.cc:260] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:06.832652 19123 tablet_bootstrap.cc:492] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:06.833674 19123 tablet_bootstrap.cc:492] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:06.834422 19123 ts_tablet_manager.cc:1403] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.032s	user 0.024s	sys 0.004s
I20260709 13:17:06.837525 19123 raft_consensus.cc:359] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:06.838456 19123 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:06.839171 19123 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:06.842367 19126 tablet_copy_client.cc:323] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:06.848970 19123 ts_tablet_manager.cc:1434] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:17:06.855388 18429 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet f59be45893c741da9dfbf367c31f3851 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:06.855993 18429 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet f59be45893c741da9dfbf367c31f3851 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-f59be45893c741da9dfbf367c31f3851
I20260709 13:17:06.866838 18429 tablet_copy_source_session.cc:215] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:06.872521 18428 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-c88b963fb1b740418ee335cb0fe83049 received from {username='slave'} at 127.0.0.1:44916
I20260709 13:17:06.899765 18428 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-c88b963fb1b740418ee335cb0fe83049 on tablet c88b963fb1b740418ee335cb0fe83049 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:06.901784 19126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f59be45893c741da9dfbf367c31f3851. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:06.892150 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 63832.2us
I20260709 13:17:06.900375 19119 ts_tablet_manager.cc:1434] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.107s	user 0.016s	sys 0.023s
I20260709 13:17:06.934005 19126 tablet_copy_client.cc:806] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:06.934669 19126 tablet_copy_client.cc:670] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:06.949744 19126 tablet_copy_client.cc:538] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:06.959547 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-6419a332888d490f92e43b717ff1edd4 received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:06.960107 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-6419a332888d490f92e43b717ff1edd4 on tablet 6419a332888d490f92e43b717ff1edd4 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:06.959764 19126 tablet_bootstrap.cc:492] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
W20260709 13:17:06.977463 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 79526.2us
W20260709 13:17:06.988276 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 86696.1us
I20260709 13:17:06.991858 19062 raft_consensus.cc:1217] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:07.033625 19126 tablet_bootstrap.cc:492] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:07.034852 19126 tablet_bootstrap.cc:492] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:07.035604 19126 ts_tablet_manager.cc:1403] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.017s
I20260709 13:17:07.038821 19126 raft_consensus.cc:359] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:07.039767 19126 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:07.040524 19126 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:07.048532 19126 ts_tablet_manager.cc:1434] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:17:07.055732 19119 ts_tablet_manager.cc:933] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:07.074934 18428 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-f59be45893c741da9dfbf367c31f3851 received from {username='slave'} at 127.0.0.1:44916
I20260709 13:17:07.075421 18428 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-f59be45893c741da9dfbf367c31f3851 on tablet f59be45893c741da9dfbf367c31f3851 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:07.093629 19119 tablet_copy_client.cc:323] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:07.099666 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet 3b2a2d7b65c646deb16cdddec208645e from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:07.100216 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet 3b2a2d7b65c646deb16cdddec208645e from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-3b2a2d7b65c646deb16cdddec208645e
I20260709 13:17:07.105386 18354 tablet_copy_source_session.cc:215] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:07.107792 19119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b2a2d7b65c646deb16cdddec208645e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.111239 19062 raft_consensus.cc:1217] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:07.130190 19119 tablet_copy_client.cc:806] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:07.130844 19119 tablet_copy_client.cc:670] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:07.134479 19119 tablet_copy_client.cc:538] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:07.142452 19119 tablet_bootstrap.cc:492] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:07.167984 19119 tablet_bootstrap.cc:492] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:07.169019 19119 tablet_bootstrap.cc:492] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:07.169705 19119 ts_tablet_manager.cc:1403] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.027s	user 0.025s	sys 0.000s
I20260709 13:17:07.172534 19119 raft_consensus.cc:359] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:07.173403 19119 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:07.174125 19119 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:07.180557 19119 ts_tablet_manager.cc:1434] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:17:07.183674 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-3b2a2d7b65c646deb16cdddec208645e received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:07.184091 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-3b2a2d7b65c646deb16cdddec208645e on tablet 3b2a2d7b65c646deb16cdddec208645e with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:07.260152 19062 raft_consensus.cc:1217] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:07.520190 19062 raft_consensus.cc:1217] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:07.538184 19134 raft_consensus.cc:1064] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:07.541038 19134 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:07.574877 19062 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:17:07.582360 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 45166.7us
I20260709 13:17:07.588236 19134 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:07.590572 18490 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.591472 18340 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.592885 19141 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:07.593997 19132 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:07.631057 19132 raft_consensus.cc:2955] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:07.635066 18488 raft_consensus.cc:2955] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:07.667207 18340 raft_consensus.cc:2955] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:07.667156 18240 catalog_manager.cc:5697] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:07.676962 19062 raft_consensus.cc:2955] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:17:07.766028 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 59141us
I20260709 13:17:07.773350 19140 raft_consensus.cc:1064] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:07.775854 19140 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:07.834043 18488 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.835206 18336 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.835963 19140 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:07.837978 19134 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:07.850868 19062 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.856509 19134 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:07.867725 19152 raft_consensus.cc:1064] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:07.870462 19152 consensus_queue.cc:237] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:07.873149 18969 raft_consensus.cc:2955] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:07.888893 18490 raft_consensus.cc:2955] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:07.890329 18336 raft_consensus.cc:2955] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:07.897498 19061 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.901427 19151 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:07.904690 18414 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:07.911808 18493 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.891361 18241 catalog_manager.cc:5697] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:07.917821 19138 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:07.918572 18414 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.919849 19152 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:07.929308 19062 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:07.929499 18336 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:07.944401 19140 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:07.953466 19132 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:07.959728 19062 raft_consensus.cc:2955] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:07.976325 19060 raft_consensus.cc:2955] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:07.978436 19132 raft_consensus.cc:2955] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:07.994964 18336 raft_consensus.cc:2955] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.037154 19152 raft_consensus.cc:2955] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.038234 18414 raft_consensus.cc:2955] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.030272 18412 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:08.059525 18238 catalog_manager.cc:5697] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.062897 18493 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:08.070004 19140 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:08.076375 18227 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c88b963fb1b740418ee335cb0fe83049 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:08.081599 19060 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:08.095817 18484 raft_consensus.cc:2955] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.098289 19141 raft_consensus.cc:2955] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.105280 18488 raft_consensus.cc:2955] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.105872 19140 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:08.118306 18227 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f59be45893c741da9dfbf367c31f3851 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:08.124696 19060 raft_consensus.cc:2955] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.138612 19061 raft_consensus.cc:2955] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.142185 19151 raft_consensus.cc:1064] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:08.148181 19151 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:08.166106 18242 catalog_manager.cc:5697] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.182367 18411 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:08.183295 18241 catalog_manager.cc:5697] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:08.186890 18488 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:08.190876 19061 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:08.187875 19138 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:08.193315 19098 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:08.194098 19151 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:08.196209 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet c88b963fb1b740418ee335cb0fe83049 with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:08.204216 19165 tablet_replica.cc:333] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:17:08.213596 19165 raft_consensus.cc:2243] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.230624 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet f59be45893c741da9dfbf367c31f3851 with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37906
I20260709 13:17:08.248019 19138 raft_consensus.cc:2955] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.238829 18340 consensus_queue.cc:237] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:08.258563 19165 raft_consensus.cc:2272] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.258970 19061 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:08.261952 19094 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:08.265518 19169 tablet_replica.cc:333] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:17:08.269045 19169 raft_consensus.cc:2243] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.267992 19165 ts_tablet_manager.cc:1916] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:08.270511 19094 raft_consensus.cc:2955] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.269798 19169 raft_consensus.cc:2272] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.275640 18484 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:08.276540 19061 raft_consensus.cc:2955] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.278127 18484 raft_consensus.cc:2955] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.280581 19060 raft_consensus.cc:2955] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.289845 18240 catalog_manager.cc:5697] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:08.305466 19151 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:08.323504 18484 raft_consensus.cc:2955] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.332792 18336 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:08.346328 19169 ts_tablet_manager.cc:1916] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:08.343701 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6419a332888d490f92e43b717ff1edd4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:08.347792 18240 catalog_manager.cc:5697] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.354203 19061 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:08.356003 19152 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:08.356478 18488 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:08.359434 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet 6419a332888d490f92e43b717ff1edd4 with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:08.364413 19060 raft_consensus.cc:2955] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.362951 19151 raft_consensus.cc:2955] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.384660 19170 tablet_replica.cc:333] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:17:08.386916 19170 raft_consensus.cc:2243] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.391342 19170 raft_consensus.cc:2272] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.395012 19170 ts_tablet_manager.cc:1916] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:08.406287 18240 catalog_manager.cc:5697] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.415915 19165 ts_tablet_manager.cc:1929] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:08.416451 19165 log.cc:1199] T c88b963fb1b740418ee335cb0fe83049 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/c88b963fb1b740418ee335cb0fe83049
I20260709 13:17:08.418270 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b2a2d7b65c646deb16cdddec208645e with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:08.421940 19169 ts_tablet_manager.cc:1929] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:08.422390 19169 log.cc:1199] T f59be45893c741da9dfbf367c31f3851 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/f59be45893c741da9dfbf367c31f3851
I20260709 13:17:08.425451 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet c88b963fb1b740418ee335cb0fe83049 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:08.427701 19170 ts_tablet_manager.cc:1929] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:08.428081 19170 log.cc:1199] T 6419a332888d490f92e43b717ff1edd4 P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/6419a332888d490f92e43b717ff1edd4
I20260709 13:17:08.429622 19170 tablet_replica.cc:333] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:17:08.430210 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet 6419a332888d490f92e43b717ff1edd4 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:08.430857 19170 raft_consensus.cc:2243] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.431435 19170 pending_rounds.cc:70] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303: Trying to abort 1 pending ops.
I20260709 13:17:08.431684 19170 pending_rounds.cc:77] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305638003288674304 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "3b2a2d7b65c646deb16cdddec208645e" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } } }
I20260709 13:17:08.432893 19170 raft_consensus.cc:2917] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:17:08.433283 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet f59be45893c741da9dfbf367c31f3851 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:08.434986 19152 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:08.433290 19170 raft_consensus.cc:2889] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:17:08.436808 19170 raft_consensus.cc:2272] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.445771 19170 ts_tablet_manager.cc:1916] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:08.457760 18488 raft_consensus.cc:2955] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:08.463626 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3b2a2d7b65c646deb16cdddec208645e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:08.473522 19170 ts_tablet_manager.cc:1929] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:08.474061 19170 log.cc:1199] T 3b2a2d7b65c646deb16cdddec208645e P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/3b2a2d7b65c646deb16cdddec208645e
I20260709 13:17:08.477023 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet 3b2a2d7b65c646deb16cdddec208645e (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:09.510447 18336 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:09.519688 18488 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:09.519690 18414 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:09.522991 19138 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:09.533457 18309 consensus_peers.cc:597] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf69de9977524f43803f402f2cfed3d4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:09.535516 19138 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:09.573134 19138 raft_consensus.cc:2955] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:09.577600 18414 raft_consensus.cc:2955] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:09.581064 18488 raft_consensus.cc:2955] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:09.616569 18240 catalog_manager.cc:5697] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:09.672169 18488 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:09.693248 18411 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:09.696687 19174 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:09.715565 18336 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:09.719424 18975 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:09.738865 19171 raft_consensus.cc:2955] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:09.742583 18414 raft_consensus.cc:2955] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
W20260709 13:17:09.746496 18458 consensus_peers.cc:597] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9697a1f706e47fa9c62306b225e97fa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:09.780325 18241 catalog_manager.cc:5697] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:09.781232 18488 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:09.814781 18412 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:09.816754 18340 raft_consensus.cc:2955] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:09.833936 19163 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:09.836802 18340 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:09.842572 19163 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:09.844862 18458 consensus_peers.cc:597] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36d775fb4ae54c3ab8335a03e2ad44f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:09.881428 19171 raft_consensus.cc:2955] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:09.895530 18412 raft_consensus.cc:2955] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:09.912971 18488 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:09.916878 18241 catalog_manager.cc:5697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:09.912618 18336 raft_consensus.cc:2955] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
W20260709 13:17:09.943148 18458 consensus_peers.cc:597] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c860bd12a6124270ba17146fea662e3b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:09.949111 18412 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:09.952950 18341 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:09.953962 19190 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:09.954996 19174 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:09.978025 19174 raft_consensus.cc:2955] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:09.980929 18412 raft_consensus.cc:2955] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:09.990231 18341 raft_consensus.cc:2955] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:10.003077 18240 catalog_manager.cc:5697] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.145102 19199 ts_tablet_manager.cc:933] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:10.169672 19199 tablet_copy_client.cc:323] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:10.171788 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet bf69de9977524f43803f402f2cfed3d4 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:10.172432 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet bf69de9977524f43803f402f2cfed3d4 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-bf69de9977524f43803f402f2cfed3d4
I20260709 13:17:10.185096 18354 tablet_copy_source_session.cc:215] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:10.188927 19199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf69de9977524f43803f402f2cfed3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.195699 19201 ts_tablet_manager.cc:933] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:10.216920 19201 tablet_copy_client.cc:323] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.3:43125
I20260709 13:17:10.255676 19199 tablet_copy_client.cc:806] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:10.256412 19199 tablet_copy_client.cc:670] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:10.262374 19205 ts_tablet_manager.cc:933] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:10.263787 19199 tablet_copy_client.cc:538] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:10.288574 19205 tablet_copy_client.cc:323] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.3:43125
I20260709 13:17:10.288945 18503 tablet_copy_service.cc:140] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Received BeginTabletCopySession request for tablet f9697a1f706e47fa9c62306b225e97fa from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:35114)
I20260709 13:17:10.289601 18503 tablet_copy_service.cc:161] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Beginning new tablet copy session on tablet f9697a1f706e47fa9c62306b225e97fa from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:35114: session id = 31ab487dc52e4f608b39df0fae2fdfa5-f9697a1f706e47fa9c62306b225e97fa
I20260709 13:17:10.291313 19199 tablet_bootstrap.cc:492] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:10.328140 19199 tablet_bootstrap.cc:492] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:10.329392 19199 tablet_bootstrap.cc:492] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:10.330180 19199 ts_tablet_manager.cc:1403] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.039s	user 0.024s	sys 0.005s
I20260709 13:17:10.333309 19199 raft_consensus.cc:359] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:10.334380 19199 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:10.335067 19199 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:10.337666 18502 tablet_copy_service.cc:140] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Received BeginTabletCopySession request for tablet 36d775fb4ae54c3ab8335a03e2ad44f4 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:35114)
I20260709 13:17:10.338352 18502 tablet_copy_service.cc:161] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Beginning new tablet copy session on tablet 36d775fb4ae54c3ab8335a03e2ad44f4 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:35114: session id = 31ab487dc52e4f608b39df0fae2fdfa5-36d775fb4ae54c3ab8335a03e2ad44f4
I20260709 13:17:10.345767 19199 ts_tablet_manager.cc:1434] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 13:17:10.349386 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-bf69de9977524f43803f402f2cfed3d4 received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:10.349850 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-bf69de9977524f43803f402f2cfed3d4 on tablet bf69de9977524f43803f402f2cfed3d4 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:10.361896 18502 tablet_copy_source_session.cc:215] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:10.366696 18503 tablet_copy_source_session.cc:215] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:10.367264 19205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d775fb4ae54c3ab8335a03e2ad44f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.372956 19201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9697a1f706e47fa9c62306b225e97fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.423949 19205 tablet_copy_client.cc:806] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:10.424599 19205 tablet_copy_client.cc:670] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:10.428689 19205 tablet_copy_client.cc:538] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:10.439977 19205 tablet_bootstrap.cc:492] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:10.474407 19205 tablet_bootstrap.cc:492] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:10.475355 19205 tablet_bootstrap.cc:492] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:10.476043 19205 ts_tablet_manager.cc:1403] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.008s
I20260709 13:17:10.478997 19205 raft_consensus.cc:359] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:10.479876 19205 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:10.480551 19205 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:10.486961 19205 ts_tablet_manager.cc:1434] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:17:10.488547 18503 tablet_copy_service.cc:342] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-36d775fb4ae54c3ab8335a03e2ad44f4 received from {username='slave'} at 127.0.0.1:35114
I20260709 13:17:10.489004 18503 tablet_copy_service.cc:434] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-36d775fb4ae54c3ab8335a03e2ad44f4 on tablet 36d775fb4ae54c3ab8335a03e2ad44f4 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:10.515817 19201 tablet_copy_client.cc:806] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:10.516933 19201 tablet_copy_client.cc:670] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:10.522778 19201 tablet_copy_client.cc:538] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:10.525574 19205 ts_tablet_manager.cc:933] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:10.537580 19205 tablet_copy_client.cc:323] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.3:43125
I20260709 13:17:10.539187 18503 tablet_copy_service.cc:140] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Received BeginTabletCopySession request for tablet c860bd12a6124270ba17146fea662e3b from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:35114)
I20260709 13:17:10.539691 18503 tablet_copy_service.cc:161] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Beginning new tablet copy session on tablet c860bd12a6124270ba17146fea662e3b from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:35114: session id = 31ab487dc52e4f608b39df0fae2fdfa5-c860bd12a6124270ba17146fea662e3b
I20260709 13:17:10.550890 18503 tablet_copy_source_session.cc:215] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:10.555462 19205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c860bd12a6124270ba17146fea662e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:10.568344 19201 tablet_bootstrap.cc:492] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:10.572964 19205 tablet_copy_client.cc:806] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:10.573627 19205 tablet_copy_client.cc:670] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:10.579146 19205 tablet_copy_client.cc:538] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:10.590965 19205 tablet_bootstrap.cc:492] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:10.606809 19201 tablet_bootstrap.cc:492] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:10.608002 19201 tablet_bootstrap.cc:492] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:10.625083 19201 ts_tablet_manager.cc:1403] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.016s
I20260709 13:17:10.711030 19201 raft_consensus.cc:359] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:10.712003 19201 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:10.712771 19201 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:10.737193 19060 raft_consensus.cc:1217] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:10.753851 19201 ts_tablet_manager.cc:1434] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.127s	user 0.006s	sys 0.001s
I20260709 13:17:10.760466 18503 tablet_copy_service.cc:342] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-f9697a1f706e47fa9c62306b225e97fa received from {username='slave'} at 127.0.0.1:35114
I20260709 13:17:10.760911 18503 tablet_copy_service.cc:434] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-f9697a1f706e47fa9c62306b225e97fa on tablet f9697a1f706e47fa9c62306b225e97fa with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:10.780925 19205 tablet_bootstrap.cc:492] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:10.782718 19205 tablet_bootstrap.cc:492] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:10.783483 19205 ts_tablet_manager.cc:1403] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.193s	user 0.030s	sys 0.004s
I20260709 13:17:10.789045 19205 raft_consensus.cc:359] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:10.789860 19205 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:10.793131 19205 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:10.795524 19205 ts_tablet_manager.cc:1434] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:17:10.797312 18503 tablet_copy_service.cc:342] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-c860bd12a6124270ba17146fea662e3b received from {username='slave'} at 127.0.0.1:35114
I20260709 13:17:10.797715 18503 tablet_copy_service.cc:434] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-c860bd12a6124270ba17146fea662e3b on tablet c860bd12a6124270ba17146fea662e3b with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:10.861568 19060 raft_consensus.cc:1217] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:10.907925 19060 raft_consensus.cc:1217] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:11.137804 19060 raft_consensus.cc:1217] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:11.167959 19213 raft_consensus.cc:1064] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:11.170830 19213 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:11.178329 19060 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:11.178658 18484 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:11.180032 19178 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:11.180996 19173 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:11.183452 18411 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:11.187399 19213 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:11.195724 19213 raft_consensus.cc:2955] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.198230 19060 raft_consensus.cc:2955] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.204603 18414 raft_consensus.cc:2955] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.214126 18238 catalog_manager.cc:5697] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.224913 18484 raft_consensus.cc:2955] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.258265 19163 raft_consensus.cc:1064] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:11.259045 18336 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:11.260968 19163 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:11.269795 19061 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:11.271620 19213 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:11.287599 19060 raft_consensus.cc:2955] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.285162 19138 raft_consensus.cc:2955] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.303563 18411 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:11.304987 19178 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:11.314162 18411 raft_consensus.cc:2955] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.318670 19061 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:11.319005 18414 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:11.320261 19217 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:17:11.332319 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 49151.2us
I20260709 13:17:11.333755 19217 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:11.366662 18336 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:11.369151 18240 catalog_manager.cc:5697] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.386574 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet bf69de9977524f43803f402f2cfed3d4 with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:11.389006 19217 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:11.395488 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf69de9977524f43803f402f2cfed3d4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:11.403911 19190 raft_consensus.cc:2955] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.409951 19232 tablet_replica.cc:333] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:17:11.411055 19232 raft_consensus.cc:2243] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:11.411793 19232 raft_consensus.cc:2272] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:11.413044 19062 raft_consensus.cc:2955] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.416683 19232 ts_tablet_manager.cc:1916] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:11.437976 18411 raft_consensus.cc:2955] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.443713 18240 catalog_manager.cc:5697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.456427 19232 ts_tablet_manager.cc:1929] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:11.456985 19232 log.cc:1199] T bf69de9977524f43803f402f2cfed3d4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/bf69de9977524f43803f402f2cfed3d4
I20260709 13:17:11.458673 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet bf69de9977524f43803f402f2cfed3d4 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:11.462030 18484 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:11.470649 19062 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:11.475430 18411 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:11.472117 19163 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:11.478070 19217 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:11.487805 19217 raft_consensus.cc:2955] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.492228 18411 raft_consensus.cc:2955] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.493021 19062 raft_consensus.cc:2955] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.497605 19190 raft_consensus.cc:1064] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:11.501083 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36d775fb4ae54c3ab8335a03e2ad44f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:11.505770 19190 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:11.514709 18241 catalog_manager.cc:5697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:11.522148 18411 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:11.522814 18337 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:11.523630 19190 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:11.524786 19217 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:11.528663 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet 36d775fb4ae54c3ab8335a03e2ad44f4 with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37906
I20260709 13:17:11.523079 19062 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:11.530527 19217 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:11.537956 19237 tablet_replica.cc:333] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:17:11.539664 19237 raft_consensus.cc:2243] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:11.540596 19237 pending_rounds.cc:70] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19: Trying to abort 1 pending ops.
I20260709 13:17:11.540979 19237 pending_rounds.cc:77] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305638016038522880 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } } }
I20260709 13:17:11.542497 19237 raft_consensus.cc:2917] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:17:11.543987 19237 raft_consensus.cc:2889] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:17:11.544380 19237 raft_consensus.cc:2272] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:11.549335 19237 ts_tablet_manager.cc:1916] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:11.571125 19234 raft_consensus.cc:2955] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.572499 18411 raft_consensus.cc:2955] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.577965 19237 ts_tablet_manager.cc:1929] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:11.578460 19237 log.cc:1199] T 36d775fb4ae54c3ab8335a03e2ad44f4 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/36d775fb4ae54c3ab8335a03e2ad44f4
I20260709 13:17:11.586179 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet 36d775fb4ae54c3ab8335a03e2ad44f4 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:11.592803 18239 catalog_manager.cc:5697] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.594054 19062 raft_consensus.cc:2955] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.592981 18337 raft_consensus.cc:2955] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.636626 18484 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:11.643522 19062 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:11.643729 18337 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:11.645009 19190 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:11.647383 19190 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:11.658461 19217 raft_consensus.cc:2955] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.665829 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c860bd12a6124270ba17146fea662e3b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:11.668565 18336 raft_consensus.cc:2955] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.672861 19062 raft_consensus.cc:2955] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.686908 18240 catalog_manager.cc:5697] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.706643 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet c860bd12a6124270ba17146fea662e3b with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:11.708998 19240 tablet_replica.cc:333] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:17:11.710394 19240 raft_consensus.cc:2243] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:11.711215 19240 raft_consensus.cc:2272] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:11.714970 19163 raft_consensus.cc:1064] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:11.717439 19163 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:11.721983 19240 ts_tablet_manager.cc:1916] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:11.737933 19062 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:11.742069 18414 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:11.743439 19163 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:11.748507 19240 ts_tablet_manager.cc:1929] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:11.749034 19240 log.cc:1199] T c860bd12a6124270ba17146fea662e3b P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/c860bd12a6124270ba17146fea662e3b
I20260709 13:17:11.751307 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet c860bd12a6124270ba17146fea662e3b (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:11.758149 18336 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:11.759478 19190 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:11.761793 19190 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:17:11.773104 19163 raft_consensus.cc:2955] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.778533 18336 raft_consensus.cc:2955] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.785063 19062 raft_consensus.cc:2955] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.796324 18240 catalog_manager.cc:5697] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.806046 18411 raft_consensus.cc:2955] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.847707 18484 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:11.852932 19062 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:11.854560 19163 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:11.855839 18411 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:11.857612 19190 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:17:11.868331 19174 raft_consensus.cc:2955] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.900857 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f9697a1f706e47fa9c62306b225e97fa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:11.896963 19062 raft_consensus.cc:2955] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.905558 18411 raft_consensus.cc:2955] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:11.924381 18240 catalog_manager.cc:5697] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:11.940481 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet f9697a1f706e47fa9c62306b225e97fa with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37906
I20260709 13:17:11.941525 19237 tablet_replica.cc:333] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:17:11.942694 19237 raft_consensus.cc:2243] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:11.943486 19237 raft_consensus.cc:2272] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:11.946452 19237 ts_tablet_manager.cc:1916] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:11.960361 19237 ts_tablet_manager.cc:1929] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:11.960745 19237 log.cc:1199] T f9697a1f706e47fa9c62306b225e97fa P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/f9697a1f706e47fa9c62306b225e97fa
I20260709 13:17:11.962347 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet f9697a1f706e47fa9c62306b225e97fa (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:13.009532 18337 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:13.015089 18484 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:13.015934 18411 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:13.016343 18309 consensus_peers.cc:597] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8b55a3ba07d4097b2da619afcf80e3f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:13.016891 19213 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.017815 19249 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.025048 19213 raft_consensus.cc:2955] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:13.026723 18411 raft_consensus.cc:2955] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:13.030088 18488 raft_consensus.cc:2955] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:13.057085 18411 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:13.057675 18238 catalog_manager.cc:5697] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:13.065555 18488 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:13.067508 19256 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:13.068439 18384 consensus_peers.cc:597] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e0c142ad00b14613a8e3623c478ebdaf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:13.068950 18337 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:13.071465 19256 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.092268 18337 raft_consensus.cc:2955] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:13.092016 19256 raft_consensus.cc:2955] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:13.105554 18488 raft_consensus.cc:2955] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:13.113875 18484 consensus_queue.cc:237] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:13.133177 18240 catalog_manager.cc:5697] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.139688 18410 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:13.140812 18336 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:13.143491 19246 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:13.147914 18458 consensus_peers.cc:597] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1bc6fb6380b4ad7b0907976d075d20e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:13.148777 19234 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.153766 19246 raft_consensus.cc:2955] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:13.159025 18410 raft_consensus.cc:2955] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:13.167733 18337 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:13.177861 18240 catalog_manager.cc:5697] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.182224 18336 raft_consensus.cc:2955] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:13.204720 18484 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:13.204805 18309 consensus_peers.cc:597] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b532a06bf55a4b9b892b97bd8376715a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:13.208437 18410 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:13.209591 19252 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:13.210572 19229 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.218605 19229 raft_consensus.cc:2955] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:13.220214 18410 raft_consensus.cc:2955] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:13.229844 18488 raft_consensus.cc:2955] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:13.244531 18240 catalog_manager.cc:5697] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.531266 19270 ts_tablet_manager.cc:933] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:13.533260 19270 tablet_copy_client.cc:323] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:13.535210 18428 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet e0c142ad00b14613a8e3623c478ebdaf from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:13.535864 18428 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet e0c142ad00b14613a8e3623c478ebdaf from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-e0c142ad00b14613a8e3623c478ebdaf
I20260709 13:17:13.543164 18428 tablet_copy_source_session.cc:215] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:13.546212 19270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c142ad00b14613a8e3623c478ebdaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.563277 19270 tablet_copy_client.cc:806] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:13.563859 19270 tablet_copy_client.cc:670] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:13.567528 19270 tablet_copy_client.cc:538] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:13.574536 19270 tablet_bootstrap.cc:492] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:13.593719 19270 tablet_bootstrap.cc:492] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:13.594610 19270 tablet_bootstrap.cc:492] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:13.595180 19270 ts_tablet_manager.cc:1403] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.008s
I20260709 13:17:13.597366 19270 raft_consensus.cc:359] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:13.597976 19270 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:13.598537 19270 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:13.601369 19270 ts_tablet_manager.cc:1434] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:13.602931 18428 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-e0c142ad00b14613a8e3623c478ebdaf received from {username='slave'} at 127.0.0.1:44916
I20260709 13:17:13.603387 18428 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-e0c142ad00b14613a8e3623c478ebdaf on tablet e0c142ad00b14613a8e3623c478ebdaf with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:13.627188 19270 ts_tablet_manager.cc:933] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:13.629398 19270 tablet_copy_client.cc:323] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:13.631299 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet b8b55a3ba07d4097b2da619afcf80e3f from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:13.631980 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet b8b55a3ba07d4097b2da619afcf80e3f from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-b8b55a3ba07d4097b2da619afcf80e3f
I20260709 13:17:13.634838 19275 ts_tablet_manager.cc:933] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:13.638649 19275 tablet_copy_client.cc:323] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.3:43125
I20260709 13:17:13.640144 18503 tablet_copy_service.cc:140] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Received BeginTabletCopySession request for tablet e1bc6fb6380b4ad7b0907976d075d20e from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:35114)
I20260709 13:17:13.640662 18503 tablet_copy_service.cc:161] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Beginning new tablet copy session on tablet e1bc6fb6380b4ad7b0907976d075d20e from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:35114: session id = 31ab487dc52e4f608b39df0fae2fdfa5-e1bc6fb6380b4ad7b0907976d075d20e
I20260709 13:17:13.642098 18354 tablet_copy_source_session.cc:215] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:13.645370 19270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b55a3ba07d4097b2da619afcf80e3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.649207 18503 tablet_copy_source_session.cc:215] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:13.660846 19275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1bc6fb6380b4ad7b0907976d075d20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.661423 19270 tablet_copy_client.cc:806] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:13.661985 19270 tablet_copy_client.cc:670] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:13.666218 19270 tablet_copy_client.cc:538] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:13.675434 19270 tablet_bootstrap.cc:492] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:13.696786 19277 ts_tablet_manager.cc:933] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:13.700557 19275 tablet_copy_client.cc:806] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:13.702647 19275 tablet_copy_client.cc:670] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:13.705636 19277 tablet_copy_client.cc:323] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:13.715199 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet b532a06bf55a4b9b892b97bd8376715a from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:13.715739 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet b532a06bf55a4b9b892b97bd8376715a from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-b532a06bf55a4b9b892b97bd8376715a
I20260709 13:17:13.722923 18354 tablet_copy_source_session.cc:215] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:13.731787 19277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b532a06bf55a4b9b892b97bd8376715a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.746366 19270 tablet_bootstrap.cc:492] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:13.747386 19270 tablet_bootstrap.cc:492] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:13.748097 19270 ts_tablet_manager.cc:1403] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.073s	user 0.027s	sys 0.008s
I20260709 13:17:13.755795 19275 tablet_copy_client.cc:538] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:13.776880 19275 tablet_bootstrap.cc:492] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:13.779729 19270 raft_consensus.cc:359] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:13.780735 19270 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:13.781384 19270 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:13.784911 19270 ts_tablet_manager.cc:1434] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:17:13.785732 19277 tablet_copy_client.cc:806] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:13.786290 19277 tablet_copy_client.cc:670] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:13.787323 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b8b55a3ba07d4097b2da619afcf80e3f received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:13.787755 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b8b55a3ba07d4097b2da619afcf80e3f on tablet b8b55a3ba07d4097b2da619afcf80e3f with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:13.796440 19277 tablet_copy_client.cc:538] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:13.809566 19275 tablet_bootstrap.cc:492] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:13.810580 19275 tablet_bootstrap.cc:492] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:13.811257 19275 ts_tablet_manager.cc:1403] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.009s
I20260709 13:17:13.814188 19277 tablet_bootstrap.cc:492] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:13.815158 19275 raft_consensus.cc:359] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:13.816061 19275 raft_consensus.cc:740] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:13.816687 19275 consensus_queue.cc:260] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:13.826596 19275 ts_tablet_manager.cc:1434] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:17:13.835539 18503 tablet_copy_service.cc:342] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-e1bc6fb6380b4ad7b0907976d075d20e received from {username='slave'} at 127.0.0.1:35114
I20260709 13:17:13.836005 18503 tablet_copy_service.cc:434] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-e1bc6fb6380b4ad7b0907976d075d20e on tablet e1bc6fb6380b4ad7b0907976d075d20e with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:13.846289 19277 tablet_bootstrap.cc:492] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:13.847081 19277 tablet_bootstrap.cc:492] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:13.847648 19277 ts_tablet_manager.cc:1403] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.004s
I20260709 13:17:13.850190 19277 raft_consensus.cc:359] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:13.851012 19277 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:13.851630 19277 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:13.854239 19277 ts_tablet_manager.cc:1434] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:17:13.856309 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b532a06bf55a4b9b892b97bd8376715a received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:13.856690 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b532a06bf55a4b9b892b97bd8376715a on tablet b532a06bf55a4b9b892b97bd8376715a with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:13.969811 19061 raft_consensus.cc:1217] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:14.063297 19061 raft_consensus.cc:1217] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:14.139751 19061 raft_consensus.cc:1217] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:14.231730 19061 raft_consensus.cc:1217] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:14.387426 19209 raft_consensus.cc:1064] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:14.389617 19209 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:14.395428 19061 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.397330 18340 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.397318 19134 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:14.398459 18488 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.398895 19134 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:14.400367 19209 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.409575 19134 raft_consensus.cc:2955] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.411008 18340 raft_consensus.cc:2955] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.416217 18488 raft_consensus.cc:2955] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.431429 18241 catalog_manager.cc:5697] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.427264 19061 raft_consensus.cc:2955] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.465147 18411 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:14.469785 18488 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.471374 19256 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.472468 19061 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.474412 19256 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.480861 19134 raft_consensus.cc:2955] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.484483 18484 raft_consensus.cc:2955] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.486475 19061 raft_consensus.cc:2955] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.504887 18227 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e0c142ad00b14613a8e3623c478ebdaf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:14.508140 18238 catalog_manager.cc:5697] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.519054 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet e0c142ad00b14613a8e3623c478ebdaf with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37906
I20260709 13:17:14.520993 19293 tablet_replica.cc:333] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:17:14.522022 19293 raft_consensus.cc:2243] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:14.522749 19293 raft_consensus.cc:2272] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:14.537714 19293 ts_tablet_manager.cc:1916] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:14.551131 19293 ts_tablet_manager.cc:1929] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:14.551472 19293 log.cc:1199] T e0c142ad00b14613a8e3623c478ebdaf P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/e0c142ad00b14613a8e3623c478ebdaf
I20260709 13:17:14.552718 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet e0c142ad00b14613a8e3623c478ebdaf (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:14.566756 19213 raft_consensus.cc:1064] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:14.568953 19213 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:14.579596 18411 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.579960 18484 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.580508 19061 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.581290 19252 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.582669 19229 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.585582 19252 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:14.618563 19299 raft_consensus.cc:1064] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:14.621740 19299 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:14.621975 19213 raft_consensus.cc:2955] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.623116 18484 raft_consensus.cc:2955] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.624231 19062 raft_consensus.cc:2955] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.642735 18411 raft_consensus.cc:2955] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.645130 18241 catalog_manager.cc:5697] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.666364 19061 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.668721 18340 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:14.669144 18484 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.669268 19229 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.670683 19213 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.675364 18410 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.677806 19061 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.681957 18410 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.685142 19229 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.681733 19252 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.687294 19295 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.700935 19295 raft_consensus.cc:2955] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.707087 18410 raft_consensus.cc:2955] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.718497 19061 raft_consensus.cc:2955] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.723371 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b532a06bf55a4b9b892b97bd8376715a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:14.732203 18241 catalog_manager.cc:5697] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.735229 19302 raft_consensus.cc:2955] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.734326 18411 raft_consensus.cc:2955] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.740839 19061 raft_consensus.cc:2955] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.748672 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet b532a06bf55a4b9b892b97bd8376715a with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:14.753167 19305 tablet_replica.cc:333] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:17:14.754313 19305 raft_consensus.cc:2243] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:14.755761 19305 raft_consensus.cc:2272] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:14.760393 19305 ts_tablet_manager.cc:1916] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:14.760980 18484 raft_consensus.cc:2955] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.764063 18241 catalog_manager.cc:5697] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.776475 19305 ts_tablet_manager.cc:1929] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:14.777001 19305 log.cc:1199] T b532a06bf55a4b9b892b97bd8376715a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/b532a06bf55a4b9b892b97bd8376715a
I20260709 13:17:14.781054 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet b532a06bf55a4b9b892b97bd8376715a (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:14.800540 18336 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:14.806365 19062 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.807974 19299 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.812279 18410 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.813365 19246 raft_consensus.cc:1064] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:14.813772 19295 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.818325 19302 raft_consensus.cc:2955] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.820592 19246 consensus_queue.cc:237] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:14.825599 19061 raft_consensus.cc:2955] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.826406 18410 raft_consensus.cc:2955] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.852103 18411 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.854835 19264 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.859506 18239 catalog_manager.cc:5697] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.869175 18336 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.871078 19061 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.871548 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b8b55a3ba07d4097b2da619afcf80e3f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:14.873415 19264 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.876241 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet b8b55a3ba07d4097b2da619afcf80e3f with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:14.877058 19306 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:14.877820 19305 tablet_replica.cc:333] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:17:14.914191 19305 raft_consensus.cc:2243] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:14.915093 19305 raft_consensus.cc:2272] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:14.919240 19305 ts_tablet_manager.cc:1916] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:14.928851 19310 raft_consensus.cc:2955] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.932440 18411 raft_consensus.cc:2955] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.937881 19062 raft_consensus.cc:2955] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.953465 18336 raft_consensus.cc:2955] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.951165 18239 catalog_manager.cc:5697] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.975521 18488 consensus_queue.cc:237] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:14.976662 19305 ts_tablet_manager.cc:1929] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:14.977138 19305 log.cc:1199] T b8b55a3ba07d4097b2da619afcf80e3f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/b8b55a3ba07d4097b2da619afcf80e3f
I20260709 13:17:14.987735 19062 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.988134 18336 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.989501 19307 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.991832 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet b8b55a3ba07d4097b2da619afcf80e3f (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:14.991951 19264 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.996445 19310 raft_consensus.cc:2955] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:14.997835 18340 raft_consensus.cc:2955] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:15.000937 19062 raft_consensus.cc:2955] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:15.006142 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e1bc6fb6380b4ad7b0907976d075d20e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:15.014986 18239 catalog_manager.cc:5697] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:15.028697 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet e1bc6fb6380b4ad7b0907976d075d20e with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:15.033742 19314 tablet_replica.cc:333] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:17:15.034722 19314 raft_consensus.cc:2243] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:15.035370 19314 raft_consensus.cc:2272] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:15.038971 19314 ts_tablet_manager.cc:1916] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:15.050524 19314 ts_tablet_manager.cc:1929] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:15.050884 19314 log.cc:1199] T e1bc6fb6380b4ad7b0907976d075d20e P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/e1bc6fb6380b4ad7b0907976d075d20e
I20260709 13:17:15.052436 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet e1bc6fb6380b4ad7b0907976d075d20e (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:16.098208 18340 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:16.105446 18484 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:16.106509 18410 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:16.106941 18309 consensus_peers.cc:597] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218ede86207640ab99622c70bae54d07. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.107972 19317 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:16.108858 19302 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:16.118048 19315 raft_consensus.cc:2955] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.119467 18484 raft_consensus.cc:2955] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.120296 18411 raft_consensus.cc:2955] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.137315 18410 consensus_queue.cc:237] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:16.138362 18240 catalog_manager.cc:5697] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.161185 18484 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:16.162207 18336 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:16.163381 18384 consensus_peers.cc:597] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 102530a9a2f94c3492b2af9e95b376f6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.164140 19309 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:16.165015 19325 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:16.176390 19309 raft_consensus.cc:2955] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.177675 18336 raft_consensus.cc:2955] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.178102 18484 raft_consensus.cc:2955] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.189553 18488 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:16.196858 18238 catalog_manager.cc:5697] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.203032 18410 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:16.203704 18458 consensus_peers.cc:597] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f8c1407aa1e47808dbc2b1bc02c81a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.205010 18336 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:16.204967 19264 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:16.219506 19264 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:16.221701 19307 raft_consensus.cc:2955] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.224565 18411 raft_consensus.cc:2955] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.243945 18340 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:16.244028 18336 raft_consensus.cc:2955] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.261456 18238 catalog_manager.cc:5697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.268520 18484 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:16.268427 18309 consensus_peers.cc:597] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4511f72b2b34e4d82124396a41054ca. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.269797 18411 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:16.270553 19317 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:16.271456 19315 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:16.288980 19315 raft_consensus.cc:2955] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.290177 18411 raft_consensus.cc:2955] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.293536 18484 raft_consensus.cc:2955] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.308796 18238 catalog_manager.cc:5697] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:16.533553 19335 ts_tablet_manager.cc:933] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:16.535383 19335 tablet_copy_client.cc:323] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:16.536761 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet 218ede86207640ab99622c70bae54d07 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:16.537233 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet 218ede86207640ab99622c70bae54d07 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-218ede86207640ab99622c70bae54d07
I20260709 13:17:16.543035 18354 tablet_copy_source_session.cc:215] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:16.545833 19335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218ede86207640ab99622c70bae54d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.550719 19337 ts_tablet_manager.cc:933] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:16.556921 19337 tablet_copy_client.cc:323] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:16.558602 18428 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet 102530a9a2f94c3492b2af9e95b376f6 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:16.559114 18428 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet 102530a9a2f94c3492b2af9e95b376f6 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-102530a9a2f94c3492b2af9e95b376f6
I20260709 13:17:16.560974 19335 tablet_copy_client.cc:806] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:16.561510 19335 tablet_copy_client.cc:670] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:16.565534 19335 tablet_copy_client.cc:538] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:16.567233 18428 tablet_copy_source_session.cc:215] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:16.570546 19337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102530a9a2f94c3492b2af9e95b376f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.573374 19335 tablet_bootstrap.cc:492] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:16.587523 19337 tablet_copy_client.cc:806] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:16.588153 19337 tablet_copy_client.cc:670] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:16.596781 19337 tablet_copy_client.cc:538] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:16.597581 19335 tablet_bootstrap.cc:492] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:16.598475 19335 tablet_bootstrap.cc:492] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:16.599105 19335 ts_tablet_manager.cc:1403] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.010s
I20260709 13:17:16.602378 19335 raft_consensus.cc:359] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:16.603247 19335 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:16.603907 19335 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:16.606174 19337 tablet_bootstrap.cc:492] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:16.632658 19335 ts_tablet_manager.cc:1434] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.008s
I20260709 13:17:16.635242 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-218ede86207640ab99622c70bae54d07 received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:16.635818 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-218ede86207640ab99622c70bae54d07 on tablet 218ede86207640ab99622c70bae54d07 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:16.653303 19337 tablet_bootstrap.cc:492] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:16.654312 19337 tablet_bootstrap.cc:492] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:16.655059 19337 ts_tablet_manager.cc:1403] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.049s	user 0.027s	sys 0.017s
I20260709 13:17:16.657501 19337 raft_consensus.cc:359] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:16.658205 19337 raft_consensus.cc:740] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:16.658731 19337 consensus_queue.cc:260] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:16.660797 19337 ts_tablet_manager.cc:1434] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:17:16.662668 18428 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-102530a9a2f94c3492b2af9e95b376f6 received from {username='slave'} at 127.0.0.1:44916
I20260709 13:17:16.663009 18428 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-102530a9a2f94c3492b2af9e95b376f6 on tablet 102530a9a2f94c3492b2af9e95b376f6 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:16.687981 19337 ts_tablet_manager.cc:933] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:16.689576 19337 tablet_copy_client.cc:323] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.3:43125
I20260709 13:17:16.690970 18503 tablet_copy_service.cc:140] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Received BeginTabletCopySession request for tablet 4f8c1407aa1e47808dbc2b1bc02c81a3 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:35114)
I20260709 13:17:16.691406 18503 tablet_copy_service.cc:161] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Beginning new tablet copy session on tablet 4f8c1407aa1e47808dbc2b1bc02c81a3 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:35114: session id = 31ab487dc52e4f608b39df0fae2fdfa5-4f8c1407aa1e47808dbc2b1bc02c81a3
I20260709 13:17:16.696774 18503 tablet_copy_source_session.cc:215] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:16.700052 19337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f8c1407aa1e47808dbc2b1bc02c81a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.712250 19337 tablet_copy_client.cc:806] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:16.712766 19337 tablet_copy_client.cc:670] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:16.717038 19337 tablet_copy_client.cc:538] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:16.723708 19337 tablet_bootstrap.cc:492] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:16.740794 19337 tablet_bootstrap.cc:492] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:16.741515 19337 tablet_bootstrap.cc:492] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:16.742174 19337 ts_tablet_manager.cc:1403] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.003s
I20260709 13:17:16.744971 19337 raft_consensus.cc:359] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:16.745769 19337 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:16.746423 19337 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:16.748112 19337 ts_tablet_manager.cc:1434] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:17:16.750982 18503 tablet_copy_service.cc:342] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-4f8c1407aa1e47808dbc2b1bc02c81a3 received from {username='slave'} at 127.0.0.1:35114
I20260709 13:17:16.751401 18503 tablet_copy_service.cc:434] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-4f8c1407aa1e47808dbc2b1bc02c81a3 on tablet 4f8c1407aa1e47808dbc2b1bc02c81a3 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:16.820155 19337 ts_tablet_manager.cc:933] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:16.826709 19337 tablet_copy_client.cc:323] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:16.828275 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet d4511f72b2b34e4d82124396a41054ca from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:16.828799 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet d4511f72b2b34e4d82124396a41054ca from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-d4511f72b2b34e4d82124396a41054ca
I20260709 13:17:16.836345 18354 tablet_copy_source_session.cc:215] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:16.840242 19337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4511f72b2b34e4d82124396a41054ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.852861 19337 tablet_copy_client.cc:806] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:16.853432 19337 tablet_copy_client.cc:670] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:16.856917 19337 tablet_copy_client.cc:538] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:16.864050 19337 tablet_bootstrap.cc:492] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:16.877822 19337 tablet_bootstrap.cc:492] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:16.878538 19337 tablet_bootstrap.cc:492] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:16.879017 19337 ts_tablet_manager.cc:1403] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.005s
I20260709 13:17:16.880810 19337 raft_consensus.cc:359] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:16.881371 19337 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:16.881830 19337 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:16.883670 19337 ts_tablet_manager.cc:1434] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:17:16.885373 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-d4511f72b2b34e4d82124396a41054ca received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:16.885780 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-d4511f72b2b34e4d82124396a41054ca on tablet d4511f72b2b34e4d82124396a41054ca with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:17.040758 19062 raft_consensus.cc:1217] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:17.077860 19062 raft_consensus.cc:1217] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:17.111172 19062 raft_consensus.cc:1217] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:17.363206 19062 raft_consensus.cc:1217] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:17.467753 19331 raft_consensus.cc:1064] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:17.470454 19331 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:17.480907 19062 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:17.482308 19264 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:17.482965 18340 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:17.483330 18410 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:17.484915 19264 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:17.487023 19307 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:17.494504 19307 raft_consensus.cc:2955] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.497390 18410 raft_consensus.cc:2955] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.510751 19062 raft_consensus.cc:2955] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.521544 18239 catalog_manager.cc:5697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.526032 18340 raft_consensus.cc:2955] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.534909 19317 raft_consensus.cc:1064] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:17.540558 19317 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:17.552281 19062 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:17.554862 19347 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:17.555545 19348 raft_consensus.cc:1064] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:17.555092 18488 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:17.558282 19348 consensus_queue.cc:237] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:17.561538 19347 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:17.566036 18410 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:17.568641 18484 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:17.573632 19062 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:17.574621 18340 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:17.576280 19264 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:17.576483 19347 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:17.577931 19331 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:17.595110 19264 raft_consensus.cc:2955] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.604496 19315 raft_consensus.cc:2955] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.605963 19062 raft_consensus.cc:2955] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.624413 18239 catalog_manager.cc:5697] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.646133 19062 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:17.646587 18488 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:17.648228 18340 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:17.648025 19309 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:17.649889 19309 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:17.654254 19325 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:17.659152 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 44077.7us
W20260709 13:17:17.660151 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 56485.8us
I20260709 13:17:17.663455 18340 raft_consensus.cc:2955] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.665437 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4f8c1407aa1e47808dbc2b1bc02c81a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:17.667218 19061 raft_consensus.cc:2955] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.668121 18484 raft_consensus.cc:2955] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.675200 18239 catalog_manager.cc:5697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.679702 18411 raft_consensus.cc:2955] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.694574 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f8c1407aa1e47808dbc2b1bc02c81a3 with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:17.704288 18488 raft_consensus.cc:2955] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.704245 19325 raft_consensus.cc:2955] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.718511 18340 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:17.735350 18336 raft_consensus.cc:2955] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.740387 19061 raft_consensus.cc:2955] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.731886 19371 tablet_replica.cc:333] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:17:17.751354 19371 raft_consensus.cc:2243] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.752184 19371 raft_consensus.cc:2272] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.756723 19371 ts_tablet_manager.cc:1916] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:17.727614 18241 catalog_manager.cc:5697] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.769162 18411 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:17.771557 19315 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:17.779807 19061 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:17.782645 19347 raft_consensus.cc:2955] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.789981 19371 ts_tablet_manager.cc:1929] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:17.791390 19371 log.cc:1199] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/4f8c1407aa1e47808dbc2b1bc02c81a3
I20260709 13:17:17.792372 18410 consensus_queue.cc:237] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:17.793578 19317 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:17.794523 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet 4f8c1407aa1e47808dbc2b1bc02c81a3 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:17.803589 19061 raft_consensus.cc:2955] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.806870 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 218ede86207640ab99622c70bae54d07 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:17.812523 18411 raft_consensus.cc:2955] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.818647 18239 catalog_manager.cc:5697] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.823700 19061 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:17.829123 18493 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:17.834327 19348 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:17.835992 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet 218ede86207640ab99622c70bae54d07 with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:17.840422 19325 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:17.842976 19325 raft_consensus.cc:2955] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.844663 18484 raft_consensus.cc:2955] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.853539 19347 raft_consensus.cc:1064] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:17.868680 19347 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:17.871465 18227 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 102530a9a2f94c3492b2af9e95b376f6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:17.872928 19372 tablet_replica.cc:333] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:17:17.872982 18239 catalog_manager.cc:5697] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.881038 19061 raft_consensus.cc:2955] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.891088 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet 102530a9a2f94c3492b2af9e95b376f6 with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37906
I20260709 13:17:17.892279 19372 raft_consensus.cc:2243] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.893047 19372 raft_consensus.cc:2272] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.897255 19372 ts_tablet_manager.cc:1916] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:17.906661 19374 tablet_replica.cc:333] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:17:17.907917 19374 raft_consensus.cc:2243] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.910388 19374 raft_consensus.cc:2272] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.922201 19374 ts_tablet_manager.cc:1916] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:17.931990 19372 ts_tablet_manager.cc:1929] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:17.932533 19372 log.cc:1199] T 218ede86207640ab99622c70bae54d07 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/218ede86207640ab99622c70bae54d07
I20260709 13:17:17.934219 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet 218ede86207640ab99622c70bae54d07 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:17.946528 19374 ts_tablet_manager.cc:1929] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:17.947086 19374 log.cc:1199] T 102530a9a2f94c3492b2af9e95b376f6 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/102530a9a2f94c3492b2af9e95b376f6
I20260709 13:17:17.948678 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet 102530a9a2f94c3492b2af9e95b376f6 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:17.952524 19061 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:17.953797 19317 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:17.954783 18488 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:17.956723 19366 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:17.962116 18411 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:17.963996 19317 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:17.991457 19366 raft_consensus.cc:2955] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:17.999888 18410 raft_consensus.cc:2955] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:18.017249 18488 raft_consensus.cc:2955] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:18.028167 18238 catalog_manager.cc:5697] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:18.032652 19061 raft_consensus.cc:2955] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:18.054519 18340 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:18.059989 19061 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:18.061365 18410 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:18.061419 19315 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:18.064105 19317 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:18.069000 19317 raft_consensus.cc:2955] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:18.070685 19061 raft_consensus.cc:2955] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:18.072144 18411 raft_consensus.cc:2955] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:18.082508 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d4511f72b2b34e4d82124396a41054ca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:18.084365 18238 catalog_manager.cc:5697] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:18.098223 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet d4511f72b2b34e4d82124396a41054ca with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:18.099112 19372 tablet_replica.cc:333] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:17:18.100014 19372 raft_consensus.cc:2243] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.100823 19372 raft_consensus.cc:2272] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.103669 19372 ts_tablet_manager.cc:1916] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:18.117662 19372 ts_tablet_manager.cc:1929] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:18.118054 19372 log.cc:1199] T d4511f72b2b34e4d82124396a41054ca P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/d4511f72b2b34e4d82124396a41054ca
I20260709 13:17:18.119609 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet d4511f72b2b34e4d82124396a41054ca (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:19.286656 18340 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:19.295378 18488 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:19.295373 18411 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:17:19.295565 18309 consensus_peers.cc:597] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3eb2cd7aaa1d4bd3866023ef0cbae974. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.297158 19382 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.298187 19381 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.311414 19382 raft_consensus.cc:2955] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.312944 18488 raft_consensus.cc:2955] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.324518 18410 raft_consensus.cc:2955] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.334466 18484 consensus_queue.cc:237] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:17:19.350449 18458 consensus_peers.cc:597] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b176e8c616ab4b039f2e48b14549f43b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.351007 18341 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:19.352299 19379 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:19.352744 18410 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:19.358673 19331 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:19.363667 18238 catalog_manager.cc:5697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 2 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.377453 19331 raft_consensus.cc:2955] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.380019 18412 raft_consensus.cc:2955] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.390507 18341 raft_consensus.cc:2955] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.404678 18412 consensus_queue.cc:237] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:19.412670 18488 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.414451 18341 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.415125 19384 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:19.416267 19325 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:19.417259 18384 consensus_peers.cc:597] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9e75d2ac4114e428bf95ddfa6245037. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.454197 19384 raft_consensus.cc:2955] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.478515 18241 catalog_manager.cc:5697] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 2 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.499799 18493 raft_consensus.cc:2955] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
W20260709 13:17:19.507103 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 53888us
I20260709 13:17:19.509166 18340 raft_consensus.cc:2955] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.520747 18412 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:19.528090 18239 catalog_manager.cc:5697] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.553150 18493 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.553439 18340 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.554788 19384 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:19.556041 18384 consensus_peers.cc:597] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9986bcf770bb42549bfb7d77ec66768b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.556162 19398 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:19.569481 19398 raft_consensus.cc:2955] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.572054 18493 raft_consensus.cc:2955] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.572715 18336 raft_consensus.cc:2955] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.592976 18241 catalog_manager.cc:5697] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:19.761081 19403 ts_tablet_manager.cc:933] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:19.763121 19403 tablet_copy_client.cc:323] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.3:43125
I20260709 13:17:19.765407 18503 tablet_copy_service.cc:140] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Received BeginTabletCopySession request for tablet b176e8c616ab4b039f2e48b14549f43b from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:35114)
I20260709 13:17:19.766038 18503 tablet_copy_service.cc:161] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Beginning new tablet copy session on tablet b176e8c616ab4b039f2e48b14549f43b from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:35114: session id = 31ab487dc52e4f608b39df0fae2fdfa5-b176e8c616ab4b039f2e48b14549f43b
I20260709 13:17:19.774667 18503 tablet_copy_source_session.cc:215] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:19.778121 19403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b176e8c616ab4b039f2e48b14549f43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:19.796000 19403 tablet_copy_client.cc:806] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:19.796869 19403 tablet_copy_client.cc:670] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:19.810431 19403 tablet_copy_client.cc:538] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:19.824887 19403 tablet_bootstrap.cc:492] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:19.851336 19403 tablet_bootstrap.cc:492] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:19.852355 19403 tablet_bootstrap.cc:492] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:19.853081 19403 ts_tablet_manager.cc:1403] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.000s
I20260709 13:17:19.856063 19403 raft_consensus.cc:359] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:19.856694 19403 raft_consensus.cc:740] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:19.857261 19403 consensus_queue.cc:260] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:19.861699 19403 ts_tablet_manager.cc:1434] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:17:19.868937 18503 tablet_copy_service.cc:342] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b176e8c616ab4b039f2e48b14549f43b received from {username='slave'} at 127.0.0.1:35114
I20260709 13:17:19.869417 18503 tablet_copy_service.cc:434] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b176e8c616ab4b039f2e48b14549f43b on tablet b176e8c616ab4b039f2e48b14549f43b with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:19.870100 19408 ts_tablet_manager.cc:933] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:19.879021 19408 tablet_copy_client.cc:323] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:19.881649 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet 3eb2cd7aaa1d4bd3866023ef0cbae974 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:19.882221 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet 3eb2cd7aaa1d4bd3866023ef0cbae974 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-3eb2cd7aaa1d4bd3866023ef0cbae974
I20260709 13:17:19.890466 18354 tablet_copy_source_session.cc:215] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:19.893802 19408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb2cd7aaa1d4bd3866023ef0cbae974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:19.911953 19408 tablet_copy_client.cc:806] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:19.912604 19408 tablet_copy_client.cc:670] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:19.916903 19408 tablet_copy_client.cc:538] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:19.920682 19403 ts_tablet_manager.cc:933] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:19.927891 19408 tablet_bootstrap.cc:492] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:19.929798 19403 tablet_copy_client.cc:323] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:19.932459 18428 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet f9e75d2ac4114e428bf95ddfa6245037 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:19.933034 18428 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet f9e75d2ac4114e428bf95ddfa6245037 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-f9e75d2ac4114e428bf95ddfa6245037
I20260709 13:17:19.944661 18428 tablet_copy_source_session.cc:215] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:19.949734 19403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e75d2ac4114e428bf95ddfa6245037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:19.967705 19403 tablet_copy_client.cc:806] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:19.971150 19403 tablet_copy_client.cc:670] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:19.976943 19408 tablet_bootstrap.cc:492] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:19.977499 19403 tablet_copy_client.cc:538] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:19.978065 19408 tablet_bootstrap.cc:492] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:19.978799 19408 ts_tablet_manager.cc:1403] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.016s
I20260709 13:17:19.981608 19408 raft_consensus.cc:359] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:19.982295 19408 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:19.982959 19408 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:19.985821 19408 ts_tablet_manager.cc:1434] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:19.987561 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-3eb2cd7aaa1d4bd3866023ef0cbae974 received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:19.988003 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-3eb2cd7aaa1d4bd3866023ef0cbae974 on tablet 3eb2cd7aaa1d4bd3866023ef0cbae974 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:19.988844 19403 tablet_bootstrap.cc:492] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:20.012673 19403 tablet_bootstrap.cc:492] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:20.013430 19403 tablet_bootstrap.cc:492] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:20.014101 19403 ts_tablet_manager.cc:1403] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.009s
I20260709 13:17:20.016436 19403 raft_consensus.cc:359] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:20.017061 19403 raft_consensus.cc:740] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:20.017565 19403 consensus_queue.cc:260] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:20.019874 19403 ts_tablet_manager.cc:1434] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:17:20.021529 18428 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-f9e75d2ac4114e428bf95ddfa6245037 received from {username='slave'} at 127.0.0.1:44916
I20260709 13:17:20.021986 18428 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-f9e75d2ac4114e428bf95ddfa6245037 on tablet f9e75d2ac4114e428bf95ddfa6245037 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:20.026178 19403 ts_tablet_manager.cc:933] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:20.027753 19403 tablet_copy_client.cc:323] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:20.029162 18428 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet 9986bcf770bb42549bfb7d77ec66768b from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:20.029613 18428 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet 9986bcf770bb42549bfb7d77ec66768b from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-9986bcf770bb42549bfb7d77ec66768b
I20260709 13:17:20.035012 18428 tablet_copy_source_session.cc:215] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:20.041515 19403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9986bcf770bb42549bfb7d77ec66768b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:20.053759 19403 tablet_copy_client.cc:806] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:20.054350 19403 tablet_copy_client.cc:670] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:20.057703 19403 tablet_copy_client.cc:538] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:20.063932 19403 tablet_bootstrap.cc:492] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:20.078440 19403 tablet_bootstrap.cc:492] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:20.079169 19403 tablet_bootstrap.cc:492] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:20.079675 19403 ts_tablet_manager.cc:1403] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.007s
I20260709 13:17:20.081629 19403 raft_consensus.cc:359] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:20.082249 19403 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:20.082760 19403 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:20.087374 19403 ts_tablet_manager.cc:1434] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:20.088794 18428 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-9986bcf770bb42549bfb7d77ec66768b received from {username='slave'} at 127.0.0.1:44916
I20260709 13:17:20.089213 18428 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-9986bcf770bb42549bfb7d77ec66768b on tablet 9986bcf770bb42549bfb7d77ec66768b with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:20.199000 19061 raft_consensus.cc:1217] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:17:20.316685 19061 raft_consensus.cc:1217] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:17:20.493825 19061 raft_consensus.cc:1217] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:20.517699 19061 raft_consensus.cc:1217] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:20.688850 19331 raft_consensus.cc:1064] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:20.690546 19331 consensus_queue.cc:237] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:20.696676 19061 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:20.697957 18412 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:20.698469 19378 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.699357 18337 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:20.699590 19331 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.701956 19378 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.714838 19317 raft_consensus.cc:1064] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:20.718735 19317 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:20.764964 19062 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:20.768314 19381 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.785362 18493 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:20.799456 18414 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:20.801649 19405 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.815762 19381 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.865491 19317 raft_consensus.cc:2955] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:20.880802 19062 raft_consensus.cc:2955] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:20.890154 19378 raft_consensus.cc:2955] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:20.894814 18412 raft_consensus.cc:2955] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:20.904374 19398 raft_consensus.cc:1064] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:20.904739 18241 catalog_manager.cc:5697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:20.906886 19398 consensus_queue.cc:237] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:20.913481 18238 catalog_manager.cc:5697] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:20.920292 19061 raft_consensus.cc:2955] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:20.952039 18412 raft_consensus.cc:2955] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:20.962999 18340 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:20.968866 19415 raft_consensus.cc:1064] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:20.972031 19415 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:20.989161 19062 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:20.990852 19405 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:20.999879 19431 raft_consensus.cc:2955] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.002130 19062 raft_consensus.cc:2955] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.011042 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3eb2cd7aaa1d4bd3866023ef0cbae974 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:21.014456 18484 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.017122 19438 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:21.032223 18337 raft_consensus.cc:2955] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:17:21.038115 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 54724.7us
I20260709 13:17:21.066740 18493 consensus_queue.cc:237] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:21.072979 18336 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.074478 18341 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.075541 18239 catalog_manager.cc:5697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 2 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.081568 19061 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.087025 18493 raft_consensus.cc:2955] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.088313 19060 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.095211 18484 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.084187 19438 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:17:21.105660 18489 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:21.113498 19060 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:21.122488 19429 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:21.122778 19418 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.119161 19437 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:17:21.122534 19348 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:17:21.134658 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 66037.2us
I20260709 13:17:21.137535 18493 raft_consensus.cc:2955] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:17:21.139703 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 60698.1us
I20260709 13:17:21.180734 18412 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:21.201901 19331 raft_consensus.cc:2955] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.219108 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb2cd7aaa1d4bd3866023ef0cbae974 with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:21.219717 19435 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:17:21.239921 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b176e8c616ab4b039f2e48b14549f43b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:21.216455 19437 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:17:21.324664 19062 raft_consensus.cc:2955] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.335043 19348 raft_consensus.cc:2955] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.354136 19437 raft_consensus.cc:2955] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.364231 19060 raft_consensus.cc:2955] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.344633 18340 raft_consensus.cc:2955] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.334693 19450 tablet_replica.cc:333] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:17:21.386247 19061 raft_consensus.cc:2955] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.388060 19448 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:17:21.394932 18239 catalog_manager.cc:5697] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.401645 18238 catalog_manager.cc:5697] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 2 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.406502 18414 raft_consensus.cc:2955] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.412781 18412 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:21.424307 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet b176e8c616ab4b039f2e48b14549f43b with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37906
I20260709 13:17:21.426187 18484 raft_consensus.cc:2955] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.450788 19450 raft_consensus.cc:2243] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.451538 19450 raft_consensus.cc:2272] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.456874 19061 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.463223 19450 ts_tablet_manager.cc:1916] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:21.467869 19348 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.479367 18340 raft_consensus.cc:2955] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.479806 19348 raft_consensus.cc:2955] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.482502 18493 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.490423 19439 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:21.503396 18493 raft_consensus.cc:2955] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.497903 19062 raft_consensus.cc:2955] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.526759 19455 tablet_replica.cc:333] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:17:21.528115 18240 catalog_manager.cc:5697] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.533367 18488 raft_consensus.cc:2955] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.528162 19455 raft_consensus.cc:2243] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.539201 19455 raft_consensus.cc:2272] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.540187 18241 catalog_manager.cc:5697] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.554539 19455 ts_tablet_manager.cc:1916] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:21.557631 18227 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9986bcf770bb42549bfb7d77ec66768b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:21.569373 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet 9986bcf770bb42549bfb7d77ec66768b with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37906
I20260709 13:17:21.578263 18412 consensus_queue.cc:237] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:21.585871 19455 ts_tablet_manager.cc:1929] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:17:21.586310 19060 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.580596 19450 ts_tablet_manager.cc:1929] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:17:21.587863 19450 log.cc:1199] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/3eb2cd7aaa1d4bd3866023ef0cbae974
I20260709 13:17:21.588238 18336 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.588979 19348 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.589417 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet 3eb2cd7aaa1d4bd3866023ef0cbae974 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:21.590449 19455 log.cc:1199] T b176e8c616ab4b039f2e48b14549f43b P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/b176e8c616ab4b039f2e48b14549f43b
I20260709 13:17:21.592130 19455 tablet_replica.cc:333] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:17:21.592123 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet b176e8c616ab4b039f2e48b14549f43b (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:21.593341 19455 raft_consensus.cc:2243] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.594135 19455 raft_consensus.cc:2272] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.599650 19455 ts_tablet_manager.cc:1916] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:21.600492 19060 raft_consensus.cc:2955] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.597114 19435 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.604671 19437 raft_consensus.cc:2955] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.621650 18336 raft_consensus.cc:2955] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.624256 18227 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f9e75d2ac4114e428bf95ddfa6245037 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:21.640976 19455 ts_tablet_manager.cc:1929] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:21.641502 19455 log.cc:1199] T 9986bcf770bb42549bfb7d77ec66768b P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/9986bcf770bb42549bfb7d77ec66768b
I20260709 13:17:21.642112 18240 catalog_manager.cc:5697] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:21.643973 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet 9986bcf770bb42549bfb7d77ec66768b (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:21.654739 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet f9e75d2ac4114e428bf95ddfa6245037 with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:21.663591 19457 tablet_replica.cc:333] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:17:21.664498 19457 raft_consensus.cc:2243] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.664960 19457 raft_consensus.cc:2272] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.667949 19457 ts_tablet_manager.cc:1916] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:21.678102 19457 ts_tablet_manager.cc:1929] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:21.678435 19457 log.cc:1199] T f9e75d2ac4114e428bf95ddfa6245037 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/f9e75d2ac4114e428bf95ddfa6245037
I20260709 13:17:21.680033 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet f9e75d2ac4114e428bf95ddfa6245037 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:22.724357 18488 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:22.730206 18340 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:22.730537 18414 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:22.730968 18458 consensus_peers.cc:597] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9088f88404fe42cd909dc0c66c1c0c17. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:22.731817 19448 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.732627 19459 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.740597 19459 raft_consensus.cc:2955] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.744975 18412 raft_consensus.cc:2955] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.749185 18340 raft_consensus.cc:2955] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.763695 18241 catalog_manager.cc:5697] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.767321 18488 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:17:22.786532 18458 consensus_peers.cc:597] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41082fa41d05470eb1937d1997399fa4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:22.787133 18336 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:22.788858 19444 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.796443 18414 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:22.798357 19448 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.810931 19463 raft_consensus.cc:2955] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.825124 18337 raft_consensus.cc:2955] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.841566 18340 consensus_queue.cc:237] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:22.853823 18238 catalog_manager.cc:5697] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.863921 18414 raft_consensus.cc:2955] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.867103 18488 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:22.868423 18410 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:22.870146 19431 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.871047 19317 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:22.875506 18309 consensus_peers.cc:597] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06fc3d36b088480ab5fb6ac2a5600252. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:22.890246 19317 raft_consensus.cc:2955] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.893219 18410 raft_consensus.cc:2955] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.894232 18488 raft_consensus.cc:2955] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.911284 18240 catalog_manager.cc:5697] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.913136 18340 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:22.931079 18493 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:22.931488 18309 consensus_peers.cc:597] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fcca3d62b9ee4ee98c16e7e079d076b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:22.932140 18410 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:22.932508 19317 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.933900 19475 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:22.941260 19475 raft_consensus.cc:2955] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.945039 18493 raft_consensus.cc:2955] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.948717 18410 raft_consensus.cc:2955] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:22.963619 18238 catalog_manager.cc:5697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:23.249023 19480 ts_tablet_manager.cc:933] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:23.251072 19481 ts_tablet_manager.cc:933] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:23.251637 19480 tablet_copy_client.cc:323] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.3:43125
I20260709 13:17:23.253089 18503 tablet_copy_service.cc:140] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Received BeginTabletCopySession request for tablet 9088f88404fe42cd909dc0c66c1c0c17 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:35114)
I20260709 13:17:23.253472 19481 tablet_copy_client.cc:323] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:23.253639 18503 tablet_copy_service.cc:161] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Beginning new tablet copy session on tablet 9088f88404fe42cd909dc0c66c1c0c17 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:35114: session id = 31ab487dc52e4f608b39df0fae2fdfa5-9088f88404fe42cd909dc0c66c1c0c17
I20260709 13:17:23.255285 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet 06fc3d36b088480ab5fb6ac2a5600252 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:23.255800 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet 06fc3d36b088480ab5fb6ac2a5600252 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-06fc3d36b088480ab5fb6ac2a5600252
I20260709 13:17:23.261083 18503 tablet_copy_source_session.cc:215] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:23.264297 19480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9088f88404fe42cd909dc0c66c1c0c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.265651 18354 tablet_copy_source_session.cc:215] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:23.268767 19481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fc3d36b088480ab5fb6ac2a5600252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.279457 19480 tablet_copy_client.cc:806] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:23.280030 19480 tablet_copy_client.cc:670] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:23.283769 19480 tablet_copy_client.cc:538] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:23.284832 19481 tablet_copy_client.cc:806] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:23.285398 19481 tablet_copy_client.cc:670] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:23.296881 19480 tablet_bootstrap.cc:492] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:23.300151 19484 ts_tablet_manager.cc:933] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:23.302008 19481 tablet_copy_client.cc:538] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:23.320129 19481 tablet_bootstrap.cc:492] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:23.345160 19480 tablet_bootstrap.cc:492] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.348404 19480 tablet_bootstrap.cc:492] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:23.349329 19480 ts_tablet_manager.cc:1403] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.013s
I20260709 13:17:23.352201 19481 tablet_bootstrap.cc:492] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.349174 19484 tablet_copy_client.cc:323] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.3:43125
I20260709 13:17:23.353245 19481 tablet_bootstrap.cc:492] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:23.354084 19481 ts_tablet_manager.cc:1403] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.009s
I20260709 13:17:23.353271 19480 raft_consensus.cc:359] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:23.354635 19480 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:23.355330 19480 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:23.357087 19481 raft_consensus.cc:359] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:23.357836 19481 raft_consensus.cc:740] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:23.358671 18503 tablet_copy_service.cc:140] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Received BeginTabletCopySession request for tablet 41082fa41d05470eb1937d1997399fa4 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:35114)
I20260709 13:17:23.359203 18503 tablet_copy_service.cc:161] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Beginning new tablet copy session on tablet 41082fa41d05470eb1937d1997399fa4 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:35114: session id = 31ab487dc52e4f608b39df0fae2fdfa5-41082fa41d05470eb1937d1997399fa4
I20260709 13:17:23.358806 19481 consensus_queue.cc:260] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:23.369542 18503 tablet_copy_source_session.cc:215] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:23.377333 19484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41082fa41d05470eb1937d1997399fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.381006 19481 ts_tablet_manager.cc:1434] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.027s	user 0.001s	sys 0.005s
I20260709 13:17:23.381554 19480 ts_tablet_manager.cc:1434] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.002s
I20260709 13:17:23.383445 18503 tablet_copy_service.cc:342] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-9088f88404fe42cd909dc0c66c1c0c17 received from {username='slave'} at 127.0.0.1:35114
I20260709 13:17:23.383831 18503 tablet_copy_service.cc:434] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-9088f88404fe42cd909dc0c66c1c0c17 on tablet 9088f88404fe42cd909dc0c66c1c0c17 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:23.385320 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-06fc3d36b088480ab5fb6ac2a5600252 received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:23.385764 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-06fc3d36b088480ab5fb6ac2a5600252 on tablet 06fc3d36b088480ab5fb6ac2a5600252 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:23.388645 19480 ts_tablet_manager.cc:933] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:23.403980 19484 tablet_copy_client.cc:806] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:23.404647 19484 tablet_copy_client.cc:670] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:23.405745 19480 tablet_copy_client.cc:323] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:23.407490 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet fcca3d62b9ee4ee98c16e7e079d076b7 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:23.407938 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet fcca3d62b9ee4ee98c16e7e079d076b7 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-fcca3d62b9ee4ee98c16e7e079d076b7
I20260709 13:17:23.410972 19484 tablet_copy_client.cc:538] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:23.414279 18354 tablet_copy_source_session.cc:215] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:23.416949 19480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcca3d62b9ee4ee98c16e7e079d076b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.420346 19484 tablet_bootstrap.cc:492] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:23.432121 19480 tablet_copy_client.cc:806] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:23.432788 19480 tablet_copy_client.cc:670] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:23.437032 19480 tablet_copy_client.cc:538] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:23.445748 19480 tablet_bootstrap.cc:492] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:23.455830 19484 tablet_bootstrap.cc:492] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.457316 19484 tablet_bootstrap.cc:492] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:23.458599 19484 ts_tablet_manager.cc:1403] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.038s	user 0.027s	sys 0.000s
I20260709 13:17:23.462040 19484 raft_consensus.cc:359] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:23.462917 19484 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:23.464139 19484 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:23.468538 19484 ts_tablet_manager.cc:1434] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:17:23.472416 18503 tablet_copy_service.cc:342] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-41082fa41d05470eb1937d1997399fa4 received from {username='slave'} at 127.0.0.1:35114
I20260709 13:17:23.472856 18503 tablet_copy_service.cc:434] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-41082fa41d05470eb1937d1997399fa4 on tablet 41082fa41d05470eb1937d1997399fa4 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:23.475178 19480 tablet_bootstrap.cc:492] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.476163 19480 tablet_bootstrap.cc:492] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:23.476953 19480 ts_tablet_manager.cc:1403] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.031s	user 0.024s	sys 0.002s
I20260709 13:17:23.480247 19480 raft_consensus.cc:359] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:23.481243 19480 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:23.482007 19480 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:23.485141 19480 ts_tablet_manager.cc:1434] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:23.495725 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-fcca3d62b9ee4ee98c16e7e079d076b7 received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:23.496174 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-fcca3d62b9ee4ee98c16e7e079d076b7 on tablet fcca3d62b9ee4ee98c16e7e079d076b7 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:23.638963 19062 raft_consensus.cc:1217] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:23.848556 19062 raft_consensus.cc:1217] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:23.865621 19062 raft_consensus.cc:1217] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:23.891966 19062 raft_consensus.cc:1217] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:24.050875 19476 raft_consensus.cc:1064] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:24.053630 19476 consensus_queue.cc:237] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:24.060379 18493 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.060810 19062 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.062140 19431 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.064134 19431 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.072258 18412 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.074693 19476 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:17:24.080487 19475 raft_consensus.cc:2955] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.090938 18484 raft_consensus.cc:2955] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.096148 19062 raft_consensus.cc:2955] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.098141 18410 raft_consensus.cc:2955] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.115432 18240 catalog_manager.cc:5697] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.145784 18340 consensus_queue.cc:237] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:24.158450 19062 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.159998 19475 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.162914 18410 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.165585 19475 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.168555 19494 raft_consensus.cc:2955] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.177464 19060 raft_consensus.cc:2955] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.184296 18410 raft_consensus.cc:2955] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.187995 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 06fc3d36b088480ab5fb6ac2a5600252 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:24.198457 18238 catalog_manager.cc:5697] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.213644 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet 06fc3d36b088480ab5fb6ac2a5600252 with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:24.219046 19503 tablet_replica.cc:333] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:17:24.221206 19503 raft_consensus.cc:2243] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:24.222084 19503 raft_consensus.cc:2272] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.231590 19503 ts_tablet_manager.cc:1916] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:24.234032 19459 raft_consensus.cc:1064] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:24.236508 19459 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:24.247700 19503 ts_tablet_manager.cc:1929] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:24.248250 19503 log.cc:1199] T 06fc3d36b088480ab5fb6ac2a5600252 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/06fc3d36b088480ab5fb6ac2a5600252
I20260709 13:17:24.249794 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet 06fc3d36b088480ab5fb6ac2a5600252 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:24.260455 19060 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.261317 18414 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.261317 18340 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.262449 19459 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.263352 19448 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.264475 19463 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.292490 19463 raft_consensus.cc:2955] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.296135 19060 raft_consensus.cc:2955] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.301239 18340 raft_consensus.cc:2955] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.306542 18414 raft_consensus.cc:2955] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.314028 18238 catalog_manager.cc:5697] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.330642 18484 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:24.339999 18340 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.340924 19060 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.344072 19505 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.346424 19505 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.355877 19448 raft_consensus.cc:2955] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.358398 19060 raft_consensus.cc:2955] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.360178 18340 raft_consensus.cc:2955] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.374154 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9088f88404fe42cd909dc0c66c1c0c17 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:24.386111 18239 catalog_manager.cc:5697] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.405731 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet 9088f88404fe42cd909dc0c66c1c0c17 with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:24.407730 19509 tablet_replica.cc:333] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:17:24.413298 19509 raft_consensus.cc:2243] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:24.414112 19509 raft_consensus.cc:2272] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.417676 19509 ts_tablet_manager.cc:1916] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:24.430557 19509 ts_tablet_manager.cc:1929] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:24.430996 19476 raft_consensus.cc:1064] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:24.431056 19509 log.cc:1199] T 9088f88404fe42cd909dc0c66c1c0c17 P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/9088f88404fe42cd909dc0c66c1c0c17
I20260709 13:17:24.433310 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet 9088f88404fe42cd909dc0c66c1c0c17 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:24.433820 19476 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:24.441241 19060 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.443774 19431 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.444929 18414 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.448655 19431 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.456863 18484 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.463407 19476 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.489080 19505 raft_consensus.cc:1064] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:24.491873 19505 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:24.496031 19476 raft_consensus.cc:2955] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.498438 18492 raft_consensus.cc:2955] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.500105 19062 raft_consensus.cc:2955] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.517544 18241 catalog_manager.cc:5697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.525894 18412 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.525419 18414 raft_consensus.cc:2955] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.527604 19505 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.529309 19062 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.531706 18340 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.535161 19463 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.536813 19505 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.546766 18337 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:24.558341 19060 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.559901 19494 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.567167 19476 raft_consensus.cc:2955] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.569283 18492 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.570519 19494 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.570320 19062 raft_consensus.cc:2955] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.579942 19459 raft_consensus.cc:2955] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.584559 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fcca3d62b9ee4ee98c16e7e079d076b7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:24.595144 18239 catalog_manager.cc:5697] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.597026 19061 raft_consensus.cc:2955] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.605068 18337 raft_consensus.cc:2955] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.603215 18414 raft_consensus.cc:2955] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.610685 18240 catalog_manager.cc:5697] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.615808 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet fcca3d62b9ee4ee98c16e7e079d076b7 with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:24.616771 19509 tablet_replica.cc:333] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:17:24.617985 19509 raft_consensus.cc:2243] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:24.583657 18492 raft_consensus.cc:2955] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.618731 19509 raft_consensus.cc:2272] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.622808 19509 ts_tablet_manager.cc:1916] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:24.627516 18488 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:24.636423 19061 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.644914 19505 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.651427 19463 raft_consensus.cc:2955] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.653285 19061 raft_consensus.cc:2955] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.665992 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 41082fa41d05470eb1937d1997399fa4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:24.667181 18412 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.673336 19505 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:24.691872 18240 catalog_manager.cc:5697] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.692312 18414 raft_consensus.cc:2955] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:24.700614 19509 ts_tablet_manager.cc:1929] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:24.701143 19509 log.cc:1199] T fcca3d62b9ee4ee98c16e7e079d076b7 P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/fcca3d62b9ee4ee98c16e7e079d076b7
I20260709 13:17:24.703095 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet fcca3d62b9ee4ee98c16e7e079d076b7 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:24.705572 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet 41082fa41d05470eb1937d1997399fa4 with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37906
I20260709 13:17:24.711476 19519 tablet_replica.cc:333] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:17:24.712815 19519 raft_consensus.cc:2243] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:24.713670 19519 raft_consensus.cc:2272] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.717708 19519 ts_tablet_manager.cc:1916] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:24.731472 19519 ts_tablet_manager.cc:1929] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:24.731799 19519 log.cc:1199] T 41082fa41d05470eb1937d1997399fa4 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/41082fa41d05470eb1937d1997399fa4
I20260709 13:17:24.733064 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet 41082fa41d05470eb1937d1997399fa4 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:25.433869 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:25.483544 18492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:25.484282 18492 raft_consensus.cc:606] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:25.499264 18337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:17:25.499796 18337 raft_consensus.cc:606] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:25.511097 18414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:25.511746 18414 raft_consensus.cc:606] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:25.514457 18414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:25.514994 18414 raft_consensus.cc:606] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:25.518930 18414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:25.519498 18414 raft_consensus.cc:606] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:25.521641 18488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:25.522149 18488 raft_consensus.cc:606] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:25.523095 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:25.524221 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:25.735252 19505 raft_consensus.cc:993] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:25.735829 19459 raft_consensus.cc:1081] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:25.737362 19062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38700
I20260709 13:17:25.737907 19062 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:25.738256 19062 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.743686 19062 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:25.746608 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:25.747278 18414 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.750187 19062 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:25.750491 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:25.751057 18488 raft_consensus.cc:3055] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:25.751360 18488 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:25.752019 18488 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:25.753201 18488 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.754153 18414 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:25.755884 19026 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:25.759088 18488 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:25.762488 19524 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:25.770408 19524 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:25.771440 19524 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:25.776957 19458 raft_consensus.cc:993] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:25.777362 19458 raft_consensus.cc:1081] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:25.778946 19062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38692
I20260709 13:17:25.779444 19062 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:25.779757 19062 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.780261 18240 catalog_manager.cc:5697] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 2, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.786039 19062 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:25.788314 19062 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:25.788559 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:25.789140 18414 raft_consensus.cc:3055] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:25.789424 18414 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:25.790155 18414 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:25.791287 18414 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.793702 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:25.794274 18488 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.804153 18488 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:25.805552 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:25.806480 19524 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:25.806947 19524 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:25.807590 19476 raft_consensus.cc:993] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:25.808032 19476 raft_consensus.cc:1081] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:25.808811 18414 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:25.807952 19524 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:25.809970 18410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34462
I20260709 13:17:25.810509 18410 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:25.810853 18410 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.822389 18410 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:25.825903 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:25.824007 18337 consensus_queue.cc:237] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:25.826658 18492 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.826913 18410 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:25.826062 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:25.829128 18340 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:25.829427 18340 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:25.830072 18340 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:25.831012 18340 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.831064 18240 catalog_manager.cc:5697] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.832717 18492 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:25.834484 18382 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:25.836093 19492 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:25.836545 19492 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:25.837400 19492 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:25.840621 18340 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
W20260709 13:17:25.846494 18309 consensus_peers.cc:597] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88ca5739563d4349a7b7a6c70d81e653. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:25.847694 18488 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:25.851416 18410 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:25.852319 19476 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:25.853382 19475 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:25.859567 18240 catalog_manager.cc:5697] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.871857 19525 raft_consensus.cc:2955] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:25.873235 18410 raft_consensus.cc:2955] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:25.873888 18488 raft_consensus.cc:2955] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:25.887006 18492 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:25.889300 18240 catalog_manager.cc:5697] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:25.900844 18410 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:25.901698 18337 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:25.900933 18458 consensus_peers.cc:597] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35d61c75b589420ab4319c7a05b2b72b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:25.903357 19537 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:25.904469 19459 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:25.918646 19505 raft_consensus.cc:2955] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:25.920496 18337 raft_consensus.cc:2955] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:25.924247 19458 raft_consensus.cc:993] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:25.924695 19458 raft_consensus.cc:1081] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:25.926199 19062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38692
I20260709 13:17:25.926700 19062 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:25.927055 19062 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.933954 18414 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:25.937697 18410 raft_consensus.cc:2955] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:25.938263 19062 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:25.943238 19062 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:25.944098 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:25.944666 18411 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:25.944936 18411 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:25.945611 18411 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:25.946781 18411 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.947206 18239 catalog_manager.cc:5697] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:25.946694 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:25.950385 18488 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.954648 18411 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:25.956017 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:25.956543 18488 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:25.958027 19524 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:25.958660 19524 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:25.959585 19524 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:25.963946 18384 consensus_peers.cc:597] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 069e2e1b4c714f01a2bc3ad59e3618f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:25.964591 18488 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:25.965593 18337 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:25.965838 19458 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:25.967015 19492 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:25.969529 19537 raft_consensus.cc:993] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:25.970062 19537 raft_consensus.cc:1081] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:25.973367 18410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34458
I20260709 13:17:25.973906 18410 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:25.974296 18410 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.980880 18410 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:25.983260 18239 catalog_manager.cc:5697] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.985984 18410 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:25.985976 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:25.986104 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:25.986984 18488 raft_consensus.cc:3055] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:25.987448 18488 raft_consensus.cc:740] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:25.986974 18340 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.994251 18488 consensus_queue.cc:260] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:25.995553 18488 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.996768 18340 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:25.997995 18384 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:25.998668 19458 raft_consensus.cc:2955] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:26.003767 18488 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:26.004632 19492 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:26.005174 19492 raft_consensus.cc:697] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:26.004567 18340 raft_consensus.cc:2955] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:26.006009 19492 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:26.000417 18492 raft_consensus.cc:2955] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:26.013645 18488 consensus_queue.cc:237] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:26.035997 18336 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:26.036744 19549 raft_consensus.cc:993] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:26.037237 19549 raft_consensus.cc:1081] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
W20260709 13:17:26.037366 18458 consensus_peers.cc:597] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: beb1497b39de4cbbaf75d8c82f903278. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:26.038470 18411 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:26.040215 19062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38692
I20260709 13:17:26.040751 19062 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:26.041101 19062 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:26.045663 19536 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:26.048540 19505 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:26.051980 18239 catalog_manager.cc:5697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:26.077433 19062 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:26.084107 19537 raft_consensus.cc:2955] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:26.089272 19062 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:26.091850 18411 raft_consensus.cc:2955] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:26.094503 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:26.095498 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:26.095986 18340 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:26.096060 18410 raft_consensus.cc:3055] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:26.097978 18410 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:26.098704 18410 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:26.099817 18410 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:26.101950 18337 raft_consensus.cc:2955] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:26.112509 18242 catalog_manager.cc:5697] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.113349 18239 catalog_manager.cc:5697] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 2, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.118813 18410 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:26.135972 19026 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:26.137612 19524 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:26.138123 19524 raft_consensus.cc:697] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:26.139029 19524 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:26.142535 18340 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:26.168694 18410 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:26.169852 19524 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:26.172936 18239 catalog_manager.cc:5697] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:26.183228 18492 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:26.185416 19524 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:26.201714 18410 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:26.203235 19524 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:26.213208 18488 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:26.217505 19526 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:26.258054 18336 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:26.259904 19458 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:26.270922 18492 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:26.272542 19549 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:26.278678 19564 ts_tablet_manager.cc:933] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:26.294157 19564 tablet_copy_client.cc:323] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:26.295838 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet 88ca5739563d4349a7b7a6c70d81e653 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:26.296334 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet 88ca5739563d4349a7b7a6c70d81e653 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-88ca5739563d4349a7b7a6c70d81e653
I20260709 13:17:26.304150 18354 tablet_copy_source_session.cc:215] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:26.307497 19564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ca5739563d4349a7b7a6c70d81e653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.341513 19564 tablet_copy_client.cc:806] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:26.342185 19564 tablet_copy_client.cc:670] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:26.346472 19564 tablet_copy_client.cc:538] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:26.354444 19564 tablet_bootstrap.cc:492] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:26.376550 19564 tablet_bootstrap.cc:492] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:26.377650 19564 tablet_bootstrap.cc:492] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:26.378459 19564 ts_tablet_manager.cc:1403] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.005s
I20260709 13:17:26.380707 19564 raft_consensus.cc:359] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:26.381325 19564 raft_consensus.cc:740] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:26.381846 19564 consensus_queue.cc:260] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:26.383690 19564 ts_tablet_manager.cc:1434] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:26.385149 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-88ca5739563d4349a7b7a6c70d81e653 received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:26.385568 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-88ca5739563d4349a7b7a6c70d81e653 on tablet 88ca5739563d4349a7b7a6c70d81e653 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:26.415068 19564 ts_tablet_manager.cc:933] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:26.422814 19564 tablet_copy_client.cc:323] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.3:43125
I20260709 13:17:26.424312 18503 tablet_copy_service.cc:140] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Received BeginTabletCopySession request for tablet 35d61c75b589420ab4319c7a05b2b72b from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:35114)
I20260709 13:17:26.424858 18503 tablet_copy_service.cc:161] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Beginning new tablet copy session on tablet 35d61c75b589420ab4319c7a05b2b72b from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:35114: session id = 31ab487dc52e4f608b39df0fae2fdfa5-35d61c75b589420ab4319c7a05b2b72b
I20260709 13:17:26.432530 18503 tablet_copy_source_session.cc:215] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:26.435475 19564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d61c75b589420ab4319c7a05b2b72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.437191 18410 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:26.439114 19524 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:26.450433 18492 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:26.452335 19526 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:26.483978 19564 tablet_copy_client.cc:806] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:26.484637 19564 tablet_copy_client.cc:670] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:26.491565 19564 tablet_copy_client.cc:538] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:26.497529 18341 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:26.499176 19492 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:26.505046 19564 tablet_bootstrap.cc:492] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:26.526014 19573 ts_tablet_manager.cc:933] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:26.531225 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:26.539419 19564 tablet_bootstrap.cc:492] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:26.540839 18488 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:26.540982 19564 tablet_bootstrap.cc:492] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:26.541896 19564 ts_tablet_manager.cc:1403] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.016s
I20260709 13:17:26.542312 19548 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:26.546892 19573 tablet_copy_client.cc:323] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:26.552702 18428 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet 069e2e1b4c714f01a2bc3ad59e3618f1 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:26.553190 18428 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet 069e2e1b4c714f01a2bc3ad59e3618f1 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-069e2e1b4c714f01a2bc3ad59e3618f1
I20260709 13:17:26.544649 19564 raft_consensus.cc:359] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:26.561031 19564 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:26.561480 18428 tablet_copy_source_session.cc:215] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:26.561738 19564 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:26.564666 19564 ts_tablet_manager.cc:1434] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.003s
I20260709 13:17:26.567541 18503 tablet_copy_service.cc:342] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-35d61c75b589420ab4319c7a05b2b72b received from {username='slave'} at 127.0.0.1:35114
I20260709 13:17:26.567996 18503 tablet_copy_service.cc:434] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-35d61c75b589420ab4319c7a05b2b72b on tablet 35d61c75b589420ab4319c7a05b2b72b with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:26.574209 19573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069e2e1b4c714f01a2bc3ad59e3618f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.589152 19573 tablet_copy_client.cc:806] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:26.589735 19573 tablet_copy_client.cc:670] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:26.595352 19573 tablet_copy_client.cc:538] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:26.606199 19573 tablet_bootstrap.cc:492] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:26.626196 19573 tablet_bootstrap.cc:492] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:26.626608 19564 ts_tablet_manager.cc:933] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:26.627166 19573 tablet_bootstrap.cc:492] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:26.627887 19573 ts_tablet_manager.cc:1403] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:17:26.630982 19573 raft_consensus.cc:359] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:26.631868 19573 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:26.632481 19573 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:26.634878 19573 ts_tablet_manager.cc:1434] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:17:26.635809 19564 tablet_copy_client.cc:323] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.3:43125
I20260709 13:17:26.638388 18503 tablet_copy_service.cc:140] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Received BeginTabletCopySession request for tablet beb1497b39de4cbbaf75d8c82f903278 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:35114)
I20260709 13:17:26.638895 18503 tablet_copy_service.cc:161] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Beginning new tablet copy session on tablet beb1497b39de4cbbaf75d8c82f903278 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:35114: session id = 31ab487dc52e4f608b39df0fae2fdfa5-beb1497b39de4cbbaf75d8c82f903278
I20260709 13:17:26.642202 18428 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-069e2e1b4c714f01a2bc3ad59e3618f1 received from {username='slave'} at 127.0.0.1:44916
I20260709 13:17:26.642645 18428 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-069e2e1b4c714f01a2bc3ad59e3618f1 on tablet 069e2e1b4c714f01a2bc3ad59e3618f1 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:26.648262 18503 tablet_copy_source_session.cc:215] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:26.651831 19564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb1497b39de4cbbaf75d8c82f903278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.657505 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:26.666802 19564 tablet_copy_client.cc:806] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:26.667449 19564 tablet_copy_client.cc:670] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:26.671233 19564 tablet_copy_client.cc:538] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:26.678992 19564 tablet_bootstrap.cc:492] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:26.715508 18341 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:26.724392 19526 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:26.738579 18336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "218ede86207640ab99622c70bae54d07"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:17:26.739140 18336 raft_consensus.cc:606] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:26.742671 19564 tablet_bootstrap.cc:492] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:26.743503 18411 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:26.746892 19524 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:26.743605 19564 tablet_bootstrap.cc:492] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:26.754266 19564 ts_tablet_manager.cc:1403] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.005s
I20260709 13:17:26.755851 18488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:26.756630 18488 raft_consensus.cc:606] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:26.756913 19564 raft_consensus.cc:359] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:26.757668 19564 raft_consensus.cc:740] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:26.758255 19564 consensus_queue.cc:260] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:26.760761 19564 ts_tablet_manager.cc:1434] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:17:26.762633 18503 tablet_copy_service.cc:342] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-beb1497b39de4cbbaf75d8c82f903278 received from {username='slave'} at 127.0.0.1:35114
I20260709 13:17:26.763109 18503 tablet_copy_service.cc:434] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-beb1497b39de4cbbaf75d8c82f903278 on tablet beb1497b39de4cbbaf75d8c82f903278 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:26.767023 18488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:26.767647 18488 raft_consensus.cc:606] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:26.785012 18411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:26.787432 18411 raft_consensus.cc:606] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:26.796852 18488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:26.797469 18488 raft_consensus.cc:606] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:26.801668 18411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:26.802294 18411 raft_consensus.cc:606] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:26.803464 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:26.807441 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:26.854247 19062 raft_consensus.cc:1217] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:26.975800 19525 raft_consensus.cc:993] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:26.976346 19525 raft_consensus.cc:1081] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:26.979168 19062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "218ede86207640ab99622c70bae54d07"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38686
I20260709 13:17:26.979638 19062 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:26.979962 19062 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:26.986966 19062 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:26.988209 19537 raft_consensus.cc:993] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:26.988703 19537 raft_consensus.cc:1081] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:26.989529 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:26.990342 18337 raft_consensus.cc:3055] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:26.990638 18337 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:26.991348 19061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38700
I20260709 13:17:26.991852 19061 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:26.992178 19061 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:26.990351 19062 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:26.991086 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:26.994390 18411 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:26.998164 18337 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:26.999363 19061 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:26.999567 18337 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.000674 18411 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:27.001683 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:27.002116 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:27.002684 18341 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.002936 19524 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:27.003397 19524 raft_consensus.cc:697] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:27.004230 19524 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.006107 18337 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:27.009244 19061 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:27.010025 18341 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:27.012101 19027 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:27.012943 19526 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:27.013470 19526 raft_consensus.cc:697] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:27.012856 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:27.014231 18492 raft_consensus.cc:3055] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.014544 18492 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:27.015384 19061 raft_consensus.cc:1217] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:27.015347 18492 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.016449 18492 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.019165 19526 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.021407 18239 catalog_manager.cc:5697] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.031339 18492 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:27.047617 18239 catalog_manager.cc:5697] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 2, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.061569 19536 raft_consensus.cc:993] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:27.062109 19459 raft_consensus.cc:1081] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:27.063475 18411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34458
I20260709 13:17:27.063903 18411 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.064158 18411 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.069479 18411 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:27.071348 18411 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:27.074997 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:27.075522 18488 raft_consensus.cc:3055] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.075717 18488 raft_consensus.cc:740] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:27.076262 18488 consensus_queue.cc:260] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:27.076918 18488 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.079329 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:27.079876 18341 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.083630 19061 raft_consensus.cc:1217] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:27.086408 18488 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:27.087512 18382 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:27.088341 19492 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:27.088796 19492 raft_consensus.cc:697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:27.089610 19492 consensus_queue.cc:237] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:27.093266 18341 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:27.101985 18239 catalog_manager.cc:5697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 2, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.166216 19580 raft_consensus.cc:993] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:27.166674 19580 raft_consensus.cc:1081] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:27.169101 19061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38692
I20260709 13:17:27.169597 19061 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.169898 19061 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.174396 19061 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.176148 19061 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:27.176844 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:27.177091 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:27.177444 18411 raft_consensus.cc:3055] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.177644 18488 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.177767 18411 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:27.178442 18411 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.179174 18411 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.183856 18488 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:27.185078 19025 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:27.186012 19526 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:27.186488 19526 raft_consensus.cc:697] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:27.187307 19526 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.188851 19537 raft_consensus.cc:993] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:27.189337 19536 raft_consensus.cc:1081] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:27.192008 18411 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:27.191020 18410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34458
I20260709 13:17:27.193125 18410 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.193534 18410 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.200999 18410 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:27.200529 18239 catalog_manager.cc:5697] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.205703 18410 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:27.206985 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:27.207535 18488 raft_consensus.cc:3055] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.207799 18488 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:27.208087 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:27.208636 18341 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.208448 18488 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:27.209625 18488 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.214118 18341 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:27.215253 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:27.216148 19580 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:27.216614 19580 raft_consensus.cc:697] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:27.217413 19580 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:27.243482 19061 raft_consensus.cc:1217] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:27.244983 18488 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:27.246537 19548 raft_consensus.cc:993] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:27.246001 18239 catalog_manager.cc:5697] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 2, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.246973 19548 raft_consensus.cc:1081] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:27.249631 19062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38692
I20260709 13:17:27.250125 19062 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.250478 19062 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.256553 19062 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.258121 19525 raft_consensus.cc:1064] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:27.258852 19062 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:27.260674 19525 consensus_queue.cc:237] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.261766 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:27.261122 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:27.262323 18411 raft_consensus.cc:3055] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.262575 18341 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.262621 18411 raft_consensus.cc:740] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:27.263473 18411 consensus_queue.cc:260] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.264546 18411 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.268736 18341 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:27.269726 19027 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:27.270493 19526 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:27.270975 19526 raft_consensus.cc:697] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:27.271790 19526 consensus_queue.cc:237] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.274829 18488 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.274855 18410 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.276486 19475 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.278782 19062 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.281172 19584 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.283640 19584 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.306280 18239 catalog_manager.cc:5697] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.312175 19475 raft_consensus.cc:2955] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.321581 18492 raft_consensus.cc:2955] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.347280 18411 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:27.357194 18410 raft_consensus.cc:2955] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.363256 19061 raft_consensus.cc:2955] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.367372 18239 catalog_manager.cc:5697] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.390285 18341 consensus_queue.cc:237] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.394598 19061 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.398030 19600 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:27.399883 18492 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.406805 19475 raft_consensus.cc:2955] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.409531 19599 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:27.409868 18337 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:27.411880 19526 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:27.414675 19061 raft_consensus.cc:2955] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.416122 18492 raft_consensus.cc:2955] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.430394 18241 catalog_manager.cc:5697] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.442396 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 88ca5739563d4349a7b7a6c70d81e653 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:27.450186 18336 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:27.452028 19526 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:27.462268 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet 88ca5739563d4349a7b7a6c70d81e653 with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:27.462880 18411 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:27.464576 19581 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:27.465368 19605 tablet_replica.cc:333] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:17:27.466409 19605 raft_consensus.cc:2243] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:27.470057 19605 raft_consensus.cc:2272] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:27.472525 19605 ts_tablet_manager.cc:1916] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:27.477545 18492 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:27.479406 19581 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:27.491963 19580 raft_consensus.cc:1064] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:27.494851 19580 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.498785 19605 ts_tablet_manager.cc:1929] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:27.507155 19605 log.cc:1199] T 88ca5739563d4349a7b7a6c70d81e653 P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/88ca5739563d4349a7b7a6c70d81e653
I20260709 13:17:27.520795 19537 raft_consensus.cc:1064] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:27.526459 19537 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.529628 19061 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.536083 18488 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.536118 19548 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:17:27.539958 19458 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.544112 18341 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.546944 19549 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.562776 18341 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:27.555546 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet 88ca5739563d4349a7b7a6c70d81e653 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:27.571594 19549 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:27.576401 19062 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.577725 19459 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.579203 18410 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.583590 19459 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.588999 18341 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.603317 19459 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:27.623798 19537 raft_consensus.cc:2955] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.637043 18484 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:27.638499 19580 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:27.641853 19062 raft_consensus.cc:2955] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.653939 18340 raft_consensus.cc:2955] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.662883 19549 raft_consensus.cc:2955] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.670672 18242 catalog_manager.cc:5697] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.671425 18411 raft_consensus.cc:2955] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.677637 18336 raft_consensus.cc:2955] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.683967 18337 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:27.683668 19061 raft_consensus.cc:2955] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.687721 18414 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:27.689597 19581 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:27.710947 19492 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:27.723634 18484 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:27.725055 19580 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:27.730641 18241 catalog_manager.cc:5697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.760929 18488 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:27.781270 19581 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:17:27.794685 18336 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:27.800871 18488 raft_consensus.cc:2955] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.807452 19581 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:27.830304 19537 raft_consensus.cc:1064] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:27.832767 19537 consensus_queue.cc:237] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.808822 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:27.835839 18410 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:27.850615 18493 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.863196 19061 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.865528 18414 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.866926 19459 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:27.876696 19524 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:27.890950 18411 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:27.892596 19619 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:27.900137 19062 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.900806 19459 raft_consensus.cc:2955] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.901867 19062 raft_consensus.cc:2955] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.906597 19619 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.907559 18414 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.910809 19619 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.923821 18337 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.931275 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 35d61c75b589420ab4319c7a05b2b72b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:27.931701 19619 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.933635 19062 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.942785 18241 catalog_manager.cc:5697] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.966748 19548 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:27.971870 18337 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.973699 18411 raft_consensus.cc:2955] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:27.990160 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:27.999925 19629 raft_consensus.cc:2955] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:28.008831 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet 35d61c75b589420ab4319c7a05b2b72b with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37906
I20260709 13:17:28.009332 19548 raft_consensus.cc:2955] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:28.010578 19580 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.024163 19061 raft_consensus.cc:2955] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:28.024837 18336 raft_consensus.cc:2955] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:28.027170 18340 raft_consensus.cc:2955] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:28.028257 18411 raft_consensus.cc:2955] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:28.028611 18240 catalog_manager.cc:5697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:28.029663 18227 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 069e2e1b4c714f01a2bc3ad59e3618f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:28.091957 19061 raft_consensus.cc:2955] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:28.095155 19634 tablet_replica.cc:333] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:17:28.096184 19634 raft_consensus.cc:2243] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.096937 19634 raft_consensus.cc:2272] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.100769 18411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:28.098656 18239 catalog_manager.cc:5697] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:28.101356 18411 raft_consensus.cc:606] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:28.108846 18340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:17:28.112123 19634 ts_tablet_manager.cc:1916] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:28.113138 18493 consensus_queue.cc:237] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:28.115392 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet 069e2e1b4c714f01a2bc3ad59e3618f1 with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:28.109598 18340 raft_consensus.cc:606] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:28.121130 19636 tablet_replica.cc:333] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:17:28.124614 19636 raft_consensus.cc:2243] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.125366 19636 raft_consensus.cc:2272] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.136094 18340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:17:28.136674 18340 raft_consensus.cc:606] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:28.137146 19636 ts_tablet_manager.cc:1916] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:28.138417 19061 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:28.139919 19459 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.146690 18340 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:28.147948 18340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:17:28.148473 18340 raft_consensus.cc:606] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:28.147998 19630 raft_consensus.cc:2955] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:28.149454 19536 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.155635 18340 raft_consensus.cc:2955] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:28.159030 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet beb1497b39de4cbbaf75d8c82f903278 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:28.160725 18411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:28.161262 18411 raft_consensus.cc:606] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:28.161183 19062 raft_consensus.cc:2955] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:28.148856 19634 ts_tablet_manager.cc:1929] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:28.172482 19634 log.cc:1199] T 35d61c75b589420ab4319c7a05b2b72b P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/35d61c75b589420ab4319c7a05b2b72b
I20260709 13:17:28.164594 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:28.175592 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:28.178184 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet 35d61c75b589420ab4319c7a05b2b72b (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:28.179867 19636 ts_tablet_manager.cc:1929] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:28.180325 19636 log.cc:1199] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/069e2e1b4c714f01a2bc3ad59e3618f1
I20260709 13:17:28.179037 18242 catalog_manager.cc:5697] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:28.187276 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet 069e2e1b4c714f01a2bc3ad59e3618f1 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:28.192473 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet beb1497b39de4cbbaf75d8c82f903278 with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:28.194159 19637 tablet_replica.cc:333] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:17:28.194983 19637 raft_consensus.cc:2243] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.195570 19637 raft_consensus.cc:2272] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.198216 19637 ts_tablet_manager.cc:1916] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:28.212605 19637 ts_tablet_manager.cc:1929] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:28.213038 19637 log.cc:1199] T beb1497b39de4cbbaf75d8c82f903278 P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/beb1497b39de4cbbaf75d8c82f903278
I20260709 13:17:28.214533 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet beb1497b39de4cbbaf75d8c82f903278 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:28.342206 19548 raft_consensus.cc:993] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:28.343254 19580 raft_consensus.cc:1081] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:28.345162 18493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:17:28.345669 18493 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:28.346021 18493 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.351228 19594 raft_consensus.cc:993] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:28.351697 19525 raft_consensus.cc:1081] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:28.353121 19062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38686
I20260709 13:17:28.353705 19062 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:28.354140 19062 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.354177 18493 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:28.357043 18493 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:28.357393 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:28.358273 18412 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:28.358552 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:28.359072 18340 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.358603 18412 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:28.360176 18412 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:28.360739 19062 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:28.361498 18412 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.363271 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:28.363816 18336 raft_consensus.cc:3055] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:28.364050 18336 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:28.364739 18336 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:28.365407 18340 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:28.365695 18336 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.367056 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:28.367304 18412 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:28.368453 19630 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:28.369040 19630 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:28.369890 19630 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:28.371031 19062 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:28.371222 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:28.371781 18411 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.372393 18336 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:28.373551 19027 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:28.375267 19526 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:28.375907 19526 raft_consensus.cc:697] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:28.376979 19526 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:28.381889 18411 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:28.388741 18239 catalog_manager.cc:5697] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:28.389634 18241 catalog_manager.cc:5697] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 2 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:28.399071 19635 raft_consensus.cc:993] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:28.399571 19525 raft_consensus.cc:1081] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:28.401005 18411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34462
I20260709 13:17:28.401430 18411 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:28.401695 18411 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.406493 18411 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:28.407972 18411 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:28.408798 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:28.408895 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:28.409355 18336 raft_consensus.cc:3055] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:28.409426 18493 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.409751 18336 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:28.410517 18336 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:28.411336 18336 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.414482 18493 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:28.415588 18382 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:28.416324 19580 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:28.416967 18336 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:28.417116 19580 raft_consensus.cc:697] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:28.417961 19580 consensus_queue.cc:237] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:28.427821 18241 catalog_manager.cc:5697] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:28.594509 19492 raft_consensus.cc:993] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:28.594933 19492 raft_consensus.cc:1081] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:28.596341 18492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:17:28.596853 18492 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:28.597177 18492 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.603457 19594 raft_consensus.cc:993] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:28.603468 18492 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:28.604102 19594 raft_consensus.cc:1081] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:28.605592 18412 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34462
I20260709 13:17:28.606066 18412 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:28.606043 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:28.606588 18412 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.606725 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:28.607298 18411 raft_consensus.cc:3055] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:28.607532 18411 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:28.608134 18411 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:28.609050 18411 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.606765 18336 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.606143 18492 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:28.613340 18412 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:28.615157 18412 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:28.621027 18411 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:28.619601 18336 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:28.622807 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:28.623194 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:28.623333 18340 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:28.623502 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:28.623772 18340 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:28.624017 19630 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:28.624032 19062 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.624550 18340 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:28.625854 18340 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.629181 19630 raft_consensus.cc:697] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:28.630089 19630 consensus_queue.cc:237] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:28.630800 19062 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:28.631840 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:28.633114 18340 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:28.633229 19492 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:28.634233 19492 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:28.635134 19492 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:28.643803 18241 catalog_manager.cc:5697] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 2 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:28.647503 18239 catalog_manager.cc:5697] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:28.759460 18340 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.760619 19630 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.778745 18411 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.780915 19630 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.791270 18337 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:28.792943 19526 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:28.824993 18412 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:28.826591 19526 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:28.918606 18340 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.919749 19580 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.927886 18492 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:28.929697 19548 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:29.039551 18340 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:29.040752 19629 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:29.052539 18412 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:29.055231 19630 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:29.076400 18340 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:29.077562 19580 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:29.085763 19061 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:29.089140 19492 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:29.180456 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:29.272073 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:29.323602 18412 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:29.348775 18493 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:29.350800 18384 consensus_peers.cc:597] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1734a6c318d4e6ba6b65fd828d4fe66. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:29.360067 18336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:17:29.361042 18336 raft_consensus.cc:606] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:29.353183 19548 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:29.377779 18336 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:29.379107 18492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:29.379887 18492 raft_consensus.cc:606] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:29.383942 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:29.384704 18412 raft_consensus.cc:606] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:29.388280 19492 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:29.388913 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b972754511104f898e9cbc171aa6c170"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:29.391137 18412 raft_consensus.cc:606] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:29.399449 19580 raft_consensus.cc:2955] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.403827 18493 raft_consensus.cc:2955] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.407521 18492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:29.408270 18492 raft_consensus.cc:606] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:29.411379 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:29.414036 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:29.426070 19661 raft_consensus.cc:993] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:29.426652 19492 raft_consensus.cc:1081] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:29.435050 18336 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b972754511104f898e9cbc171aa6c170"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37920
I20260709 13:17:29.435731 18336 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:29.436026 18336 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.444219 18336 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:29.462510 18488 consensus_queue.cc:237] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:29.467303 18336 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:29.470213 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:29.470388 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:29.470860 18492 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.470999 18412 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:29.471431 18412 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:29.472301 18412 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:29.473428 18412 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.482092 19630 raft_consensus.cc:993] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:29.482710 19630 raft_consensus.cc:1081] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:29.486416 18239 catalog_manager.cc:5697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.488152 18340 raft_consensus.cc:2955] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.489861 18336 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37928
I20260709 13:17:29.490389 18336 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:29.490739 18336 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:29.492087 18458 consensus_peers.cc:597] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 479d13df82394c22b38ff5fd8a8b5931. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:29.488620 18492 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:29.495028 18337 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:29.503662 18412 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:29.498678 18307 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:29.505822 19629 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:29.507886 18411 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:29.508024 18336 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:29.513219 19663 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:29.513620 18336 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:29.513721 19663 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:29.514845 19663 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:29.515551 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:29.516126 18492 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:29.516425 18492 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:29.517132 18492 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:29.517257 19629 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:29.518461 18492 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.525962 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:29.526686 19061 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.527976 18492 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:29.529218 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:29.530157 19594 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:29.530647 19594 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:29.530848 19580 raft_consensus.cc:993] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:29.531601 19580 raft_consensus.cc:1081] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:29.531651 19594 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:29.536211 19062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38692
I20260709 13:17:29.536698 19062 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:29.537030 19062 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.555439 19459 raft_consensus.cc:2955] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.560747 19061 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:29.552428 19062 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:29.572346 19062 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:29.574743 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:29.575323 18412 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:29.575678 18412 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:29.576431 18412 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:29.575383 18337 raft_consensus.cc:2955] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.577064 18412 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.591434 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:29.592157 18336 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.600840 18412 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:17:29.602418 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:29.602926 18336 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:17:29.602681 18492 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:29.603344 19526 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:29.603897 19526 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:29.604775 19526 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:29.615471 18411 raft_consensus.cc:2955] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.619335 18242 catalog_manager.cc:5697] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 2 to 3, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 3 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.626091 18238 catalog_manager.cc:5697] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.651320 18337 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:29.650882 18239 catalog_manager.cc:5697] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.651950 18412 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:29.652474 18239 catalog_manager.cc:5697] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 1 to 2, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.653403 19630 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:29.654378 19672 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:29.657308 18458 consensus_peers.cc:597] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77cd16981fa049aaaa881bdeacda2fc3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:29.670579 19672 raft_consensus.cc:2955] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.672416 18412 raft_consensus.cc:2955] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.688220 18337 consensus_queue.cc:237] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:29.688355 18336 raft_consensus.cc:2955] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.696377 19594 raft_consensus.cc:993] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:29.695923 18238 catalog_manager.cc:5697] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.697013 19594 raft_consensus.cc:1081] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:29.700246 18488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55660
I20260709 13:17:29.700766 18488 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:29.701085 18488 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.708299 18488 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:29.711833 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:29.712170 18412 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:29.712327 19061 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.714345 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:29.714869 18336 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:17:29.714893 18309 consensus_peers.cc:597] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97efddba551a406f8d4427488fc22c5c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:29.715253 18336 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:29.715762 19669 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:29.716014 18336 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:29.717154 18336 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.718710 18492 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:29.720094 19663 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:29.724062 18488 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:29.723981 19061 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:29.723978 18336 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:29.726661 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:29.727360 19459 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:29.727771 19459 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:29.728521 19459 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:29.749472 18492 raft_consensus.cc:2955] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.749006 19635 raft_consensus.cc:2955] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.758004 19629 raft_consensus.cc:993] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:29.758507 19629 raft_consensus.cc:1081] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:29.760133 18412 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34458
I20260709 13:17:29.760715 18412 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:29.761116 18412 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.767890 18414 raft_consensus.cc:2955] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.769055 18412 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:29.774169 18240 catalog_manager.cc:5697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 3, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.776609 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:29.777187 18488 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:29.777485 18488 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:29.778321 18488 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:29.781073 18488 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.788339 18412 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:29.793543 18239 catalog_manager.cc:5697] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:29.791832 18488 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:29.811659 18382 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:29.812721 19661 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:29.813318 19661 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:29.814774 19685 ts_tablet_manager.cc:933] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:29.814321 19661 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:29.788216 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:29.816255 18336 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.827466 18336 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:29.831588 19685 tablet_copy_client.cc:323] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:29.834236 18428 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet b1734a6c318d4e6ba6b65fd828d4fe66 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:29.835027 18428 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet b1734a6c318d4e6ba6b65fd828d4fe66 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-b1734a6c318d4e6ba6b65fd828d4fe66
I20260709 13:17:29.841326 18240 catalog_manager.cc:5697] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 2 to 3, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.843151 18428 tablet_copy_source_session.cc:215] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:29.846781 19685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1734a6c318d4e6ba6b65fd828d4fe66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.864557 19685 tablet_copy_client.cc:806] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:29.865171 19685 tablet_copy_client.cc:670] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:29.868871 19685 tablet_copy_client.cc:538] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:29.877388 19685 tablet_bootstrap.cc:492] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:29.904906 19685 tablet_bootstrap.cc:492] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:29.905644 19685 tablet_bootstrap.cc:492] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:29.906277 19685 ts_tablet_manager.cc:1403] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.010s
I20260709 13:17:29.908732 19685 raft_consensus.cc:359] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:29.909354 19685 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:29.909875 19685 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:29.912302 19685 ts_tablet_manager.cc:1434] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:17:29.916023 18428 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b1734a6c318d4e6ba6b65fd828d4fe66 received from {username='slave'} at 127.0.0.1:44916
I20260709 13:17:29.916535 18428 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b1734a6c318d4e6ba6b65fd828d4fe66 on tablet b1734a6c318d4e6ba6b65fd828d4fe66 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:29.933315 19685 ts_tablet_manager.cc:933] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:29.934957 19685 tablet_copy_client.cc:323] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.3:43125
I20260709 13:17:29.937064 18503 tablet_copy_service.cc:140] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Received BeginTabletCopySession request for tablet 479d13df82394c22b38ff5fd8a8b5931 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:35114)
I20260709 13:17:29.937539 18503 tablet_copy_service.cc:161] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Beginning new tablet copy session on tablet 479d13df82394c22b38ff5fd8a8b5931 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:35114: session id = 31ab487dc52e4f608b39df0fae2fdfa5-479d13df82394c22b38ff5fd8a8b5931
I20260709 13:17:29.944664 18503 tablet_copy_source_session.cc:215] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:29.948143 19685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479d13df82394c22b38ff5fd8a8b5931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.961696 19685 tablet_copy_client.cc:806] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:29.962277 19685 tablet_copy_client.cc:670] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:29.971447 19685 tablet_copy_client.cc:538] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:29.981027 19685 tablet_bootstrap.cc:492] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:29.995078 18414 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:29.998718 19635 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:30.006654 19685 tablet_bootstrap.cc:492] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:30.012996 19685 tablet_bootstrap.cc:492] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:30.013679 19685 ts_tablet_manager.cc:1403] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.033s	user 0.028s	sys 0.000s
I20260709 13:17:30.015506 18492 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:30.017771 18412 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:30.018719 19685 raft_consensus.cc:359] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:30.019554 19685 raft_consensus.cc:740] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:30.020169 19685 consensus_queue.cc:260] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:30.021085 19635 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:30.022397 19526 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:30.027280 19685 ts_tablet_manager.cc:1434] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:17:30.028925 18503 tablet_copy_service.cc:342] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-479d13df82394c22b38ff5fd8a8b5931 received from {username='slave'} at 127.0.0.1:35114
I20260709 13:17:30.029341 18503 tablet_copy_service.cc:434] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-479d13df82394c22b38ff5fd8a8b5931 on tablet 479d13df82394c22b38ff5fd8a8b5931 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:30.037031 18492 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:30.038638 19635 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:30.066906 18336 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:30.069137 19526 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:30.079164 19685 ts_tablet_manager.cc:933] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:30.086081 19062 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:30.087651 19669 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:30.122743 19685 tablet_copy_client.cc:323] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.3:43125
I20260709 13:17:30.124748 18503 tablet_copy_service.cc:140] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Received BeginTabletCopySession request for tablet 77cd16981fa049aaaa881bdeacda2fc3 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:35114)
I20260709 13:17:30.125443 18503 tablet_copy_service.cc:161] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Beginning new tablet copy session on tablet 77cd16981fa049aaaa881bdeacda2fc3 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:35114: session id = 31ab487dc52e4f608b39df0fae2fdfa5-77cd16981fa049aaaa881bdeacda2fc3
I20260709 13:17:30.137879 18503 tablet_copy_source_session.cc:215] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:30.150934 19685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cd16981fa049aaaa881bdeacda2fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.178331 19685 tablet_copy_client.cc:806] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:30.179356 19685 tablet_copy_client.cc:670] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:30.182734 19685 tablet_copy_client.cc:538] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:30.190423 19685 tablet_bootstrap.cc:492] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:30.206215 19685 tablet_bootstrap.cc:492] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:30.207122 19685 tablet_bootstrap.cc:492] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:30.207232 19703 ts_tablet_manager.cc:933] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:30.207820 19685 ts_tablet_manager.cc:1403] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:17:30.211910 19685 raft_consensus.cc:359] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:30.212832 19685 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:30.213395 19685 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:30.219154 19685 ts_tablet_manager.cc:1434] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:30.226615 18503 tablet_copy_service.cc:342] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-77cd16981fa049aaaa881bdeacda2fc3 received from {username='slave'} at 127.0.0.1:35114
I20260709 13:17:30.227042 18503 tablet_copy_service.cc:434] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-77cd16981fa049aaaa881bdeacda2fc3 on tablet 77cd16981fa049aaaa881bdeacda2fc3 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:30.230165 19703 tablet_copy_client.cc:323] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:30.232163 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet 97efddba551a406f8d4427488fc22c5c from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:30.232709 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet 97efddba551a406f8d4427488fc22c5c from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-97efddba551a406f8d4427488fc22c5c
I20260709 13:17:30.237285 18336 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:30.238689 19459 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:30.241750 18354 tablet_copy_source_session.cc:215] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:30.247766 19059 raft_consensus.cc:1217] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:30.249583 19703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97efddba551a406f8d4427488fc22c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.265137 19059 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:30.267153 19459 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:30.275846 19703 tablet_copy_client.cc:806] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:30.276477 19703 tablet_copy_client.cc:670] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:30.280900 19703 tablet_copy_client.cc:538] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:30.291819 18488 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:30.293221 19492 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.304966 19703 tablet_bootstrap.cc:492] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:30.325605 18337 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:30.327967 19661 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.374706 19703 tablet_bootstrap.cc:492] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:30.375586 19703 tablet_bootstrap.cc:492] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:30.376328 19703 ts_tablet_manager.cc:1403] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.072s	user 0.024s	sys 0.011s
I20260709 13:17:30.379149 19703 raft_consensus.cc:359] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:30.379923 19703 raft_consensus.cc:740] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:30.380591 19703 consensus_queue.cc:260] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:30.383073 19703 ts_tablet_manager.cc:1434] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:17:30.389750 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-97efddba551a406f8d4427488fc22c5c received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:30.390230 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-97efddba551a406f8d4427488fc22c5c on tablet 97efddba551a406f8d4427488fc22c5c with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:30.415129 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:30.432796 19059 raft_consensus.cc:1217] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:30.474138 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:30.519865 18492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:30.520375 18492 raft_consensus.cc:606] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:30.522797 18337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:17:30.523231 18337 raft_consensus.cc:606] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:30.525491 18414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:30.525950 18414 raft_consensus.cc:606] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:30.528100 18337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:17:30.528535 18337 raft_consensus.cc:606] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:30.529517 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:30.530645 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:30.552625 19525 raft_consensus.cc:993] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:30.553211 19669 raft_consensus.cc:1081] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:30.555280 18488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55660
I20260709 13:17:30.555826 18488 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:30.556174 18488 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.563851 18488 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:30.565784 18488 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:30.566387 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:30.566989 18337 raft_consensus.cc:3055] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:30.567261 18337 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:30.567384 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:30.567940 19059 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.567988 18337 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:30.569155 18337 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.575875 18337 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:30.579066 19059 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:30.579471 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:30.580543 19459 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:30.581075 19459 raft_consensus.cc:697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:30.581995 19459 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:30.616614 18238 catalog_manager.cc:5697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 2 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.618893 19059 raft_consensus.cc:1217] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:30.654450 19059 raft_consensus.cc:1217] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:30.760100 19492 raft_consensus.cc:1064] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:30.762383 19492 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:30.774811 19059 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.776721 19580 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.780892 19630 raft_consensus.cc:993] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:30.781826 19672 raft_consensus.cc:1081] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:30.793053 18336 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37928
I20260709 13:17:30.793803 18336 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:30.794266 18336 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.803376 18492 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.822103 19661 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.851763 18336 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:30.855218 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:30.855978 18488 raft_consensus.cc:3055] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:30.856397 18488 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:30.857350 18488 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:30.858759 18488 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.871677 18488 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:30.872901 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:30.873705 19669 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:30.874274 19669 raft_consensus.cc:697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:30.875138 19669 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:30.875185 19062 raft_consensus.cc:2955] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:30.883514 18337 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.882632 19717 raft_consensus.cc:2955] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:30.885347 19492 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.891538 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:30.892128 19059 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.894383 18238 catalog_manager.cc:5697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:30.900115 18240 catalog_manager.cc:5697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 1 to 2, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.873692 18336 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:30.908207 19712 raft_consensus.cc:993] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:30.908675 19712 raft_consensus.cc:1081] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:30.910429 18484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55660
I20260709 13:17:30.911002 18484 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:30.911594 18484 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.919567 19661 raft_consensus.cc:993] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:30.920077 19661 raft_consensus.cc:1081] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:30.921180 18484 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:30.923307 18484 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:30.924386 18492 raft_consensus.cc:2955] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:30.929446 18488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:17:30.930073 18488 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:30.936124 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:30.936421 18488 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.936686 19060 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.932482 18337 raft_consensus.cc:2955] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:30.950608 19060 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:30.951700 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:30.952987 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:30.953974 18336 raft_consensus.cc:3055] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:30.954598 18336 raft_consensus.cc:740] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:30.915427 19059 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:30.991415 18488 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:31.010399 18488 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:31.015143 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:31.015776 18414 raft_consensus.cc:3055] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.016109 18414 raft_consensus.cc:740] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:31.016782 18414 consensus_queue.cc:260] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:31.018790 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:31.019021 18340 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:31.019405 18341 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.991842 18336 consensus_queue.cc:260] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:31.017881 18414 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.023382 18336 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.024712 19672 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:30.953697 19630 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.027309 19630 raft_consensus.cc:697] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:31.028241 19630 consensus_queue.cc:237] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:31.029976 18336 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:31.031739 18341 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:31.018759 19059 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:31.040742 19672 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:31.047819 18338 raft_consensus.cc:1240] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.059437 18458 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:31.060793 19459 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.061448 19459 raft_consensus.cc:697] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:31.062378 19459 consensus_queue.cc:237] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:31.072220 19672 raft_consensus.cc:1064] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:31.074992 19672 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:31.082265 19712 raft_consensus.cc:1064] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:31.036445 18414 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:31.084918 19712 consensus_queue.cc:237] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:31.124589 19062 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.124771 18336 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.129781 19459 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.133262 19459 raft_consensus.cc:1064] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:31.135504 19459 consensus_queue.cc:237] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:31.146597 19059 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.147727 19630 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:31.151167 19669 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.162016 18414 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.164637 19059 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.165997 19630 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.171478 19725 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.186133 18412 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.193465 18412 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.194481 19733 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.196568 19525 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.208496 18240 catalog_manager.cc:5697] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 2 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:31.213858 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 60077us
I20260709 13:17:31.223730 18493 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.232946 18337 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.239774 19459 raft_consensus.cc:2955] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.246637 19060 raft_consensus.cc:2955] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.248994 19725 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.255867 19669 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.282555 18414 raft_consensus.cc:2955] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.290602 18336 raft_consensus.cc:2955] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.295388 18488 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:31.296821 19669 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:31.263669 18240 catalog_manager.cc:5697] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 2 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.312405 19669 raft_consensus.cc:2955] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.328364 18410 raft_consensus.cc:2955] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.330708 19725 raft_consensus.cc:2955] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.334874 18414 raft_consensus.cc:2955] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.347246 18238 catalog_manager.cc:5697] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.350526 19060 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:31.356163 19525 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:31.358417 18492 raft_consensus.cc:2955] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.420037 19061 raft_consensus.cc:2955] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:17:31.426043 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 65022.5us
I20260709 13:17:31.438627 18336 raft_consensus.cc:2955] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.447822 19061 raft_consensus.cc:2955] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.461758 18493 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:31.472065 19059 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:31.475694 19062 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:31.478235 18414 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:31.481134 19725 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:31.482601 19725 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:31.494673 19725 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:31.506021 19725 raft_consensus.cc:2955] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.506932 18336 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:31.507817 18414 raft_consensus.cc:2955] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.511302 18242 catalog_manager.cc:5697] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.513273 18242 catalog_manager.cc:5697] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.521868 19630 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:31.522404 19061 raft_consensus.cc:2955] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.526518 18410 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.531759 19459 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.535845 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 77cd16981fa049aaaa881bdeacda2fc3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:31.537031 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:31.546814 18337 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.548287 19725 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.562489 18492 consensus_queue.cc:237] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:31.575330 19061 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:31.578399 18414 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:31.577282 19733 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:17:31.579241 18336 consensus_queue.cc:237] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:31.583505 19733 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:31.585645 19061 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:31.587095 19736 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:31.583946 18242 catalog_manager.cc:5697] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.595841 19727 raft_consensus.cc:2955] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.602108 19669 raft_consensus.cc:2955] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.604013 19059 raft_consensus.cc:2955] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.610045 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet 77cd16981fa049aaaa881bdeacda2fc3 with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37906
I20260709 13:17:31.622076 18492 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:31.648707 18412 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:31.663329 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 97efddba551a406f8d4427488fc22c5c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:31.667145 19755 tablet_replica.cc:333] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:17:31.668386 19755 raft_consensus.cc:2243] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.658017 18411 raft_consensus.cc:2955] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.669155 19755 raft_consensus.cc:2272] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.673884 19755 ts_tablet_manager.cc:1916] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:31.674631 19060 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:31.679986 18336 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:31.680646 19492 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:31.682302 19492 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:31.684682 19060 raft_consensus.cc:2955] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.688809 19580 raft_consensus.cc:2955] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.696614 19736 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:31.702934 19755 ts_tablet_manager.cc:1929] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:31.703109 18227 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1734a6c318d4e6ba6b65fd828d4fe66 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:31.703593 19755 log.cc:1199] T 77cd16981fa049aaaa881bdeacda2fc3 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/77cd16981fa049aaaa881bdeacda2fc3
I20260709 13:17:31.707394 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 479d13df82394c22b38ff5fd8a8b5931 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:31.710291 18336 raft_consensus.cc:2955] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.720453 18492 raft_consensus.cc:2955] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.705367 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet 77cd16981fa049aaaa881bdeacda2fc3 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:31.731549 18240 catalog_manager.cc:5697] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.743358 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet 97efddba551a406f8d4427488fc22c5c with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:31.739902 19060 raft_consensus.cc:2955] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.753762 18240 catalog_manager.cc:5697] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 1 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:31.757190 18239 catalog_manager.cc:5697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.768567 19756 tablet_replica.cc:333] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:17:31.778522 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet 479d13df82394c22b38ff5fd8a8b5931 with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37906
I20260709 13:17:31.779582 19755 tablet_replica.cc:333] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:17:31.780656 19755 raft_consensus.cc:2243] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.781388 19755 raft_consensus.cc:2272] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.789330 19755 ts_tablet_manager.cc:1916] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:31.805508 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet b1734a6c318d4e6ba6b65fd828d4fe66 with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:31.812759 19756 raft_consensus.cc:2243] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.813592 19756 raft_consensus.cc:2272] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.818694 19756 ts_tablet_manager.cc:1916] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:31.819247 19755 ts_tablet_manager.cc:1929] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:31.820010 19755 log.cc:1199] T 479d13df82394c22b38ff5fd8a8b5931 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/479d13df82394c22b38ff5fd8a8b5931
I20260709 13:17:31.820055 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:31.821774 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet 479d13df82394c22b38ff5fd8a8b5931 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:31.829581 19757 tablet_replica.cc:333] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:17:31.830791 19757 raft_consensus.cc:2243] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.831563 19757 raft_consensus.cc:2272] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.834918 19757 ts_tablet_manager.cc:1916] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:31.838056 19756 ts_tablet_manager.cc:1929] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:31.838584 19756 log.cc:1199] T 97efddba551a406f8d4427488fc22c5c P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/97efddba551a406f8d4427488fc22c5c
I20260709 13:17:31.840318 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet 97efddba551a406f8d4427488fc22c5c (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:31.850566 19757 ts_tablet_manager.cc:1929] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:31.851078 19757 log.cc:1199] T b1734a6c318d4e6ba6b65fd828d4fe66 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/b1734a6c318d4e6ba6b65fd828d4fe66
I20260709 13:17:31.852797 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet b1734a6c318d4e6ba6b65fd828d4fe66 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:31.871685 18488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:31.872185 18488 raft_consensus.cc:606] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:31.874732 18337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:17:31.875304 18337 raft_consensus.cc:606] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:31.877857 18488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:31.878381 18488 raft_consensus.cc:606] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:31.880256 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:31.881747 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:31.895692 19712 raft_consensus.cc:993] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:31.896166 19736 raft_consensus.cc:1081] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:31.897573 18488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55660
I20260709 13:17:31.897990 18488 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.898214 18488 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.902503 18488 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:31.903852 18488 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:31.904788 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:31.905305 18337 raft_consensus.cc:3055] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.905614 18337 raft_consensus.cc:740] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:31.905664 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:31.906529 18411 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.906270 18337 consensus_queue.cc:260] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:31.907431 18337 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.911680 18411 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:31.911765 18337 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:31.913339 18457 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:31.914455 19733 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.914875 19733 raft_consensus.cc:697] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:31.915566 19733 consensus_queue.cc:237] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:31.924543 18242 catalog_manager.cc:5697] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 2 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.968067 19630 raft_consensus.cc:993] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:31.968518 19630 raft_consensus.cc:1081] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:31.970085 19060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38700
I20260709 13:17:31.970573 19060 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.970866 19060 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.976531 19060 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:31.978225 19060 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:31.978909 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:31.979533 18337 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.979620 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:31.980222 18492 raft_consensus.cc:3055] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:31.980556 18492 raft_consensus.cc:740] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:31.981496 18492 consensus_queue.cc:260] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:31.982807 18492 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.986500 18337 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:17:31.987818 19027 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:31.988590 19676 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:31.988982 19676 raft_consensus.cc:697] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:31.989774 18492 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:17:31.989797 19676 consensus_queue.cc:237] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:31.998350 18242 catalog_manager.cc:5697] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 2 to 3, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 3 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.020357 19733 raft_consensus.cc:993] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:32.020795 19630 raft_consensus.cc:1081] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:32.021996 18411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34458
I20260709 13:17:32.022370 18411 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.022584 18411 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.027189 18411 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:32.028694 18411 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:32.029354 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:32.029567 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:32.029958 18492 raft_consensus.cc:3055] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.030108 19061 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.030304 18492 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:32.031131 18492 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:32.032235 18492 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.036233 19061 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:32.038559 18492 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:32.038945 18384 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:32.039767 19661 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.041025 19661 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:32.041872 19661 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:32.050168 18242 catalog_manager.cc:5697] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 2, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.408015 18411 raft_consensus.cc:1275] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.409969 19630 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.420975 18337 raft_consensus.cc:1275] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.423660 19733 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:32.529378 18488 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:32.530639 19661 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:32.537909 19060 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:32.540546 19661 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:32.578204 18488 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:32.579685 19526 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:32.592705 18337 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:32.615437 19773 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:32.869772 18411 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:32.877275 18488 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:32.877503 18337 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:32.878980 19661 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.880417 19765 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:32.881356 18384 consensus_peers.cc:597] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac1699feafbd4621b7b7a28933b59fec. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.882617 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:32.899421 19661 raft_consensus.cc:2955] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:32.900523 18337 raft_consensus.cc:2955] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:32.904665 18488 raft_consensus.cc:2955] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:32.924522 18238 catalog_manager.cc:5697] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:32.932405 18411 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:32.946172 18488 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:32.947232 18337 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:32.949339 19661 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:32.951270 18384 consensus_peers.cc:597] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3024cea1b1847929dd26f32197f9067. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.952184 19661 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:32.958763 19661 raft_consensus.cc:2955] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:32.961541 18492 raft_consensus.cc:2955] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:32.968156 18337 raft_consensus.cc:2955] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:32.975734 18341 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:32.983268 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:32.988526 18239 catalog_manager.cc:5697] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
W20260709 13:17:33.000878 18309 consensus_peers.cc:597] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64f9a8403ec74b85bc4a3ff12e5f686a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:33.005761 18492 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:33.006196 18411 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:33.007751 19669 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.009363 19669 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.022215 19669 raft_consensus.cc:2955] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:33.070423 18412 raft_consensus.cc:2955] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:33.074018 18411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:33.074635 18411 raft_consensus.cc:606] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:33.083874 18488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:33.085001 18488 raft_consensus.cc:606] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:33.085723 18341 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:33.084213 18242 catalog_manager.cc:5697] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.093303 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:33.094978 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:33.095254 18492 raft_consensus.cc:2955] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
W20260709 13:17:33.103320 18309 consensus_peers.cc:597] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b972754511104f898e9cbc171aa6c170. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:33.104959 18412 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:33.108976 19669 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:33.109696 18488 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:33.112716 19712 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:33.129346 18411 raft_consensus.cc:2955] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:33.127490 19712 raft_consensus.cc:2955] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:33.186551 19761 raft_consensus.cc:993] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:33.189482 19733 raft_consensus.cc:1081] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:33.179873 18242 catalog_manager.cc:5697] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 2 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:33.192407 18411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34458
I20260709 13:17:33.194919 18411 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.195894 19766 raft_consensus.cc:993] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:33.196457 19766 raft_consensus.cc:1081] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:33.198734 18341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37920
I20260709 13:17:33.199296 18341 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.199678 18341 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:33.201992 18411 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.205796 18492 raft_consensus.cc:2955] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:33.220223 18341 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:33.219122 18411 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:33.224304 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:33.224929 18492 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:33.225538 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:33.226162 18336 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.231982 18492 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:17:33.233322 18307 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:33.233830 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:33.234382 18493 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.234560 18493 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:33.235194 18493 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:33.235929 18493 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.231909 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:33.237476 18412 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:33.237794 18412 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:33.238251 19712 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:33.238724 19712 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:33.238561 18412 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:33.239820 18412 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:33.232081 18336 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:33.239581 19712 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:33.223373 18341 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:33.243141 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:33.243206 18411 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:33.244058 19661 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.244489 19661 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:33.245198 19661 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:33.251600 18493 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:33.256940 18412 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:17:33.267812 18238 catalog_manager.cc:5697] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 2, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.274797 18239 catalog_manager.cc:5697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 3 to 4, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.402931 19797 ts_tablet_manager.cc:933] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:33.404984 19797 tablet_copy_client.cc:323] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:33.406613 18428 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet ac1699feafbd4621b7b7a28933b59fec from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:33.407172 18428 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet ac1699feafbd4621b7b7a28933b59fec from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-ac1699feafbd4621b7b7a28933b59fec
I20260709 13:17:33.415258 18428 tablet_copy_source_session.cc:215] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:33.418509 19797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac1699feafbd4621b7b7a28933b59fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:33.435236 19797 tablet_copy_client.cc:806] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:33.435864 19797 tablet_copy_client.cc:670] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:33.445436 19797 tablet_copy_client.cc:538] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:33.454963 19797 tablet_bootstrap.cc:492] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:33.475834 19799 ts_tablet_manager.cc:933] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:33.477715 19799 tablet_copy_client.cc:323] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:33.479110 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet 64f9a8403ec74b85bc4a3ff12e5f686a from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:33.479715 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet 64f9a8403ec74b85bc4a3ff12e5f686a from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-64f9a8403ec74b85bc4a3ff12e5f686a
I20260709 13:17:33.483389 19797 tablet_bootstrap.cc:492] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:33.487865 19797 tablet_bootstrap.cc:492] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:33.488535 18354 tablet_copy_source_session.cc:215] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:33.488615 19797 ts_tablet_manager.cc:1403] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.008s
I20260709 13:17:33.491853 19799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f9a8403ec74b85bc4a3ff12e5f686a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:33.492594 19797 raft_consensus.cc:359] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:33.493256 19797 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:33.493770 19797 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:33.496158 19797 ts_tablet_manager.cc:1434] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:33.498421 18428 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-ac1699feafbd4621b7b7a28933b59fec received from {username='slave'} at 127.0.0.1:44916
I20260709 13:17:33.498803 18428 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-ac1699feafbd4621b7b7a28933b59fec on tablet ac1699feafbd4621b7b7a28933b59fec with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:33.503432 19797 ts_tablet_manager.cc:933] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:33.526856 19799 tablet_copy_client.cc:806] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:33.527581 19799 tablet_copy_client.cc:670] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:33.532859 19799 tablet_copy_client.cc:538] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:33.572587 19799 tablet_bootstrap.cc:492] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:33.582993 19797 tablet_copy_client.cc:323] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:33.584479 18428 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet c3024cea1b1847929dd26f32197f9067 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:33.585052 18428 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet c3024cea1b1847929dd26f32197f9067 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-c3024cea1b1847929dd26f32197f9067
I20260709 13:17:33.586014 19803 ts_tablet_manager.cc:933] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:33.591399 19803 tablet_copy_client.cc:323] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:33.592671 18428 tablet_copy_source_session.cc:215] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:33.592818 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet b972754511104f898e9cbc171aa6c170 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:33.593355 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet b972754511104f898e9cbc171aa6c170 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-b972754511104f898e9cbc171aa6c170
I20260709 13:17:33.596151 19797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3024cea1b1847929dd26f32197f9067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:33.600917 18354 tablet_copy_source_session.cc:215] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:33.604477 19803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b972754511104f898e9cbc171aa6c170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:33.614005 19797 tablet_copy_client.cc:806] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:33.615324 19797 tablet_copy_client.cc:670] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:33.619184 19797 tablet_copy_client.cc:538] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:33.626749 19799 tablet_bootstrap.cc:492] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:33.627573 19803 tablet_copy_client.cc:806] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:33.627720 19799 tablet_bootstrap.cc:492] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:33.628180 19803 tablet_copy_client.cc:670] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:33.628774 19799 ts_tablet_manager.cc:1403] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.004s
I20260709 13:17:33.630951 19797 tablet_bootstrap.cc:492] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:33.632159 19803 tablet_copy_client.cc:538] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:33.636510 19799 raft_consensus.cc:359] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:33.637408 19799 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:33.638048 19799 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:33.640895 19799 ts_tablet_manager.cc:1434] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:17:33.644142 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-64f9a8403ec74b85bc4a3ff12e5f686a received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:33.644541 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-64f9a8403ec74b85bc4a3ff12e5f686a on tablet 64f9a8403ec74b85bc4a3ff12e5f686a with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:33.661011 19803 tablet_bootstrap.cc:492] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:33.677014 19797 tablet_bootstrap.cc:492] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:33.677940 19797 tablet_bootstrap.cc:492] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:33.678601 19797 ts_tablet_manager.cc:1403] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.048s	user 0.026s	sys 0.010s
I20260709 13:17:33.681474 19797 raft_consensus.cc:359] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:33.682317 19797 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:33.682927 19797 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:33.686497 19797 ts_tablet_manager.cc:1434] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:17:33.689026 18428 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-c3024cea1b1847929dd26f32197f9067 received from {username='slave'} at 127.0.0.1:44916
I20260709 13:17:33.689471 18428 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-c3024cea1b1847929dd26f32197f9067 on tablet c3024cea1b1847929dd26f32197f9067 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:33.694746 19803 tablet_bootstrap.cc:492] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:33.695685 19803 tablet_bootstrap.cc:492] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:33.696309 19803 ts_tablet_manager.cc:1403] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.002s
I20260709 13:17:33.700062 19803 raft_consensus.cc:359] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:33.700886 19803 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:33.701519 19803 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:33.704012 19803 ts_tablet_manager.cc:1434] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:17:33.705724 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b972754511104f898e9cbc171aa6c170 received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:33.706149 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b972754511104f898e9cbc171aa6c170 on tablet b972754511104f898e9cbc171aa6c170 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:33.722299 18493 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.722695 18341 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.723624 19766 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.724835 19766 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.797060 18493 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:33.798700 19813 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:33.832118 18412 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:33.833860 19814 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:33.922652 19060 raft_consensus.cc:1217] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:33.989537 19060 raft_consensus.cc:1217] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:34.002039 19060 raft_consensus.cc:1217] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:34.056864 19060 raft_consensus.cc:1217] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:34.095990 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:34.232924 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:34.289976 18493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b345033a56994fff90990b7d03324074"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:34.290546 18493 raft_consensus.cc:606] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:34.294135 18410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:34.294657 18410 raft_consensus.cc:606] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:34.299857 18337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b972754511104f898e9cbc171aa6c170"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:17:34.300365 18337 raft_consensus.cc:606] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:34.301565 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:34.303174 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:34.415782 19712 raft_consensus.cc:1064] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:34.417850 19712 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:34.423964 19060 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:34.424031 18492 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:34.425766 18410 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:34.426069 19814 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:34.426893 19712 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:34.427711 19813 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:34.440032 19813 raft_consensus.cc:2955] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.442553 18410 raft_consensus.cc:2955] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.449512 19060 raft_consensus.cc:2955] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.456032 18492 raft_consensus.cc:2955] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.472477 18238 catalog_manager.cc:5697] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.493852 18341 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:34.505668 18492 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:34.507709 19060 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:34.508960 19813 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:34.511349 19712 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:34.535022 19808 raft_consensus.cc:1064] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:34.541059 19061 raft_consensus.cc:2955] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.533648 19814 raft_consensus.cc:2955] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.548959 18493 raft_consensus.cc:2955] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.537598 19808 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:34.558180 19813 raft_consensus.cc:1064] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
W20260709 13:17:34.558670 19813 raft_consensus.cc:1068] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Unable to promote non-voter 31ab487dc52e4f608b39df0fae2fdfa5: Service unavailable: leader transfer in progress
I20260709 13:17:34.561664 18242 catalog_manager.cc:5697] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.584918 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet 64f9a8403ec74b85bc4a3ff12e5f686a with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:34.593673 19766 raft_consensus.cc:1064] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:34.596282 19766 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:34.613673 19061 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:34.615880 19831 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:34.624094 19794 raft_consensus.cc:993] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:34.624531 19794 raft_consensus.cc:1081] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:34.626185 18410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b345033a56994fff90990b7d03324074"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34458
I20260709 13:17:34.626688 18410 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:34.627032 18410 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:34.721745 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 139528us
I20260709 13:17:34.750402 18410 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:34.752265 18410 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:34.766434 19832 tablet_replica.cc:333] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:17:34.767917 19832 raft_consensus.cc:2243] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:34.769011 19832 raft_consensus.cc:2272] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:34.790652 18492 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:34.792824 19830 raft_consensus.cc:993] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:34.793735 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:34.805231 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 64f9a8403ec74b85bc4a3ff12e5f686a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:34.854329 18484 raft_consensus.cc:3055] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:34.854645 18484 raft_consensus.cc:740] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:34.813519 18341 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:34.818429 18336 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:34.855374 18484 consensus_queue.cc:260] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:34.856498 18484 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.814222 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:34.858371 18337 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.858657 19661 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:34.860117 18488 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:34.862622 19832 ts_tablet_manager.cc:1916] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:34.864893 18337 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:34.853962 19830 raft_consensus.cc:1081] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
W20260709 13:17:34.854475 18228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 49266.5us
I20260709 13:17:34.822181 19060 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:34.868857 19830 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:34.871671 18484 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:34.883491 19830 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:34.889760 19712 raft_consensus.cc:993] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:34.890229 19814 raft_consensus.cc:1081] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:34.891973 19661 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:34.892088 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:34.893760 19661 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.894443 19661 raft_consensus.cc:697] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:34.899251 19834 raft_consensus.cc:2955] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.898294 19661 consensus_queue.cc:237] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:34.901252 18492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b972754511104f898e9cbc171aa6c170"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55660
I20260709 13:17:34.900756 18337 raft_consensus.cc:2955] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.902052 18492 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:34.902920 18492 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.917078 18484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:17:34.917689 18484 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:34.918185 18484 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.917399 19061 raft_consensus.cc:2955] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.918298 18492 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:34.921056 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:34.921317 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:34.921684 18337 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:34.921833 18410 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.922067 18337 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:34.922936 18337 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:34.923156 19831 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:34.926180 18484 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:34.928006 18484 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:34.929111 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:34.929669 18419 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:34.930030 18419 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:34.930260 18410 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:34.930790 18419 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:34.931778 18419 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.932029 18457 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:34.932896 19829 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:34.932603 18242 catalog_manager.cc:5697] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.933497 19829 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:34.934681 19829 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:34.937018 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:34.937585 18341 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.943980 18341 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:34.945832 18492 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:34.946295 18419 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:34.951963 18457 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:34.952772 19794 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:34.953220 19794 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:34.954278 19794 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:34.960731 18240 catalog_manager.cc:5697] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 2, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.963912 18239 catalog_manager.cc:5697] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 3, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.966131 19832 ts_tablet_manager.cc:1929] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:34.966629 19832 log.cc:1199] T 64f9a8403ec74b85bc4a3ff12e5f686a P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/64f9a8403ec74b85bc4a3ff12e5f686a
I20260709 13:17:34.970304 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet 64f9a8403ec74b85bc4a3ff12e5f686a (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:34.973026 18337 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.971922 18484 raft_consensus.cc:2955] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.988958 19661 raft_consensus.cc:2955] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.998227 18341 raft_consensus.cc:2955] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:34.983758 18337 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:35.000053 18492 raft_consensus.cc:2955] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.021965 18484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b972754511104f898e9cbc171aa6c170"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:35.025434 19061 raft_consensus.cc:2955] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.027592 18410 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:35.034173 18484 raft_consensus.cc:606] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Received request to transfer leadership
I20260709 13:17:35.036396 18242 catalog_manager.cc:5697] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.037710 19060 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:35.039553 18484 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:35.039327 19808 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:35.041296 19808 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:35.047519 19831 raft_consensus.cc:2955] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.048910 19060 raft_consensus.cc:2955] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.059826 18493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b972754511104f898e9cbc171aa6c170"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:35.060429 18493 raft_consensus.cc:606] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Received request to transfer leadership
I20260709 13:17:35.068209 18410 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:35.070209 18226 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for b972754511104f898e9cbc171aa6c170 already in progress
I20260709 13:17:35.071990 18240 catalog_manager.cc:5697] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 3, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.075388 18492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b972754511104f898e9cbc171aa6c170"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:35.075912 18492 raft_consensus.cc:606] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Received request to transfer leadership
I20260709 13:17:35.074049 18336 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:35.079803 19808 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:17:35.083009 18290 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 13:17:35.084470 18242 catalog_manager.cc:5697] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:17:35.087360 18290 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for b972754511104f898e9cbc171aa6c170 already in progress
W20260709 13:17:35.087762 18290 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for b972754511104f898e9cbc171aa6c170 already in progress
I20260709 13:17:35.088111 19834 raft_consensus.cc:2955] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.089651 18336 raft_consensus.cc:2955] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.097011 18492 raft_consensus.cc:2955] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.103197 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet c3024cea1b1847929dd26f32197f9067 with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37906
I20260709 13:17:35.107391 18242 catalog_manager.cc:5697] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 1 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.109302 18227 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ac1699feafbd4621b7b7a28933b59fec with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:35.110073 19060 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:35.111466 18227 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c3024cea1b1847929dd26f32197f9067 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:35.108116 19847 tablet_replica.cc:333] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:17:35.113018 19847 raft_consensus.cc:2243] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:35.121495 19831 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:35.121541 19847 raft_consensus.cc:2272] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:35.125628 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet ac1699feafbd4621b7b7a28933b59fec with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:35.126437 19060 raft_consensus.cc:2955] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.130270 19847 ts_tablet_manager.cc:1916] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:35.134970 19848 tablet_replica.cc:333] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:17:35.136092 19848 raft_consensus.cc:2243] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:35.147293 19848 raft_consensus.cc:2272] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:35.150583 19848 ts_tablet_manager.cc:1916] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:35.151292 19847 ts_tablet_manager.cc:1929] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:35.151731 19847 log.cc:1199] T c3024cea1b1847929dd26f32197f9067 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/c3024cea1b1847929dd26f32197f9067
I20260709 13:17:35.153061 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet c3024cea1b1847929dd26f32197f9067 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:35.160794 19848 ts_tablet_manager.cc:1929] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:35.161186 19848 log.cc:1199] T ac1699feafbd4621b7b7a28933b59fec P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/ac1699feafbd4621b7b7a28933b59fec
I20260709 13:17:35.162660 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet ac1699feafbd4621b7b7a28933b59fec (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:35.303980 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:35.329133 18336 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:35.330339 19837 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:35.336102 19794 raft_consensus.cc:993] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:35.336544 19794 raft_consensus.cc:1081] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:35.338663 18341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b972754511104f898e9cbc171aa6c170"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37928
I20260709 13:17:35.339159 18341 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.339499 18341 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.343773 19059 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Advancing to term 3
I20260709 13:17:35.346047 18341 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:35.345407 18410 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:35.353204 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:35.353396 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:35.353734 18410 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.353490 19829 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:35.354359 18336 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:35.358951 19059 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:35.361657 18341 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:35.363391 18492 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:35.363749 18492 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:35.364538 18492 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:35.367831 18410 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:17:35.368513 18419 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:17:35.370595 18308 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:35.371353 19712 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:35.371765 19712 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:35.372488 19712 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:35.373620 19630 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:35.387902 18240 catalog_manager.cc:5697] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 3 to 4, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.399665 19837 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:35.400905 19829 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:35.409628 18492 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.416841 18492 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:17:35.447258 18336 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.448468 19808 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.459079 18492 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.460520 19808 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.466991 18336 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:35.468559 19837 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:35.477836 18410 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:35.478996 19794 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:35.482378 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:35.531697 18410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:35.532428 18410 raft_consensus.cc:606] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:35.535424 18493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:35.535965 18493 raft_consensus.cc:606] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:35.538498 18341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:17:35.538959 18341 raft_consensus.cc:606] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:35.540131 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:35.541651 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:35.591217 19831 raft_consensus.cc:993] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:35.591698 19808 raft_consensus.cc:1081] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:35.593009 18492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:17:35.593406 18492 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.593701 18492 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.598321 18492 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:35.600723 18492 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:35.601164 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:35.601750 18419 raft_consensus.cc:3055] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:35.601910 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:35.602140 18419 raft_consensus.cc:740] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:35.602421 18341 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.602849 18419 consensus_queue.cc:260] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:35.603945 18419 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.609077 18341 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:35.610383 18458 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:35.611167 19829 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:35.611644 19829 raft_consensus.cc:697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:35.610810 18419 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:35.612509 19829 consensus_queue.cc:237] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:35.624039 18239 catalog_manager.cc:5697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 3, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.791961 19794 raft_consensus.cc:993] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:35.792390 19829 raft_consensus.cc:1081] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:35.793771 19059 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38700
I20260709 13:17:35.794349 19059 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.794708 19059 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.801178 19059 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:35.803598 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:35.803844 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:35.804194 18341 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.804383 18493 raft_consensus.cc:3055] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.804694 18493 raft_consensus.cc:740] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:35.810218 18341 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:35.810123 18493 consensus_queue.cc:260] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:35.811192 18493 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.811187 19027 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:35.812005 19836 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:35.812436 19836 raft_consensus.cc:697] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:35.813242 19836 consensus_queue.cc:237] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:35.816256 18493 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:35.819124 19059 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:35.832695 18419 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:35.833858 19814 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:35.834028 18239 catalog_manager.cc:5697] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 2, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.847164 18493 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:35.848166 19059 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEARNER]: Advancing to term 4
I20260709 13:17:35.848551 19863 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:35.855544 19059 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:35.856691 19712 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:35.885551 19712 raft_consensus.cc:1064] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:35.887570 19712 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:35.895830 18492 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:35.897121 19814 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:35.898777 18411 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:35.900002 19059 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:35.899991 19814 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:35.901268 19823 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:35.906942 19814 raft_consensus.cc:2955] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.914312 19060 raft_consensus.cc:2955] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.918983 18411 raft_consensus.cc:2955] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.930707 18492 raft_consensus.cc:2955] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.937788 18240 catalog_manager.cc:5697] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 3 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.957698 18336 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:35.960608 19814 raft_consensus.cc:993] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:35.961212 19814 raft_consensus.cc:1081] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:35.962725 18410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34462
I20260709 13:17:35.963229 18410 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.963544 18410 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.965973 19060 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:35.968500 19863 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:35.971680 18410 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:35.973771 18410 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:35.975191 18411 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:35.975551 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:35.976099 19060 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.976513 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:35.977053 18336 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.977396 18336 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:35.977183 19863 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:35.978204 18336 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:35.979406 18336 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.982474 19712 raft_consensus.cc:2955] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.984951 19060 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:35.984484 19061 raft_consensus.cc:2955] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:35.987953 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:35.988755 19830 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:35.989200 19830 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:35.990051 19830 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:35.992959 18410 raft_consensus.cc:2955] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:36.003057 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b972754511104f898e9cbc171aa6c170 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:36.002936 18239 catalog_manager.cc:5697] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 6 to 7, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:36.004745 18336 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:36.006275 18411 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:36.007922 19794 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.015715 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet b972754511104f898e9cbc171aa6c170 with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:36.023849 19868 tablet_replica.cc:333] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:17:36.027153 19868 raft_consensus.cc:2243] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.027953 19868 raft_consensus.cc:2272] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.031502 19868 ts_tablet_manager.cc:1916] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:36.032363 18242 catalog_manager.cc:5697] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.042171 18336 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:36.043862 19630 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.048388 19868 ts_tablet_manager.cc:1929] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:17:36.048936 19868 log.cc:1199] T b972754511104f898e9cbc171aa6c170 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/b972754511104f898e9cbc171aa6c170
I20260709 13:17:36.050462 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet b972754511104f898e9cbc171aa6c170 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:36.192334 18336 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:17:36.199507 18309 consensus_peers.cc:597] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 839ba6300c764efc8e880c80a27079b2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:36.200702 18492 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:36.201629 18411 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:36.202989 19823 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:36.203863 19866 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:36.214437 19863 raft_consensus.cc:2955] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.216574 18492 raft_consensus.cc:2955] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.217058 18411 raft_consensus.cc:2955] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.228686 18493 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:36.231290 18242 catalog_manager.cc:5697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 5, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:36.237625 18458 consensus_peers.cc:597] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5d50aacd9894a6ca1895dbf30df38dc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:36.240784 18341 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:36.243057 19837 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.244680 18411 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:36.246745 19837 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.253082 19829 raft_consensus.cc:2955] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.256074 18336 raft_consensus.cc:2955] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.258563 18337 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:36.260643 19773 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:36.260447 18411 raft_consensus.cc:2955] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.281493 18411 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:36.281952 18240 catalog_manager.cc:5697] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 4, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.290354 18493 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:17:36.293627 18384 consensus_peers.cc:597] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1c3d9691e854ee98b2b7d81f868c727. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:36.294826 18492 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:36.298900 19876 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:17:36.302054 18337 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:36.303918 19836 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:36.308960 19831 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.330991 19831 raft_consensus.cc:2955] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.339859 18493 raft_consensus.cc:2955] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.348340 18336 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:36.352396 18337 raft_consensus.cc:2955] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.361083 18411 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:36.362972 19866 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:36.364562 18309 consensus_peers.cc:597] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21b9264b0a434b79b6292c2ed23bbae0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:36.365955 18493 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:36.368424 19866 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:36.372560 18239 catalog_manager.cc:5697] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.383148 19712 raft_consensus.cc:2955] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.385179 18411 raft_consensus.cc:2955] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.396745 18492 raft_consensus.cc:2955] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:36.404827 18239 catalog_manager.cc:5697] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 2, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.452831 19060 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:36.454265 19831 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:36.468343 18336 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:36.474269 19830 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:36.542528 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:36.620903 19887 ts_tablet_manager.cc:933] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:36.622906 19887 tablet_copy_client.cc:323] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.3:43125
I20260709 13:17:36.624576 18503 tablet_copy_service.cc:140] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Received BeginTabletCopySession request for tablet b5d50aacd9894a6ca1895dbf30df38dc from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:35114)
I20260709 13:17:36.625093 18503 tablet_copy_service.cc:161] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Beginning new tablet copy session on tablet b5d50aacd9894a6ca1895dbf30df38dc from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:35114: session id = 31ab487dc52e4f608b39df0fae2fdfa5-b5d50aacd9894a6ca1895dbf30df38dc
I20260709 13:17:36.633052 18503 tablet_copy_source_session.cc:215] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:36.640651 19887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d50aacd9894a6ca1895dbf30df38dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:36.657999 19887 tablet_copy_client.cc:806] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:36.658654 19887 tablet_copy_client.cc:670] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:36.664382 19887 tablet_copy_client.cc:538] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:36.672363 19889 ts_tablet_manager.cc:933] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:36.673776 19887 tablet_bootstrap.cc:492] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:36.705644 19889 tablet_copy_client.cc:323] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:36.707906 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet 839ba6300c764efc8e880c80a27079b2 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:36.708706 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet 839ba6300c764efc8e880c80a27079b2 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-839ba6300c764efc8e880c80a27079b2
I20260709 13:17:36.731686 18354 tablet_copy_source_session.cc:215] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:36.734828 19887 tablet_bootstrap.cc:492] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:36.735797 19889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839ba6300c764efc8e880c80a27079b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:36.735899 19887 tablet_bootstrap.cc:492] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:36.736681 19887 ts_tablet_manager.cc:1403] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.063s	user 0.023s	sys 0.029s
I20260709 13:17:36.739713 19887 raft_consensus.cc:359] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:36.740501 19887 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:36.741159 19887 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:36.747108 19887 ts_tablet_manager.cc:1434] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:17:36.752803 18503 tablet_copy_service.cc:342] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b5d50aacd9894a6ca1895dbf30df38dc received from {username='slave'} at 127.0.0.1:35114
I20260709 13:17:36.753288 18503 tablet_copy_service.cc:434] P 9d6cd7c600ec4ab2b5cac479f05d4c0f: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b5d50aacd9894a6ca1895dbf30df38dc on tablet b5d50aacd9894a6ca1895dbf30df38dc with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:36.763324 19892 ts_tablet_manager.cc:933] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:36.773104 19887 ts_tablet_manager.cc:933] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:36.776367 19889 tablet_copy_client.cc:806] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:36.776919 19889 tablet_copy_client.cc:670] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:36.778769 19892 tablet_copy_client.cc:323] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:36.780696 18428 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet b1c3d9691e854ee98b2b7d81f868c727 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:36.781215 18428 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet b1c3d9691e854ee98b2b7d81f868c727 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-b1c3d9691e854ee98b2b7d81f868c727
I20260709 13:17:36.782059 19889 tablet_copy_client.cc:538] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:36.832324 18428 tablet_copy_source_session.cc:215] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:36.838577 19887 tablet_copy_client.cc:323] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:36.840205 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet 21b9264b0a434b79b6292c2ed23bbae0 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:36.840692 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet 21b9264b0a434b79b6292c2ed23bbae0 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-21b9264b0a434b79b6292c2ed23bbae0
I20260709 13:17:36.842308 19892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c3d9691e854ee98b2b7d81f868c727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:36.842545 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:36.847347 18354 tablet_copy_source_session.cc:215] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:36.854022 19889 tablet_bootstrap.cc:492] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:36.863356 19887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b9264b0a434b79b6292c2ed23bbae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:36.876641 19892 tablet_copy_client.cc:806] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:36.878708 19892 tablet_copy_client.cc:670] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:36.882956 19892 tablet_copy_client.cc:538] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:36.903270 19887 tablet_copy_client.cc:806] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:36.903944 19887 tablet_copy_client.cc:670] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:36.909116 19887 tablet_copy_client.cc:538] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:36.910656 19892 tablet_bootstrap.cc:492] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:36.928010 19889 tablet_bootstrap.cc:492] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:36.928890 19889 tablet_bootstrap.cc:492] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:36.929538 19889 ts_tablet_manager.cc:1403] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.076s	user 0.024s	sys 0.014s
I20260709 13:17:36.934988 19887 tablet_bootstrap.cc:492] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:36.940600 18410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:36.941298 18410 raft_consensus.cc:606] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:36.943867 19889 raft_consensus.cc:359] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:36.944687 19889 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:36.945302 19889 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:36.947707 19889 ts_tablet_manager.cc:1434] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:17:36.952355 18493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:36.953147 18493 raft_consensus.cc:606] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:36.953974 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-839ba6300c764efc8e880c80a27079b2 received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:36.954391 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-839ba6300c764efc8e880c80a27079b2 on tablet 839ba6300c764efc8e880c80a27079b2 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:36.965291 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:36.967468 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:37.003917 19887 tablet_bootstrap.cc:492] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:37.004855 19887 tablet_bootstrap.cc:492] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:37.005529 19887 ts_tablet_manager.cc:1403] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.071s	user 0.020s	sys 0.012s
I20260709 13:17:37.012837 19887 raft_consensus.cc:359] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:37.014029 19887 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:37.014814 19887 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:37.017620 19892 tablet_bootstrap.cc:492] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:37.018865 19892 tablet_bootstrap.cc:492] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:37.019594 19892 ts_tablet_manager.cc:1403] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.114s	user 0.037s	sys 0.036s
I20260709 13:17:37.017614 19887 ts_tablet_manager.cc:1434] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:17:37.024533 19892 raft_consensus.cc:359] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:37.025398 19892 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:17:37.026047 19892 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:37.028347 19892 ts_tablet_manager.cc:1434] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:17:37.030723 18428 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b1c3d9691e854ee98b2b7d81f868c727 received from {username='slave'} at 127.0.0.1:44916
I20260709 13:17:37.031132 18428 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b1c3d9691e854ee98b2b7d81f868c727 on tablet b1c3d9691e854ee98b2b7d81f868c727 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:37.044173 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-21b9264b0a434b79b6292c2ed23bbae0 received from {username='slave'} at 127.0.0.1:53812
I20260709 13:17:37.044574 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-21b9264b0a434b79b6292c2ed23bbae0 on tablet 21b9264b0a434b79b6292c2ed23bbae0 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:37.146072 19060 raft_consensus.cc:1217] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:17:37.214181 19060 raft_consensus.cc:1217] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:17:37.234715 19830 raft_consensus.cc:993] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:37.235236 19831 raft_consensus.cc:1081] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:37.236748 18337 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37920
I20260709 13:17:37.237347 18337 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:37.237669 18337 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.243839 18337 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:37.246519 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:37.247128 18411 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:37.247439 18411 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:37.248210 18411 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:37.249295 18411 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.249377 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:37.250041 18493 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.260090 19060 raft_consensus.cc:1217] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:37.276844 18337 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:37.277604 18493 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:37.285148 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:37.286016 19863 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:37.286687 19863 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:37.287636 19863 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:37.290793 18411 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:37.308071 19630 raft_consensus.cc:993] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:37.308533 19630 raft_consensus.cc:1081] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:37.317250 18411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34458
I20260709 13:17:37.318073 18411 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:37.318415 18411 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.321171 19060 raft_consensus.cc:1217] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:37.330143 18411 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:37.331940 18411 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:37.333703 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:37.334316 18337 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.337333 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:37.339425 18493 raft_consensus.cc:3055] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:37.340585 18493 raft_consensus.cc:740] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:37.341404 18493 consensus_queue.cc:260] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:37.342968 18337 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:37.344162 18384 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:37.347110 19830 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.347565 19830 raft_consensus.cc:697] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:37.348358 19830 consensus_queue.cc:237] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:37.350044 18493 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.336421 18240 catalog_manager.cc:5697] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.357146 18493 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:37.361332 18242 catalog_manager.cc:5697] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 2 to 3, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.709129 19863 raft_consensus.cc:1064] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:37.712663 19863 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:37.719339 19059 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:37.719588 18484 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:37.721161 19900 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:37.721475 18411 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:37.722010 19863 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:37.723253 19823 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:37.741302 19863 raft_consensus.cc:2955] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:37.742983 18411 raft_consensus.cc:2955] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:37.746515 18484 raft_consensus.cc:2955] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:37.750991 18337 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:37.753867 19059 raft_consensus.cc:2955] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:37.761322 18242 catalog_manager.cc:5697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 5 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.764426 19830 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:37.768399 19831 raft_consensus.cc:1064] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:37.771342 19831 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:37.782384 18336 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:37.783362 19060 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:37.793907 19830 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:37.798790 18493 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:37.799064 19061 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:37.811930 19823 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:37.819832 19900 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:37.844941 19814 raft_consensus.cc:2955] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:37.847762 18492 raft_consensus.cc:2955] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:37.852157 19837 raft_consensus.cc:1064] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:37.855440 19837 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:37.866816 18493 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:37.872191 19823 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:37.878607 18336 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:37.881863 19831 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:37.883764 19900 raft_consensus.cc:1064] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:17:37.900682 18411 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:37.900307 19059 raft_consensus.cc:2955] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:37.905383 19061 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEARNER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:17:37.906905 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 75461.7us
I20260709 13:17:37.921533 19630 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:37.923699 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 55540.2us
I20260709 13:17:37.938292 18493 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:37.945876 18341 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:37.951952 18493 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:37.952140 18411 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:37.933838 19837 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:17:37.937348 19900 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:37.969239 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:37.970364 19830 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:37.970830 18242 catalog_manager.cc:5697] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 6 to 7, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:37.965775 19831 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:17:37.988286 19863 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:38.002055 19911 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:38.003351 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 48777.6us
W20260709 13:17:38.017566 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 60996.8us
W20260709 13:17:38.022382 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 66109.7us
W20260709 13:17:38.067461 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 81982.3us
I20260709 13:17:38.090524 18410 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:17:38.099184 19825 log.cc:927] Time spent T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: Append to log took a long time: real 0.069s	user 0.004s	sys 0.000s
I20260709 13:17:38.106963 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 839ba6300c764efc8e880c80a27079b2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:17:38.113765 19926 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:17:38.126315 18490 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:38.121779 19900 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:17:38.203161 19808 raft_consensus.cc:2955] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:38.229076 18484 raft_consensus.cc:2955] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:38.239508 19837 raft_consensus.cc:2955] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:38.261868 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet 839ba6300c764efc8e880c80a27079b2 with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:38.267027 19061 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:17:38.317261 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 51827.8us
I20260709 13:17:38.319445 19946 tablet_replica.cc:333] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:17:38.320428 19946 raft_consensus.cc:2243] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:38.321169 19946 raft_consensus.cc:2272] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:38.321686 18340 raft_consensus.cc:2955] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:38.316303 19900 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:17:38.324640 18419 raft_consensus.cc:2955] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:38.328328 18239 catalog_manager.cc:5697] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 3 to 4, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:38.376971 19059 raft_consensus.cc:2955] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:38.326862 19814 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:17:38.475281 19946 ts_tablet_manager.cc:1916] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:17:38.547776 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 58949.7us
W20260709 13:17:38.548593 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 67530.7us
W20260709 13:17:38.604976 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 222929us
W20260709 13:17:39.024441 19028 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.010s	sys 0.029s
I20260709 13:17:38.561106 19059 raft_consensus.cc:2955] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:17:39.170682 19028 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.010s	sys 0.029s
W20260709 13:17:39.312209 18459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.043s	sys 0.026s
W20260709 13:17:39.314749 18459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.043s	sys 0.026s
W20260709 13:17:39.315019 19061 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.023s	sys 0.047s
W20260709 13:17:39.317880 19061 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.024s	sys 0.047s
W20260709 13:17:39.322043 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 157811us
W20260709 13:17:39.575143 19837 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.221s	user 0.063s	sys 0.078s
W20260709 13:17:39.626955 19837 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.273s	user 0.063s	sys 0.078s
I20260709 13:17:39.639302 19965 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.650101 19965 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:39.651685 19965 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:39.679118 19957 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:39.679351 19956 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.684136 19951 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.691560 19972 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:39.690346 19974 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.689699 19956 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.696059 19977 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.696101 19973 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:39.694463 19974 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.697208 19977 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.685683 19964 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.703109 19964 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.703519 19956 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:39.681283 19957 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:39.705802 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 375417us
I20260709 13:17:39.708375 19957 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:39.710536 19978 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.716935 19978 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.720456 19978 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:39.721095 19978 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:39.695596 19951 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.692904 19972 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.722252 19978 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.724088 19977 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:39.727926 19964 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.728561 19973 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:39.729521 19970 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.002s
I20260709 13:17:39.731601 19973 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:39.731839 19951 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.734110 19978 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.737797 19962 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.738497 19837 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.738778 19962 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.740859 19956 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.748622 19928 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:39.749424 19956 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.739424 19837 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.744396 19962 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:39.759425 19974 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:39.749485 19928 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.741257 19973 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.760568 19837 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:39.763774 19928 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:39.764539 19928 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:39.764467 19973 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.765479 19928 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.766916 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:39.768599 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:39.769322 18492 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
I20260709 13:17:39.770906 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:39.774001 19977 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.774194 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 341) took 1213 ms. Trace:
I20260709 13:17:39.768319 19956 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:39.776757 19951 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:39.777650 19951 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.783429 19928 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:39.783926 19951 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.784684 19837 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.786986 19956 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:39.787736 19837 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.788190 19956 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.790552 19837 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:39.775517 19977 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.787029 19974 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.790552 19956 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:39.791766 19972 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.795544 19983 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:39.803095 19983 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.810986 19980 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.811968 19980 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.824934 19978 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:39.825939 19978 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.827328 19976 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.831153 19956 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.831902 19956 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.834573 19956 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:39.839039 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 44704.7us
I20260709 13:17:39.775048 19059 rpcz_store.cc:276] 0709 13:17:38.560069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.560479 (+   410us) service_pool.cc:224] Handling call
0709 13:17:38.560795 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.560996 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:39.201355 (+640359us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.739601 (+538246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.742768 (+  3167us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:39.752322 (+  9554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.761613 (+  9291us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.773833 (+ 12220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":347484,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":351,"thread_start_us":496713,"threads_started":2,"wal-append.queue_time_us":430919}
I20260709 13:17:39.846731 19986 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.841857 19025 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:39.854800 19956 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.860376 19837 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.828349 19976 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.863261 19956 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.863633 19837 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.860803 19962 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.865857 19984 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:39.866536 19962 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.871310 19977 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.872305 19962 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:39.872836 19977 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:39.865865 19987 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:39.873590 19977 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.874076 19977 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.875630 19982 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.858351 19974 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.874027 19987 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.847885 19986 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.876317 19982 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.866571 19984 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.883569 19978 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.885265 19976 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.887116 19962 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.887508 19984 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.888381 19962 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.883701 19987 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.894757 19957 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.894922 19918 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.895627 19957 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.896045 19918 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.892771 19974 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:39.900657 19960 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.901430 19956 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:39.891534 19988 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.905468 19982 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:17:39.907678 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 65943.1us
I20260709 13:17:39.899644 19837 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:39.905969 19960 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.902434 19957 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:39.912389 19988 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.913722 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:39.918421 19950 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:39.918784 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:39.919807 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:39.919838 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:39.919692 19950 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.922269 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:39.923705 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:39.922024 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:39.926987 19960 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:39.923858 19950 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.924233 19962 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:39.928305 19918 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.929095 19962 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:39.929843 19962 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.931041 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:39.920635 19982 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:39.932657 19982 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.935040 19962 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:39.920610 19983 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.942636 19986 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.943432 19962 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.944255 19962 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.938879 19946 ts_tablet_manager.cc:1929] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:17:39.949489 19946 log.cc:1199] T 839ba6300c764efc8e880c80a27079b2 P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/839ba6300c764efc8e880c80a27079b2
I20260709 13:17:39.154680 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:39.951326 19946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34454 (request call id 81) took 1698 ms. Trace:
I20260709 13:17:39.951821 19946 rpcz_store.cc:276] 0709 13:17:38.252953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.253081 (+   128us) service_pool.cc:224] Handling call
0709 13:17:38.319124 (+ 66043us) ts_tablet_manager.cc:1151] Deleting tablet 839ba6300c764efc8e880c80a27079b2
0709 13:17:38.319180 (+    56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:17:39.721889 (+1402709us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:39.938535 (+216646us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:39.951155 (+ 12620us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":56681,"thread_start_us":32045,"threads_started":1}
I20260709 13:17:39.958317 19960 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.954560 19977 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.959092 19960 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.969156 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:39.969398 19957 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.970139 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:39.970067 19957 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.971616 18488 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:39.973363 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:39.974753 19990 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:39.979367 19983 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:39.967528 19988 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.982300 19962 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:39.982594 19933 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:39.985510 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:39.983353 19933 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:39.986158 19983 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.988284 19933 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:39.988870 19933 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:39.989954 19933 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.983439 19990 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:39.994961 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:39.995656 19986 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:40.009987 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.010246 19986 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.011022 19058 raft_consensus.cc:2393] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 2: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:40.012202 19918 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.013063 19986 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.012853 19918 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.013653 19990 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.007202 19983 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.007287 19933 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:40.005856 18384 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.041s	sys 0.147s
I20260709 13:17:40.015652 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.013625 19986 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:40.015425 19918 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.008764 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.019227 19062 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:40.022289 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.026614 19062 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:40.033066 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.017036 19986 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.035036 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.035893 19057 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:17:40.036676 19986 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:40.016319 18384 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.045s	sys 0.147s
I20260709 13:17:40.053972 19954 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.054847 19954 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.056530 19968 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.057627 19954 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.057281 19968 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.059942 19968 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.060520 19968 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:40.061228 19968 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.062227 19986 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:40.063457 19968 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.063591 19986 raft_consensus.cc:3055] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:40.064158 19986 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:40.066344 19971 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:40.067195 19971 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.075923 19954 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.076041 19966 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.076747 19954 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.076804 19966 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.079414 19966 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.079712 19971 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.065455 19986 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.081305 19986 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.086690 19954 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.100836 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.101872 18410 raft_consensus.cc:2410] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:17:40.102361 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.103060 18415 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:40.103242 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.104249 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.104750 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.105628 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.105691 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.106660 18412 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:40.107606 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.107618 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.108053 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.108907 18417 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:17:40.109388 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:17:40.112710 18382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.025s	sys 0.064s
W20260709 13:17:40.113032 18382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.025s	sys 0.064s
I20260709 13:17:40.114817 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.115446 18336 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:40.116631 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.117444 18338 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:40.118513 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.120585 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.121137 18344 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:40.121803 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.122555 18415 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:40.125737 19911 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:40.126559 19911 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.127287 19968 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.127951 19968 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.128794 19971 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.129405 19971 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.129626 19911 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.130065 19968 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.136193 19971 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.132422 19957 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.136814 19954 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:40.137990 19830 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.138346 19954 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.138883 19830 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.140460 19954 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.141050 19830 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.144030 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.144625 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.148367 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.144826 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.131814 19986 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:40.150107 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.146104 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.151139 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.151758 18410 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
I20260709 13:17:40.149909 19986 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.145617 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.153019 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.153726 18410 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
I20260709 13:17:40.156301 19986 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.157282 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.157546 19925 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.156533 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.158162 19925 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.160403 19925 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.161028 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.166004 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.171456 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.172196 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.172775 18344 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:40.177302 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.177822 18344 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:40.180249 18242 catalog_manager.cc:5697] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 4 to 5, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:40.181396 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:40.182631 19954 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.182745 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:40.183099 19954 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.183640 19954 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.183969 18384 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:40.184149 19830 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:40.188045 19830 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.188316 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:40.188542 19830 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.191633 19968 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.192361 19968 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.192729 19968 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.193161 19968 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.196313 19982 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.164713 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet 839ba6300c764efc8e880c80a27079b2 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:40.201808 19954 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.202441 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1488) took 2096 ms. Trace:
I20260709 13:17:40.202564 18239 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42292 (request call id 317) took 1890 ms. Trace:
I20260709 13:17:40.202832 18341 rpcz_store.cc:276] 0709 13:17:38.105764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.105898 (+   134us) service_pool.cc:224] Handling call
0709 13:17:38.195113 (+ 89215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.195492 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.195533 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:38.249272 (+ 53739us) log.cc:844] Serialized 556 byte log entry
0709 13:17:38.427754 (+178482us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:38.427783 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.427842 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.202008 (+1774166us) raft_consensus.cc:1685] finished
0709 13:17:40.202046 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.202230 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":178183,"threads_started":1,"wal-append.queue_time_us":219892}
I20260709 13:17:40.204252 19954 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.203342 18240 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42278 (request call id 347) took 1774 ms. Trace:
I20260709 13:17:40.205171 18240 rpcz_store.cc:276] 0709 13:17:38.429010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.429145 (+   135us) service_pool.cc:224] Handling call
0709 13:17:40.203140 (+1773995us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1706777,"reported_tablets":1}
I20260709 13:17:40.207458 19949 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.208122 19949 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.208945 19968 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.210383 19949 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.210937 19968 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.211580 19925 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:40.211712 19949 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:40.212217 19925 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.212352 19949 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.214329 19925 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.215080 19925 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:40.214468 19949 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.216791 19949 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:40.217654 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:40.221073 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:40.221812 19954 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:40.222451 18385 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.673s	user 0.009s	sys 0.033s
I20260709 13:17:40.222689 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.215658 19925 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:40.222775 18385 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.674s	user 0.009s	sys 0.033s
I20260709 13:17:40.227989 19971 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.228180 19973 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.228360 19971 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.228921 19971 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.229820 19925 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.203891 18239 rpcz_store.cc:276] 0709 13:17:38.311990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.312145 (+   155us) service_pool.cc:224] Handling call
0709 13:17:40.202294 (+1890149us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:38.351826 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:38.410589 (+ 58763us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:38.410622 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:17:38.410636 (+    14us) tablet.cc:662] Decoding operations
0709 13:17:38.433788 (+ 23152us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:38.433840 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:38.433866 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:38.434081 (+   215us) tablet.cc:701] Row locks acquired
0709 13:17:38.434099 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:17:38.434248 (+   149us) write_op.cc:270] Start()
0709 13:17:38.434367 (+   119us) write_op.cc:276] Timestamp: P: 1783603058434208 usec, L: 0
0709 13:17:38.434388 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:17:38.434962 (+   574us) log.cc:844] Serialized 595 byte log entry
0709 13:17:38.436784 (+  1822us) op_driver.cc:464] REPLICATION: finished
0709 13:17:38.437169 (+   385us) write_op.cc:301] APPLY: starting
0709 13:17:38.441491 (+  4322us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:38.444832 (+  3341us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:38.446090 (+  1258us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:38.446288 (+   198us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:38.446482 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:38.446562 (+    80us) write_op.cc:312] APPLY: finished
0709 13:17:38.453169 (+  6607us) log.cc:844] Serialized 23 byte log entry
0709 13:17:38.453363 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:38.453442 (+    79us) write_op.cc:454] Released schema lock
0709 13:17:38.453480 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:38.453790 (+   310us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:38.453830 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":140549,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":209,"apply.run_cpu_time_us":1712,"apply.run_wall_time_us":16568,"num_ops":1,"prepare.queue_time_us":89,"prepare.run_cpu_time_us":6847,"prepare.run_wall_time_us":83386,"replication_time_us":2264}]]}
I20260709 13:17:40.217730 19949 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.236408 19968 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:40.223592 19830 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:40.240192 18383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.007s	sys 0.012s
I20260709 13:17:40.222225 19954 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.246956 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:40.247995 18337 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.248262 19980 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:40.246992 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:40.249583 18344 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.248665 19954 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.255396 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.256114 18338 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
W20260709 13:17:40.259028 18383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.007s	sys 0.013s
I20260709 13:17:40.246387 19949 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.258155 19830 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.308077 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.344676 19935 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:40.354535 19995 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:40.359280 19977 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.363469 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.390252 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.390780 19831 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:40.310521 19968 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.397992 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.383916 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.399856 18484 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:17:40.403064 18344 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:40.402005 18337 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:40.409189 18336 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.407807 18382 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:40.415452 19831 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.422894 19995 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.415246 19961 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:40.424141 19961 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.425344 19995 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.426273 19961 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:40.427512 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.428226 18343 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
I20260709 13:17:40.415699 19977 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:40.431013 19977 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.431464 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.417292 19997 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:40.433904 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.429674 19968 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.436175 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:40.436743 18341 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.436381 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.439397 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.440025 18488 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:40.440726 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.441293 18484 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:17:40.442381 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.442428 19928 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:40.444156 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.434464 19997 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:40.446626 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.447844 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:40.432873 19971 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.451182 19928 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.448436 19997 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.455024 19977 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.452001 19968 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.437228 19935 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.463662 19986 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:40.467991 19986 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.469866 19986 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.454059 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.470469 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.466131 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.450546 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.473783 19831 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.473893 18343 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:40.471493 19968 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:40.471473 18382 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:40.469429 19997 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.475466 19831 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:40.474727 19968 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.476588 19831 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:40.477660 19831 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.475028 18338 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:17:40.493260 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:40.491158 19917 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:40.499181 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.500017 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1422) took 2020 ms. Trace:
I20260709 13:17:40.500451 18340 rpcz_store.cc:276] 0709 13:17:38.479872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.481118 (+  1246us) service_pool.cc:224] Handling call
0709 13:17:40.499410 (+2018292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.499620 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:40.499643 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:40.499702 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:40.499727 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.499772 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.499868 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:40.500267 19917 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.507169 19917 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.512059 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.512842 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.512941 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.512122 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.514815 18341 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:40.515564 18337 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:40.500056 18413 raft_consensus.cc:2393] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:17:40.520599 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:40.522142 19923 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:40.522915 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.524783 19986 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:40.526741 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.525367 19986 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.529518 19986 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.530805 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.534981 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:40.529059 19997 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.531826 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.530827 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.531678 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.536897 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:40.540086 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:40.542062 18484 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.540769 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.541253 19960 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:40.543141 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:40.544040 19928 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.544569 19945 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:40.545029 19945 raft_consensus.cc:697] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:40.545740 19914 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:40.546271 19914 raft_consensus.cc:697] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:40.546073 19945 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.547245 19914 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.527578 19954 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.549305 19968 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.562059 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:40.563076 19830 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:40.563642 19830 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:40.564586 19986 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:40.565181 19986 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.565894 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.570026 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.577658 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.577831 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.581298 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.579836 19830 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.586508 18484 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:40.587527 19831 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.581370 19954 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.597867 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.617775 18413 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.598706 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.620107 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:40.623943 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:40.624225 19971 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.624858 19836 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.625371 19836 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:40.625818 19836 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.624883 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.631479 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.632369 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:40.632603 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.633695 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:40.599201 19831 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.601001 19935 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.597862 18382 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:40.603865 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.604732 19986 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.604853 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:17:40.605384 19958 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.975s	user 0.000s	sys 0.003s
W20260709 13:17:40.641752 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 44551us
I20260709 13:17:40.607631 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.607925 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.608902 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.609225 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:40.609758 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.609977 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.612957 19968 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.614580 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:40.636540 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.638924 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:40.636013 18340 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:40.645779 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:40.633976 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:40.653389 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:40.659264 18484 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.653242 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.653539 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.663434 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:40.664291 18485 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.664798 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.665982 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.667007 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:40.667390 19972 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.655447 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.654839 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.669724 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.670555 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.657308 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.671190 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.659528 18488 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.658847 18419 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:40.655913 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.668332 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.667181 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.653302 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.646695 19935 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:40.661172 19831 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.673760 19026 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:40.661612 18384 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:40.676822 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.668316 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 563) took 2335 ms. Trace:
I20260709 13:17:40.679066 18337 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:17:40.682156 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.686059 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.686570 18384 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:40.689407 19026 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:40.691072 19968 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.691171 19951 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.691555 19968 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:40.691987 19968 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.692198 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.685565 19931 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:40.691354 19982 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.705101 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.686030 18487 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
I20260709 13:17:40.707623 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.708431 18416 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:17:40.699005 19027 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:40.710603 19027 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:40.699571 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:17:40.711649 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 69265.9us
I20260709 13:17:40.713178 19026 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:40.701725 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.663934 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.704931 19968 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.721328 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:40.678949 19061 rpcz_store.cc:276] 0709 13:17:38.332377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.350805 (+ 18428us) service_pool.cc:224] Handling call
0709 13:17:38.351250 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.351550 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.351574 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:38.354079 (+  2505us) log.cc:844] Serialized 556 byte log entry
0709 13:17:39.318387 (+964308us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:39.318432 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.318512 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.604696 (+1286184us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:17:40.667876 (+ 63180us) raft_consensus.cc:1685] finished
0709 13:17:40.667909 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.668145 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5070720,"thread_start_us":963944,"threads_started":1,"wal-append.queue_time_us":1220608}
I20260709 13:17:40.722898 19630 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:40.723238 19630 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:40.723546 19630 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.728824 18419 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.728699 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:40.729018 19027 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:40.711021 18488 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:40.718859 18484 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:40.709717 19928 consensus_queue.cc:1059] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:40.730394 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.731091 18410 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:40.731825 19026 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:40.720387 19973 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.720674 19982 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:40.720854 18308 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:40.736140 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.734279 19026 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:40.734943 19027 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:40.733067 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:40.737481 18382 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:40.738754 19831 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:40.739643 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.739959 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.740685 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.741460 19831 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:40.738569 19026 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:40.743170 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.744398 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.744508 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.747272 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.753876 19917 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.754527 19917 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:40.754962 19917 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.748437 19980 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:40.755374 18485 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:40.755653 19980 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:40.756031 19980 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.757970 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.761438 18490 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:40.761616 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.762574 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.763898 19831 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.771900 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.772804 18335 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:40.735850 19929 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:40.773516 18486 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.773859 19929 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:40.774264 19929 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.779560 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.733109 19973 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:40.741662 19951 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:40.781111 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.735713 19977 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.736140 19972 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:40.785364 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 50460.9us
I20260709 13:17:40.748236 19966 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:40.788585 19966 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:40.788852 19951 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:40.789286 19951 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:40.789603 19951 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.784725 19973 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.790014 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:40.736361 19982 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:40.785055 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.786289 19027 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:40.792696 19630 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.798345 19027 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:40.800132 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 61650.7us
W20260709 13:17:40.800166 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 45237.4us
I20260709 13:17:40.798171 19982 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.812338 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.789613 19966 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.803609 18489 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:40.802093 19935 raft_consensus.cc:697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:40.823522 19977 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.847651 19836 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.849664 20005 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.850528 19935 consensus_queue.cc:237] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.851315 20005 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:40.863085 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:40.864929 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 67163.7us
I20260709 13:17:40.867362 19027 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:40.869736 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:40.877254 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 70050.4us
I20260709 13:17:40.883553 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:40.886804 19999 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:17:40.887130 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.886579 20007 consensus_queue.cc:1059] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:17:40.886866 20001 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:17:40.896593 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.897710 18457 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:40.896584 19836 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.893900 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.899814 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.900734 19960 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.901185 19960 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:40.904381 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.906580 19986 raft_consensus.cc:2955] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:17:40.899878 20000 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:17:40.920953 18412 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.926375 19968 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.928109 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:40.930528 19630 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.934134 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.901562 19960 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.938306 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:17:40.939803 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 71669.1us
I20260709 13:17:40.907558 19836 consensus_queue.cc:1059] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:17:40.940709 19027 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:40.897842 19917 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:40.907716 20009 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.944087 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.946189 18337 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.948195 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.945214 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:40.950846 19027 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:40.956604 19982 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.958746 20005 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:40.959604 19973 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.963977 18490 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:40.964751 19973 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:40.965071 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.986073 19977 raft_consensus.cc:3055] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:40.986546 19977 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:40.965610 18491 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.987463 19977 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.988687 19977 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.990429 19981 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:40.990849 19981 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:40.991859 18338 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:40.991699 19981 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:40.992900 19981 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.966334 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.993477 18242 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42284 (request call id 311) took 2545 ms. Trace:
I20260709 13:17:40.967159 19917 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:40.967837 18485 raft_consensus.cc:2955] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:40.969161 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.970422 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:40.971056 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:40.971405 18337 raft_consensus.cc:2955] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:40.975345 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:40.981539 19027 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:40.947220 20007 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.011861 19929 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.001652 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:41.013348 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:40.958791 19925 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.013893 19929 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:41.014251 18413 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:17:41.014959 18307 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.015110 19917 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.015208 20009 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.020927 20009 raft_consensus.cc:697] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:41.022632 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.008015 18410 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:41.009032 19057 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:40.993844 18242 rpcz_store.cc:276] 0709 13:17:38.448229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.448350 (+   121us) service_pool.cc:224] Handling call
0709 13:17:40.993392 (+2545042us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:40.214633 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:40.215450 (+   817us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:40.215514 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:17:40.215565 (+    51us) tablet.cc:662] Decoding operations
0709 13:17:40.216063 (+   498us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:40.216170 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:40.216201 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:40.216585 (+   384us) tablet.cc:701] Row locks acquired
0709 13:17:40.216643 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:17:40.507823 (+291180us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b2c00000448. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e4a0a 00007f409d7e4693 00007f409d7e4631 00007f409ef17902 00007f409ef176dd 00007f40a2912243 00007f40a2911d58 00007f40a29169f1 00007f40a29169a9 00007f40a2916939
0709 13:17:40.507903 (+    80us) write_op.cc:270] Start()
0709 13:17:40.508158 (+   255us) write_op.cc:276] Timestamp: P: 1783603060317953 usec, L: 0
0709 13:17:40.508207 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 13:17:40.508891 (+   684us) log.cc:844] Serialized 595 byte log entry
0709 13:17:40.870392 (+361501us) op_driver.cc:464] REPLICATION: finished
0709 13:17:40.979662 (+109270us) write_op.cc:301] APPLY: starting
0709 13:17:40.979876 (+   214us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:40.979990 (+   114us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:40.980024 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:40.980387 (+   363us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:40.980639 (+   252us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:40.980706 (+    67us) write_op.cc:312] APPLY: finished
0709 13:17:40.989107 (+  8401us) log.cc:844] Serialized 23 byte log entry
0709 13:17:40.989298 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:40.989377 (+    79us) write_op.cc:454] Released schema lock
0709 13:17:40.989428 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:40.989765 (+   337us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:40.989793 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":223737,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":108958,"apply.run_cpu_time_us":2180,"apply.run_wall_time_us":10114,"num_ops":1,"prepare.queue_time_us":30257,"prepare.run_cpu_time_us":24133,"prepare.run_wall_time_us":426528,"raft.queue_time_us":125166,"raft.run_cpu_time_us":21835,"raft.run_wall_time_us":73099,"replication_time_us":362021,"spinlock_wait_cycles":232684928,"thread_start_us":266479,"threads_started":4,"wal-append.queue_time_us":201083}]]}
I20260709 13:17:41.009829 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:17:41.050771 18440 debug-util.cc:398] Leaking SignalData structure 0x7b08000cc6e0 after lost signal to thread 17231
I20260709 13:17:41.052496 18382 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:41.054956 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 47894.2us
I20260709 13:17:41.033641 19917 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:40.995048 19980 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.059825 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:41.017518 19925 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:17:41.058595 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 161196us
I20260709 13:17:41.058727 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.062507 19830 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.063043 19934 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.063454 19056 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:41.062554 18413 raft_consensus.cc:2955] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:41.064299 18238 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54880 (request call id 240) took 2557 ms. Trace:
I20260709 13:17:41.064373 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:41.067487 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:17:41.069053 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 45432.8us
I20260709 13:17:41.068382 18457 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:41.067150 18238 rpcz_store.cc:276] 0709 13:17:38.489115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.561319 (+ 72204us) service_pool.cc:224] Handling call
0709 13:17:41.035016 (+2473697us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":233729,"reported_tablets":1}
I20260709 13:17:41.016963 19951 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.077195 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:41.059068 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:41.079907 19630 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:41.071004 18440 debug-util.cc:398] Leaking SignalData structure 0x7b08000585a0 after lost signal to thread 18276
I20260709 13:17:41.081209 19630 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:41.082012 18457 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:41.084030 19630 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.070659 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:41.086985 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:41.087453 19060 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:41.088047 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:41.090834 19061 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.092033 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.094266 19831 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:41.021776 20009 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.084838 19995 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:17:41.099270 19973 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:41.102952 19980 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:41.085161 19982 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:41.103911 18309 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:41.102350 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:41.117295 19060 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:41.110687 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:41.118880 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.120456 18412 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:17:41.122464 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 47137.6us
I20260709 13:17:41.119941 19630 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.127575 18411 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.128151 18340 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:41.128580 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:41.128224 19925 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:41.131736 18309 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:17:41.132712 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 50782.8us
I20260709 13:17:41.133055 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:41.130144 20018 consensus_queue.cc:1059] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:17:41.134418 18457 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:41.140094 19830 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:41.141172 18309 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:41.142359 19630 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:41.114815 19973 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:41.146718 20020 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.147540 19055 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:41.130620 18440 debug-util.cc:398] Leaking SignalData structure 0x7b0800362920 after lost signal to thread 18368
I20260709 13:17:41.123090 19945 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.131881 19954 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:17:41.162897 19954 raft_consensus.cc:3055] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.163237 19954 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:41.163554 19951 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:41.164105 19954 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.164711 19025 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.159113 19917 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.167979 19954 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.130509 19960 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.171797 19960 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:41.160853 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:17:41.161394 18440 debug-util.cc:398] Leaking SignalData structure 0x7b0800347780 after lost signal to thread 18443
I20260709 13:17:41.172515 19960 consensus_queue.cc:1059] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:41.173436 18440 debug-util.cc:398] Leaking SignalData structure 0x7b08002aba40 after lost signal to thread 18517
I20260709 13:17:41.173599 19960 raft_consensus.cc:3055] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.171847 18414 raft_consensus.cc:1240] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.160753 18339 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.178779 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:41.150292 19973 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.184247 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:41.184748 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.205713 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:41.178193 19960 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:41.224531 19061 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:41.213979 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:17:41.210647 18440 debug-util.cc:398] Leaking SignalData structure 0x7b080033dd40 after lost signal to thread 19086
I20260709 13:17:41.199242 19917 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.230523 19026 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:41.218359 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 137947us
W20260709 13:17:41.233625 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 88774.2us
I20260709 13:17:41.235379 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.191406 19982 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:17:41.241159 20014 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.243209 19975 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.225338 20005 raft_consensus.cc:2764] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:17:41.245468 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.204041 19972 consensus_queue.cc:1059] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:17:41.246901 20023 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.251622 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.246433 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.252895 19630 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.253818 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:41.254617 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 117328us
I20260709 13:17:41.256546 19630 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.262308 18419 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:41.265507 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:41.269038 19027 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.259934 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:41.260190 19057 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:41.273514 20022 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:41.254076 19945 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.308503 19981 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.267824 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:41.274258 18344 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:41.314911 19027 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:41.275981 20011 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:17:41.276503 19965 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.277246 19960 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:41.278977 19972 consensus_queue.cc:1243] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:41.320025 19059 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:41.319701 19981 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:17:41.338387 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 268734us
I20260709 13:17:41.327407 19055 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:41.319780 20022 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:41.347337 20022 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.318799 19917 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:17:41.351727 19917 consensus_queue.cc:1243] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:17:41.353093 19917 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.354956 19917 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:41.355986 19917 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:41.357429 19917 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.361423 19960 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.362871 19054 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.365751 18491 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.367530 19981 consensus_queue.cc:1059] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:41.367864 19995 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:41.368521 19981 raft_consensus.cc:3055] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.368893 19981 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:41.352263 19923 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:17:41.369764 19981 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.371805 19981 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.335527 19951 consensus_queue.cc:1059] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:17:41.402089 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 260959us
I20260709 13:17:41.383317 19954 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:17:41.349139 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.408804 18309 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:41.405681 20018 consensus_queue.cc:1243] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:17:41.413185 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 64133.7us
I20260709 13:17:41.419615 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.414661 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:41.414489 19928 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.410239 19945 raft_consensus.cc:3055] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.439800 18307 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:17:41.444429 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 190663us
I20260709 13:17:41.445434 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.451927 18458 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.455772 18458 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.427877 19945 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:41.462173 20010 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.448002 19986 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:41.464336 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.461706 20016 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.458705 19965 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.473405 20035 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.478066 20036 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.466758 19961 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.483806 20006 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.484596 18340 raft_consensus.cc:3055] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.484934 18340 raft_consensus.cc:740] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:41.486267 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:41.485672 18340 consensus_queue.cc:260] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:41.491586 20034 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.522989 18340 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.529563 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.534000 20016 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.534022 18336 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.532485 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.536814 18458 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.545639 18489 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.546798 18486 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:41.546828 20016 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.547499 18492 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.550614 19972 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:41.550910 18340 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.552606 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.553534 18458 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:41.553858 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 114177us
I20260709 13:17:41.525808 19945 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.555833 19914 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:41.554275 19965 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.556686 20008 consensus_queue.cc:1059] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:41.557618 19977 raft_consensus.cc:3055] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.554729 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.559218 18458 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.558061 19977 raft_consensus.cc:740] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:41.559933 19917 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:41.561470 20029 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.562101 19977 consensus_queue.cc:260] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.563331 19977 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.563874 19997 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:41.564224 18485 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:41.559669 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.565385 19995 raft_consensus.cc:3055] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.565794 19995 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:41.561074 19972 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.566733 18458 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.568015 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:41.558145 20010 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.568044 19986 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.578509 19972 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:41.574448 19995 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.568157 19961 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.565056 19965 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.581856 18307 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.580323 19995 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.559404 19973 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:41.585096 19973 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:41.585573 19986 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:41.568276 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 117583us
I20260709 13:17:41.589953 18309 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.587273 20016 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.590960 19986 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:41.591053 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:41.591820 18418 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.592736 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:41.593674 20007 raft_consensus.cc:3055] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.594077 20007 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:41.594930 20007 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.596107 20007 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.597862 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:41.598603 19986 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.599165 19995 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:41.599663 19995 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.603389 19968 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:41.604970 18414 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.607308 19968 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:41.615731 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:41.621796 19968 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:41.621973 19026 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:41.624348 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.560974 20022 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:41.627740 20019 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:17:41.628273 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:41.635341 19980 consensus_queue.cc:1059] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:41.618973 20020 consensus_queue.cc:1059] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:17:41.635946 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:41.636219 19980 consensus_queue.cc:1243] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:41.644098 20043 consensus_queue.cc:1059] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:17:41.645617 19917 raft_consensus.cc:3055] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.629767 19975 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.646035 19917 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:41.629158 20022 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:41.646896 19917 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.649595 20020 raft_consensus.cc:3055] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.650027 20020 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:41.650910 20020 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.651471 18485 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.651791 18410 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.618359 19995 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:41.652980 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:41.652083 20020 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:41.656628 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 52400.3us
I20260709 13:17:41.659610 18307 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.665663 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.666353 18458 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:41.668756 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:41.668558 19964 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.663796 19054 raft_consensus.cc:2955] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:41.672701 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:41.673002 18336 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:41.661033 19972 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:17:41.682593 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:41.691363 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:41.697506 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:41.663956 20041 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:17:41.667459 19954 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:17:41.681023 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.693018 19965 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.696713 19917 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.710453 20010 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:41.667613 19975 consensus_queue.cc:1059] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:17:41.700503 20045 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.713707 19053 raft_consensus.cc:3055] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.677747 20002 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:41.715662 18307 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.703398 19961 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.683009 19997 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:17:41.722035 18307 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.725016 18307 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.726506 18307 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:41.705746 20032 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:41.698318 18336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:17:41.742002 18336 raft_consensus.cc:606] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:41.718374 19053 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:41.719247 20021 consensus_queue.cc:1059] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:17:41.682928 20005 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:17:41.719105 20019 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:17:41.724633 20018 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.749858 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:41.752389 20046 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:41.752908 20046 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.756789 20019 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.757202 20019 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:41.758074 20019 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.759214 19981 raft_consensus.cc:3055] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.759285 20019 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.759724 19981 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:41.735169 20006 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:41.760756 20045 consensus_queue.cc:1175] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:17:41.738283 20036 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:41.768188 19630 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.775846 19630 raft_consensus.cc:697] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:41.774987 18458 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:41.778110 20034 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.757218 19945 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.741122 20002 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:41.783612 18492 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:41.748656 19968 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:17:41.776511 20021 consensus_queue.cc:1243] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:17:41.793968 18492 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:41.794070 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:41.801203 19630 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.802594 20030 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.822297 20002 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:41.824688 19055 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:41.815302 19981 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.830302 19925 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.835891 19053 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:41.843195 18491 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:41.846323 18458 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:41.866175 20046 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:41.670850 20031 consensus_queue.cc:1175] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:41.884822 19053 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.860325 20010 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:41.892112 19059 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:41.893553 20010 raft_consensus.cc:697] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:17:41.920336 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 208340us
I20260709 13:17:41.922802 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:41.911886 19960 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:41.930924 19960 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:41.934521 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:41.934657 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:41.910198 19965 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:17:41.910030 20010 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:42.006047 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 302253us
I20260709 13:17:42.025264 19053 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:42.028995 18384 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:42.028167 20012 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:17:42.032270 18384 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:42.033195 20050 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.039589 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:42.026283 19923 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:17:42.035792 20050 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.047516 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:42.056694 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:42.062178 19928 consensus_queue.cc:1059] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:42.063721 20031 raft_consensus.cc:3055] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:42.064139 20031 raft_consensus.cc:740] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:42.065001 20031 consensus_queue.cc:260] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:42.066082 20029 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:42.035640 19960 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.073009 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:42.052847 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:42.077167 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:42.084331 18344 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:42.092223 19981 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.105695 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:42.117357 18338 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:42.119421 19928 consensus_queue.cc:1059] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:42.120585 19917 raft_consensus.cc:3055] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:42.120961 19917 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:42.122006 19917 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:42.123575 20031 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.127068 19960 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.144567 18238 catalog_manager.cc:5697] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 2 to 3, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:42.146360 19917 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.147217 18418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:42.147825 18418 raft_consensus.cc:606] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:42.146459 18238 catalog_manager.cc:5697] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:17:42.151172 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 48975.8us
I20260709 13:17:42.151973 18307 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:42.152717 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:42.154691 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:42.152709 19928 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:42.155961 19928 raft_consensus.cc:697] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:42.156812 19928 consensus_queue.cc:237] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:42.110747 18336 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:42.173384 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:42.174373 20016 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:42.151136 18238 catalog_manager.cc:5697] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 2 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.190649 20016 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:42.231128 18384 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:42.233767 19971 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:42.235146 19971 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:42.233280 18384 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:42.239310 19923 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:42.241484 20050 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.207149 20016 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.302735 20021 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:17:42.320998 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 88048.8us
I20260709 13:17:42.333662 18337 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:17:42.325989 20021 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.334544 20053 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.345431 20053 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:42.367897 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:42.368646 18418 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:42.369993 20021 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:42.371781 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:42.373135 20021 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:42.373718 20021 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:42.374161 20021 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.430778 19054 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:42.419467 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:42.435681 18410 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.444324 18410 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:42.435326 19053 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 2: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:42.447305 19961 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:42.456480 20021 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.463423 20043 raft_consensus.cc:993] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:42.464126 20043 raft_consensus.cc:1081] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:42.466485 18418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34462
I20260709 13:17:42.468787 18418 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:42.469296 18418 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.467554 20053 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:42.481282 20064 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.185s	user 0.002s	sys 0.002s
I20260709 13:17:42.478929 19055 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:42.483049 20034 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:42.484185 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:42.489220 18458 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:42.466557 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:42.492369 18337 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:42.513070 20052 raft_consensus.cc:993] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:42.513581 20052 raft_consensus.cc:1081] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:42.515288 18485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:17:42.515836 18485 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:42.516191 18485 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.520614 20010 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:42.521126 20010 raft_consensus.cc:697] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:42.522003 20010 consensus_queue.cc:237] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:42.523823 18418 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.525206 19965 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:42.526867 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:42.527482 18338 raft_consensus.cc:3055] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:42.527951 18338 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:42.528116 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:42.528834 18338 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.529860 19056 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 2: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:42.532394 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:42.534051 19965 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:42.534813 18485 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:42.530017 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:42.535673 18338 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.530210 20021 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:42.538913 18485 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:42.539047 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:42.539624 18412 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:42.539937 18412 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:42.540261 18414 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:42.540673 18412 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:42.541710 20053 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.546406 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:42.547117 18339 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.561827 18412 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.585562 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:42.586266 18491 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.595453 18418 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:42.608011 18491 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:42.587121 19917 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:42.590574 20021 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:42.599488 18486 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:42.621116 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:42.621768 19055 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.627671 18412 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:42.629123 18457 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:42.624079 18338 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:42.632488 19965 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:42.632742 18339 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:42.633016 19965 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:42.633950 19965 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:42.619076 20021 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.639678 20021 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:42.641492 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:42.642349 19058 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 2: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:42.644341 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:42.644982 18418 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:42.646112 18308 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:42.654038 19917 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:42.657902 19917 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:42.658381 19917 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.665645 18384 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:42.656107 20021 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:17:42.674582 18413 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:42.682632 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:42.683367 19997 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:42.684549 20043 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:42.685130 20043 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:42.686250 20043 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.685163 19997 raft_consensus.cc:697] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:17:42.698341 20085 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:17:42.699802 19055 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:42.687909 19997 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.711467 19917 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.715524 19917 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:42.717365 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:42.730029 18412 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:42.732409 18308 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:42.760473 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:42.770212 19054 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 2: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:42.748127 20050 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.749665 20043 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:42.790638 18337 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:42.801667 20002 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.789990 19981 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.796545 20012 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:42.826881 20093 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:17:42.790477 20050 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.834229 20050 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:42.812295 19981 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.838941 19981 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:42.805809 20002 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.841125 20002 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:42.842242 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:42.843357 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:42.843920 18412 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:42.816267 20012 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.845185 19026 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:42.846033 19980 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:42.846410 19980 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.846724 19980 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.846886 20012 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:42.801983 20034 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:17:42.851269 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:42.851972 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:42.856573 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:42.857245 18412 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:17:42.859465 19026 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:42.851892 18242 catalog_manager.cc:5697] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 2 to 3, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:42.871122 18242 catalog_manager.cc:5697] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 3 to 4, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 4 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:42.870863 19929 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.876389 20053 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:42.879568 19929 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.884589 18486 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.894876 19917 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.862083 20043 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:42.901618 19929 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.906006 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:42.910202 20053 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.921130 20053 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:42.926191 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:42.927019 18412 raft_consensus.cc:2393] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:17:42.892572 19980 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.904647 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:42.942106 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:42.942876 18342 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:42.917616 19917 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.945711 19980 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:42.945974 19917 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:42.946894 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:42.934347 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:42.937079 19053 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:42.949151 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:42.949491 18309 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:42.949887 18412 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.955513 19917 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.952137 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:42.940938 19971 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:42.964389 19935 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.974721 19935 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.975101 19935 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.977277 18412 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:17:42.980731 19026 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:42.970485 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:42.981948 19971 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.983318 19929 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.984135 19058 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.984498 19056 raft_consensus.cc:2393] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:42.984826 19971 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:42.981904 19980 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:42.986668 19980 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:42.987030 19929 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:42.987583 19980 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.989830 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:42.990533 19917 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.990556 20053 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:42.992009 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:42.992758 18412 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.991326 20053 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:42.995455 20053 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:42.997991 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:42.998557 19059 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:43.000118 18309 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:42.979347 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:42.995795 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:43.007269 19055 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:43.007440 19054 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:43.009944 18309 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:43.013392 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:43.014396 18491 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 3: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:43.014038 18384 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:43.019461 20002 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:43.019888 20002 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:43.020246 20002 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:43.022146 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:43.023005 18413 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:17:43.017028 20053 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:43.027906 20053 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.028252 20053 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:43.029832 18384 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:43.032783 19935 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.034487 19929 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.013286 19917 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:43.035156 19917 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:43.034986 19929 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.035594 19917 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:43.037289 19929 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:43.039036 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:43.033182 18240 catalog_manager.cc:5697] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 2 to 3, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:43.041086 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:43.041671 19056 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:43.041853 20002 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.044900 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:43.045341 19058 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:43.051620 19056 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:43.001152 20043 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.049667 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:43.055306 18344 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:43.039686 18414 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:43.057837 19026 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:43.058823 19945 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:43.059391 19945 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.061275 19945 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:43.063936 19929 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:43.064558 19929 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.064910 19929 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:43.067373 19961 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:43.070067 18335 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:43.078423 18239 catalog_manager.cc:5697] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 2 to 3, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.081670 18413 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:43.081861 18239 catalog_manager.cc:5697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.084461 19973 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:43.083617 18239 catalog_manager.cc:5697] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:43.087114 18228 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 21b9264b0a434b79b6292c2ed23bbae0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d03b672b2ff044b8bc2a0dfd8180ee19 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:43.088172 19914 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.080195 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:43.038232 19935 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:43.098480 19971 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:43.098991 19971 raft_consensus.cc:697] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:43.099664 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:43.099879 19971 consensus_queue.cc:237] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.100412 18491 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 3: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:43.093675 18344 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:43.106098 18412 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:17:43.107409 19026 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:43.107609 19968 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:43.102958 19914 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.119995 19914 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:43.107843 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:43.122152 19053 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 2: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:43.123845 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:43.126107 19917 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.129189 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:43.130553 20002 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:43.143016 20099 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:43.148614 20099 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:43.146802 19056 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:43.149976 20099 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.157038 19981 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.157577 19981 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.159741 19981 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:43.162302 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:43.163098 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:43.163935 18412 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:17:43.166419 18238 catalog_manager.cc:5697] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 3, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.091706 20053 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.186709 18238 catalog_manager.cc:5697] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 3, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.150372 19917 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:43.190601 18238 catalog_manager.cc:5697] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 3 to 4, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 4 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:43.195319 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 91906.3us
I20260709 13:17:43.196182 18238 catalog_manager.cc:5697] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 2 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.217268 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:43.222853 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:43.239857 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:43.240754 18337 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:43.244940 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:43.187453 20010 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:17:43.276662 19054 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:43.251351 18338 raft_consensus.cc:2368] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3.
I20260709 13:17:43.301512 19061 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:43.316985 18412 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:17:43.379737 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 59243.2us
I20260709 13:17:43.288915 18413 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:43.385505 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 141852us
W20260709 13:17:43.424053 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 198721us
I20260709 13:17:43.377997 19925 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:17:43.541193 18337 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:17:43.554593 20106 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:17:43.567158 20103 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:17:43.573442 20053 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:43.574618 20112 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:17:43.580030 19929 consensus_meta.cc:287] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.004s
I20260709 13:17:43.580634 19929 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.629774 18337 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.600898 19056 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:43.615645 19053 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:43.681981 20117 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.682917 20110 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:43.682727 20117 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:43.683576 20110 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:43.685482 20117 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:17:43.688239 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 179044us
I20260709 13:17:43.691416 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:43.691964 18412 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:43.760401 18412 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:43.766527 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:43.711827 19929 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:43.768205 20110 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:43.793197 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:43.793862 18489 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:17:43.843295 18308 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:43.844821 18412 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.853619 18309 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:43.857579 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:43.859176 18410 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:17:43.844914 20021 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:43.867887 20133 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:43.879453 18412 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:43.860311 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:43.858477 20130 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:43.886291 18419 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:43.889138 20124 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:43.905247 20130 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.890712 20122 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:43.906791 20122 raft_consensus.cc:697] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:43.908071 20130 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:43.895538 18384 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:43.909883 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:43.896265 20104 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:43.887157 20133 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.863612 18413 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:43.907750 20122 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.891549 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:43.912884 19054 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:43.938894 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:43.939416 20133 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:43.939798 18485 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 2: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:43.913029 19935 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:43.913353 20124 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:17:43.929844 18412 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.930676 20132 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.926800 19968 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:43.958335 20132 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:43.954587 19025 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:43.962029 19935 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:43.951308 19968 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.962898 19968 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:43.963034 19935 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:43.959239 20117 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.967629 18457 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:43.974416 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:43.983543 20131 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:43.985563 18384 leader_election.cc:400] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3.
I20260709 13:17:43.985900 18384 leader_election.cc:403] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:43.986418 20131 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3.
I20260709 13:17:43.990233 19027 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:43.991777 20012 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:43.994980 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 255) took 1155 ms. Trace:
I20260709 13:17:43.995424 18339 rpcz_store.cc:276] 0709 13:17:42.840016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.850908 (+ 10892us) service_pool.cc:224] Handling call
0709 13:17:43.994755 (+1143847us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b540007eed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:17:43.994895 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951489280}
I20260709 13:17:43.975034 18490 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
W20260709 13:17:44.003470 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 149979us
I20260709 13:17:43.969230 20119 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:43.971521 20010 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:43.973279 20096 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.008870 18490 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.024111 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:44.007932 20119 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.011619 20010 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.008927 18335 raft_consensus.cc:3055] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:44.043489 18491 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:44.030539 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:44.047140 18335 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:44.012343 19973 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:17:44.018800 20021 raft_consensus.cc:697] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:44.045931 20119 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:44.086951 18344 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:44.048128 20010 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:44.023350 20129 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
W20260709 13:17:44.085624 20142 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:17:44.021955 20096 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:44.137310 20134 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:17:44.142843 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 137213us
I20260709 13:17:44.199309 18335 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.203622 20134 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.204129 18335 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:44.208189 20050 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:44.208722 20050 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.209329 20118 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.209841 20118 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.210678 20050 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:44.155256 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 138561us
W20260709 13:17:44.189232 20140 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:44.191597 20096 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:44.192054 18337 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:44.197409 18490 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:44.198583 19054 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
W20260709 13:17:44.199290 20139 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:17:44.199136 20021 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.202841 18415 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:44.218339 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:44.223806 18419 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:44.225207 18308 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:44.226243 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:44.226908 20118 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:44.227654 19058 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:44.229498 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:44.234114 19961 raft_consensus.cc:2955] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:44.205747 20134 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:44.239989 18238 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42292 (request call id 319) took 1287 ms. Trace:
I20260709 13:17:44.229988 19968 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.242964 18335 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:17:44.243631 18335 pending_rounds.cc:85] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 4
I20260709 13:17:44.243935 18335 pending_rounds.cc:107] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:17:44.244395 18335 raft_consensus.cc:2889] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:44.244916 19968 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:44.242262 18238 rpcz_store.cc:276] 0709 13:17:42.952636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.954613 (+  1977us) service_pool.cc:224] Handling call
0709 13:17:44.239933 (+1285320us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:43.277726 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:43.278344 (+   618us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:43.278380 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:17:43.278403 (+    23us) tablet.cc:662] Decoding operations
0709 13:17:43.279082 (+   679us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:43.279142 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:43.279186 (+    44us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:17:43.279593 (+   407us) tablet.cc:701] Row locks acquired
0709 13:17:43.279613 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:17:43.279751 (+   138us) write_op.cc:270] Start()
0709 13:17:43.279870 (+   119us) write_op.cc:276] Timestamp: P: 1783603063279706 usec, L: 0
0709 13:17:43.279893 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:17:43.405224 (+125331us) log.cc:844] Serialized 1684 byte log entry
0709 13:17:43.548777 (+143553us) op_driver.cc:464] REPLICATION: finished
0709 13:17:43.549234 (+   457us) write_op.cc:301] APPLY: starting
0709 13:17:43.549322 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:43.549473 (+   151us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:43.549562 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:43.550266 (+   704us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:43.550454 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:17:43.550508 (+    54us) write_op.cc:312] APPLY: finished
0709 13:17:43.550735 (+   227us) log.cc:844] Serialized 41 byte log entry
0709 13:17:43.550914 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:43.551011 (+    97us) write_op.cc:454] Released schema lock
0709 13:17:43.551054 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:43.551390 (+   336us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:43.551420 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14589,"reported_tablets":9,"spinlock_wait_cycles":2944,"child_traces":[["op",{"apply.queue_time_us":239,"apply.run_cpu_time_us":2049,"apply.run_wall_time_us":2114,"num_ops":4,"prepare.queue_time_us":205,"prepare.run_cpu_time_us":3804,"prepare.run_wall_time_us":232675,"replication_time_us":268733}]]}
W20260709 13:17:44.258148 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 50112us
I20260709 13:17:44.211241 20117 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.260735 20122 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:44.261103 20117 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.261359 20122 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.263485 20053 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:44.264077 20053 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:44.276194 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 51063.6us
W20260709 13:17:44.276722 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.277421 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:44.258162 20119 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.282887 18457 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:44.284292 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:44.284538 19056 raft_consensus.cc:2368] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5.
I20260709 13:17:44.284972 19058 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:44.285009 20134 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:44.286725 20119 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:44.276074 20135 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:17:44.291383 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:44.291944 18492 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:44.273980 20141 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:44.263839 20117 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:44.275796 19059 raft_consensus.cc:2955] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:44.293980 20141 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.296569 20130 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:44.298094 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:44.298313 20135 raft_consensus.cc:3055] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:44.302477 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:44.265434 20122 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:44.303719 20053 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:44.303615 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 81415us
W20260709 13:17:44.305459 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 64676.5us
I20260709 13:17:44.307122 20010 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:44.308503 18458 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:44.292302 19980 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:17:44.318989 18492 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:17:44.324761 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:44.325114 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:17:44.346076 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 86990.7us
W20260709 13:17:44.358476 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 50072.9us
I20260709 13:17:44.347011 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:44.361394 19025 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:44.362644 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:44.362078 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:44.365732 19059 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.365893 19060 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:44.319550 20130 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.320034 20135 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:44.377292 18490 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:44.374162 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:17:44.379323 20149 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:17:44.358866 20012 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:17:44.382889 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 105284us
I20260709 13:17:44.385550 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:44.386190 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:44.370121 20120 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:44.371011 19925 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:44.392652 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:44.392998 18340 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:17:44.371578 19981 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:44.372797 20130 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:44.389637 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:44.395085 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:44.358551 19968 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:17:44.396188 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:44.396394 19968 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.396962 19968 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:44.386678 20012 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.399519 20012 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:44.400182 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:44.386907 20005 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:44.391963 19059 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:44.396291 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:44.420395 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:44.369653 20121 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:17:44.422062 18308 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:44.422283 20135 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.422086 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:44.432875 20021 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:44.380880 20141 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:44.393102 20120 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.439242 20120 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.477290 18309 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:17:44.481732 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 51490us
I20260709 13:17:44.482285 20122 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:44.483554 19968 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:44.488065 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:44.488323 20118 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:44.488837 20118 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.490882 20118 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:44.494791 18340 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:17:44.496726 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:44.423908 19981 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:44.495433 19925 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.507529 19925 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:44.401010 20005 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:44.510076 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 178500us
I20260709 13:17:44.492715 19961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55634 (request call id 86) took 1561 ms. Trace:
I20260709 13:17:44.479856 20154 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:44.507947 19981 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.526063 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:44.530208 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:44.536064 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:44.551388 19058 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:44.542165 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:44.518532 20154 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:44.561216 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:44.540489 20010 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:44.568794 18412 raft_consensus.cc:2955] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:44.581712 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:17:44.583210 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 88485.5us
I20260709 13:17:44.590692 18384 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:44.631956 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:44.632661 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:44.637567 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:44.637850 20104 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:44.638746 20104 raft_consensus.cc:697] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:44.553742 20120 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.646880 18457 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:44.564438 20096 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:17:44.660713 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 64226.9us
W20260709 13:17:44.657745 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 61847.6us
I20260709 13:17:44.595309 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:44.659135 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:44.617777 20005 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:44.645027 18417 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:44.635528 20121 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:44.670384 18384 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:44.660429 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:17:44.672412 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 77186.4us
I20260709 13:17:44.675606 20119 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:44.686452 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:44.639640 20104 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.681645 20119 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.693308 19630 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:44.674403 20005 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:44.674245 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:44.677153 20096 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:44.637986 20159 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:17:44.679958 20132 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:44.691820 18228 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 21b9264b0a434b79b6292c2ed23bbae0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d03b672b2ff044b8bc2a0dfd8180ee19 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:44.714452 20154 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:44.704748 20119 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:44.685596 19981 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:44.711153 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:44.716982 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:44.513531 19961 rpcz_store.cc:276] 0709 13:17:42.858240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.858361 (+   121us) service_pool.cc:224] Handling call
0709 13:17:42.939495 (+ 81134us) log.cc:844] Serialized 494 byte log entry
0709 13:17:43.066667 (+127172us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b2c001042f8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e4a0a 00007f409d7e4693 00007f409d7e4631 00007f409ef18b52 00007f409ef18cf5 00007f409ee55691 00007f409ee35eaa 00007f409ee3cd53 00007f409ee3ccd9 00007f409ee3cc69
0709 13:17:43.067693 (+  1026us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b180002dd80. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ef18d01 00007f409ee55691 00007f409ee35eaa 00007f409ee3cd53 00007f409ee3ccd9 00007f409ee3cc69 00007f409ee3cc31 00007f409ee3bdfd 000000000038f354 000000000038f199
0709 13:17:43.143832 (+ 76139us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:17:44.419426 (+1275594us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3562,"raft.run_cpu_time_us":4012,"raft.run_wall_time_us":44185,"spinlock_wait_cycles":99573760,"thread_start_us":62635,"threads_started":1,"wal-append.queue_time_us":147619,"wal-append.run_cpu_time_us":4156,"wal-append.run_wall_time_us":1042516}
W20260709 13:17:44.737608 20164 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:17:44.732133 18417 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
W20260709 13:17:44.752523 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 85276.7us
I20260709 13:17:44.753286 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:44.744900 20132 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:44.758005 20130 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:44.785933 20155 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:44.808048 18336 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:17:44.786767 20162 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.110s	user 0.000s	sys 0.002s
I20260709 13:17:44.786682 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 249) took 1020 ms. Trace:
I20260709 13:17:44.749482 20151 raft_consensus.cc:2764] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:17:44.796186 19925 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.791378 20119 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:44.822013 20119 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:44.801222 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 118178us
I20260709 13:17:44.808745 20134 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:44.752326 19981 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.837811 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 263) took 1135 ms. Trace:
I20260709 13:17:44.838274 18335 rpcz_store.cc:276] 0709 13:17:43.709219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.712079 (+  2860us) service_pool.cc:224] Handling call
0709 13:17:44.001869 (+289790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:44.244894 (+243025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.837583 (+592689us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540007eed0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:17:44.837733 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532345600}
I20260709 13:17:44.851078 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:44.805994 20132 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:44.857249 20114 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:44.875450 20130 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:44.879336 19925 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:44.879592 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:44.879149 19981 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:17:44.805083 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 51904.1us
I20260709 13:17:44.810497 18486 rpcz_store.cc:276] 0709 13:17:43.767477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.769771 (+  2294us) service_pool.cc:224] Handling call
0709 13:17:44.741878 (+972107us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b5800143198. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:17:44.748253 (+  6375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:44.753235 (+  4982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.757941 (+  4706us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:44.786379 (+ 28438us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:44.786417 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.786489 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.786607 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6112640}
I20260709 13:17:44.807768 20155 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:44.879081 18309 leader_election.cc:400] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5.
I20260709 13:17:44.884238 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:44.882404 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:44.885257 18414 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:44.886209 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:44.888687 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:44.877816 18415 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:44.890610 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:44.894438 20114 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:44.949249 18384 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:44.950994 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:44.958012 18337 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
W20260709 13:17:44.959658 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 71042.4us
I20260709 13:17:44.965374 20115 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:44.981956 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:44.963213 20112 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:44.983372 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:44.984431 18492 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:44.985533 20137 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:17:44.986479 18335 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:44.985558 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:44.988866 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:44.989153 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:44.989614 18491 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:44.968611 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:44.968879 20132 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:44.979848 20155 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:45.061362 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b5d50aacd9894a6ca1895dbf30df38dc with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:17:45.067071 20152 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:45.069996 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:17:45.075397 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 78925.1us
I20260709 13:17:45.080217 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:45.081871 18491 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
W20260709 13:17:45.086810 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 96135.3us
W20260709 13:17:45.092213 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 101132us
W20260709 13:17:45.093006 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.093192 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 421) took 1141 ms. Trace:
I20260709 13:17:45.093344 18457 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:45.094156 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:45.086346 19997 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.082340 20119 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:45.093762 19061 rpcz_store.cc:276] 0709 13:17:43.951543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.952922 (+  1379us) service_pool.cc:224] Handling call
0709 13:17:43.953267 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.953702 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.953741 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:43.955960 (+  2219us) log.cc:844] Serialized 26 byte log entry
0709 13:17:44.851756 (+895796us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b18002bc660. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:17:44.950835 (+ 99079us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:44.950875 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.950933 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.090278 (+139345us) raft_consensus.cc:1685] finished
0709 13:17:45.090300 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.093111 (+  2811us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8080,"raft.queue_time_us":1497,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":26315520,"thread_start_us":98893,"threads_started":1,"wal-append.queue_time_us":1039719}
I20260709 13:17:45.101562 18307 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:45.105875 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:45.109288 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:45.086644 18226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 103349us
I20260709 13:17:45.118616 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:45.103044 20021 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:45.148825 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:45.182457 18238 catalog_manager.cc:5697] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 3, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:17:45.186122 18308 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:45.187379 18419 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:45.192143 19057 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:17:45.194525 19054 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:45.103307 19058 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:45.177270 18240 catalog_manager.cc:5697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 3, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 3 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.100024 20141 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:45.195578 20122 raft_consensus.cc:3055] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:45.257006 20122 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:45.109557 20112 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:45.239106 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:45.116108 20137 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:45.258505 20137 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:17:45.245875 20175 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:17:45.238852 20147 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:45.242121 20053 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:17:45.265146 20183 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.301275 20183 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:45.263478 20112 raft_consensus.cc:697] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:17:45.315847 20176 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:17:45.315476 20053 consensus_queue.cc:1243] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:17:45.304845 20177 log.cc:927] Time spent T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
W20260709 13:17:45.319099 20180 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:17:45.319881 20130 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:17:45.317253 20110 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:45.324111 20137 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:45.350426 20112 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:45.416529 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1568) took 1043 ms. Trace:
W20260709 13:17:45.416735 20192 log.cc:927] Time spent T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:17:45.417021 18339 rpcz_store.cc:276] 0709 13:17:44.373262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.376327 (+  3065us) service_pool.cc:224] Handling call
0709 13:17:45.402244 (+1025917us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b5800002a98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:17:45.412957 (+ 10713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.416186 (+  3229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.416215 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.416259 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:45.416295 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.416355 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.416472 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11955072}
I20260709 13:17:45.348801 20110 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:45.413273 20180 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:45.424115 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1567) took 1051 ms. Trace:
I20260709 13:17:45.428400 20110 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:45.431901 20135 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.443198 20169 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:45.453593 20169 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:45.457365 20114 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:45.427950 18338 rpcz_store.cc:276] 0709 13:17:44.372920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.377425 (+  4505us) service_pool.cc:224] Handling call
0709 13:17:45.340892 (+963467us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b5800002a98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7eee 0000000000375939 00007f40a3e2b1e0 00007f40a3ef40c4 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:17:45.343671 (+  2779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.394570 (+ 50899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.398255 (+  3685us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.401766 (+  3511us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:45.405038 (+  3272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.413717 (+  8679us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.423074 (+  9357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10612992}
I20260709 13:17:45.462945 20169 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:45.470960 18384 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:45.459291 20119 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:45.473959 20110 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:45.475911 20188 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.477073 20119 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:45.479240 20119 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:45.458865 20114 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:45.483803 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:45.488703 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:45.501016 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:45.501850 19053 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 3: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:45.493723 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:45.503008 19053 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:45.492202 20053 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:45.504266 20053 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:45.510418 19968 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:45.514473 19060 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:45.526145 20141 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:45.527405 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:45.528116 18335 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:45.528398 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:45.529050 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:45.531121 19026 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:45.531494 20191 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.131s	user 0.002s	sys 0.000s
I20260709 13:17:45.532760 19981 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.537441 18336 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:45.539541 20122 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:45.540928 20122 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.518453 20123 raft_consensus.cc:2955] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:45.546592 20120 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:45.546782 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:45.549190 18492 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:45.549751 20050 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:45.549853 20110 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:45.567006 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:45.562264 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:45.591727 19995 consensus_queue.cc:1059] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:45.555306 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:45.595006 19025 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:45.551170 20053 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:45.541386 20114 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:45.606945 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:17:45.631623 20198 log.cc:927] Time spent T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:17:45.634305 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:45.635704 19025 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:45.560645 19056 raft_consensus.cc:2955] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:45.599103 19929 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:45.598105 19980 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.647118 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:45.648694 18491 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:45.633723 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:45.653151 19025 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:45.664315 18457 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:45.666172 20150 raft_consensus.cc:3055] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:45.666586 20150 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:45.667356 20150 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:45.668469 20150 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.670253 18309 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:45.690270 20204 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:17:45.681289 19925 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.660669 20125 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:45.700762 20183 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:45.701929 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:45.702255 18335 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
W20260709 13:17:45.731741 20200 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:17:45.680835 20016 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:45.741633 20199 log.cc:927] Time spent T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:45.765733 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:45.770383 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:45.776299 20110 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:45.776803 20110 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:45.777194 20119 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:45.777218 20110 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.781769 18458 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:45.801827 20128 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.777787 20119 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:45.804591 18489 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:17:45.826864 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 122987us
W20260709 13:17:45.835809 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 84085us
I20260709 13:17:45.839984 20110 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:45.842490 20110 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:45.844808 20114 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:45.805539 20119 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:45.847153 18343 raft_consensus.cc:2955] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:45.837543 19027 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:45.866447 18344 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:45.851384 20187 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:17:45.868288 20187 consensus_queue.cc:1243] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:45.869843 19965 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.875598 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:45.876446 19057 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 3: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:45.857038 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:45.858609 18337 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:17:45.884554 18337 pending_rounds.cc:85] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 5
I20260709 13:17:45.884912 18337 pending_rounds.cc:107] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:17:45.885234 18337 raft_consensus.cc:2889] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:45.858752 20141 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:45.893045 20050 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:17:45.934067 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 279049us
I20260709 13:17:45.956310 18412 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:45.962319 20119 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:45.964262 19965 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:45.983579 20125 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.984962 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:45.986876 20123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34454 (request call id 82) took 2077 ms. Trace:
I20260709 13:17:45.987337 20123 rpcz_store.cc:276] 0709 13:17:43.909320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.910684 (+  1364us) service_pool.cc:224] Handling call
0709 13:17:43.958081 (+ 47397us) log.cc:844] Serialized 494 byte log entry
0709 13:17:44.262402 (+304321us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b5400438da0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee55142 00007f409ee35eaa 00007f409ee3cd53 00007f409ee3ccd9 00007f409ee3cc69 00007f409ee3cc31 00007f409ee3bdfd 000000000038f354 000000000038f199 00007f409bdef475
0709 13:17:44.858671 (+596269us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b18003c6ca0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdbd2a6 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee5cb26 00007f409ee5649a 00007f409ee55714
0709 13:17:44.859371 (+   700us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b5400438da0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee5cb26 00007f409ee5649a 00007f409ee55714 00007f409ee35eaa 00007f409ee3cd53 00007f409ee3ccd9 00007f409ee3cc69 00007f409ee3cc31 00007f409ee3bdfd 000000000038f354
0709 13:17:45.986780 (+1127409us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43325,"raft.queue_time_us":3561,"raft.run_cpu_time_us":12793,"raft.run_wall_time_us":1019045,"spinlock_wait_cycles":123791744,"thread_start_us":44216,"threads_started":1,"wal-append.queue_time_us":131555,"wal-append.run_cpu_time_us":1530,"wal-append.run_wall_time_us":1079669}
I20260709 13:17:45.988720 19057 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:17:45.989189 19057 pending_rounds.cc:85] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 5
I20260709 13:17:45.989483 19057 pending_rounds.cc:107] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:17:45.989861 19057 raft_consensus.cc:2889] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:45.993037 20141 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:45.993682 18227 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1c3d9691e854ee98b2b7d81f868c727 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:46.032490 18336 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:46.035660 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:46.039563 20150 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.048161 20150 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:46.049337 20150 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:46.097326 18238 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42292 (request call id 320) took 1796 ms. Trace:
I20260709 13:17:46.098932 18238 rpcz_store.cc:276] 0709 13:17:44.300777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.313736 (+ 12959us) service_pool.cc:224] Handling call
0709 13:17:46.097270 (+1783534us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:45.272226 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:45.393868 (+121642us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:45.393936 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:17:45.393956 (+    20us) tablet.cc:662] Decoding operations
0709 13:17:45.417480 (+ 23524us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:45.417530 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:45.417561 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:45.417742 (+   181us) tablet.cc:701] Row locks acquired
0709 13:17:45.417758 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:17:45.417889 (+   131us) write_op.cc:270] Start()
0709 13:17:45.418019 (+   130us) write_op.cc:276] Timestamp: P: 1783603065417852 usec, L: 0
0709 13:17:45.418044 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:17:45.418673 (+   629us) log.cc:844] Serialized 538 byte log entry
0709 13:17:45.505598 (+ 86925us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409bdd20ac 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b
0709 13:17:46.000146 (+494548us) op_driver.cc:464] REPLICATION: finished
0709 13:17:46.083594 (+ 83448us) write_op.cc:301] APPLY: starting
0709 13:17:46.083700 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:46.083793 (+    93us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:46.083820 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:46.084065 (+   245us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:46.086613 (+  2548us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:46.089122 (+  2509us) write_op.cc:312] APPLY: finished
0709 13:17:46.091829 (+  2707us) log.cc:844] Serialized 23 byte log entry
0709 13:17:46.092502 (+   673us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.092566 (+    64us) write_op.cc:454] Released schema lock
0709 13:17:46.092602 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:46.094779 (+  2177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.094805 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":6912,"child_traces":[["op",{"apply.queue_time_us":81770,"apply.run_cpu_time_us":1647,"apply.run_wall_time_us":12380,"num_ops":1,"prepare.queue_time_us":24320,"prepare.run_cpu_time_us":18063,"prepare.run_wall_time_us":317137,"raft.queue_time_us":256444,"raft.run_cpu_time_us":9691,"raft.run_wall_time_us":77985,"replication_time_us":581959,"spinlock_wait_cycles":5370624,"thread_start_us":442222,"threads_started":4,"wal-append.queue_time_us":238782}]]}
I20260709 13:17:46.107668 18240 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54880 (request call id 242) took 2284 ms. Trace:
I20260709 13:17:46.119009 18239 catalog_manager.cc:5697] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.108150 18240 rpcz_store.cc:276] 0709 13:17:43.823075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.824653 (+  1578us) service_pool.cc:224] Handling call
0709 13:17:46.107611 (+2282958us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:45.643580 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:45.736382 (+ 92802us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:45.736412 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:17:45.736431 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:45.736789 (+   358us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:45.736838 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:45.736867 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:45.737048 (+   181us) tablet.cc:701] Row locks acquired
0709 13:17:45.737066 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:17:45.737188 (+   122us) write_op.cc:270] Start()
0709 13:17:45.737303 (+   115us) write_op.cc:276] Timestamp: P: 1783603065737145 usec, L: 0
0709 13:17:45.737320 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:17:45.737893 (+   573us) log.cc:844] Serialized 533 byte log entry
0709 13:17:46.058143 (+320250us) op_driver.cc:464] REPLICATION: finished
0709 13:17:46.095086 (+ 36943us) write_op.cc:301] APPLY: starting
0709 13:17:46.095143 (+    57us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:46.095231 (+    88us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:46.098271 (+  3040us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:46.098441 (+   170us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:46.098540 (+    99us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:46.098569 (+    29us) write_op.cc:312] APPLY: finished
0709 13:17:46.098700 (+   131us) log.cc:844] Serialized 23 byte log entry
0709 13:17:46.099822 (+  1122us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.099875 (+    53us) write_op.cc:454] Released schema lock
0709 13:17:46.099899 (+    24us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:46.103662 (+  3763us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.103687 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":401553,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":36771,"apply.run_cpu_time_us":1248,"apply.run_wall_time_us":5056,"num_ops":1,"prepare.queue_time_us":340447,"prepare.run_cpu_time_us":2835,"prepare.run_wall_time_us":103283,"replication_time_us":320693,"thread_start_us":19323,"threads_started":1}]]}
I20260709 13:17:46.146826 18242 catalog_manager.cc:5697] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 2 to 4, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 4 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.149094 18242 catalog_manager.cc:5697] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.165330 18239 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42278 (request call id 349) took 2474 ms. Trace:
I20260709 13:17:46.167614 18239 rpcz_store.cc:276] 0709 13:17:43.691280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.691414 (+   134us) service_pool.cc:224] Handling call
0709 13:17:46.165265 (+2473851us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:46.123907 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:46.124487 (+   580us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:46.124521 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:17:46.124536 (+    15us) tablet.cc:662] Decoding operations
0709 13:17:46.124891 (+   355us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:46.124946 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:46.124975 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:46.125165 (+   190us) tablet.cc:701] Row locks acquired
0709 13:17:46.125178 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:17:46.125324 (+   146us) write_op.cc:270] Start()
0709 13:17:46.125425 (+   101us) write_op.cc:276] Timestamp: P: 1783603066125283 usec, L: 0
0709 13:17:46.125442 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:17:46.126665 (+  1223us) log.cc:844] Serialized 533 byte log entry
0709 13:17:46.131367 (+  4702us) op_driver.cc:464] REPLICATION: finished
0709 13:17:46.131729 (+   362us) write_op.cc:301] APPLY: starting
0709 13:17:46.131803 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:46.131894 (+    91us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:46.134345 (+  2451us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:46.134762 (+   417us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:46.134944 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:46.134990 (+    46us) write_op.cc:312] APPLY: finished
0709 13:17:46.136121 (+  1131us) log.cc:844] Serialized 23 byte log entry
0709 13:17:46.136446 (+   325us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.136540 (+    94us) write_op.cc:454] Released schema lock
0709 13:17:46.136578 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:46.136921 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.136950 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":818002,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":153,"apply.run_cpu_time_us":1989,"apply.run_wall_time_us":5173,"num_ops":1,"prepare.queue_time_us":334,"prepare.run_cpu_time_us":2448,"prepare.run_wall_time_us":3018,"replication_time_us":5794}]]}
I20260709 13:17:46.171955 18242 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42284 (request call id 313) took 1554 ms. Trace:
I20260709 13:17:46.173462 18242 rpcz_store.cc:276] 0709 13:17:44.617412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.638292 (+ 20880us) service_pool.cc:224] Handling call
0709 13:17:46.171894 (+1533602us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:46.154993 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:46.155585 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:46.155622 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:17:46.155645 (+    23us) tablet.cc:662] Decoding operations
0709 13:17:46.156101 (+   456us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:46.156156 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:46.156188 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:17:46.156533 (+   345us) tablet.cc:701] Row locks acquired
0709 13:17:46.156557 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:17:46.156713 (+   156us) write_op.cc:270] Start()
0709 13:17:46.156839 (+   126us) write_op.cc:276] Timestamp: P: 1783603066156667 usec, L: 0
0709 13:17:46.156864 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:17:46.157542 (+   678us) log.cc:844] Serialized 975 byte log entry
0709 13:17:46.164621 (+  7079us) op_driver.cc:464] REPLICATION: finished
0709 13:17:46.165082 (+   461us) write_op.cc:301] APPLY: starting
0709 13:17:46.165165 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:46.165369 (+   204us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:46.165477 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:46.165857 (+   380us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:46.166056 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:17:46.166108 (+    52us) write_op.cc:312] APPLY: finished
0709 13:17:46.166322 (+   214us) log.cc:844] Serialized 29 byte log entry
0709 13:17:46.166491 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.166576 (+    85us) write_op.cc:454] Released schema lock
0709 13:17:46.166613 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:46.166925 (+   312us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.166954 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3338,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":264,"apply.run_cpu_time_us":1813,"apply.run_wall_time_us":1812,"num_ops":2,"prepare.queue_time_us":983,"prepare.run_cpu_time_us":2821,"prepare.run_wall_time_us":2821,"replication_time_us":7629}]]}
I20260709 13:17:46.267725 18415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:46.268442 18415 raft_consensus.cc:606] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:17:46.270063 18240 catalog_manager.cc:5697] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 5 to 6, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.282243 20122 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:46.282867 20122 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:46.285828 20122 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:46.290916 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:46.294318 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:46.298940 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:46.298981 18309 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:46.300335 20096 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:46.311524 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:46.312294 18412 raft_consensus.cc:606] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:46.315685 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:46.316740 18412 raft_consensus.cc:606] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:46.323210 20110 raft_consensus.cc:993] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:46.323696 20110 raft_consensus.cc:1081] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:17:46.273216 18240 catalog_manager.cc:5697] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 3, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.330420 18240 catalog_manager.cc:5697] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 4, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 4 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:46.335203 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:46.335948 18412 raft_consensus.cc:606] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:46.331987 18240 catalog_manager.cc:5697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 3 to 6, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 6 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:46.343118 18486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:46.343747 18486 raft_consensus.cc:606] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:46.343976 18489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:17:46.344659 18489 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.345098 18489 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.347406 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:46.350842 18415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:46.358564 18415 raft_consensus.cc:606] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:46.354789 18412 raft_consensus.cc:606] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Received request to transfer leadership
W20260709 13:17:46.362121 18227 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 21b9264b0a434b79b6292c2ed23bbae0 already in progress
I20260709 13:17:46.362021 18489 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:46.366900 18415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:46.367496 18415 raft_consensus.cc:606] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:46.368600 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:46.373445 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:46.373934 18238 catalog_manager.cc:5697] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 2 to 3, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:46.376438 18238 catalog_manager.cc:5697] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 2 to 4, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 4 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:46.377789 18238 catalog_manager.cc:5697] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:46.381764 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:46.382421 18337 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.385402 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet b5d50aacd9894a6ca1895dbf30df38dc with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37906
I20260709 13:17:46.386961 18415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34454
I20260709 13:17:46.387524 18415 raft_consensus.cc:606] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:17:46.390818 18337 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:46.392434 20169 raft_consensus.cc:993] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:46.392962 20169 raft_consensus.cc:1081] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
W20260709 13:17:46.393500 18290 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:17:46.393903 18290 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 21b9264b0a434b79b6292c2ed23bbae0 already in progress
I20260709 13:17:46.394016 18489 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:46.394222 18290 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 21b9264b0a434b79b6292c2ed23bbae0 already in progress
I20260709 13:17:46.395079 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:46.395689 18415 raft_consensus.cc:3055] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:46.396032 18415 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:46.396531 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:46.397163 19059 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.396903 18415 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:46.398906 18415 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.402128 19054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38700
I20260709 13:17:46.402964 19054 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.403365 19054 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:46.410220 18238 catalog_manager.cc:5697] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 4 to 5, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:46.416929 19059 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:46.417999 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:46.418810 20169 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.419446 20169 raft_consensus.cc:697] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:46.420315 20169 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:46.421205 20110 raft_consensus.cc:993] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:46.421662 20110 raft_consensus.cc:1081] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:46.423790 18337 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37920
I20260709 13:17:46.424299 18337 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.424624 18337 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.423131 19054 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:46.432039 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:46.432556 18343 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:46.433686 18337 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:46.441324 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:46.441869 18419 raft_consensus.cc:3055] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:46.442348 18419 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:46.443078 18419 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:46.444078 18419 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.441795 18343 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:17:46.447647 19027 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:46.448122 18337 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:46.448688 20183 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:46.449255 20183 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:46.450198 20183 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:46.455256 20221 tablet_replica.cc:333] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:17:46.456627 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:46.457154 18489 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.460855 20221 raft_consensus.cc:2243] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:46.460837 18415 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:46.459792 20050 raft_consensus.cc:993] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:46.462224 20050 raft_consensus.cc:1081] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:46.461875 20221 raft_consensus.cc:2272] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:46.464084 18335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37920
I20260709 13:17:46.464618 18335 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.464991 18335 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:46.470655 18239 catalog_manager.cc:5697] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 2 to 3, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.475279 18419 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:46.476819 18308 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:46.485389 18489 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:46.484011 20141 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.488368 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:46.489157 18489 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:46.489650 18489 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:46.489095 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet b1c3d9691e854ee98b2b7d81f868c727 with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55634
I20260709 13:17:46.490715 18489 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:46.492087 18489 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:46.496573 20221 ts_tablet_manager.cc:1916] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:46.491815 20141 raft_consensus.cc:697] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:46.508829 19057 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:46.501961 20141 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:46.530436 20123 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:46.539211 20110 raft_consensus.cc:993] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:46.539829 20110 raft_consensus.cc:1081] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:46.541112 18335 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:46.488102 19054 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:46.551443 18337 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37920
I20260709 13:17:46.551954 18337 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.552301 18337 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.574043 18489 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:17:46.609702 18337 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:46.615685 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:46.616406 18419 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:46.616739 18419 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:46.617528 18419 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:46.619138 18419 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.623499 18337 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:46.629051 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:46.630069 18489 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.634352 18419 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:46.661434 20224 tablet_replica.cc:333] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:17:46.663180 20224 raft_consensus.cc:2243] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:46.664548 20224 raft_consensus.cc:2272] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:46.670913 18308 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:46.699185 18489 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:46.692010 18239 catalog_manager.cc:5697] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 3, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.716825 18337 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:46.722952 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:46.723867 18489 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:46.714567 18240 catalog_manager.cc:5697] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 2 to 3, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.715759 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:46.722375 18335 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:46.748014 18489 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
W20260709 13:17:46.737074 20223 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:17:46.733389 20227 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.764367 20224 ts_tablet_manager.cc:1916] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:46.766332 20221 ts_tablet_manager.cc:1929] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:17:46.767707 20221 log.cc:1199] T b5d50aacd9894a6ca1895dbf30df38dc P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/b5d50aacd9894a6ca1895dbf30df38dc
I20260709 13:17:46.750097 18415 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:46.778436 18238 catalog_manager.cc:5697] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 3 to 4, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 4 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:46.781213 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 64646.7us
W20260709 13:17:46.781248 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 68397.8us
W20260709 13:17:46.782742 18227 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 21b9264b0a434b79b6292c2ed23bbae0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 20e06cff39b649c48d342b7431135303 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:46.789750 20111 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:46.794611 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet b5d50aacd9894a6ca1895dbf30df38dc (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:46.775797 20227 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:46.819195 20227 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:46.778092 18415 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:46.823935 18415 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:46.825511 18415 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:46.844139 19059 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:46.845644 20232 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:46.852751 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:46.857551 20122 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:46.863498 20122 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:46.884114 20050 raft_consensus.cc:993] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:46.884652 20050 raft_consensus.cc:1081] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
W20260709 13:17:46.892267 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 101400us
I20260709 13:17:46.892747 19057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38692
I20260709 13:17:46.893306 19057 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.893671 19057 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.897461 18485 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:46.898324 20122 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:46.910533 18413 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:46.912151 20230 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:46.919726 20123 raft_consensus.cc:993] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:46.920332 20123 raft_consensus.cc:1081] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:17:46.924002 18343 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:46.909175 19057 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:46.934892 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:46.935050 20228 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:46.935577 18335 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.936249 20114 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:46.936859 19057 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:46.938548 18343 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:46.948108 20114 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:46.952802 18335 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:17:46.954190 19027 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:46.955056 20114 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.955816 20114 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:46.956959 20114 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:46.963565 18344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37920
I20260709 13:17:46.964083 18344 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.964413 18344 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.971524 18344 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:46.974429 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:46.975047 18419 raft_consensus.cc:3055] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.975360 18419 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:46.976261 18419 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:46.977377 18419 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.984499 18417 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:46.986806 18344 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:46.944850 18415 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
W20260709 13:17:46.975381 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 94464.2us
I20260709 13:17:47.016501 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:47.017238 18485 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.025622 18419 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:47.044476 18308 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:47.052230 20236 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:47.066656 18485 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:47.067186 20236 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:47.051928 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:47.064050 20169 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:17:47.077677 20236 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:47.083654 20248 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:17:47.088937 18242 catalog_manager.cc:5697] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 2 to 3, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.087831 18415 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:47.094309 20114 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:47.109532 18238 catalog_manager.cc:5697] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 2 to 3, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 3 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.097563 20224 ts_tablet_manager.cc:1929] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:17:47.114471 18415 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:17:47.127193 20249 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:47.127590 18415 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:47.132623 18415 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:47.135738 20253 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:47.118147 20114 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:47.141460 20114 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:47.150341 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:47.151163 18486 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:47.130244 18485 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.126077 20224 log.cc:1199] T b1c3d9691e854ee98b2b7d81f868c727 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/b1c3d9691e854ee98b2b7d81f868c727
I20260709 13:17:47.153067 18415 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
W20260709 13:17:47.164340 20247 log.cc:927] Time spent T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:17:47.166561 20230 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.166157 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet b1c3d9691e854ee98b2b7d81f868c727 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:17:47.168154 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:47.169993 18415 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:17:47.207082 19026 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:47.207932 20114 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:47.208359 20114 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:47.208730 20114 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:47.223690 20114 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:47.226462 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:47.234367 18415 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:17:47.235693 19026 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:47.236578 20183 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:47.237097 20183 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:47.238055 20183 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:47.241302 20114 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:47.242002 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:47.242967 18492 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:47.272993 18240 catalog_manager.cc:5697] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 3 to 4, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 4 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.277853 18242 catalog_manager.cc:5697] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 1 to 2, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.284351 18242 catalog_manager.cc:5697] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 3 to 4, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.301702 18485 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.303246 20236 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.319063 18414 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.320688 20096 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.356737 18336 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:47.359097 20114 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:47.374384 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:47.384632 18415 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:47.397025 20114 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:47.414518 18492 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:47.420785 18413 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:47.422575 20096 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:47.434152 20141 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:17:47.555883 18492 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.569643 18414 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.571326 20141 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.583046 20230 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.648694 18413 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:47.651042 20119 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:47.675830 18485 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:47.677337 20114 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:47.711838 18413 consensus_queue.cc:237] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:17:47.719247 18384 consensus_peers.cc:597] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b12e68055d54f32b4b3e7d0d0c76af4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:47.727108 18485 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:47.728910 20235 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.736421 18335 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:47.739264 20123 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.747622 20111 raft_consensus.cc:2955] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:47.753542 18485 raft_consensus.cc:2955] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:47.759281 18335 raft_consensus.cc:2955] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:47.780478 18242 catalog_manager.cc:5697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:47.792796 18413 consensus_queue.cc:237] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:17:47.809945 18384 consensus_peers.cc:597] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b345033a56994fff90990b7d03324074. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:47.812047 18335 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:47.813747 18485 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:47.818557 20235 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.819593 20111 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.839555 20123 raft_consensus.cc:2955] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:47.841023 18335 raft_consensus.cc:2955] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:47.858795 18489 raft_consensus.cc:2955] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:47.872457 18242 catalog_manager.cc:5697] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:47.873199 18336 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:17:47.891737 18309 consensus_peers.cc:597] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb654ec8beb54a539b5b6b44aa5181c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:48.028119 18413 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:48.037304 20238 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:48.046213 18485 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:48.055008 20230 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:48.052835 20096 raft_consensus.cc:2955] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:48.077704 18415 raft_consensus.cc:2955] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:48.080603 18485 raft_consensus.cc:2955] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:48.096428 18242 catalog_manager.cc:5697] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index -1 to 4, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 3 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:48.098140 18413 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:48.157203 18485 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:48.160241 20123 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:48.163251 18384 consensus_peers.cc:597] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 02f16ac6b95a48868f83cdf22debb207. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:48.170939 20279 raft_consensus.cc:2955] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:48.171985 18485 raft_consensus.cc:2955] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:48.681782 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:49.276100 20285 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.276690 20285 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.278891 20285 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:17:49.316910 18365 debug-util.cc:398] Leaking SignalData structure 0x7b08001aece0 after lost signal to thread 17231
I20260709 13:17:49.340684 20285 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.341468 20285 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.344022 20285 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.355468 20283 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.355993 20283 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.357650 20283 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.364393 20283 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.364966 20283 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.382575 20283 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.384143 20286 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.384688 20286 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.386399 20283 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.387164 20286 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.386965 20283 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:49.392228 20286 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.392760 20286 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.394722 20286 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.400367 20283 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.417207 20287 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.417795 20287 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.419975 20287 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.421831 20285 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.422535 20285 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.424587 20285 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.421932 20169 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.427349 20169 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.425841 20285 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.452876 20285 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.458536 20169 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.459168 20169 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.459661 20169 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.463362 20278 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.463945 20278 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.470328 20285 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.491412 20278 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.495038 20288 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.495224 20230 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.495657 20288 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.495949 20230 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.498522 20230 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.468801 20169 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.499338 20230 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.499980 20230 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.500757 20295 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.501283 20295 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.528437 20285 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.529098 20285 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.529390 20287 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.529989 20287 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.531561 20285 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.533613 20283 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.534150 20283 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.535434 20295 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.535952 20295 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.536051 20283 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.536403 20295 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.531966 20287 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.544629 20285 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.545358 20285 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.547282 20285 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.540604 20254 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.548306 20254 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.550360 20254 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.551888 20295 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.553951 20283 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.554507 20283 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.555430 20285 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.555938 20285 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.556521 20283 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.557042 20283 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.557907 20285 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.558377 20287 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.558907 20287 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:49.559958 18365 debug-util.cc:398] Leaking SignalData structure 0x7b080019e580 after lost signal to thread 18276
I20260709 13:17:49.560858 20287 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.561381 20287 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.564222 20110 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.564958 20230 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.572811 20276 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.573484 20276 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.576218 20276 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.578502 20280 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:17:49.579327 18365 debug-util.cc:398] Leaking SignalData structure 0x7b0800217320 after lost signal to thread 18368
I20260709 13:17:49.579051 20280 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:49.579682 18365 debug-util.cc:398] Leaking SignalData structure 0x7b0800334600 after lost signal to thread 18369
I20260709 13:17:49.564857 20110 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.557461 20283 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.585875 20285 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.587119 20096 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:17:49.587664 18365 debug-util.cc:398] Leaking SignalData structure 0x7b080010b860 after lost signal to thread 18443
I20260709 13:17:49.587559 20285 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:49.588182 18365 debug-util.cc:398] Leaking SignalData structure 0x7b0800389c20 after lost signal to thread 18444
I20260709 13:17:49.587672 20096 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.591624 20141 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.591754 20285 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.580878 20276 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.592244 20283 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.592214 20141 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.592821 20283 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.592635 20276 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:49.593314 20283 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.594226 20111 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.581156 20287 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.594717 20111 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.595270 20283 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.596694 20287 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.597033 20111 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.599459 20280 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.599596 20276 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.594617 20236 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.601325 20096 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.601236 20236 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:49.604056 20236 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.552646 20288 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.612123 18242 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42284 (request call id 330) took 1518 ms. Trace:
I20260709 13:17:49.612561 18242 rpcz_store.cc:276] 0709 13:17:48.093300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.093877 (+   577us) service_pool.cc:224] Handling call
0709 13:17:49.612066 (+1518189us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:48.202506 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:48.203076 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:48.203113 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:17:48.203134 (+    21us) tablet.cc:662] Decoding operations
0709 13:17:48.203497 (+   363us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:48.203555 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:48.203588 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:48.203794 (+   206us) tablet.cc:701] Row locks acquired
0709 13:17:48.203816 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:17:48.203968 (+   152us) write_op.cc:270] Start()
0709 13:17:48.204077 (+   109us) write_op.cc:276] Timestamp: P: 1783603068203922 usec, L: 0
0709 13:17:48.204099 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:17:48.204797 (+   698us) log.cc:844] Serialized 595 byte log entry
0709 13:17:48.209447 (+  4650us) op_driver.cc:464] REPLICATION: finished
0709 13:17:48.209697 (+   250us) write_op.cc:301] APPLY: starting
0709 13:17:48.209776 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:48.209894 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:48.210020 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:48.215390 (+  5370us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:48.215715 (+   325us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:48.215766 (+    51us) write_op.cc:312] APPLY: finished
0709 13:17:48.220687 (+  4921us) log.cc:844] Serialized 23 byte log entry
0709 13:17:49.536199 (+1315512us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:49.536284 (+    85us) write_op.cc:454] Released schema lock
0709 13:17:49.536321 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:49.608935 (+ 72614us) write_op.cc:489] Releasing partition, row and schema locks
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":86,"apply.run_cpu_time_us":19461,"apply.run_wall_time_us":1375979,"num_ops":1,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":2555,"prepare.run_wall_time_us":2555,"replication_time_us":5244}]]}
I20260709 13:17:49.621433 18239 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42278 (request call id 365) took 1524 ms. Trace:
I20260709 13:17:49.621992 18239 rpcz_store.cc:276] 0709 13:17:48.097504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.097647 (+   143us) service_pool.cc:224] Handling call
0709 13:17:49.621348 (+1523701us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46049,"reported_tablets":1}
I20260709 13:17:49.628278 18336 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:49.630312 18238 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42292 (request call id 338) took 1529 ms. Trace:
I20260709 13:17:49.630826 18238 rpcz_store.cc:276] 0709 13:17:48.101349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.101487 (+   138us) service_pool.cc:224] Handling call
0709 13:17:49.630229 (+1528742us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2171,"reported_tablets":1}
I20260709 13:17:49.631889 20230 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.647619 20230 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.618651 20236 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.665891 20114 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.665962 20286 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.666623 20286 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.662451 20183 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.667994 20298 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.667770 20183 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.668483 20298 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.669423 20286 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.666560 20114 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.666042 20291 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.627410 20119 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.669881 20183 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.670491 20291 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.671161 20183 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.671080 20119 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.671460 20117 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.672030 20117 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.671736 20114 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.672926 20292 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.673120 20119 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.673471 20236 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.638564 20278 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:17:49.663192 18365 debug-util.cc:398] Leaking SignalData structure 0x7b0800061ba0 after lost signal to thread 18517
I20260709 13:17:49.673869 20114 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.674820 20277 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.687633 20303 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.687903 20114 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.687989 20277 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:49.688457 20303 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.690919 20303 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.682488 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.682684 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.692869 18336 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:49.671726 20183 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.685405 20141 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.675387 20296 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.695503 20183 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.695969 20296 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.698546 20296 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.698815 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:49.674005 20117 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.700397 20117 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.700973 20117 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.701985 20114 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.702746 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:49.686547 20304 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.704001 20304 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.674933 20292 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.654042 20169 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.711814 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:49.720227 18491 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:17:49.665197 20288 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:17:49.738113 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 46615.6us
I20260709 13:17:49.710029 20279 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.711781 20297 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.711549 20111 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.711370 20238 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.711550 20286 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.719187 20141 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.720695 20096 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.720925 20280 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.726030 20283 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.723119 20287 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.746732 20279 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.748816 20291 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.749364 20238 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.749828 20117 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.706570 20278 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.726131 20305 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.756356 20306 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.744474 20236 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.756779 20110 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.723438 20169 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.741969 20288 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.766213 20289 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.754245 20141 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.754060 20096 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.756970 20283 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.775719 20279 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.757205 20287 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.775755 20308 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.782735 20230 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.784582 20304 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.750075 20111 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.756989 20300 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.805208 20308 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:49.805954 20300 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.807013 20141 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.807206 20096 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.759025 20303 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:17:49.795159 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 67655.1us
I20260709 13:17:49.808650 19025 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:49.766336 20285 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.753592 20286 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.778421 20238 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.755244 20280 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.793768 20301 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:17:49.796221 20183 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.791661 20305 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.746553 20297 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.810372 20300 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.804900 20312 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.811305 20278 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.822549 20313 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.800041 20289 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.820847 20296 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.823864 20297 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.809556 20315 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:49.824769 20114 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.825066 20289 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.824747 20315 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.825423 20169 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.823077 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:49.810734 20303 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.812022 20308 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.827301 20278 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.827244 20300 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:49.810597 20285 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:49.826936 20315 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.828454 20288 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.812311 20119 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.828145 20300 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.812016 20286 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.823818 20296 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.828104 20278 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.823064 20313 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.823936 20277 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.812001 20111 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.827455 20287 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.831449 20298 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.832134 20285 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.794322 20306 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.812193 20280 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.833173 20313 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.829149 20300 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:49.826936 20283 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.846751 20306 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.827245 20292 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.830046 20312 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.849077 20312 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.839819 20305 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.839833 20296 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.833194 20303 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.882921 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.886175 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.887683 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.889727 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.891408 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.891733 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.892831 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.776443 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.896420 18335 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:49.897246 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.898211 18341 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:17:49.880549 18242 catalog_manager.cc:5697] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:49.901364 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.901412 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:17:49.750491 18365 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9980 after lost signal to thread 19086
I20260709 13:17:49.916985 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:49.918076 19055 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:17:49.919966 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:49.829149 20119 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.815383 20183 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.932694 20111 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.927837 20292 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.934036 20292 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.935261 20183 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:49.833145 20278 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.928700 20296 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.825462 20114 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.926496 20110 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:49.934407 20303 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.929687 20305 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.944674 20292 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.948764 20279 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.950417 19054 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:49.951438 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.951452 19053 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:49.961452 20111 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.964344 20111 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.964035 20110 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.935273 20119 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.969828 20302 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.971133 20110 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:49.970834 20302 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:49.971995 20301 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:49.972741 20301 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.975391 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:17:49.975575 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 166853us
I20260709 13:17:49.976773 20296 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.977480 20301 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:49.935288 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 195965us
I20260709 13:17:49.979703 20296 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.980635 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:49.981197 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:49.982069 20305 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.982861 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:49.983950 18489 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:49.985502 20305 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.986112 20293 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.986593 20294 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:50.010486 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.043905 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:49.987663 20114 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.988231 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:49.990134 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:49.990556 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:49.991657 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:49.991808 20300 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.992751 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:49.994002 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:49.994199 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:49.980851 20295 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:49.994740 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.048888 18341 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:17:50.048832 20295 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.994923 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:49.996994 20303 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.051259 20295 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.051900 20303 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.998059 20279 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:49.999354 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.053354 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.054225 18492 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:50.054610 20279 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.055115 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.056031 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:49.999703 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.000053 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.000968 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.058523 18491 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
I20260709 13:17:50.001629 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.002264 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.045943 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.066077 20294 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.066764 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.002421 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.002696 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.003342 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.004086 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.005242 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.044582 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.044755 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.045327 20302 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:49.987308 18485 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
I20260709 13:17:50.010224 20301 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.046286 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:49.997394 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:49.980655 20307 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.075736 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.047871 18414 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:50.075434 20307 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.078372 19060 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:50.079337 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.082054 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.082326 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.083644 20311 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.083956 19062 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:50.080039 18417 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:50.010246 20111 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:50.071163 19055 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:50.079599 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:50.096866 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.098779 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.084347 20311 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.095721 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.076540 20301 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:50.098917 20314 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.091984 19057 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:50.073225 20110 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.105378 20322 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:50.105604 19053 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:50.106155 19061 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:17:50.106572 18342 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:50.074342 18416 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:50.108069 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:17:50.108836 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 97732.2us
I20260709 13:17:50.109275 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.110860 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.099640 19062 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:50.097628 20293 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.118310 20111 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.152213 18489 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:50.152308 20110 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.153507 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.154270 18489 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:50.154479 20111 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.154798 20110 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.152102 18414 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:50.155318 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.156047 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.156260 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.156667 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.156944 18414 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:17:50.157516 20323 ts_tablet_manager.cc:933] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
I20260709 13:17:50.158035 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.158113 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.119665 20300 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.082078 20307 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.141173 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.099231 19054 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:50.145139 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.143071 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.150060 20316 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.149895 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.149849 20314 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.152079 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.146962 20324 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:50.150791 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.158890 18488 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:50.123018 20301 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.162366 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.163074 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.164768 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.157464 18490 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:50.169437 18412 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:50.155191 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.166160 19025 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:50.168139 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.171051 18417 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:50.162813 20322 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:50.168110 20294 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.182094 19060 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:17:50.183236 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.184072 18416 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:50.185012 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.186452 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.190589 19025 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:50.172581 20114 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.191548 20114 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.168040 20324 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:50.192632 20324 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:50.190677 20311 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.194382 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.195681 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.196350 18416 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:50.197249 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.198257 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.198382 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.198956 18410 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:50.199946 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.200532 18410 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:17:50.201397 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.172851 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.202214 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.202991 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.203859 18419 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:50.204205 20321 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:50.204643 20321 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.204689 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.206738 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.206169 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.205156 20321 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.208191 18417 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:50.209419 20293 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.205412 20316 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.211498 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.212137 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.202996 18413 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:50.222273 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.223003 20294 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.223608 20294 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.225409 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.214073 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.226156 18492 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
I20260709 13:17:50.226325 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.226547 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:50.226969 20305 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.227206 18490 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:50.227574 20305 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.228372 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.217533 20314 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.233657 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.243081 20303 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:50.243525 20303 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:50.210539 20114 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.243923 20303 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.251004 18309 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:50.252990 18309 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.254261 20286 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:50.254812 20286 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.255155 20286 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:50.255337 20294 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.257599 20299 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.258054 20299 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.258433 20299 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.254204 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.264369 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.266777 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.268136 18308 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.270166 20287 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:50.270671 20287 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.272634 20287 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.271803 20301 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.271251 20305 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.274302 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.275139 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.263895 20324 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.282176 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.282511 18308 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.282848 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.284220 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.289069 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.281116 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:50.280099 20321 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.294049 18418 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:17:50.282534 20316 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.295326 20280 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:50.299625 20280 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.300794 20280 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.305266 20283 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:50.304742 18308 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.305697 20283 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.309330 20283 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:50.331297 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 50271.7us
I20260709 13:17:50.336253 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.337220 18308 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.331305 20322 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.330808 20283 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.343120 20141 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.344425 20141 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.344769 18337 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:50.345099 20288 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:50.345479 20288 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.345868 20288 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:50.346351 18341 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:50.344772 20141 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.331141 20299 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.349102 20323 tablet_copy_client.cc:323] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.1:37809
I20260709 13:17:50.346777 20283 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.371495 18308 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.360571 20299 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.366137 20301 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.374948 20324 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:50.398303 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 55987.8us
I20260709 13:17:50.395988 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.367458 20303 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.403357 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.391750 20321 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.406159 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.401850 20303 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.410053 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.415409 20329 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:50.410941 20286 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.415324 18457 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:50.410370 18458 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:50.408483 18309 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.419410 20286 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.420408 20291 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.420657 18457 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.420949 20291 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.421332 20291 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.422215 20277 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.422646 20277 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:50.423015 20277 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.430080 20298 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:50.415902 20329 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.431941 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.432123 20329 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:50.434495 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.435694 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.437101 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.437799 18344 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:50.439558 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.439977 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.441250 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.442490 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.443401 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.446234 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.446770 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.448452 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.453326 20330 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:50.453554 18457 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.457350 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.457458 20330 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.458069 20330 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:50.458693 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.452052 19025 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:50.462122 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.463505 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.458601 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.468046 18308 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.470026 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.474817 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.476198 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.476189 18342 raft_consensus.cc:2955] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:17:50.477649 20280 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.479951 20280 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.479758 20141 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.474296 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:50.465895 20321 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:50.483326 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 75324.4us
I20260709 13:17:50.484489 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.488739 18343 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.419785 20288 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.484825 20321 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.495558 20321 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.496902 20329 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.499138 20329 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.502297 20141 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.502455 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.502630 20287 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.503616 18415 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:50.504997 18308 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.505226 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.506559 18308 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.507318 20287 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.507921 20287 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:50.508271 20287 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.508633 20287 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:50.509536 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.510172 20283 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.510603 20283 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:50.510643 20286 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:50.511099 20283 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.509617 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:50.511150 20286 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.485296 20280 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:50.518031 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 87656.1us
I20260709 13:17:50.518160 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:17:50.520233 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 112134us
I20260709 13:17:50.521261 18343 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:50.524184 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.524233 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:50.515950 20286 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.526369 18458 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:50.527348 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:50.527886 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:50.528239 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.530225 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:50.538846 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.540091 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.540372 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.540952 18457 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:50.541252 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.540251 20277 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.542306 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.543444 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.543690 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.544605 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.519006 20280 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.545642 20280 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.546051 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.545848 20283 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.547174 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.547814 20283 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.548460 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.549206 20298 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:50.549662 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.550889 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.551890 20298 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:50.531193 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.552271 20298 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.552685 20298 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.553123 20322 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.553514 20322 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:50.553906 20322 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.553601 20288 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.543572 20277 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:50.559433 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:50.568608 18337 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:50.567095 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.572547 18337 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:50.573884 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.575316 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.579110 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.579869 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.580086 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.580256 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.581419 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.578457 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.582810 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.587987 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.577584 20322 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.589430 20287 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.572664 20332 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:50.590370 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.582829 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.591572 18384 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.592489 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:50.590919 20332 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:50.566634 20280 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.562656 20291 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.595726 20314 consensus_queue.cc:1059] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:17:50.599486 20316 raft_consensus.cc:3055] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:50.599860 20316 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:50.600152 20291 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:50.600889 18490 raft_consensus.cc:1240] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:50.600972 20316 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.602347 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.598167 20301 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.606212 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.606443 20301 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.607012 20301 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.607909 20316 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.615561 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.617600 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.619925 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.622355 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:50.623387 20335 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:50.595944 20332 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:50.623413 19062 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:50.634523 18309 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:50.635571 20322 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.635974 18309 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:50.641395 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.642640 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.642997 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.644260 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.644863 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.644932 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.646335 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.646711 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.647001 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:50.647979 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:50.649026 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:50.649557 20288 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.650059 20335 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:50.650493 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.651171 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.651810 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.652446 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:50.652514 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.653164 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:50.653475 20332 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.654260 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.655925 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:50.657058 20298 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.651177 18309 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:50.661419 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.664505 20321 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.667376 20287 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.670077 20305 consensus_queue.cc:1059] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:50.688066 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:50.689670 20334 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:50.690244 20298 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:50.690544 20334 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:50.690922 20298 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:50.678145 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 162029us
I20260709 13:17:50.691425 20298 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.691834 18457 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:50.691900 20298 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:50.692642 20336 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:50.692713 18457 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:50.693104 20336 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:50.693511 20336 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:50.694087 20277 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:50.694479 20277 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:50.694864 20277 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:50.694571 20330 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.696792 18487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:50.684444 20322 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:50.680519 20335 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.679662 20288 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.633545 20286 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.690968 20334 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:50.697614 20303 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:50.693602 18457 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:50.672535 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 47325.3us
W20260709 13:17:50.708173 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 57096.2us
I20260709 13:17:50.709052 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:50.707091 20322 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:50.712744 18491 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.713631 20141 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.696801 20330 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.725253 18309 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.709111 20335 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:50.715013 20301 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.715823 20332 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.716619 20280 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.723006 18341 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:17:50.719980 20303 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:50.697619 18487 raft_consensus.cc:606] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.724354 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.735612 20286 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.724947 19027 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.717983 20321 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.718819 20288 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.727938 18339 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:50.731267 18309 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:50.744378 20322 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.744956 20336 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.746374 20287 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:50.746865 20287 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.731149 20330 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:50.747270 20287 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:50.728593 20337 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.747531 20320 consensus_queue.cc:1059] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:50.747984 20337 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:50.748416 20337 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.749082 20320 raft_consensus.cc:3055] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:50.732775 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:50.736097 18307 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:50.753491 20324 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:50.725699 20141 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.754850 20320 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:50.763463 20141 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.763931 18341 raft_consensus.cc:1240] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:50.755594 20114 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:17:50.722671 20277 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:50.781394 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 50182.9us
I20260709 13:17:50.787184 18309 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:50.780514 20311 consensus_queue.cc:1059] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:17:50.788878 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:50.789654 18335 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:17:50.764194 20320 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:50.790638 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 49249.2us
I20260709 13:17:50.747526 20330 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.761018 20301 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:50.789705 20311 raft_consensus.cc:3055] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:50.749799 20334 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.794767 20280 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:50.815721 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 73010.3us
I20260709 13:17:50.812009 18309 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:50.814980 19026 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:17:50.816105 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 80183us
W20260709 13:17:50.813354 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 105149us
I20260709 13:17:50.790015 20277 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.754268 20324 consensus_queue.cc:1059] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:17:50.810974 20330 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.804590 20299 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:50.812291 20311 raft_consensus.cc:740] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:50.820385 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:50.818305 20280 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.821530 20329 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:50.842237 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 88433.7us
I20260709 13:17:50.821424 20114 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:50.845292 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:50.847973 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:50.850544 19026 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.823731 20320 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:50.851222 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.854105 19027 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.841485 20299 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:50.846508 20280 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:50.865315 18382 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.868175 20141 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.844734 20329 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:17:50.880810 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 63074.2us
I20260709 13:17:50.884351 19026 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.881502 20114 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:50.889724 20141 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.890372 20141 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:50.892244 18457 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.892519 20305 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:50.893077 20277 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:50.871416 20299 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:50.887532 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 67666.5us
I20260709 13:17:50.894968 20286 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:50.895366 20286 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:50.896301 20286 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:50.897475 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.898877 20334 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.899452 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.880317 20329 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:50.882227 20324 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:50.852358 20298 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:50.919448 19027 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:50.924563 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.884022 20336 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.897819 20286 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:50.862457 20335 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.927160 19027 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:50.928599 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 48944.8us
I20260709 13:17:50.900671 20340 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:50.887158 20287 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.925468 20314 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:50.952749 19026 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.952695 19027 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.930606 20305 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:50.951330 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 68027.2us
I20260709 13:17:50.964252 18341 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:50.953054 20324 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:50.923833 20337 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:50.963990 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:50.985385 20287 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.972477 20288 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.987020 18340 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:50.987633 20288 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:50.974845 20305 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:50.980984 20311 consensus_queue.cc:260] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.974268 19026 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.983587 20303 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.984064 20280 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:50.988181 20298 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:50.983952 20353 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:50.997679 20353 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:50.991688 20305 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:50.992285 19026 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.001107 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.992575 20303 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.002077 20300 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.002507 20345 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.002662 18242 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42292 (request call id 339) took 1340 ms. Trace:
I20260709 13:17:51.004194 20335 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:51.005337 20337 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:51.001247 20353 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:51.004160 19026 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.009682 18344 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:51.010126 20345 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:51.010926 18342 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:51.011294 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.012049 20324 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:50.993815 19027 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:50.963608 20339 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:50.989035 20311 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:51.022037 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.027817 19026 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:51.028401 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 129007us
I20260709 13:17:51.019872 20339 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.019342 20355 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:17:51.018000 20321 raft_consensus.cc:3055] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:51.031947 20321 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:51.001451 20299 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.032642 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.033325 19054 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:51.033015 20321 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.003059 18242 rpcz_store.cc:276] 0709 13:17:49.662507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.662674 (+   167us) service_pool.cc:224] Handling call
0709 13:17:50.005128 (+342454us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b5400049628. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a2846161 00007f40a28d03af 00007f40a28d1b11 00007f40a4dd22d1 00007f40a4dd2b2f 00007f40a4c91d4b 00007f40a4d99c3e 00007f40a325a2a4 00007f40a325a232 00007f40a325a161 00007f40a325a0dc
0709 13:17:51.002560 (+997432us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:50.246213 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:50.336531 (+ 90318us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:50.340711 (+  4180us) write_op.cc:435] Acquired schema lock
0709 13:17:50.350914 (+ 10203us) tablet.cc:662] Decoding operations
0709 13:17:50.397840 (+ 46926us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:50.405283 (+  7443us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:50.406928 (+  1645us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:50.442312 (+ 35384us) tablet.cc:701] Row locks acquired
0709 13:17:50.442358 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:17:50.442516 (+   158us) write_op.cc:270] Start()
0709 13:17:50.442673 (+   157us) write_op.cc:276] Timestamp: P: 1783603070442458 usec, L: 0
0709 13:17:50.442710 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:17:50.443497 (+   787us) log.cc:844] Serialized 595 byte log entry
0709 13:17:50.735010 (+291513us) op_driver.cc:464] REPLICATION: finished
0709 13:17:50.870192 (+135182us) write_op.cc:301] APPLY: starting
0709 13:17:50.870296 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:50.870413 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:50.870547 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:50.870860 (+   313us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:50.871103 (+   243us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:50.871163 (+    60us) write_op.cc:312] APPLY: finished
0709 13:17:50.925373 (+ 54210us) log.cc:844] Serialized 23 byte log entry
0709 13:17:50.952306 (+ 26933us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:50.954251 (+  1945us) write_op.cc:454] Released schema lock
0709 13:17:50.962950 (+  8699us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:50.990651 (+ 27701us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:51.003137 (+ 12486us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":4161408,"child_traces":[["op",{"apply.queue_time_us":134846,"apply.run_cpu_time_us":2603,"apply.run_wall_time_us":104295,"num_ops":1,"prepare.queue_time_us":168776,"prepare.run_cpu_time_us":14648,"prepare.run_wall_time_us":270877,"raft.queue_time_us":136641,"raft.run_cpu_time_us":8882,"raft.run_wall_time_us":82618,"replication_time_us":292140,"spinlock_wait_cycles":56576,"thread_start_us":315521,"threads_started":4,"wal-append.queue_time_us":70538}]]}
I20260709 13:17:51.034081 20299 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:51.037186 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:51.037808 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:51.038007 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:51.038410 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:51.018818 20314 consensus_queue.cc:1059] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:17:51.034101 18335 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:51.044137 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:51.034360 20321 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.027406 20316 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:17:51.019032 20341 consensus_queue.cc:1059] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:17:51.035209 20280 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:51.050464 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:51.050570 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:51.057415 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:51.054525 18382 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.065025 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.066135 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.066713 20314 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:51.067102 20314 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:51.068117 20316 raft_consensus.cc:3055] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:51.068573 20316 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:51.068601 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.069738 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.054222 20339 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:51.070313 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.070516 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.070925 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.069880 19054 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:51.071499 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.071920 20341 raft_consensus.cc:3055] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:51.072271 20341 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:51.074088 20294 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:51.074421 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.067021 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:51.074457 20294 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:51.076277 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.067003 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.076870 20294 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.078051 20294 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:51.068238 20314 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.079001 20314 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.069502 20316 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.073233 20341 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.061671 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.082619 18382 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.084602 18489 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:51.088392 20361 ts_tablet_manager.cc:933] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:51.092607 18382 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.091622 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:51.098181 18382 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.101719 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.090107 20320 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.104538 20354 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.106415 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.109450 20329 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.111685 18491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:51.112262 18491 raft_consensus.cc:606] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:17:51.113164 20329 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:51.115854 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:51.117092 20316 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.118292 20341 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.070077 20293 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:17:51.129900 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:51.129619 20330 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.132014 20330 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:51.110821 20301 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:51.121986 20322 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.134120 20356 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:51.134327 18487 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:51.135375 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.135294 18240 catalog_manager.cc:5697] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 3 to 4, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 4 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.137302 18490 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:51.136072 19055 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:51.138420 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.138828 18490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:51.139360 18490 raft_consensus.cc:606] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:17:51.139894 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 78290.7us
I20260709 13:17:51.140653 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.145941 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.147403 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.148391 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.148523 20361 tablet_copy_client.cc:323] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:51.148989 20321 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:51.151989 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 183662us
I20260709 13:17:51.152647 19026 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.153383 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:51.154948 18489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:17:51.155705 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.156023 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.156841 20301 raft_consensus.cc:3055] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:51.157224 20301 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:51.158217 20301 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.159475 20301 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:51.175599 18410 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:17:51.155572 18489 raft_consensus.cc:606] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:51.176017 19026 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.167601 18415 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
W20260709 13:17:51.148092 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 44598.3us
I20260709 13:17:51.180076 18382 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:51.181993 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.182323 19057 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:51.183525 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.187188 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.188879 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.189182 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.189821 19062 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:51.190220 20362 ts_tablet_manager.cc:933] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:51.187252 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:51.194362 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.194821 18490 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:51.198115 18416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:17:51.198757 18416 raft_consensus.cc:606] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:51.199105 18416 raft_consensus.cc:614] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:51.200768 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:51.203776 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:51.206254 19062 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:17:51.206647 18417 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:17:51.178035 20356 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.188457 20316 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.176800 20321 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.213094 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.214090 19054 raft_consensus.cc:1240] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:51.215240 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.215327 19056 raft_consensus.cc:1240] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:51.215360 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.213131 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.216578 20359 ts_tablet_manager.cc:933] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:51.216372 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.217971 20287 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:51.215468 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.218447 20287 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:51.218920 20287 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.223305 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:17:51.226440 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.228648 20287 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:51.230384 18412 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:17:51.234858 20321 consensus_queue.cc:1059] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:51.239205 20356 consensus_queue.cc:1059] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:51.239991 20316 consensus_queue.cc:1059] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:51.282845 20303 raft_consensus.cc:3055] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:51.283295 20303 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:51.240177 20357 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:51.283862 20321 raft_consensus.cc:3055] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:51.284312 20321 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:51.284248 20303 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.285275 20357 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:51.241545 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.242102 19053 raft_consensus.cc:1240] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:51.285746 20357 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:51.243343 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.244585 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.286823 20357 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.246014 19061 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:51.250809 18308 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:51.251096 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.252449 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.288374 18308 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:51.252717 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.260509 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.285398 20321 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.289809 18308 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:51.290596 20321 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:51.285624 20303 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:51.266062 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.264737 20339 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:17:51.292797 18354 tablet_copy_service.cc:140] P d03b672b2ff044b8bc2a0dfd8180ee19: Received BeginTabletCopySession request for tablet bb654ec8beb54a539b5b6b44aa5181c3 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:53812)
I20260709 13:17:51.293465 18354 tablet_copy_service.cc:161] P d03b672b2ff044b8bc2a0dfd8180ee19: Beginning new tablet copy session on tablet bb654ec8beb54a539b5b6b44aa5181c3 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:53812: session id = 31ab487dc52e4f608b39df0fae2fdfa5-bb654ec8beb54a539b5b6b44aa5181c3
I20260709 13:17:51.293552 20339 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:51.294005 20339 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:51.294862 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.294989 20339 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.292856 20360 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:51.296245 20339 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:51.296553 20360 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:51.267490 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.297691 20360 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.298334 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:51.300598 19062 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:17:51.301884 20330 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:51.302438 20330 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:51.302862 20280 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:51.269073 18309 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:51.303448 20330 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.304420 18309 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:51.283427 20316 raft_consensus.cc:3055] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:51.306491 20335 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:51.269668 20362 tablet_copy_client.cc:323] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:51.288075 20357 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.303452 20280 raft_consensus.cc:697] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:51.314051 20280 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:51.240747 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 59754.3us
I20260709 13:17:51.268709 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.307071 20335 raft_consensus.cc:697] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:51.315924 18382 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.316334 20335 consensus_queue.cc:237] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.317085 20301 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.306551 20316 raft_consensus.cc:740] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:51.317126 18382 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.318616 20316 consensus_queue.cc:260] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:51.319831 20316 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.306411 20286 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.321035 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:51.322511 20301 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.322810 20358 consensus_queue.cc:1059] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:51.323549 20329 consensus_queue.cc:1059] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:51.323894 20358 raft_consensus.cc:3055] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:51.322854 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:51.327627 20358 raft_consensus.cc:740] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:51.327951 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:51.325647 18341 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:51.328599 20358 consensus_queue.cc:260] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.329717 18428 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet 2b12e68055d54f32b4b3e7d0d0c76af4 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:51.327642 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:17:51.326355 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.326468 18489 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: []
W20260709 13:17:51.278390 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 101271us
I20260709 13:17:51.333310 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:51.333489 18382 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.330283 18428 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet 2b12e68055d54f32b4b3e7d0d0c76af4 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-2b12e68055d54f32b4b3e7d0d0c76af4
I20260709 13:17:51.335209 18309 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:51.338195 20341 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.338475 20359 tablet_copy_client.cc:323] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:17:51.339643 18307 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:51.342653 20280 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:51.342862 20286 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.343165 20280 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:51.343727 20280 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.336011 19026 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:17:51.337234 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 48643.3us
I20260709 13:17:51.348778 19026 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.351377 18354 tablet_copy_source_session.cc:215] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:51.351505 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.330552 20358 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.357583 18309 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:51.356462 20141 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.359576 20353 raft_consensus.cc:3055] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:51.349881 20303 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:51.360450 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.361161 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 110128us
I20260709 13:17:51.356823 20356 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:17:51.361821 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.349887 20299 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:51.362829 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.347818 20287 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:51.363871 20298 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.363997 18428 tablet_copy_source_session.cc:215] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:51.368225 20280 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:51.372175 20341 consensus_queue.cc:1059] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:17:51.375087 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.390977 18458 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 1.614s (SENT) [suppressed 1 similar messages]
I20260709 13:17:51.396251 20341 raft_consensus.cc:3055] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:51.396710 20341 raft_consensus.cc:740] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:51.397447 20280 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:51.398283 18429 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet 02f16ac6b95a48868f83cdf22debb207 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:51.397708 20341 consensus_queue.cc:260] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:51.398849 18429 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet 02f16ac6b95a48868f83cdf22debb207 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-02f16ac6b95a48868f83cdf22debb207
I20260709 13:17:51.399616 20341 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:51.357666 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 97711.6us
I20260709 13:17:51.402307 18307 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.403513 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:51.378381 18309 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:51.405222 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:51.383154 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.405402 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.407302 19026 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.386442 20283 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.410557 20324 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.410900 20361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b12e68055d54f32b4b3e7d0d0c76af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.382658 20353 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:51.421296 20141 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:51.422022 20353 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.421850 20141 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:51.423211 20141 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.423362 20353 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.387547 20321 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.419782 20364 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.419093 18428 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet b345033a56994fff90990b7d03324074 from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:17:51.434479 18428 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet b345033a56994fff90990b7d03324074 from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-b345033a56994fff90990b7d03324074
I20260709 13:17:51.394731 20299 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:51.435496 20299 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.419872 20329 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:51.420677 20283 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:51.442248 20283 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:51.411373 20324 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.443226 20283 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.441833 20329 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:51.447743 20329 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.392668 20330 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:51.449837 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 44677.9us
I20260709 13:17:51.451324 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.453548 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.454552 19062 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 2: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:51.447795 18428 tablet_copy_source_session.cc:215] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:51.462819 19061 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:17:51.463598 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 72643.6us
I20260709 13:17:51.465972 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.467628 19062 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:17:51.469223 20298 raft_consensus.cc:993] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:51.470431 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.471858 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.472523 20337 raft_consensus.cc:993] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:51.472999 20337 raft_consensus.cc:1081] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:51.474184 18458 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.475522 20334 raft_consensus.cc:1081] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:17:51.479846 20337 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.475782 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.479223 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.497437 19059 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:17:51.506417 20141 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:51.508693 20141 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:51.509529 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.510690 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.511579 19055 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 2: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:51.520344 18340 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:51.521240 20337 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.521972 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:51.524760 20329 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:51.520983 18410 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:17:51.527038 18308 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:51.531777 19027 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.536419 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.537307 20334 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.530422 20353 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:51.538012 20357 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.538542 20353 raft_consensus.cc:697] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:51.537590 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.539477 20298 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:51.541388 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.542452 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.525760 19058 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:17:51.546401 18384 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.547240 19027 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.548242 18307 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.549283 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.551093 20303 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:51.553380 20283 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.555333 19057 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:51.556166 20316 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.556949 20303 raft_consensus.cc:697] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:51.558269 20303 consensus_queue.cc:237] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.558808 19056 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:51.559525 20359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b345033a56994fff90990b7d03324074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.563397 20323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb654ec8beb54a539b5b6b44aa5181c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.550884 20358 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:51.575755 18384 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.539575 20353 consensus_queue.cc:237] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:51.551474 20364 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.614092 20301 consensus_queue.cc:1059] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:51.615620 20301 raft_consensus.cc:3055] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:51.616127 20301 raft_consensus.cc:740] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:51.619036 18307 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.620231 18307 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.621255 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.622277 20364 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.622920 20364 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.623529 20364 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.629971 18307 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.610219 20316 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:51.631812 20141 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.635347 18429 tablet_copy_source_session.cc:215] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:51.638888 20362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f16ac6b95a48868f83cdf22debb207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.639865 18307 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.613300 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.646803 18307 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.647753 20141 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.649392 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.650887 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:51.651239 20298 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:51.653142 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:51.654790 18307 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.655753 20358 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.656409 20358 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.656279 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.658109 20141 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:51.666545 20298 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:51.617372 20301 consensus_queue.cc:260] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.671064 20301 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.682806 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.683908 20341 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.684293 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.685163 20341 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.657823 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.687731 20358 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.687732 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:51.688328 18341 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:51.688643 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:51.689316 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:51.690105 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:51.693370 18342 raft_consensus.cc:1240] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:51.694898 20350 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.695839 20350 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.698344 20346 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:51.700891 20346 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:51.701490 20346 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:51.709782 20346 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:51.714280 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 61222.5us
I20260709 13:17:51.715425 18458 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:51.716509 20337 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.722833 18458 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:51.727074 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.749202 18341 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:51.750217 18458 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:51.737267 20316 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:51.754561 18340 raft_consensus.cc:1240] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:51.748432 18335 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:51.727193 20329 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:51.751729 18458 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:17:51.749210 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.761932 18341 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:51.763170 18384 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.764240 18384 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.767699 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:51.768224 18335 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:51.768313 19062 raft_consensus.cc:2376] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3. Re-sending same reply.
I20260709 13:17:51.770409 20341 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.760553 20336 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:51.760828 20298 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:51.783511 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:51.778405 18341 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:51.779686 20341 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.753908 20316 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.782176 19057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38700
I20260709 13:17:51.772734 20334 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:51.768136 20294 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:51.796247 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:51.780382 19056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38700
I20260709 13:17:51.797477 18342 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:51.796125 20298 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:17:51.809829 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 45656.4us
I20260709 13:17:51.796197 20336 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:51.811707 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:51.804039 19057 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:51.822254 19057 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.807969 20341 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:51.837455 20359 tablet_copy_client.cc:806] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:51.817387 18340 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:51.817952 20298 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.819702 20316 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:51.803804 20334 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:17:51.820291 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.821245 20350 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.825335 18339 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:51.827961 18335 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:51.814832 20294 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.880661 20334 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.882141 20294 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:51.833350 20336 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.817096 19056 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:51.886433 19056 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.846400 19055 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:51.900468 18410 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:51.902302 18490 raft_consensus.cc:1240] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:51.856827 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.904016 20350 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:51.904119 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 47405.9us
I20260709 13:17:51.904947 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.905743 20350 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.838725 19057 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.906849 19054 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:51.907371 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:51.907932 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.811784 20337 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.873734 19059 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.840585 20378 consensus_queue.cc:1059] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:51.909251 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:51.909852 18492 raft_consensus.cc:3055] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:51.910174 18492 raft_consensus.cc:740] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:51.911967 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:51.912369 20358 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:51.912925 18340 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 2: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:17:51.910878 18492 consensus_queue.cc:260] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.871008 18242 catalog_manager.cc:5697] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 4 to 5, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 5 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.914391 18492 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.895354 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:51.839915 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.914736 18242 catalog_manager.cc:5697] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 2 to 3, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:51.915940 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 76108us
I20260709 13:17:51.916610 18384 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:17:51.854545 20376 log.cc:927] Time spent T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:51.909399 20378 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:51.917405 20378 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:51.918040 18486 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:51.918262 20316 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:51.918313 20378 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.919087 20316 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:51.919667 20378 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.916388 18242 catalog_manager.cc:5697] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 4 to 5, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 5 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.914098 19057 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:51.914979 20141 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:51.872403 20361 tablet_copy_client.cc:806] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:51.924823 20361 tablet_copy_client.cc:670] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:51.924566 18242 catalog_manager.cc:5697] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 3 to 4, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.874480 18240 catalog_manager.cc:5697] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.926051 20358 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:51.930593 19055 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.932803 19059 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:51.934460 20337 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.935004 20350 consensus_queue.cc:1059] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:51.935182 20329 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:51.936017 20350 raft_consensus.cc:3055] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:51.936376 20350 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:51.936501 18410 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:51.937855 20359 tablet_copy_client.cc:670] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:51.937320 20350 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.921066 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:51.940773 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.940773 18458 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.943539 18458 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.944893 18242 catalog_manager.cc:5697] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 3 to 4, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.905361 19056 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:51.951495 18492 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:17:51.967447 18242 catalog_manager.cc:5697] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 4 to 5, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 5 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.968915 20361 tablet_copy_client.cc:538] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:51.945291 20337 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.951288 20341 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.972911 18458 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.948711 18384 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:51.978297 19025 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:51.945472 20378 consensus_queue.cc:1059] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:17:51.945412 20358 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:17:51.967897 20382 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.987977 20357 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:51.988006 18417 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:51.993531 19056 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:51.994169 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:51.987473 20334 consensus_queue.cc:1059] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:17:51.994768 20381 consensus_queue.cc:1059] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:51.995021 18242 catalog_manager.cc:5697] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 3 to 4, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.997189 19055 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:52.000739 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:52.001164 20378 raft_consensus.cc:3055] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.001344 20316 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:52.009496 18492 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:17:52.001194 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 52552.6us
I20260709 13:17:52.009851 18492 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:52.010998 18492 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:52.011837 18492 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:52.012854 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.981101 20337 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:52.010048 18412 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.014806 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:52.016219 18340 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:52.016389 18335 raft_consensus.cc:1240] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:52.018049 18339 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:52.018258 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:52.019384 18341 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:52.020624 18342 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:52.021116 18412 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:17:52.024241 18492 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:17:52.031060 20378 raft_consensus.cc:740] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:52.032297 20378 consensus_queue.cc:260] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:52.033813 20378 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.979060 20350 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.976756 20383 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:17:52.124709 18415 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:52.128120 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:52.066045 20357 raft_consensus.cc:697] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:52.130323 18384 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:52.007356 20298 consensus_queue.cc:1059] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.119s
W20260709 13:17:52.132654 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 123750us
I20260709 13:17:52.137369 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:52.070013 20346 consensus_queue.cc:1059] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:17:52.113252 20344 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:17:52.128692 20364 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.129820 20341 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:52.173152 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 159565us
I20260709 13:17:52.137079 20316 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:52.131597 20336 consensus_queue.cc:1059] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:17:52.131400 20353 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:17:52.174360 20364 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:52.186180 20364 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:52.188357 20341 consensus_queue.cc:1059] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:52.154412 20294 consensus_queue.cc:1059] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:17:52.174955 20381 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:17:52.203711 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:52.204070 19058 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:52.203950 19061 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:52.191527 20380 consensus_queue.cc:1059] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:17:52.206763 19055 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:17:52.209718 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:52.210423 20391 consensus_queue.cc:1059] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:52.211932 20336 raft_consensus.cc:3055] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:52.212340 20336 raft_consensus.cc:740] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:52.213243 20336 consensus_queue.cc:260] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:52.217024 20336 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.220995 20361 tablet_bootstrap.cc:492] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:52.223603 18309 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:52.189200 20383 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:17:52.226122 20357 consensus_queue.cc:237] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:52.229589 20316 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.229878 19058 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:17:52.205574 20301 consensus_meta.cc:287] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260709 13:17:52.203065 20298 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:52.264200 19061 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:17:52.262650 20364 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:52.262395 20383 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:52.275038 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 100778us
W20260709 13:17:52.302294 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 163657us
I20260709 13:17:52.303102 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:52.278192 20364 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.266320 20316 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:52.287119 20298 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:52.275172 20358 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:17:52.317524 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.311053 20364 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:52.287214 20383 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:52.296603 20353 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:17:52.322379 20385 log.cc:927] Time spent T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:17:52.314201 20298 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:17:52.362231 20323 consensus_meta.cc:287] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260709 13:17:52.362924 20298 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:52.354331 20359 tablet_copy_client.cc:538] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:52.364495 20383 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:52.366699 20316 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:52.378446 20403 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:17:52.456404 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:52.490196 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 170056us
I20260709 13:17:52.460631 20362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38692 (request call id 515) took 1317 ms. Trace:
I20260709 13:17:52.390322 20400 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:17:52.497254 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 182771us
I20260709 13:17:52.472267 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:38686 (request call id 702) took 2481 ms. Trace:
I20260709 13:17:52.483215 20350 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:17:52.506844 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:52.528203 20357 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:17:52.530133 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:52.530995 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.494570 20364 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:52.550482 20378 raft_consensus.cc:3055] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:52.550953 20378 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:52.551844 20378 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:52.553332 20378 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.566586 18417 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:17:52.581795 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 229304us
I20260709 13:17:52.584370 18339 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:52.571756 20393 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:52.533674 20357 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:17:52.587433 18415 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:52.528936 20403 consensus_queue.cc:1059] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:17:52.611229 18419 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:52.572635 20303 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:52.501045 20400 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:52.621034 18489 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.577390 20316 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:52.631835 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 98936.1us
I20260709 13:17:52.636991 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:17:52.639569 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 53103.6us
I20260709 13:17:52.645471 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:52.637689 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:52.690999 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:52.691905 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:52.692619 18490 raft_consensus.cc:2393] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 2: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:52.693876 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:52.681226 18416 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:17:52.494642 20362 rpcz_store.cc:276] 0709 13:17:51.060020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.060880 (+   860us) service_pool.cc:224] Handling call
0709 13:17:51.190547 (+129667us) ts_tablet_manager.cc:934] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
0709 13:17:51.637499 (+446952us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:51.921536 (+284037us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:51.921654 (+   118us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:52.313069 (+391415us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:52.337939 (+ 24870us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:52.371349 (+ 33410us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:52.377541 (+  6192us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":4979,"tablet-copy.queue_time_us":115591,"thread_start_us":175707,"threads_started":2}
I20260709 13:17:52.650607 20403 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:52.499763 20323 rpcz_store.cc:276] 0709 13:17:49.914492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.919401 (+  4909us) service_pool.cc:224] Handling call
0709 13:17:50.157980 (+238579us) ts_tablet_manager.cc:934] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
0709 13:17:51.550611 (+1392631us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:51.851393 (+300782us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:51.851521 (+   128us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:52.362682 (+511161us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:52.362968 (+   286us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:52.378055 (+ 15087us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:52.379179 (+  1124us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":98768,"tablet-copy.queue_time_us":226488,"thread_start_us":215356,"threads_started":2}
I20260709 13:17:52.701820 20400 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:52.702045 20323 tablet_copy_client.cc:806] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:52.634114 20303 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:52.591406 20393 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:52.697808 18492 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
W20260709 13:17:52.705036 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.727473 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:52.652671 20417 consensus_queue.cc:1059] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:17:52.734097 18492 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:52.735204 18485 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 2: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:52.639815 20316 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:17:52.732640 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 49419.1us
I20260709 13:17:52.715276 20323 tablet_copy_client.cc:670] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:52.745612 20316 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:52.746779 20414 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:52.748562 18489 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:52.739711 20394 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:52.749221 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:52.718118 20362 tablet_copy_client.cc:806] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:52.752120 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:52.766225 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:52.766745 20382 raft_consensus.cc:3055] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:52.767097 19055 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:52.770514 20412 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:52.773233 20337 raft_consensus.cc:3055] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:52.773795 20337 raft_consensus.cc:740] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:52.774930 20337 consensus_queue.cc:260] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:52.775985 20337 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:52.780922 20405 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.405s	user 0.001s	sys 0.000s
I20260709 13:17:52.787384 20346 raft_consensus.cc:3055] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.787869 20346 raft_consensus.cc:740] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:52.762146 18489 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:52.790966 18382 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:52.793601 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:52.717743 20403 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:52.791872 18487 raft_consensus.cc:2393] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:52.715488 20420 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:17:52.795472 20316 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:52.715607 20357 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:52.789543 20364 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:52.792495 20362 tablet_copy_client.cc:670] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:52.798616 20316 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.813252 18489 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:52.790906 20382 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:52.821771 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:52.822635 18339 raft_consensus.cc:2393] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:17:52.808063 20407 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:17:52.834766 18335 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:52.834609 20346 consensus_queue.cc:260] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:52.835933 20346 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.836998 20383 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:52.837616 20383 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:52.840029 20383 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:52.840307 20298 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.847896 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:52.808238 20364 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:52.853192 20409 raft_consensus.cc:3055] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:52.849283 20380 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.850091 20382 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:52.749677 20394 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:52.873041 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 607365us
I20260709 13:17:52.809319 20399 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:17:52.812732 20316 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.879215 20402 raft_consensus.cc:993] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:52.879768 20402 raft_consensus.cc:1081] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:17:52.888415 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:52.889101 18335 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
W20260709 13:17:52.889678 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.892207 18418 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.893417 18414 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34458
I20260709 13:17:52.893966 18414 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.894308 18414 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.894207 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:52.905548 18341 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:52.907114 19055 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:17:52.906800 20380 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:52.905650 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:52.908003 18340 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:52.908267 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:52.908985 18342 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:52.909299 20380 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:52.860481 20389 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:17:52.931128 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 113492us
I20260709 13:17:52.909955 20410 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:52.939216 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.882917 20393 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:52.949864 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:52.853729 20409 raft_consensus.cc:740] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:52.822332 20421 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:17:52.938123 18416 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:52.978732 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 154880us
I20260709 13:17:52.984277 18489 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:52.954092 20403 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:52.998919 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:52.982760 20382 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.981164 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:52.999518 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:53.007730 18342 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:53.009019 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:53.009541 18485 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:53.022378 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:52.990638 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:53.029634 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:52.954296 20410 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.026120 20359 tablet_bootstrap.cc:492] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:53.003260 20329 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.059448 18307 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:53.062242 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:53.025162 20443 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:53.001579 20393 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:17:53.057217 20323 tablet_copy_client.cc:538] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:53.067550 19058 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 3: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:53.081450 18307 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:17:53.090029 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.078807 20399 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:53.070500 20329 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.090453 18307 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:17:53.098821 19053 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:17:53.085990 20321 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.121480 20435 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:53.121491 20434 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.123059 20434 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.132692 20441 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:53.134490 20434 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:53.134714 18490 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:17:53.137001 20429 log.cc:927] Time spent T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
W20260709 13:17:53.139137 20440 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:17:53.141052 20341 raft_consensus.cc:3055] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:53.141472 20341 raft_consensus.cc:740] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:53.146185 20433 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:53.133296 20441 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:53.078640 20422 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.164s
I20260709 13:17:53.150477 18340 raft_consensus.cc:2393] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:17:53.154553 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 58303.9us
I20260709 13:17:53.157262 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:17:53.148558 20419 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.448s	user 0.002s	sys 0.000s
I20260709 13:17:53.109794 20421 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:53.155095 18414 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.172412 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:53.177066 18410 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:17:53.055527 20409 consensus_queue.cc:260] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:53.113133 20394 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.178503 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:53.170678 18307 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:53.166432 20434 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:17:53.186440 18416 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:17:53.187776 20438 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.188952 20410 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:53.073829 20443 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:53.213703 18485 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:17:53.148465 20321 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.216849 18414 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:53.167900 20329 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:53.222824 20391 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.006s	sys 0.026s
I20260709 13:17:53.212869 20421 raft_consensus.cc:697] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:53.227511 20433 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:53.234995 19058 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:53.242733 20383 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:53.242460 20391 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.006s	sys 0.027s
I20260709 13:17:53.219250 20438 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.249818 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:53.259882 20433 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.284497 18418 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:53.220980 20341 consensus_queue.cc:260] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:53.255990 20378 consensus_queue.cc:1059] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:17:53.284808 20358 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:53.304337 20418 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.304884 20418 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:53.310426 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 130175us
I20260709 13:17:53.293087 20433 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:53.320199 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 261398us
I20260709 13:17:53.290050 18487 raft_consensus.cc:3055] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:53.300668 20454 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.287348 20383 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.321373 20391 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:53.320971 20453 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:53.347055 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:53.353194 20422 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:53.360462 18384 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:53.346241 18487 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:53.352488 20321 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:53.335057 20444 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:53.350472 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:53.348762 20383 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:53.389382 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:53.340680 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:53.390352 19059 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
W20260709 13:17:53.358633 20428 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.010s	sys 0.032s
W20260709 13:17:53.390971 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 50448us
I20260709 13:17:53.389380 18486 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
W20260709 13:17:53.392197 20456 log.cc:927] Time spent T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:17:53.392118 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:53.369199 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:53.390364 18384 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:53.357450 20451 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:53.414877 19061 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:53.365108 20141 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:17:53.395032 20298 consensus_meta.cc:287] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.003s
I20260709 13:17:53.431042 19062 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:53.408488 20412 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.419682 20464 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:53.419425 18487 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.351353 20433 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.420138 20452 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.414355 20321 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:17:53.454156 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.454351 20321 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.420650 20461 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:53.421089 20392 raft_consensus.cc:3055] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:53.458628 20392 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:53.459673 20392 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:53.460831 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:53.461170 20392 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.421654 20443 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.417989 20358 consensus_queue.cc:1059] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:17:53.462889 20358 raft_consensus.cc:3055] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:53.463234 20358 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:53.424014 18336 raft_consensus.cc:1240] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:53.463642 20420 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:53.424317 20383 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.464042 20420 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:53.464766 18336 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:53.464885 20420 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:53.466658 20344 raft_consensus.cc:3055] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:53.467088 20344 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:53.467868 20344 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.469039 20344 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.367507 20453 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.472239 20453 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.477365 18340 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:53.477984 18489 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:53.480804 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:53.481482 19053 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
W20260709 13:17:53.425448 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.482525 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:17:53.482940 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.483119 19053 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:17:53.425904 18338 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:53.426288 20446 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:53.322880 20421 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.505400 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:53.391649 20402 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:17:53.438228 20455 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:17:53.546018 18336 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:17:53.439199 20466 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.441851 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:53.442266 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:53.443279 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:53.408926 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:53.449476 20412 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:53.550529 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 107340us
I20260709 13:17:53.550788 18342 raft_consensus.cc:2393] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:17:53.418532 20451 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.452347 18487 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:53.453178 20433 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:53.454071 20452 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:53.397405 20428 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.010s	sys 0.040s
I20260709 13:17:53.454895 20458 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 13:17:53.458216 20337 consensus_meta.cc:287] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.682s	user 0.013s	sys 0.000s
I20260709 13:17:53.485858 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:53.473623 20453 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:53.433405 20441 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.503212 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:53.498407 20446 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.456833 20461 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.361018 20391 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:53.455886 20346 consensus_meta.cc:287] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.620s	user 0.004s	sys 0.008s
I20260709 13:17:53.367221 20422 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.510432 18344 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 2: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:17:53.506863 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:17:53.455801 20316 consensus_meta.cc:287] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 13:17:53.346619 20454 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.542090 20420 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:53.598380 20412 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.542233 20345 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:53.396564 20444 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.547050 19062 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:53.457278 20418 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.562036 20465 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.546954 20298 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:53.568676 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 468796us
I20260709 13:17:53.564157 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:53.557132 20443 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:53.610093 20443 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.609944 20298 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.610471 20443 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.612087 20298 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:53.557390 20451 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:53.551815 20438 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:53.590847 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.464052 20358 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:53.593005 18343 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:17:53.593091 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.619403 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:53.619963 18489 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:53.596391 19053 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:17:53.596614 20411 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:53.597180 20448 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.597301 20428 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.630263 20428 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:53.630755 20441 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:53.631307 20441 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.588410 20301 raft_consensus.cc:3055] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:53.636093 20301 raft_consensus.cc:740] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:53.636948 20452 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:53.590425 20461 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:53.567211 20466 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.584926 20453 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.622776 18382 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:53.623772 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:53.613292 20465 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.629535 20391 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:53.588218 20446 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.601788 20316 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:53.617249 19056 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:53.619868 20438 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:53.640540 20358 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:53.643179 20383 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:53.642405 20321 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.639679 20428 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.637076 20301 consensus_queue.cc:260] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:53.643256 20452 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:53.653280 20452 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.653772 20452 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.651234 20438 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.657058 20441 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:53.605473 20345 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.654783 20465 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.646416 19054 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:53.663056 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:53.625880 20411 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:53.676543 20453 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.678331 20391 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.644994 20448 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:53.687783 20391 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:53.685987 20438 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:53.708091 20454 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.711045 20422 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.712545 20316 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.714579 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:53.715157 18489 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:53.716099 20323 tablet_bootstrap.cc:492] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:53.719962 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:53.721181 18490 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:53.689846 20443 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.722875 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:53.726599 18415 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:53.727908 18457 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:53.744330 20344 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:53.759495 20344 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.759908 20344 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:53.788139 18308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.013s	sys 0.026s
W20260709 13:17:53.788729 18308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.013s	sys 0.026s
I20260709 13:17:53.713646 20448 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.729990 20391 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:53.846760 18382 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:17:53.863344 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 117067us
I20260709 13:17:53.865247 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:53.874680 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.880514 18489 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:53.882231 18382 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:53.886426 20316 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:53.886986 20316 raft_consensus.cc:697] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:53.884950 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:17:53.888832 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.897576 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:17:53.898293 18418 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:53.889374 18419 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:53.878989 20448 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:53.915472 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:53.918605 18419 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:53.920948 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:53.921797 18415 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:17:53.891237 20420 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.895963 20415 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.933097 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:53.935815 18489 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:53.933389 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 318835us
I20260709 13:17:53.887904 20316 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:53.908177 20422 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.904773 20428 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.909121 20448 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:53.937521 18411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.000s	sys 0.063s
W20260709 13:17:53.946183 18411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.000s	sys 0.063s
I20260709 13:17:53.941247 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:53.941061 18418 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:17:53.934451 20462 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.931058 20458 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.911880 20466 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.938975 20444 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:53.947868 20448 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:53.964076 18412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.038s	sys 0.040s
W20260709 13:17:53.980243 18412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.038s	sys 0.040s
I20260709 13:17:53.956934 20441 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.939514 20420 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:54.007495 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.014487 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:54.017624 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.024156 18240 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54880 (request call id 255) took 2177 ms. Trace:
I20260709 13:17:54.032897 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:54.040555 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.033875 18490 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:54.047140 18382 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:54.029651 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:53.970033 20466 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:53.940738 20415 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.047842 19062 raft_consensus.cc:2955] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:53.965349 20345 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:53.953528 20453 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:17:54.062655 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:53.983177 20444 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:17:54.009383 20392 consensus_meta.cc:287] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.000s
I20260709 13:17:54.023985 20321 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.065879 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:17:54.025951 19057 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.021s	sys 0.034s
I20260709 13:17:54.051594 18458 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:53.946807 20422 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:53.964615 20458 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:53.953292 20428 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.043848 20438 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.086949 18489 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:54.018015 20391 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.085150 18485 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:54.014092 20408 raft_consensus.cc:3055] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:17:54.088137 19059 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.039s	sys 0.048s
I20260709 13:17:54.091651 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:54.096294 19059 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.039s	sys 0.048s
I20260709 13:17:54.043241 20411 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:54.050820 20457 raft_consensus.cc:2764] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:54.092849 18309 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:17:54.077670 19057 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.021s	sys 0.034s
I20260709 13:17:54.135174 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:54.136101 19054 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:17:54.075734 20303 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:53.997702 20452 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.151507 19060 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:17:53.998584 20423 raft_consensus.cc:2955] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:17:54.087723 20337 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:54.090056 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:53.986207 20472 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.145s
I20260709 13:17:54.044245 20441 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:54.082370 20382 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:54.031230 18240 rpcz_store.cc:276] 0709 13:17:51.843456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.843618 (+   162us) service_pool.cc:224] Handling call
0709 13:17:51.854095 (+ 10477us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b5400270010. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb80b2 00007f40a4d31a89 00007f40a4cc9da6 00007f40a4c9b088 00007f40a4d9937e 00007f40a325a2a4 00007f40a325a232 00007f40a325a161 00007f40a325a0dc
0709 13:17:54.021282 (+2167187us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:52.167254 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:52.179567 (+ 12313us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:52.179609 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:17:52.179631 (+    22us) tablet.cc:662] Decoding operations
0709 13:17:52.180068 (+   437us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:52.180164 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:52.180202 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:52.180453 (+   251us) tablet.cc:701] Row locks acquired
0709 13:17:52.180484 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:17:52.180717 (+   233us) write_op.cc:270] Start()
0709 13:17:52.180915 (+   198us) write_op.cc:276] Timestamp: P: 1783603072180644 usec, L: 0
0709 13:17:52.180970 (+    55us) op_driver.cc:348] REPLICATION: starting
0709 13:17:52.181855 (+   885us) log.cc:844] Serialized 533 byte log entry
0709 13:17:52.642915 (+461060us) op_driver.cc:464] REPLICATION: finished
0709 13:17:52.937631 (+294716us) write_op.cc:301] APPLY: starting
0709 13:17:52.937726 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:52.937843 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:52.980631 (+ 42788us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:53.003511 (+ 22880us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:53.054673 (+ 51162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:53.063053 (+  8380us) write_op.cc:312] APPLY: finished
0709 13:17:53.077717 (+ 14664us) log.cc:844] Serialized 23 byte log entry
0709 13:17:53.092382 (+ 14665us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:53.101763 (+  9381us) write_op.cc:454] Released schema lock
0709 13:17:53.106648 (+  4885us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:53.146925 (+ 40277us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:53.146959 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2003,"reported_tablets":1,"spinlock_wait_cycles":18703616,"child_traces":[["op",{"apply.queue_time_us":286351,"apply.run_cpu_time_us":2736,"apply.run_wall_time_us":209264,"num_ops":1,"prepare.queue_time_us":202422,"prepare.run_cpu_time_us":3701,"prepare.run_wall_time_us":67139,"replication_time_us":449158,"spinlock_wait_cycles":6272,"thread_start_us":177776,"threads_started":2}]]}
I20260709 13:17:53.964653 20462 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:54.089496 20321 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.095844 20408 raft_consensus.cc:740] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:17:54.153534 20298 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:54.210819 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 163443us
W20260709 13:17:54.210163 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 241446us
I20260709 13:17:54.134605 20438 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.158694 20411 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:54.158887 20378 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:54.067263 20466 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.088271 20451 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.134359 20392 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
W20260709 13:17:54.229070 20446 consensus_meta.cc:287] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.580s	user 0.003s	sys 0.013s
W20260709 13:17:54.232129 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 202576us
I20260709 13:17:54.315651 18384 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:54.080601 20444 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:54.241302 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:54.204262 20346 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:17:54.269414 20468 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 13:17:54.242640 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:54.149847 20391 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:54.342433 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.206842 20402 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.273538 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:54.344012 18418 raft_consensus.cc:2368] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5.
I20260709 13:17:54.272287 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:54.276073 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:54.208967 20471 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.278908 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:54.285905 20415 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:54.233189 20382 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:54.292459 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:17:54.359658 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 88078.1us
I20260709 13:17:54.360015 18413 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:17:54.360572 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:54.362171 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:54.294240 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:54.296229 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:17:54.301565 20475 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:17:54.303712 20482 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:17:54.233249 20141 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:54.269300 20455 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.341372 20458 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:54.292308 20422 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:54.388674 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1733) took 1381 ms. Trace:
I20260709 13:17:54.275604 20411 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:54.183013 20357 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:54.346474 18416 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:17:54.316486 20378 raft_consensus.cc:697] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:54.370332 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:54.368526 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:54.375530 20428 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:54.375867 20462 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:54.376449 20484 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:54.324438 20346 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.345976 20303 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:54.381577 18308 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:54.374370 19058 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:54.396972 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 81425.1us
I20260709 13:17:54.325315 20446 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.422284 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1734) took 1335 ms. Trace:
W20260709 13:17:54.422845 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.403110 20488 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.405124 20498 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:54.389132 18412 rpcz_store.cc:276] 0709 13:17:52.999171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.003718 (+  4547us) service_pool.cc:224] Handling call
0709 13:17:53.004018 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.083456 (+ 79438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.083486 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.085410 (+  1924us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.981203 (+895793us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:54.279667 (+298464us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.279915 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.280012 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.379899 (+ 99887us) raft_consensus.cc:1685] finished
0709 13:17:54.379928 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.380118 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26937,"prepare.queue_time_us":396405,"raft.queue_time_us":252208,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":31408,"thread_start_us":1097830,"threads_started":3,"wal-append.queue_time_us":1047695}
I20260709 13:17:54.396521 20420 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:54.385399 20444 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:54.421101 18308 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:54.446027 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:17:54.418022 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.389376 20141 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:17:54.397346 20411 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:54.377118 19056 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:54.395532 20422 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:54.422883 18411 rpcz_store.cc:276] 0709 13:17:53.087371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.087482 (+   111us) service_pool.cc:224] Handling call
0709 13:17:53.100639 (+ 13157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.231966 (+131327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.232005 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.242083 (+ 10078us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.946578 (+704495us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:53.946619 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.946685 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.422013 (+475328us) raft_consensus.cc:1685] finished
0709 13:17:54.422041 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.422209 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20318,"raft.queue_time_us":137236,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8660,"thread_start_us":795181,"threads_started":2,"wal-append.queue_time_us":822388}
I20260709 13:17:54.451268 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:54.452421 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:54.456830 20486 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:54.410336 20357 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.460388 18410 raft_consensus.cc:2368] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3.
I20260709 13:17:54.463835 20451 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:54.465639 18413 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:54.417979 20392 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:54.466133 18419 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
W20260709 13:17:54.483947 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.445053 20485 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:54.440972 20484 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.350539 20408 consensus_queue.cc:260] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:54.364581 20402 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.372426 20471 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.425117 20303 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.389194 20455 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:54.512305 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 410900us
W20260709 13:17:54.728490 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 636892us
I20260709 13:17:54.668339 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:54.729948 18336 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:17:54.699841 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:54.622990 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 774) took 1079 ms. Trace:
I20260709 13:17:54.732038 19059 rpcz_store.cc:276] 0709 13:17:53.479778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.484100 (+  4322us) service_pool.cc:224] Handling call
0709 13:17:53.501453 (+ 17353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.501676 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:54.096966 (+595290us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.558403 (+461437us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.558460 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:54.558523 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.558594 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.558741 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49591,"prepare.queue_time_us":53127,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":60939,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":39465,"thread_start_us":1004598,"threads_started":2}
I20260709 13:17:54.505991 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:54.731266 18344 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:17:54.740864 20446 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:54.462086 20353 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:17:54.772235 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 493393us
I20260709 13:17:54.476984 20498 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:54.459821 20428 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:54.762421 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:54.762956 20358 consensus_meta.cc:287] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.110s	user 0.009s	sys 0.003s
W20260709 13:17:54.764592 20361 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.257s	user 0.000s	sys 0.000s
I20260709 13:17:54.764998 20321 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:54.772408 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:54.547428 18487 consensus_meta.cc:287] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.976s	user 0.008s	sys 0.004s
W20260709 13:17:54.701126 20495 log.cc:927] Time spent T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:17:54.699942 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:54.785578 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:54.802175 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:54.804096 20448 consensus_meta.cc:287] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.779s	user 0.000s	sys 0.008s
I20260709 13:17:54.702467 20452 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:54.562093 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:54.746311 20391 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:54.503198 20461 consensus_meta.cc:287] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.851s	user 0.003s	sys 0.010s
I20260709 13:17:54.702612 20451 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:54.549306 20441 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:54.624126 20486 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:54.723223 20141 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.653302 20378 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.502735 20422 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:54.828892 18343 raft_consensus.cc:2393] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 3: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:17:55.281503 18308 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:17:55.672739 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 391331us
I20260709 13:17:55.670326 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:54.154284 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:55.666992 18492 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:54.657218 20483 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:17:54.872628 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 75313us
I20260709 13:17:55.678349 18490 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:55.790107 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1701) took 1014 ms. Trace:
I20260709 13:17:55.062729 18242 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42278 (request call id 368) took 3217 ms. Trace:
W20260709 13:17:54.871322 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.791671 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:55.247357 18415 raft_consensus.cc:2368] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5.
W20260709 13:17:55.667030 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 925348us
W20260709 13:17:55.211690 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.790576 18490 rpcz_store.cc:276] 0709 13:17:54.785131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.785287 (+   156us) service_pool.cc:224] Handling call
0709 13:17:55.790022 (+1004735us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:55.679242 18411 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:17:54.766552 20382 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:55.673533 18308 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:54.546893 20501 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:54.771222 20500 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:55.674045 18493 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:17:55.819108 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:55.819443 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1705) took 1024 ms. Trace:
I20260709 13:17:55.794380 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:55.820159 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:54.769079 20484 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:55.796003 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:55.800498 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 126964us
I20260709 13:17:55.153288 20438 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:55.035867 20473 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 1.110s	user 0.003s	sys 0.000s
I20260709 13:17:55.820500 18488 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:54.828492 20323 tablet_bootstrap.cc:700] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent opening tablet: real 0.398s	user 0.001s	sys 0.000s
I20260709 13:17:55.895388 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1754) took 1344 ms. Trace:
I20260709 13:17:55.897096 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 380) took 1133 ms. Trace:
I20260709 13:17:55.897645 18490 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:55.819844 18485 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
W20260709 13:17:55.895881 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 76371.6us
I20260709 13:17:55.923007 18309 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:54.547556 20392 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:55.819837 18493 rpcz_store.cc:276] 0709 13:17:54.794980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.796635 (+  1655us) service_pool.cc:224] Handling call
0709 13:17:55.819383 (+1022748us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51840}
I20260709 13:17:55.819860 20451 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:55.903388 18492 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:55.935985 18343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 375) took 1480 ms (client timeout 1569 ms). Trace:
I20260709 13:17:55.930140 20452 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:55.790779 18242 rpcz_store.cc:276] 0709 13:17:51.845786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.846012 (+   226us) service_pool.cc:224] Handling call
0709 13:17:51.860431 (+ 14419us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b5400270010. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb80b2 00007f40a4d31a89 00007f40a4cc9da6 00007f40a4c9b088 00007f40a4d9937e 00007f40a325a2a4 00007f40a325a232 00007f40a325a161 00007f40a325a0dc
0709 13:17:55.062634 (+3202203us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:52.273747 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:52.347500 (+ 73753us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:52.352761 (+  5261us) write_op.cc:435] Acquired schema lock
0709 13:17:52.354428 (+  1667us) tablet.cc:662] Decoding operations
0709 13:17:52.376465 (+ 22037us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:52.376510 (+    45us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:52.376534 (+    24us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:17:52.377396 (+   862us) tablet.cc:701] Row locks acquired
0709 13:17:52.377419 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:17:52.472461 (+ 95042us) write_op.cc:270] Start()
0709 13:17:52.488059 (+ 15598us) write_op.cc:276] Timestamp: P: 1783603072461460 usec, L: 0
0709 13:17:52.489897 (+  1838us) op_driver.cc:348] REPLICATION: starting
0709 13:17:52.584778 (+ 94881us) log.cc:844] Serialized 2819 byte log entry
0709 13:17:53.561356 (+976578us) op_driver.cc:464] REPLICATION: finished
0709 13:17:53.561694 (+   338us) write_op.cc:301] APPLY: starting
0709 13:17:53.561778 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:53.561995 (+   217us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:53.562101 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:53.562983 (+   882us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:53.563187 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:17:53.563236 (+    49us) write_op.cc:312] APPLY: finished
0709 13:17:53.563504 (+   268us) log.cc:844] Serialized 59 byte log entry
0709 13:17:53.563664 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:53.563785 (+   121us) write_op.cc:454] Released schema lock
0709 13:17:53.563833 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:53.564149 (+   316us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:53.564179 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":463043,"reported_tablets":10,"spinlock_wait_cycles":18513920,"child_traces":[["op",{"apply.queue_time_us":120,"apply.run_cpu_time_us":2430,"apply.run_wall_time_us":2430,"num_ops":7,"prepare.queue_time_us":138825,"prepare.run_cpu_time_us":5357,"prepare.run_wall_time_us":351484,"replication_time_us":1071254}]]}
I20260709 13:17:55.910248 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:55.911756 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:55.912787 18382 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:54.779587 20428 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.919535 18411 rpcz_store.cc:276] 0709 13:17:54.450936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.508073 (+ 57137us) service_pool.cc:224] Handling call
0709 13:17:55.795568 (+1287495us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:55.919930 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:55.900566 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 372) took 1875 ms. Trace:
I20260709 13:17:55.031358 20443 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:55.920126 18341 rpcz_store.cc:276] 0709 13:17:54.667386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.667527 (+   141us) service_pool.cc:224] Handling call
0709 13:17:55.800596 (+1133069us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:55.896345 18415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 392) took 1654 ms (client timeout 1929 ms). Trace:
I20260709 13:17:54.877959 20403 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.730326 20461 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:55.788039 20448 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:56.378564 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.989421 18492 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:56.437281 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:17:56.175987 18310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.258s	user 0.004s	sys 0.050s
I20260709 13:17:56.080992 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1707) took 2658 ms. Trace:
W20260709 13:17:56.438184 18310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.520s	user 0.011s	sys 0.055s
I20260709 13:17:55.937405 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1699) took 1190 ms. Trace:
W20260709 13:17:56.432077 19025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.006s	sys 0.002s
W20260709 13:17:55.841536 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.937748 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:56.444653 18418 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
W20260709 13:17:56.282234 18457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.002s	sys 0.011s
I20260709 13:17:56.445650 18413 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:17:55.820148 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 146654us
I20260709 13:17:56.451646 18339 raft_consensus.cc:2393] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 2: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:17:56.438232 18410 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:17:55.896502 20394 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:55.819756 20397 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:56.455818 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 378) took 1789 ms. Trace:
I20260709 13:17:54.868970 20408 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:55.146127 20479 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.419s	user 0.001s	sys 0.000s
I20260709 13:17:56.446973 18485 rpcz_store.cc:276] 0709 13:17:54.730036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.730157 (+   121us) service_pool.cc:224] Handling call
0709 13:17:55.920655 (+1190498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:54.827912 18487 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:56.482016 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:56.482842 18411 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:17:56.439770 20301 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.795442 20488 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:17:55.936476 18343 rpcz_store.cc:269] 0709 13:17:54.455561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.455729 (+   168us) service_pool.cc:224] Handling call
0709 13:17:55.935734 (+1480005us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b540028dcd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:17:55.935913 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207277440}
W20260709 13:17:56.458901 18457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.006s	sys 0.011s
I20260709 13:17:55.007450 20362 tablet_copy_client.cc:538] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:56.389962 20486 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:55.212332 20344 consensus_meta.cc:287] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 1.452s	user 0.007s	sys 0.006s
I20260709 13:17:55.894785 20483 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:55.061182 20423 consensus_meta.cc:287] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.000s
W20260709 13:17:56.283847 20361 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:17:56.449474 18337 rpcz_store.cc:276] 0709 13:17:53.410958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.411122 (+   164us) service_pool.cc:224] Handling call
0709 13:17:53.421300 (+ 10178us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.421665 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.421693 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.422563 (+   870us) log.cc:844] Serialized 494 byte log entry
0709 13:17:53.865494 (+442931us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:53.865546 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.865683 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:55.034967 (+1169284us) spinlock_profiling.cc:243] Waited 6.88 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:17:55.937369 (+902402us) raft_consensus.cc:1685] finished
0709 13:17:55.937392 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.069657 (+132265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15829888,"thread_start_us":442503,"threads_started":1,"wal-append.queue_time_us":494278}
I20260709 13:17:56.468523 18339 rpcz_store.cc:276] 0709 13:17:54.666699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.666821 (+   122us) service_pool.cc:224] Handling call
0709 13:17:55.937566 (+1270745us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5800002a98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:17:56.455761 (+518195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246265600}
W20260709 13:17:56.516264 19026 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.004s	sys 0.013s
W20260709 13:17:56.516589 19026 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.004s	sys 0.013s
I20260709 13:17:55.908675 20457 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:55.921516 20464 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:56.235081 19057 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.178s	user 0.005s	sys 0.011s
W20260709 13:17:56.393610 20411 consensus_meta.cc:287] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.916s	user 0.011s	sys 0.000s
W20260709 13:17:55.904856 18416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1786) took 2180 ms (client timeout 1556 ms). Trace:
I20260709 13:17:56.555039 20451 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:56.488435 20316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.015s	user 0.002s	sys 0.019s
I20260709 13:17:55.154841 20466 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:54.875932 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:56.555773 20451 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:56.474884 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 1700) took 1692 ms. Trace:
I20260709 13:17:56.558831 19055 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
W20260709 13:17:56.458895 19025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.006s	sys 0.002s
I20260709 13:17:54.966822 20357 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:54.920912 20446 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:55.783306 20420 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:54.918115 20353 raft_consensus.cc:697] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:17:56.201452 20480 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.007s	sys 0.008s
W20260709 13:17:56.175024 20358 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.011s	sys 0.001s
I20260709 13:17:54.808192 20492 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:56.351468 20471 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:56.237736 20303 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:55.919267 20438 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:55.930330 20294 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:56.606117 20294 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:56.606530 20438 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:56.608258 20294 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:56.478158 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:56.608700 20438 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:56.608981 18344 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:56.609346 20508 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.610113 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:56.610718 18344 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:56.611392 20303 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.612082 20303 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:56.478971 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:56.436878 20409 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:56.394693 20392 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:56.614979 20392 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.615623 20392 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:56.479990 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:56.618182 18340 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:17:56.332996 20491 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:56.563771 20420 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.091534 20455 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:17:56.445524 18415 rpcz_store.cc:269] 0709 13:17:54.242229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.242392 (+   163us) service_pool.cc:224] Handling call
0709 13:17:55.896147 (+1653755us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54003ecbd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:17:55.896292 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2089763200}
W20260709 13:17:56.015784 18342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 379) took 1348 ms (client timeout 1564 ms). Trace:
I20260709 13:17:56.457136 20346 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:56.333016 20496 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
I20260709 13:17:56.467159 20410 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:56.467545 20497 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:17:56.488485 18384 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.910s	user 0.003s	sys 0.019s
I20260709 13:17:55.904275 20382 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.904523 20500 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:56.518631 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:56.642386 18384 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.064s	user 0.004s	sys 0.019s
W20260709 13:17:56.620179 20494 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.288s	user 0.000s	sys 0.004s
I20260709 13:17:56.474996 20503 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:56.519410 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:56.519501 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:56.442072 18335 rpcz_store.cc:276] 0709 13:17:53.922590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.922756 (+   166us) service_pool.cc:224] Handling call
0709 13:17:53.923143 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:54.190728 (+267585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:54.190777 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:54.207726 (+ 16949us) log.cc:844] Serialized 26 byte log entry
0709 13:17:54.373714 (+165988us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:54.373777 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.151727 (+777950us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54004182d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:17:55.151791 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:55.218478 (+ 66687us) raft_consensus.cc:1685] finished
0709 13:17:55.218507 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.798025 (+579518us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12185,"raft.queue_time_us":56992,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":31291,"spinlock_wait_cycles":539816704,"thread_start_us":105131,"threads_started":1,"wal-append.queue_time_us":156146}
I20260709 13:17:56.476035 20443 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:56.517496 20483 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:56.547355 20448 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:56.526772 19057 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.470s	user 0.006s	sys 0.012s
I20260709 13:17:56.548833 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 1784) took 2997 ms. Trace:
I20260709 13:17:56.550122 20411 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:56.521253 20457 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:55.481731 20498 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:56.505051 20488 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:56.513633 18487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1720) took 3277 ms (client timeout 2290 ms). Trace:
I20260709 13:17:56.514602 20344 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:54.817600 20485 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:55.937505 20501 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:56.635998 18342 rpcz_store.cc:269] 0709 13:17:54.667037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.699621 (+ 32584us) service_pool.cc:224] Handling call
0709 13:17:55.935390 (+1235769us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.463296 20403 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:56.554994 18416 rpcz_store.cc:269] 0709 13:17:53.614137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.614977 (+   840us) service_pool.cc:224] Handling call
0709 13:17:54.740545 (+1125568us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b5400234e54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:17:55.794366 (+1053821us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1450003712}
W20260709 13:17:56.274911 19058 consensus_meta.cc:287] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.829s	user 0.009s	sys 0.006s
I20260709 13:17:56.488009 20504 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:56.517851 20486 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:56.564842 19025 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.564s (SENT) [suppressed 2 similar messages]
I20260709 13:17:56.517370 20422 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:17:56.560483 18456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.000s	sys 0.035s
W20260709 13:17:56.560139 20316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.086s	user 0.002s	sys 0.019s
I20260709 13:17:56.558796 18489 rpcz_store.cc:276] 0709 13:17:54.774955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.775113 (+   158us) service_pool.cc:224] Handling call
0709 13:17:55.283820 (+508707us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b5800143198. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7e9c 00007f409bdb7a5b 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:17:55.284081 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.082243 (+798162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.082289 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.082345 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:56.082387 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.467171 (+384784us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b5400122d54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:17:56.467226 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.467366 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853415680}
I20260709 13:17:56.518501 20402 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:56.559566 19055 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 539) took 3612 ms (client timeout 1552 ms). Trace:
I20260709 13:17:56.589099 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:56.471650 20394 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:56.464622 20452 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:56.520476 20464 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.745052 20486 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:56.608419 20408 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.610530 20514 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:17:56.583016 20358 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.296s	user 0.011s	sys 0.004s
I20260709 13:17:56.456884 20428 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:56.583474 20480 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.337s	user 0.008s	sys 0.009s
I20260709 13:17:56.441453 20341 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:56.630069 18340 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:56.574880 20466 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:56.588265 20412 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:56.631965 18309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.009s	sys 0.020s
W20260709 13:17:56.843367 18309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.010s	sys 0.021s
W20260709 13:17:56.843693 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 893320us
I20260709 13:17:56.584089 20357 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:17:56.642891 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 2.06457e+06us
I20260709 13:17:56.619236 20471 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.814862 20392 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:56.641197 19027 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:56.622834 20491 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.632392 20420 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:56.576128 20451 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:56.656051 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 743293us
I20260709 13:17:56.573972 20446 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:56.657291 18414 rpcz_store.cc:276] 0709 13:17:53.551455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.551643 (+   188us) service_pool.cc:224] Handling call
0709 13:17:53.552005 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.552409 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.552448 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.567531 (+ 15083us) log.cc:844] Serialized 26 byte log entry
0709 13:17:54.078013 (+510482us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:54.078051 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.078112 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.548595 (+2470483us) raft_consensus.cc:1685] finished
0709 13:17:56.548615 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.548748 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2093,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":13983,"thread_start_us":487279,"threads_started":1,"wal-append.queue_time_us":693637}
I20260709 13:17:56.683624 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:56.688529 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:56.609815 20508 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:56.637562 20421 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:56.696427 18308 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:56.657310 20346 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.704470 18344 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:17:56.586997 20353 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:56.727443 18307 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.013s	sys 0.025s
I20260709 13:17:56.730073 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1728) took 3915 ms. Trace:
W20260709 13:17:56.731243 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 98600us
W20260709 13:17:56.738477 18458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.016s	sys 0.015s
I20260709 13:17:56.739543 18491 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:17:56.703190 20400 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:17:56.745471 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 180667us
I20260709 13:17:56.653275 20382 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:56.753685 18456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.000s	sys 0.035s
I20260709 13:17:56.595270 20492 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:56.705260 20517 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.653159 20443 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:56.709740 20448 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:56.657977 20410 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:56.714540 20423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55634 (request call id 88) took 6022 ms. Trace:
I20260709 13:17:56.780107 20141 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.727612 20294 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.737351 20301 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.485996 20397 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:56.738519 19058 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:56.759809 20303 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:56.766601 20528 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:56.836566 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.653774 20497 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:56.838884 20519 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:17:56.820115 20524 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:56.652976 20503 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:56.834240 20361 tablet_bootstrap.cc:492] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:56.815865 20402 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:17:56.855676 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.622399 20391 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:56.857975 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 216862us
W20260709 13:17:56.702343 18487 rpcz_store.cc:269] 0709 13:17:53.210280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.212963 (+  2683us) service_pool.cc:224] Handling call
0709 13:17:56.487897 (+3274934us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.754026 20504 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:57.117003 18307 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.315s	user 0.013s	sys 0.034s
W20260709 13:17:57.117671 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 1.44203e+06us
I20260709 13:17:57.239395 18343 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:57.219548 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:56.830806 20464 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:56.923589 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.834695 20486 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:57.201035 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 84142.4us
I20260709 13:17:57.264114 19027 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:57.265403 19027 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:57.247112 19061 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.250603 19054 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:57.250769 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 486863us
I20260709 13:17:56.820339 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 382) took 2145 ms. Trace:
I20260709 13:17:57.143371 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:17:57.255582 18458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.465s	user 0.029s	sys 0.046s
W20260709 13:17:57.273705 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 1.48322e+06us
I20260709 13:17:57.117228 18417 rpcz_store.cc:276] 0709 13:17:52.814593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.814989 (+   396us) service_pool.cc:224] Handling call
0709 13:17:52.815245 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.815612 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.815633 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:52.821049 (+  5416us) log.cc:844] Serialized 26 byte log entry
0709 13:17:54.229764 (+1408715us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b1800245920. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:17:55.670782 (+1441018us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:55.670825 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.670893 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.467958 (+797065us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:17:56.729745 (+261787us) raft_consensus.cc:1685] finished
0709 13:17:56.729776 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.729988 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1107,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":7816,"spinlock_wait_cycles":114115712,"thread_start_us":307150,"threads_started":1,"wal-append.queue_time_us":3442455}
I20260709 13:17:57.269421 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:57.272503 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:57.273736 19062 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:17:57.265413 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:17:57.254698 18382 connection.cc:256] RPC call timeout handler was delayed by -2.2906141140001637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
I20260709 13:17:57.275918 19060 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
W20260709 13:17:57.274919 18384 connection.cc:256] RPC call timeout handler was delayed by -1.6769389680000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 13:17:57.276973 18382 connection.cc:256] RPC call timeout handler was delayed by -1.9771614630001295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.229s for a response
W20260709 13:17:57.280067 18384 connection.cc:256] RPC call timeout handler was delayed by -1.6769389680000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 13:17:57.280429 18384 connection.cc:256] RPC call timeout handler was delayed by -1.519925750000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260709 13:17:56.981122 20530 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:17:57.280587 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:17:57.280820 18384 connection.cc:256] RPC call timeout handler was delayed by -1.501705837000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260709 13:17:57.287566 18384 connection.cc:256] RPC call timeout handler was delayed by -1.2605058369999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 13:17:56.968650 20535 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:17:57.288160 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:57.289942 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:57.290416 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:56.846063 20411 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:56.953614 20532 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.287030 19026 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:17:57.239197 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:57.330657 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:17:56.845283 20514 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:56.977444 18486 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:17:56.836971 20408 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:57.332598 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:56.964084 20512 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.218091 20344 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:57.306100 20480 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:57.374958 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:57.263918 20346 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:56.862643 20422 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:57.377732 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 89630.7us
I20260709 13:17:57.462677 20422 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:57.463248 20422 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:57.279815 20316 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:57.467249 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:57.283649 20303 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:57.259142 20520 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.271473 19058 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 550) took 3214 ms (client timeout 2128 ms). Trace:
W20260709 13:17:57.332053 20483 consensus_meta.cc:287] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.670s	user 0.012s	sys 0.000s
I20260709 13:17:56.863248 20491 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:56.911772 20471 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:57.279834 20378 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:17:57.394320 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 107340us
I20260709 13:17:56.864638 20357 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:57.373526 20525 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:56.815990 19055 rpcz_store.cc:269] 0709 13:17:52.947576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.952949 (+  5373us) service_pool.cc:224] Handling call
0709 13:17:54.875711 (+1922762us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:17:56.559469 (+1683758us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3139328}
I20260709 13:17:56.982641 20501 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:57.133037 20402 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:57.272940 20403 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:57.259729 20301 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:56.979674 20485 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:57.246055 20141 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:57.442471 18485 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
W20260709 13:17:57.415338 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 718980us
W20260709 13:17:57.415217 18382 connection.cc:256] RPC call timeout handler was delayed by -1.0041717919998518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
I20260709 13:17:57.598237 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:57.258894 20391 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:57.468174 18413 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:57.246429 20448 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:56.863925 20466 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:57.471465 19061 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:17:57.611925 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:57.473083 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:57.467869 18419 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
W20260709 13:17:57.621542 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 148515us
I20260709 13:17:57.270747 20400 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:56.863529 20412 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:57.336758 20421 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:57.507506 18488 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.270923 20294 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:57.532296 20514 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:57.402052 20394 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:57.386786 20411 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:57.478324 20361 tablet_bootstrap.cc:492] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:17:57.466308 20529 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:57.556564 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 1704) took 2740 ms. Trace:
I20260709 13:17:57.571596 20378 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:57.466297 20316 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:57.477885 20303 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.442270 20480 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.283063 20523 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:57.259385 20524 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:57.479574 20452 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:57.509907 20488 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:57.593192 18337 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:57.609896 18417 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:17:57.612061 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:57.403117 20455 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.640280 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:57.641783 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:57.610850 18382 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:17:57.402065 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 110968us
I20260709 13:17:57.259032 20528 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:57.541334 20344 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:17:57.569926 20418 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:57.682047 20397 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:57.619612 20403 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.687719 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:57.688261 20361 ts_tablet_manager.cc:1403] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 5.468s	user 0.047s	sys 0.039s
I20260709 13:17:57.688388 20471 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:57.692245 18490 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:17:57.505432 20512 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:57.704879 20382 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:57.710237 20378 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:58.327950 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.619828 20525 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:57.923615 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:57.697842 18484 rpcz_store.cc:276] 0709 13:17:54.794645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.794777 (+   132us) service_pool.cc:224] Handling call
0709 13:17:54.876770 (+ 81993us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:54.877162 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:54.877200 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.901237 (+1024037us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.583480 (+682243us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:56.583529 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.584647 (+  1118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.535122 (+950475us) raft_consensus.cc:1685] finished
0709 13:17:57.535141 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.535284 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":270269,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"thread_start_us":493010,"threads_started":1,"wal-append.queue_time_us":630984}
I20260709 13:17:57.557056 20483 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:57.541759 20520 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:57.137862 20517 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:57.691187 20412 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:57.858263 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.403477 20532 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:58.067766 18488 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:57.711946 20464 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:57.698170 20411 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:57.997974 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:57.746594 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:17:58.761474 18485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 379) took 1461 ms (client timeout 1564 ms). Trace:
W20260709 13:17:58.442040 18458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.064s	sys 0.132s
I20260709 13:17:58.349247 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:17:58.742712 18411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.927s	user 0.008s	sys 0.010s
W20260709 13:17:57.514199 19058 rpcz_store.cc:269] 0709 13:17:54.045279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.051992 (+  6713us) service_pool.cc:224] Handling call
0709 13:17:54.294071 (+242079us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:17:57.259542 (+2965471us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19158912}
W20260709 13:17:58.760685 18490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1736) took 1481 ms (client timeout 1539 ms). Trace:
W20260709 13:17:58.777410 18490 rpcz_store.cc:269] 0709 13:17:57.279643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.280342 (+   699us) service_pool.cc:224] Handling call
0709 13:17:58.760577 (+1480235us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:58.766969 18384 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.127s	user 0.008s	sys 0.011s
W20260709 13:17:58.762573 18458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.387s	user 0.070s	sys 0.137s
W20260709 13:17:58.779281 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 1.48726e+06us
I20260709 13:17:58.780508 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:58.780912 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:17:58.781491 18344 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.761307 18336 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:17:58.782246 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1754) took 1035 ms. Trace:
W20260709 13:17:58.301563 20484 consensus_meta.cc:287] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.829s	user 0.009s	sys 0.005s
W20260709 13:17:58.635663 18307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.382s	user 0.009s	sys 0.010s
I20260709 13:17:57.714550 20511 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.218735 20423 rpcz_store.cc:276] 0709 13:17:50.691586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.698260 (+  6674us) service_pool.cc:224] Handling call
0709 13:17:50.729983 (+ 31723us) log.cc:844] Serialized 494 byte log entry
0709 13:17:56.714219 (+5984236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13753,"raft.run_cpu_time_us":1107,"raft.run_wall_time_us":1107,"thread_start_us":87422,"threads_started":1,"wal-append.queue_time_us":203290,"wal-append.run_cpu_time_us":2244,"wal-append.run_wall_time_us":1009192}
W20260709 13:17:58.767436 18411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.952s	user 0.011s	sys 0.011s
W20260709 13:17:58.769829 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 1.15899e+06us
W20260709 13:17:58.363073 18491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1703) took 3577 ms (client timeout 2168 ms). Trace:
I20260709 13:17:58.762025 18335 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.437829 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:58.566895 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:58.725965 18308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.015s	sys 0.026s
W20260709 13:17:58.762037 18485 rpcz_store.cc:269] 0709 13:17:57.299794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.648449 (+348655us) service_pool.cc:224] Handling call
0709 13:17:58.761416 (+1112967us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:58.760915 18419 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
W20260709 13:17:58.768481 19059 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.397s	user 0.006s	sys 0.004s
I20260709 13:17:57.273247 18338 rpcz_store.cc:276] 0709 13:17:54.674777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.702717 (+ 27940us) service_pool.cc:224] Handling call
0709 13:17:55.936735 (+1234018us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5800002a98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:17:55.936944 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.937159 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:56.589846 (+652687us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.732809 (+142963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.737259 (+  4450us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:56.754368 (+ 17109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.761227 (+  6859us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.818120 (+ 56893us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1049690,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":73691,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":283489664,"thread_start_us":557755,"threads_started":2,"wal-append.queue_time_us":237634}
I20260709 13:17:57.698091 20527 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:17:58.336254 19054 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.064s	user 0.007s	sys 0.002s
I20260709 13:17:57.698403 20529 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:57.703845 20357 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:58.782711 18336 rpcz_store.cc:276] 0709 13:17:57.746806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.748088 (+  1282us) service_pool.cc:224] Handling call
0709 13:17:58.782170 (+1034082us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:58.883796 18343 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:17:58.898248 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 415) took 1299 ms. Trace:
W20260709 13:17:58.898831 18410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.011s	sys 0.002s
I20260709 13:17:58.865692 18492 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
W20260709 13:17:58.899255 18410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.011s	sys 0.002s
W20260709 13:17:58.899803 19059 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.569s	user 0.006s	sys 0.008s
I20260709 13:17:58.900038 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1756) took 2249 ms. Trace:
W20260709 13:17:58.799333 19027 connection.cc:256] RPC call timeout handler was delayed by -3.3443205570001737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:17:58.900676 18491 rpcz_store.cc:269] 0709 13:17:54.785887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.786053 (+   166us) service_pool.cc:224] Handling call
0709 13:17:58.362802 (+3576749us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540021a2d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:17:58.362979 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2449962752}
I20260709 13:17:58.854251 18340 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 3. Ops: []
I20260709 13:17:58.333746 20362 tablet_bootstrap.cc:492] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:17:58.360407 20364 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:17:58.305364 20428 consensus_meta.cc:287] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.447s	user 0.008s	sys 0.000s
I20260709 13:17:58.294404 20402 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:57.705614 20303 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:58.232506 20537 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.704s	user 0.001s	sys 0.000s
W20260709 13:17:58.061784 20539 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.421s	user 0.000s	sys 0.000s
W20260709 13:17:58.235298 20341 consensus_meta.cc:287] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.380s	user 0.012s	sys 0.000s
W20260709 13:17:58.907426 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.170229 20526 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:58.905092 19054 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:58.957255 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 786) took 1707 ms. Trace:
W20260709 13:17:58.868202 19026 leader_election.cc:336] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.747s (SENT)
W20260709 13:17:58.897694 18307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.644s	user 0.014s	sys 0.012s
I20260709 13:17:58.957724 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 783) took 1736 ms. Trace:
I20260709 13:17:58.957626 19054 rpcz_store.cc:276] 0709 13:17:57.250029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.250189 (+   160us) service_pool.cc:224] Handling call
0709 13:17:57.250485 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.956982 (+1706497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.957195 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:58.906626 18459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.531s	user 0.003s	sys 0.010s
W20260709 13:17:58.902926 18308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.305s	user 0.020s	sys 0.026s
I20260709 13:17:58.866240 18489 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:17:58.897202 19060 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.514s	user 0.000s	sys 0.015s
W20260709 13:17:58.901432 19027 connection.cc:256] RPC call timeout handler was delayed by -1.5679382540001825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
W20260709 13:17:58.898393 18419 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 417) took 1287 ms (client timeout 1510 ms). Trace:
W20260709 13:17:58.902459 18484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 383) took 1601 ms (client timeout 1803 ms). Trace:
W20260709 13:17:58.898433 18384 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.258s	user 0.016s	sys 0.021s
I20260709 13:17:58.910192 18417 rpcz_store.cc:276] 0709 13:17:57.598471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.437519 (+839048us) service_pool.cc:224] Handling call
0709 13:17:58.898191 (+460672us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:58.292088 20540 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.543s	user 0.000s	sys 0.000s
W20260709 13:17:58.193871 20533 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.522s	user 0.000s	sys 0.001s
I20260709 13:17:58.897535 18382 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:17:58.655658 20491 consensus_meta.cc:287] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.086s	user 0.007s	sys 0.002s
I20260709 13:17:58.799333 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:59.061514 18490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 380) took 1761 ms (client timeout 1910 ms). Trace:
W20260709 13:17:58.913085 18309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.375s	user 0.004s	sys 0.010s
W20260709 13:17:59.062129 18309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.524s	user 0.004s	sys 0.011s
W20260709 13:17:59.061949 18490 rpcz_store.cc:269] 0709 13:17:57.300161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.799054 (+1498893us) service_pool.cc:224] Handling call
0709 13:17:59.061455 (+262401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.058831 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:59.063907 18417 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:17:59.064424 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 410) took 1467 ms. Trace:
I20260709 13:17:59.065169 18417 rpcz_store.cc:276] 0709 13:17:57.597047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.058564 (+1461517us) service_pool.cc:224] Handling call
0709 13:17:59.064365 (+  5801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:58.912851 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:58.900431 18411 rpcz_store.cc:276] 0709 13:17:56.650413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.651303 (+   890us) service_pool.cc:224] Handling call
0709 13:17:56.684836 (+ 33533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.684997 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:56.772916 (+ 87919us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.899723 (+2126807us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.899772 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:58.899813 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.899874 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.899977 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":588261,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":5494,"thread_start_us":2115248,"threads_started":2,"wal-append.queue_time_us":2031622}
I20260709 13:17:58.361836 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1733) took 1109 ms. Trace:
I20260709 13:17:57.691627 20497 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:58.422472 20421 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:58.456058 20345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.000s	sys 0.014s
W20260709 13:17:58.925832 19025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.554s	user 0.000s	sys 0.018s
I20260709 13:17:58.451361 20488 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:58.210649 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:58.430198 20141 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:57.715798 20480 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:57.718791 20485 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:58.777716 20418 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.682968 20408 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:58.679718 20466 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:58.940092 18344 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:59.129292 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1755) took 1382 ms. Trace:
I20260709 13:17:58.243223 20346 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:57.748730 20422 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:57.818747 20410 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:57.745970 20443 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:57.925572 20400 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:17:58.901600 20498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.195s	user 0.006s	sys 0.006s
I20260709 13:17:58.035466 20508 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:58.905630 20420 consensus_meta.cc:287] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.634s	user 0.005s	sys 0.007s
I20260709 13:17:57.716328 20503 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:58.770466 20316 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:58.171101 20492 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:58.828576 20452 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:59.153988 20420 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:59.154605 20452 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:59.155016 20452 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:59.155216 18339 raft_consensus.cc:2368] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4.
I20260709 13:17:59.156049 20420 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:58.945840 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:57.746130 20536 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:59.158358 18485 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 3: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:17:58.899830 20529 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:58.949235 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:58.847141 20382 raft_consensus.cc:2764] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:17:58.958649 18459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.583s	user 0.004s	sys 0.010s
I20260709 13:17:58.944911 20364 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:58.958230 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 1.70505e+06us
I20260709 13:17:58.781468 20403 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:58.958798 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 1.36096e+06us
I20260709 13:17:58.772290 20455 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:58.958140 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:17:58.933399 20392 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:57.749537 20523 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:58.953214 20513 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.315s	user 0.039s	sys 0.061s
W20260709 13:17:59.181232 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.158291 20536 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:58.951864 20550 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.918259 20484 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:59.039407 18484 rpcz_store.cc:269] 0709 13:17:57.301001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.437757 (+1136756us) service_pool.cc:224] Handling call
0709 13:17:58.902403 (+464646us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.040832 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:17:59.046325 19060 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.663s	user 0.000s	sys 0.021s
I20260709 13:17:58.992043 20402 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.988044 20499 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.942963 20428 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:59.025262 20486 consensus_meta.cc:287] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.742s	user 0.012s	sys 0.001s
W20260709 13:17:59.071039 18491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 378) took 1792 ms (client timeout 1991 ms). Trace:
W20260709 13:17:59.348064 18491 rpcz_store.cc:269] 0709 13:17:57.278882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.912580 (+1633698us) service_pool.cc:224] Handling call
0709 13:17:59.070956 (+158376us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.061630 18384 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:17:59.081099 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:59.349310 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 287725us
I20260709 13:17:59.088330 18335 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
W20260709 13:17:59.350265 18335 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1752) took 1604 ms (client timeout 2126 ms). Trace:
W20260709 13:17:59.350696 18335 rpcz_store.cc:269] 0709 13:17:57.746218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.746353 (+   135us) service_pool.cc:224] Handling call
0709 13:17:59.350184 (+1603831us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:59.351182 18384 leader_election.cc:336] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 1.552s (SENT)
I20260709 13:17:59.351879 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.009225 20549 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:17:59.038766 18419 rpcz_store.cc:269] 0709 13:17:57.610514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.641482 (+ 30968us) service_pool.cc:224] Handling call
0709 13:17:58.898326 (+1256844us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.091671 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:58.943230 20527 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:58.942521 20511 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:59.023684 20344 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:59.068773 20433 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.091717 20345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.635s	user 0.002s	sys 0.020s
I20260709 13:17:59.374476 20433 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:59.377276 20433 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:59.047432 20555 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:59.059127 20397 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:59.059870 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.068457 20378 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:59.127516 20552 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:59.128253 20567 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:17:59.385965 18414 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
I20260709 13:17:59.058604 20548 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:17:59.146775 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.146459 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 248982us
I20260709 13:17:59.143518 18309 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:17:59.388506 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 245063us
I20260709 13:17:59.388648 20358 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:59.389240 20358 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.389312 18309 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:17:59.390125 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.103261 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:59.123744 20418 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:59.117805 20488 raft_consensus.cc:697] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:59.129671 18344 rpcz_store.cc:276] 0709 13:17:57.747061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.780678 (+1033617us) service_pool.cc:224] Handling call
0709 13:17:59.129234 (+348556us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.157651 20524 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:59.158843 18485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 381) took 1858 ms (client timeout 2003 ms). Trace:
W20260709 13:17:59.417997 18485 rpcz_store.cc:269] 0709 13:17:57.300447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.912081 (+1611634us) service_pool.cc:224] Handling call
0709 13:17:59.158788 (+246707us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.148962 18416 raft_consensus.cc:2368] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5.
I20260709 13:17:59.161166 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1757) took 1237 ms. Trace:
I20260709 13:17:59.421515 18336 rpcz_store.cc:276] 0709 13:17:57.923691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.933117 (+1009426us) service_pool.cc:224] Handling call
0709 13:17:59.161088 (+227971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.124688 20485 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:58.990887 20526 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:59.094812 20558 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:59.083055 20491 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:59.158823 20483 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:59.140745 20517 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:17:59.219341 20513 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.600s	user 0.039s	sys 0.061s
W20260709 13:17:59.288949 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 66018.2us
I20260709 13:17:59.289364 19054 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:59.268074 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 45354.1us
W20260709 13:17:59.444555 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 62293.4us
I20260709 13:17:59.450723 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:59.171711 20448 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:59.169725 20301 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:59.337651 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 469414us
I20260709 13:17:59.288717 20392 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:59.342511 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:59.342787 20512 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:59.343564 20364 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:59.344167 20402 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:59.150310 20464 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:59.226583 20532 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:59.349367 18490 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
W20260709 13:17:59.091854 19025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.720s	user 0.000s	sys 0.019s
I20260709 13:17:59.499943 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:59.355031 20566 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:59.500675 18485 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:17:59.355288 20341 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:59.355844 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:59.357899 19061 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
W20260709 13:17:59.499933 18490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 382) took 2199 ms (client timeout 2279 ms). Trace:
I20260709 13:17:59.502156 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:17:59.502110 18490 rpcz_store.cc:269] 0709 13:17:57.300739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.080811 (+1780072us) service_pool.cc:224] Handling call
0709 13:17:59.499871 (+419060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.502910 18491 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:17:59.359032 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 133545us
I20260709 13:17:59.503165 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1750) took 5032 ms. Trace:
W20260709 13:17:59.503566 18457 connection.cc:256] RPC call timeout handler was delayed by -2.11897723900006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.231s for a response
I20260709 13:17:59.364560 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 414) took 1766 ms. Trace:
I20260709 13:17:59.503507 18412 rpcz_store.cc:276] 0709 13:17:54.449823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.452856 (+  3033us) service_pool.cc:224] Handling call
0709 13:17:54.453158 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.754830 (+2301672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.754864 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.754909 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:56.754943 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.481540 (+2726597us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b5400362ed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:17:59.481605 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.481755 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5292853504}
I20260709 13:17:59.504297 18419 rpcz_store.cc:276] 0709 13:17:57.598208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.363527 (+1765319us) service_pool.cc:224] Handling call
0709 13:17:59.363912 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.364127 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.364180 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.364236 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:59.364290 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.364362 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.364491 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.505895 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1762) took 1895 ms. Trace:
I20260709 13:17:59.506215 18419 rpcz_store.cc:276] 0709 13:17:57.610365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.505190 (+1894825us) service_pool.cc:224] Handling call
0709 13:17:59.505443 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.505606 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.505629 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.505683 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:59.505715 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.505764 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.505849 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.507184 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:59.507954 18419 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:17:59.344218 20554 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
W20260709 13:17:59.365929 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.370915 20523 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:17:59.374634 20562 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.419s	user 0.000s	sys 0.001s
I20260709 13:17:59.382109 18341 raft_consensus.cc:2368] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3.
I20260709 13:17:59.099702 20497 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:59.387737 18382 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:59.345073 20499 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:59.407904 20378 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:59.411763 20553 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:59.412034 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1759) took 1178 ms. Trace:
I20260709 13:17:59.420336 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.543916 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1760) took 1299 ms. Trace:
I20260709 13:17:59.544369 18344 rpcz_store.cc:276] 0709 13:17:58.244649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.419993 (+1175344us) service_pool.cc:224] Handling call
0709 13:17:59.543848 (+123855us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.384666 20525 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:59.510991 20512 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:59.358476 20486 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:17:59.439689 18458 connection.cc:256] RPC call timeout handler was delayed by -3.2154515750000883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
I20260709 13:17:59.414597 20433 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:59.159005 20498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.456s	user 0.007s	sys 0.007s
I20260709 13:17:59.379863 20344 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:59.413017 20411 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:59.462481 20572 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:17:59.468094 18307 connection.cc:256] RPC call timeout handler was delayed by -3.9142079749999539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
I20260709 13:17:59.474054 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.435982 20526 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.068928 18487 rpcz_store.cc:276] 0709 13:17:57.252069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.259373 (+  7304us) service_pool.cc:224] Handling call
0709 13:17:57.371731 (+112358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.873585 (+501854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.361321 (+487736us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.361388 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:58.361435 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.361509 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.361769 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28479,"raft.queue_time_us":1032662,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":53016,"thread_start_us":195779,"threads_started":1}
I20260709 13:17:59.476529 18342 raft_consensus.cc:2368] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:17:59.473328 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 390) took 1035 ms. Trace:
W20260709 13:17:59.480111 20571 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 13:17:59.623589 18484 rpcz_store.cc:276] 0709 13:17:58.437772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.342214 (+904442us) service_pool.cc:224] Handling call
0709 13:17:59.473252 (+131038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.408538 20397 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:59.480891 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:59.442287 20409 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:59.352830 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1762) took 1026 ms. Trace:
I20260709 13:17:59.627250 18335 rpcz_store.cc:276] 0709 13:17:58.326261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.351530 (+1025269us) service_pool.cc:224] Handling call
0709 13:17:59.352752 (+  1222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.510485 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 386) took 1482 ms. Trace:
I20260709 13:17:59.627987 18491 rpcz_store.cc:276] 0709 13:17:58.028404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.501935 (+1473531us) service_pool.cc:224] Handling call
0709 13:17:59.510428 (+  8493us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:59.442512 18416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 416) took 1832 ms (client timeout 1929 ms). Trace:
I20260709 13:17:59.508827 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:59.500644 19054 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:59.519129 20461 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:59.543371 18338 rpcz_store.cc:276] 0709 13:17:58.233628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.954399 (+720771us) service_pool.cc:224] Handling call
0709 13:17:59.411964 (+457565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.412508 20567 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:59.509428 20341 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:17:59.524386 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:59.528432 18457 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:59.616202 20484 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:59.638402 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 110062us
W20260709 13:17:59.638830 20506 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 2.754s	user 0.011s	sys 0.003s
I20260709 13:17:59.640039 19057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 765) took 7056 ms. Trace:
I20260709 13:17:59.457630 20528 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:59.542778 20517 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:17:59.622576 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:59.463286 20520 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:17:59.540086 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 152439us
I20260709 13:17:59.358664 20550 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:59.421765 20548 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:59.533164 20346 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.389786 20358 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:59.421149 20552 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:59.548388 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 1791) took 2084 ms. Trace:
W20260709 13:17:59.553309 18458 connection.cc:256] RPC call timeout handler was delayed by -3.1101515750001454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
I20260709 13:17:59.550917 20553 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:59.533352 20497 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.612618 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1713) took 2374 ms. Trace:
I20260709 13:17:59.458009 20558 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:59.387346 20555 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:59.611534 20561 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 13:17:59.616190 18339 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1749) took 3155 ms (client timeout 1634 ms). Trace:
W20260709 13:17:59.704526 18339 rpcz_store.cc:269] 0709 13:17:56.460404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.519085 (+ 58681us) service_pool.cc:224] Handling call
0709 13:17:59.556374 (+3037289us) spinlock_profiling.cc:243] Waited 2.51 s on lock 0x7b5400401d54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:17:59.613761 (+ 57387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5775495040}
I20260709 13:17:59.548362 20523 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:59.620935 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1761) took 1295 ms. Trace:
I20260709 13:17:59.708591 18336 rpcz_store.cc:276] 0709 13:17:58.325898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.423965 (+1098067us) service_pool.cc:224] Handling call
0709 13:17:59.620867 (+196902us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.709156 18493 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:17:59.621230 18307 connection.cc:256] RPC call timeout handler was delayed by -2.7850199849999626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 13:17:59.555850 20433 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.551937 20402 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:59.520701 20488 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:59.365056 20549 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:59.634547 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.716301 18335 raft_consensus.cc:2368] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4.
I20260709 13:17:59.635425 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:59.645006 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 389) took 1410 ms. Trace:
I20260709 13:17:59.717535 18485 rpcz_store.cc:276] 0709 13:17:58.235029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.644293 (+1409264us) service_pool.cc:224] Handling call
0709 13:17:59.644553 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.644727 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.644751 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.644795 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:59.644825 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.644874 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.644958 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:59.532282 19025 connection.cc:256] RPC call timeout handler was delayed by -1.8617585749998398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 13:17:59.645886 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.623122 20428 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:59.633406 20485 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:59.723973 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:59.647342 20572 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:17:59.612111 20512 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:59.642271 20341 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:59.659567 18382 connection.cc:256] RPC call timeout handler was delayed by -1.0166867719999573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 13:17:59.713227 20433 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.633298 20511 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:59.554077 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.621529 20452 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:59.667630 18418 rpcz_store.cc:276] 0709 13:17:57.463786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.465235 (+  1449us) service_pool.cc:224] Handling call
0709 13:17:57.465532 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.708980 (+243448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.709025 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:57.709084 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:57.709128 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.548097 (+1838969us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54001c3ed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:17:59.548166 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.548322 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559320448}
I20260709 13:17:59.642526 20403 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:17:59.632121 18416 rpcz_store.cc:269] 0709 13:17:57.610186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.028672 (+418486us) service_pool.cc:224] Handling call
0709 13:17:59.436755 (+1408083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.634196 20409 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:59.686465 18340 rpcz_store.cc:276] 0709 13:17:57.237958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.238116 (+   158us) service_pool.cc:224] Handling call
0709 13:17:57.238499 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.902619 (+1664120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.557274 (+654655us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54002d0ad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:17:59.612555 (+ 55281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3715258112}
W20260709 13:17:59.709755 18307 connection.cc:256] RPC call timeout handler was delayed by -2.5555199850000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 13:17:59.742928 18307 connection.cc:256] RPC call timeout handler was delayed by -1.4701199850001103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30610000000000004s for a response
W20260709 13:17:59.743269 18307 connection.cc:256] RPC call timeout handler was delayed by -1.4683199850001074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3063s for a response
W20260709 13:17:59.743546 18307 connection.cc:256] RPC call timeout handler was delayed by -1.334219985000118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32120000000000004s for a response
I20260709 13:17:59.721587 20536 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:59.658339 19058 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:17:59.710925 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.686808 20527 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:59.721313 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.640421 19057 rpcz_store.cc:276] 0709 13:17:52.583242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.585525 (+  2283us) service_pool.cc:224] Handling call
0709 13:17:53.483337 (+897812us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:17:53.483544 (+   207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:54.159338 (+675794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:54.180839 (+ 21501us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.056111 (+875272us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b2c0004d028. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:17:55.056871 (+   760us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.705351 (+1648480us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:56.705423 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.709480 (+  4057us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:59.345322 (+2635842us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:17:59.639818 (+294496us) raft_consensus.cc:1685] finished
0709 13:17:59.639843 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.639961 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":171846,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":3050,"spinlock_wait_cycles":26461568,"thread_start_us":2267398,"threads_started":2,"wal-append.queue_time_us":1611827}
I20260709 13:17:59.725219 19025 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:17:59.654106 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.708631 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.729157 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.688946 20497 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.644639 20408 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:59.711635 20500 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:59.717440 20523 raft_consensus.cc:697] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:17:59.742178 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.750888 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.750888 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:17:59.764768 18335 raft_consensus.cc:2368] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4.
I20260709 13:17:59.765600 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.766362 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:59.766726 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.767254 18335 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:17:59.767361 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:59.767907 19057 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:17:59.768576 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:17:59.768910 19057 raft_consensus.cc:2376] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5. Re-sending same reply.
I20260709 13:17:59.769379 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:59.746533 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 388) took 1687 ms. Trace:
I20260709 13:17:59.732707 20517 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:59.734767 20392 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:59.731585 20491 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:59.753940 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.681028 20346 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:17:59.756632 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.753995 18419 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:59.755326 19025 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:17:59.778354 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:17:59.780104 20457 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:59.780630 20566 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:59.782606 20558 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:59.759244 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 789) took 2468 ms. Trace:
I20260709 13:17:59.752089 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:59.770159 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:59.771793 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.771039 20344 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:59.763896 20408 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:17:59.758841 20528 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:59.777526 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.785120 19057 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:17:59.793883 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:17:59.773180 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.789233 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.794529 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.795265 18336 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:17:59.774868 20529 consensus_meta.cc:287] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
I20260709 13:17:59.792418 20567 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:59.795686 18335 raft_consensus.cc:2393] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 4: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:17:59.801331 20452 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:17:59.802518 20552 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:59.803494 20549 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:59.803931 20397 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:17:59.816018 20572 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:00.083803 18488 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1735) took 2813 ms (client timeout 1982 ms). Trace:
I20260709 13:17:59.787937 20516 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:00.083236 18337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1750) took 3622 ms (client timeout 1770 ms). Trace:
I20260709 13:17:59.793497 18339 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
W20260709 13:18:00.319820 18456 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:55650 dropped due to backpressure: service queue is full with 50 items
I20260709 13:18:00.298499 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 387) took 2255 ms. Trace:
W20260709 13:17:59.891978 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 43787.3us
W20260709 13:18:00.084503 18489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1734) took 2832 ms (client timeout 1872 ms). Trace:
W20260709 13:17:59.935434 18414 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 408) took 2339 ms (client timeout 1559 ms). Trace:
W20260709 13:18:00.321262 18489 rpcz_store.cc:269] 0709 13:17:57.252495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.252649 (+   154us) service_pool.cc:224] Handling call
0709 13:18:00.084241 (+2831592us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54001b7954. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.084416 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3524038016}
W20260709 13:18:00.321352 18414 rpcz_store.cc:269] 0709 13:17:57.596387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.598562 (+  2175us) service_pool.cc:224] Handling call
0709 13:17:59.935243 (+2336681us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54000a7dd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:17:59.935364 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435300608}
W20260709 13:18:00.320380 18337 rpcz_store.cc:269] 0709 13:17:56.460776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.563251 (+102475us) service_pool.cc:224] Handling call
0709 13:18:00.083058 (+3519807us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b540028e6d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.083159 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1788186368}
I20260709 13:18:00.323197 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.321076 18491 rpcz_store.cc:276] 0709 13:17:58.042908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.628575 (+1585667us) service_pool.cc:224] Handling call
0709 13:17:59.628808 (+   233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.630671 (+  1863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.630698 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:59.633906 (+  3208us) log.cc:844] Serialized 26 byte log entry
0709 13:17:59.722461 (+ 88555us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:59.722497 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.722559 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.298287 (+575728us) raft_consensus.cc:1685] finished
0709 13:18:00.298306 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.298441 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1560,"raft.queue_time_us":3574,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":8624,"thread_start_us":63064,"threads_started":1,"wal-append.queue_time_us":142894}
I20260709 13:18:00.323359 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:00.176096 18493 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 376) took 2906 ms (client timeout 1781 ms). Trace:
I20260709 13:18:00.175076 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 555) took 1133 ms. Trace:
I20260709 13:18:00.323858 18416 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
W20260709 13:18:00.154942 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.324169 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:17:59.952019 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.324352 19055 rpcz_store.cc:276] 0709 13:17:59.041450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.068697 (+ 27247us) service_pool.cc:224] Handling call
0709 13:18:00.174727 (+1106030us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b54007d2c28. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a3e05aa1 00007f40a3e80ebc 00007f40a3eb608c 00007f40a3ea093b 00007f40a3ea03d2 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c
0709 13:18:00.174994 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62042368}
I20260709 13:18:00.325098 19061 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:00.325380 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.326660 18491 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:00.327479 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:00.298053 18488 rpcz_store.cc:269] 0709 13:17:57.270471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.271109 (+   638us) service_pool.cc:224] Handling call
0709 13:18:00.083618 (+2812509us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400135e54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.083736 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249155328}
I20260709 13:17:59.874436 20529 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:00.004848 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.325906 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:00.177716 18343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 1716) took 2925 ms (client timeout 1722 ms). Trace:
W20260709 13:18:00.317741 20497 consensus_meta.cc:287] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.552s	user 0.004s	sys 0.001s
I20260709 13:18:00.150395 20433 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:17:59.935815 18492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 375) took 2667 ms (client timeout 1569 ms). Trace:
W20260709 13:18:00.324286 18493 rpcz_store.cc:269] 0709 13:17:57.269356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.269953 (+   597us) service_pool.cc:224] Handling call
0709 13:17:59.480754 (+2210801us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800143198. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:18:00.175830 (+695076us) spinlock_profiling.cc:243] Waited 63.2 ms on lock 0x7b54002201d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.175997 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151957248}
I20260709 13:18:00.076838 20504 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:00.325731 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 558) took 1283 ms. Trace:
W20260709 13:17:59.967733 20418 consensus_meta.cc:287] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.002s
I20260709 13:18:00.346993 19061 rpcz_store.cc:276] 0709 13:17:59.042439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.951611 (+909172us) service_pool.cc:224] Handling call
0709 13:18:00.325684 (+374073us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:00.338815 20526 consensus_meta.cc:287] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.010s
W20260709 13:18:00.345144 18492 rpcz_store.cc:269] 0709 13:17:57.268791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.269098 (+   307us) service_pool.cc:224] Handling call
0709 13:17:59.935628 (+2666530us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b5400258d54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:17:59.935747 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3657389952}
I20260709 13:18:00.354357 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.319809 20553 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:00.337074 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:00.338905 18343 rpcz_store.cc:269] 0709 13:17:57.252730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.252881 (+   151us) service_pool.cc:224] Handling call
0709 13:18:00.177453 (+2924572us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400267ad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.177629 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3405476096}
I20260709 13:17:59.793736 20408 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.341287 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:17:59.903589 20323 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:18:00.345325 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.324743 18414 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:17:59.784631 20517 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:17:59.967483 20359 log.cc:927] Time spent T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.142s	user 0.004s	sys 0.000s
W20260709 13:18:00.349285 20480 consensus_meta.cc:287] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.222s	user 0.013s	sys 0.000s
I20260709 13:17:59.902417 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.343222 20364 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:17:59.790336 20361 raft_consensus.cc:359] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:17:59.998334 20446 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:00.330461 20516 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.818218 20512 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:00.353860 18486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1722) took 6907 ms (client timeout 1686 ms). Trace:
W20260709 13:18:00.350680 20341 consensus_meta.cc:287] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260709 13:17:59.935395 20409 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:00.351500 20346 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:17:59.817030 20548 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:00.318924 20521 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.824559 20555 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:00.358851 20526 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:00.387292 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 385) took 2388 ms. Trace:
I20260709 13:18:00.387563 20526 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:00.387810 20323 tablet_bootstrap.cc:492] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:00.387699 18484 rpcz_store.cc:276] 0709 13:17:57.998883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.624107 (+1625224us) service_pool.cc:224] Handling call
0709 13:17:59.636227 (+ 12120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.747179 (+110952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.747222 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.747277 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:59.747323 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.387081 (+639758us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400259754. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:00.387125 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.387237 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254584064}
I20260709 13:18:00.388866 20323 tablet_bootstrap.cc:492] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:18:00.389245 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.389601 20323 ts_tablet_manager.cc:1403] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 6.674s	user 0.067s	sys 0.053s
I20260709 13:18:00.374074 20364 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:00.362901 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.361001 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 695) took 1271 ms. Trace:
I20260709 13:17:59.771848 18487 rpcz_store.cc:276] 0709 13:17:58.058701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.643166 (+1584465us) service_pool.cc:224] Handling call
0709 13:17:59.705519 (+ 62353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.717076 (+ 11557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.719527 (+  2451us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.722849 (+  3322us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:59.728212 (+  5363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.735795 (+  7583us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.741649 (+  5854us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.360460 20553 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.966388 20523 consensus_queue.cc:237] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:00.346217 20497 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:00.347093 19055 raft_consensus.cc:2376] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3. Re-sending same reply.
I20260709 13:18:00.357537 20418 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:00.366506 20361 raft_consensus.cc:740] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:18:00.376056 20516 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:59.822570 20550 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:00.385393 20529 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:00.371398 19058 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
W20260709 13:18:00.400007 19058 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 563) took 1356 ms (client timeout 1719 ms). Trace:
I20260709 13:17:58.958310 19059 rpcz_store.cc:276] 0709 13:17:57.221792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.221986 (+   194us) service_pool.cc:224] Handling call
0709 13:17:57.271136 (+ 49150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.271438 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:58.900265 (+1628827us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.957397 (+ 57132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.957448 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:58.957500 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.957564 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.957667 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"thread_start_us":1626213,"threads_started":2}
W20260709 13:18:00.400396 19058 rpcz_store.cc:269] 0709 13:17:59.043905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.765729 (+721824us) service_pool.cc:224] Handling call
0709 13:18:00.399946 (+634217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.400899 20418 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:00.401229 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.366168 20480 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:00.354280 20303 consensus_meta.cc:287] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.400s	user 0.006s	sys 0.005s
I20260709 13:18:00.390537 20433 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:00.392551 19054 rpcz_store.cc:276] 0709 13:17:59.089990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.784411 (+694421us) service_pool.cc:224] Handling call
0709 13:18:00.360947 (+576536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.411896 20303 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:00.412462 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.413179 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 688) took 1355 ms. Trace:
I20260709 13:18:00.413261 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.413556 19054 rpcz_store.cc:276] 0709 13:17:59.058003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.412179 (+1354176us) service_pool.cc:224] Handling call
0709 13:18:00.413126 (+   947us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.391090 20378 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:00.413722 20303 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:00.392350 20358 consensus_meta.cc:287] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.709s	user 0.014s	sys 0.000s
I20260709 13:18:00.393275 20391 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:00.380563 20341 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:00.414553 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.401788 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 564) took 1349 ms. Trace:
I20260709 13:18:00.414691 20358 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:00.415228 19059 rpcz_store.cc:276] 0709 13:17:59.053644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.400950 (+1347306us) service_pool.cc:224] Handling call
0709 13:18:00.401748 (+   798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.401422 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.416121 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.404089 20480 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:00.391424 20521 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:00.407450 20294 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:00.416605 20358 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:00.408706 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.403805 20499 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:00.395335 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 784) took 3170 ms. Trace:
I20260709 13:18:00.417335 19057 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:00.415244 19054 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 1.
I20260709 13:18:00.418005 19057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 561) took 1374 ms. Trace:
I20260709 13:18:00.418335 20521 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:00.418635 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.416551 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 562) took 1373 ms. Trace:
I20260709 13:18:00.418458 19057 rpcz_store.cc:276] 0709 13:17:59.043284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.815518 (+772234us) service_pool.cc:224] Handling call
0709 13:18:00.408564 (+593046us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:18:00.417877 (+  9313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32430848}
I20260709 13:18:00.405155 20359 tablet_bootstrap.cc:492] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:00.410285 20497 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:00.410530 20361 consensus_queue.cc:260] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:00.395818 20553 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:00.409133 20516 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:00.416127 20341 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:00.416743 19059 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:17:59.934895 18226 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 21b9264b0a434b79b6292c2ed23bbae0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 13:18:00.358729 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.082742 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1758) took 3416 ms. Trace:
I20260709 13:17:59.964206 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1755) took 3316 ms. Trace:
I20260709 13:18:00.358569 18488 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:00.320670 18456 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:55650 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1727)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1721)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1738)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1752)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1744)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1743)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1745)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1722)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1740)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1742)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1741)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1725)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1749)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 1707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 1708)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 1714)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1739)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1747)
I20260709 13:18:00.419492 19054 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:18:00.562248 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 570) took 1009 ms. Trace:
I20260709 13:18:00.562872 19054 rpcz_store.cc:276] 0709 13:17:59.552737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.418254 (+865517us) service_pool.cc:224] Handling call
0709 13:18:00.561975 (+143721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.564282 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.564988 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.417208 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 691) took 1327 ms. Trace:
I20260709 13:18:00.552377 18418 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:00.560614 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.566448 19053 rpcz_store.cc:276] 0709 13:17:59.086909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.413024 (+1326115us) service_pool.cc:224] Handling call
0709 13:18:00.414004 (+   980us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.392695 18484 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:00.402587 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 566) took 1344 ms. Trace:
I20260709 13:18:00.621187 19055 rpcz_store.cc:276] 0709 13:17:59.054293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.325648 (+1271355us) service_pool.cc:224] Handling call
0709 13:18:00.398649 (+ 73001us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.622170 20359 tablet_bootstrap.cc:492] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:18:00.622077 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.623217 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.414414 20408 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:00.631922 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:00.632741 18488 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.632934 20408 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:00.606113 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 797) took 1087 ms. Trace:
I20260709 13:18:00.634276 18485 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:00.634172 19054 rpcz_store.cc:276] 0709 13:17:59.500002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.564289 (+1064287us) service_pool.cc:224] Handling call
0709 13:18:00.587626 (+ 23337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.419392 19058 rpcz_store.cc:276] 0709 13:17:59.043632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.401161 (+1357529us) service_pool.cc:224] Handling call
0709 13:18:00.416491 (+ 15330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.636075 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.636197 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.637102 19054 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:00.637197 19058 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:18:00.609163 18415 rpcz_store.cc:276] 0709 13:17:56.648252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.649549 (+  1297us) service_pool.cc:224] Handling call
0709 13:17:56.649880 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.369250 (+719370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.369294 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:57.369352 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:57.369410 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.963925 (+2594515us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54000a96d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:17:59.963983 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.964145 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1567465344}
I20260709 13:18:00.639106 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.639390 20364 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:00.639920 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.641054 18415 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:00.641776 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1799) took 1135 ms. Trace:
I20260709 13:18:00.643661 18415 rpcz_store.cc:276] 0709 13:17:59.506200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.639445 (+1133245us) service_pool.cc:224] Handling call
0709 13:18:00.641639 (+  2194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.425616 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 788) took 3150 ms. Trace:
I20260709 13:18:00.607820 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:00.377353 18486 rpcz_store.cc:269] 0709 13:17:53.440993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.442018 (+  1025us) service_pool.cc:224] Handling call
0709 13:18:00.339249 (+6897231us) spinlock_profiling.cc:243] Waited 3.42 s on lock 0x7b54001b8354. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.345928 (+  6679us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7871302016}
W20260709 13:18:00.542924 18341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1748) took 4084 ms (client timeout 1535 ms). Trace:
I20260709 13:18:00.612043 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.612836 18344 raft_consensus.cc:2410] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:00.536667 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:17:59.783721 19060 rpcz_store.cc:276] 0709 13:17:57.285078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.285939 (+   861us) service_pool.cc:224] Handling call
0709 13:17:57.286222 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.286425 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:59.331991 (+2045566us) log.cc:844] Serialized 14 byte log entry
0709 13:17:59.645568 (+313577us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b1800421960. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c23a 00007f409eee6a2a
0709 13:17:59.753375 (+107807us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.753428 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:59.753492 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.753558 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.753675 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44836,"prepare.queue_time_us":1815715,"prepare.run_cpu_time_us":4383,"prepare.run_wall_time_us":81351,"raft.queue_time_us":101,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":3427,"spinlock_wait_cycles":50095360,"thread_start_us":2048694,"threads_started":2,"wal-append.queue_time_us":458483}
I20260709 13:18:00.530876 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.517051 18308 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:00.623878 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.628765 20517 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:00.417701 19056 rpcz_store.cc:276] 0709 13:17:57.224329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.248712 (+ 24383us) service_pool.cc:224] Handling call
0709 13:17:57.330321 (+ 81609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.621378 (+291057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.625825 (+  4447us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:57.646414 (+ 20589us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:57.650207 (+  3793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.384164 (+2733957us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54006446d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:00.391354 (+  7190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.394601 (+  3247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513827072}
I20260709 13:18:00.616798 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.662416 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.664073 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.664934 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1760) took 3067 ms. Trace:
I20260709 13:18:00.665141 18487 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
I20260709 13:18:00.552233 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.422544 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.651528 19062 rpcz_store.cc:276] 0709 13:17:57.275473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.284607 (+  9134us) service_pool.cc:224] Handling call
0709 13:17:57.284933 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.854241 (+1569308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.854288 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.854347 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:58.854391 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.425311 (+1570920us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400750154. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:00.425380 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.425545 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3608077568}
I20260709 13:18:00.652576 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.652626 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:00.650408 18341 rpcz_store.cc:269] 0709 13:17:56.458170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.502494 (+ 44324us) service_pool.cc:224] Handling call
0709 13:18:00.542217 (+4039723us) spinlock_profiling.cc:243] Waited 2.74 s on lock 0x7b54001e00d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.542598 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6294568576}
I20260709 13:18:00.624176 20359 ts_tablet_manager.cc:1403] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 7.629s	user 0.062s	sys 0.035s
W20260709 13:18:00.425412 20585 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.112s	user 0.003s	sys 0.000s
W20260709 13:18:00.658480 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 141866us
I20260709 13:18:00.660403 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.665511 18417 rpcz_store.cc:276] 0709 13:17:57.596843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.084209 (+1487366us) service_pool.cc:224] Handling call
0709 13:17:59.084504 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.612514 (+528010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.612545 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.612592 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:59.612636 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.664378 (+1051742us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54001784d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:00.664438 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.664669 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175015808}
I20260709 13:18:00.646093 19055 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:00.434914 20486 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:00.680200 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 572) took 1035 ms. Trace:
I20260709 13:18:00.680760 19059 rpcz_store.cc:276] 0709 13:17:59.634160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.415888 (+781728us) service_pool.cc:224] Handling call
0709 13:18:00.656863 (+240975us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.681504 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.682062 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.566778 18410 rpcz_store.cc:276] 0709 13:17:56.666298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.667109 (+   811us) service_pool.cc:224] Handling call
0709 13:17:56.667363 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.284005 (+616642us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:57.831208 (+547203us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.911312 (+1080104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.911357 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:58.911388 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.082509 (+1171121us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54000a78d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:00.082555 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.082676 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21704,"prepare.queue_time_us":95753,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":3894,"raft.queue_time_us":11548,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":19433,"spinlock_wait_cycles":1417616128,"thread_start_us":1527339,"threads_started":2,"wal-append.queue_time_us":1249892,"wal-append.run_cpu_time_us":1433,"wal-append.run_wall_time_us":1057996}
I20260709 13:18:00.682468 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.683785 18484 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 3: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:00.684749 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.676383 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:00.690940 18418 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1763) took 1177 ms (client timeout 1565 ms). Trace:
I20260709 13:18:00.691349 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.691964 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.668738 19053 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:18:00.692461 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:00.693223 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.677470 19057 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:00.677954 18308 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:00.684904 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.445694 20455 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:00.722545 18226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 787602us
I20260709 13:18:00.441150 20451 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:00.674127 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.658933 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.724020 19062 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 1.
I20260709 13:18:00.724628 19060 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:18:00.725445 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.725881 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:00.726451 19062 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:00.726784 19060 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.727169 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.727586 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.728091 18493 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:00.728448 19062 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:00.728680 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 409) took 1006 ms. Trace:
I20260709 13:18:00.678503 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:00.729557 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.678123 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.693387 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.730417 18492 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:00.730566 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1761) took 3131 ms. Trace:
I20260709 13:18:00.730988 19053 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 1.
I20260709 13:18:00.731220 19054 raft_consensus.cc:2376] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3. Re-sending same reply.
I20260709 13:18:00.731086 18412 rpcz_store.cc:276] 0709 13:17:57.599073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.509382 (+1910309us) service_pool.cc:224] Handling call
0709 13:17:59.935839 (+426457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.936019 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.936043 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.936081 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:59.936111 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.936175 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.730198 (+794023us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54000a7dd0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.730401 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980049792}
I20260709 13:18:00.732717 19053 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:00.732992 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.733990 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 684) took 1677 ms. Trace:
I20260709 13:18:00.734493 19054 rpcz_store.cc:276] 0709 13:17:59.056754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.732172 (+1675418us) service_pool.cc:224] Handling call
0709 13:18:00.732767 (+   595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.733369 (+   602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.733412 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.733502 (+    90us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:00.733635 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.733720 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.733866 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.688969 19056 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:00.673470 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 799) took 1149 ms. Trace:
I20260709 13:18:00.689837 20364 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:00.690351 20341 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:00.676530 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.729059 18493 rpcz_store.cc:276] 0709 13:17:59.721878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.726649 (+1004771us) service_pool.cc:224] Handling call
0709 13:18:00.728627 (+  1978us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.693516 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.711355 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.713974 20323 raft_consensus.cc:359] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:00.715413 19061 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:00.718308 20516 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:00.718559 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:00.718820 18342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 1715) took 3480 ms (client timeout 1839 ms). Trace:
W20260709 13:18:00.746352 18342 rpcz_store.cc:269] 0709 13:17:57.238654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.238808 (+   154us) service_pool.cc:224] Handling call
0709 13:18:00.718346 (+3479538us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b540007ec54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.718627 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4777186944}
I20260709 13:18:00.747350 18340 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:18:00.746934 20341 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:00.719661 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.747699 19054 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:00.747910 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 1720) took 1003 ms. Trace:
I20260709 13:18:00.748410 18340 rpcz_store.cc:276] 0709 13:17:59.744945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.676111 (+931166us) service_pool.cc:224] Handling call
0709 13:18:00.747858 (+ 71747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.749472 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.746886 18486 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:18:00.750488 18340 raft_consensus.cc:2393] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:00.750764 18415 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:00.744024 18412 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:00.751230 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1765) took 1231 ms. Trace:
I20260709 13:18:00.749714 20341 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:00.751559 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:00.710228 18384 consensus_peers.cc:597] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.721280 20553 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:00.687831 18417 raft_consensus.cc:2393] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:18:00.691569 18418 rpcz_store.cc:269] 0709 13:17:59.513876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.746301 (+232425us) service_pool.cc:224] Handling call
0709 13:18:00.690631 (+944330us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b540011d5d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.690863 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808525056}
I20260709 13:18:00.688284 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.730995 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1719) took 1045 ms. Trace:
I20260709 13:18:00.742439 19058 rpcz_store.cc:276] 0709 13:17:59.520581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.638487 (+1117906us) service_pool.cc:224] Handling call
0709 13:18:00.669960 (+ 31473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.677124 20361 ts_tablet_manager.cc:1434] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 1.884s	user 0.010s	sys 0.017s
I20260709 13:18:00.751138 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:00.755934 20361 ts_tablet_manager.cc:1467] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Tablet startup took 1993ms
I20260709 13:18:00.756557 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 388) took 1289 ms. Trace:
I20260709 13:18:00.682519 18491 raft_consensus.cc:2376] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8. Re-sending same reply.
I20260709 13:18:00.755090 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:00.693631 18341 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:00.754091 19057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 569) took 1387 ms. Trace:
I20260709 13:18:00.751078 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.742590 19025 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:00.749568 19059 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:00.724004 18343 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:00.720309 18335 raft_consensus.cc:2410] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:00.720799 18416 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:18:00.751613 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1804) took 1108 ms. Trace:
I20260709 13:18:00.773520 19057 rpcz_store.cc:276] 0709 13:17:59.358152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.422242 (+1064090us) service_pool.cc:224] Handling call
0709 13:18:00.743851 (+321609us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.776950 18412 rpcz_store.cc:276] 0709 13:17:59.642712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.732567 (+1089855us) service_pool.cc:224] Handling call
0709 13:18:00.751544 (+ 18977us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.752535 18415 rpcz_store.cc:276] 0709 13:17:59.520230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.717888 (+1197658us) service_pool.cc:224] Handling call
0709 13:18:00.751156 (+ 33268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.748533 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 685) took 1691 ms. Trace:
W20260709 13:18:00.752490 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 71089.2us
I20260709 13:18:00.753839 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1766) took 1227 ms. Trace:
I20260709 13:18:00.778184 19054 rpcz_store.cc:276] 0709 13:17:59.057056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.743829 (+1686773us) service_pool.cc:224] Handling call
0709 13:18:00.747230 (+  3401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.748318 (+  1088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.748465 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.745561 20364 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.747748 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:00.757010 18336 rpcz_store.cc:276] 0709 13:17:59.467585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.537573 (+1069988us) service_pool.cc:224] Handling call
0709 13:18:00.750921 (+213348us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b5800002a98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7eee 0000000000375939 00007f40a3e2b1e0 00007f40a3ef40c4 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:18:00.756475 (+  5554us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3014528}
I20260709 13:18:00.779379 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1805) took 1134 ms. Trace:
I20260709 13:18:00.756955 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 568) took 1699 ms. Trace:
I20260709 13:18:00.794073 19053 rpcz_store.cc:276] 0709 13:17:59.054871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.731821 (+1676950us) service_pool.cc:224] Handling call
0709 13:18:00.732248 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.743370 (+ 11122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.754595 (+ 11225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.775691 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 686) took 1718 ms. Trace:
I20260709 13:18:00.795850 19059 rpcz_store.cc:276] 0709 13:17:59.057351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.748681 (+1691330us) service_pool.cc:224] Handling call
0709 13:18:00.749087 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.775413 (+ 26326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.775639 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.797654 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 795) took 1312 ms. Trace:
I20260709 13:18:00.798004 18344 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:00.798087 19059 rpcz_store.cc:276] 0709 13:17:59.484840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.796673 (+1311833us) service_pool.cc:224] Handling call
0709 13:18:00.797044 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.797303 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.797335 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.797379 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:00.797410 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.797473 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.797583 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:00.799132 18413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 413) took 3201 ms (client timeout 1747 ms). Trace:
W20260709 13:18:00.799651 18413 rpcz_store.cc:269] 0709 13:17:57.597930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.639985 (+ 42055us) service_pool.cc:224] Handling call
0709 13:18:00.798754 (+3158769us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b54001c43d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.798945 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4492508416}
I20260709 13:18:00.800495 18342 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.754359 18492 rpcz_store.cc:276] 0709 13:17:59.685683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.677450 (+991767us) service_pool.cc:224] Handling call
0709 13:18:00.730930 (+ 53480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.778371 18417 rpcz_store.cc:276] 0709 13:17:59.526645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.684341 (+1157696us) service_pool.cc:224] Handling call
0709 13:18:00.753777 (+ 69436us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:00.775506 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 97849.3us
I20260709 13:18:00.757330 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 790) took 1291 ms. Trace:
I20260709 13:18:00.800184 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 796) took 1302 ms. Trace:
I20260709 13:18:00.776322 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1716) took 1091 ms. Trace:
I20260709 13:18:00.777678 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 1725) took 1029 ms. Trace:
I20260709 13:18:00.790015 18340 raft_consensus.cc:1813] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Handling vote request from an unknown peer 20e06cff39b649c48d342b7431135303
I20260709 13:18:00.790252 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.790519 18484 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:00.791013 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 1719) took 1046 ms. Trace:
I20260709 13:18:00.816982 19059 rpcz_store.cc:276] 0709 13:17:59.497930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.799342 (+1301412us) service_pool.cc:224] Handling call
0709 13:18:00.799671 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.799897 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.799922 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.799980 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:00.800005 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.800053 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.800140 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.818080 18341 rpcz_store.cc:276] 0709 13:17:59.747945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.692081 (+944136us) service_pool.cc:224] Handling call
0709 13:18:00.777620 (+ 85539us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.775795 20341 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:00.791226 18384 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:00.782470 18416 rpcz_store.cc:276] 0709 13:17:59.644643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.377058 (+732415us) service_pool.cc:224] Handling call
0709 13:18:00.779260 (+402202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.792136 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.798579 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 1718) took 1054 ms. Trace:
I20260709 13:18:00.799883 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 689) took 1741 ms. Trace:
I20260709 13:18:00.782279 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 393) took 1266 ms. Trace:
I20260709 13:18:00.752739 20323 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:18:00.782091 20364 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.804345 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.804695 18486 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
W20260709 13:18:00.756371 20361 ts_tablet_manager.cc:1469] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Trace:
0709 13:17:51.019745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.022003 (+  2258us) service_pool.cc:224] Handling call
0709 13:17:51.088725 (+ 66722us) ts_tablet_manager.cc:934] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
0709 13:17:51.409461 (+320736us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:51.666108 (+256647us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:51.666296 (+   188us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:51.871545 (+205249us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:51.871835 (+   290us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:51.872127 (+   292us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:51.872212 (+    85us) inbound_call.cc:177] Queueing success response
0709 13:17:52.220542 (+348330us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:17:58.792677 (+6572135us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:17:59.165007 (+372330us) tablet_replica.cc:261] Starting instrumentation
0709 13:17:59.165522 (+   515us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":299,"mutex_wait_us":69771,"raft.queue_time_us":45461,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":264,"tablet-copy.queue_time_us":65798,"tablet-download-pool.queue_time_us":144,"tablet-download-pool.run_cpu_time_us":1273,"tablet-download-pool.run_wall_time_us":42882,"thread_start_us":133916,"threads_started":2}
I20260709 13:18:00.806560 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.809625 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 792) took 1340 ms. Trace:
I20260709 13:18:00.825790 19054 rpcz_store.cc:276] 0709 13:17:59.469759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.808464 (+1338705us) service_pool.cc:224] Handling call
0709 13:18:00.808902 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.809234 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.809274 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.809339 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:00.809405 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.809471 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.809565 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.810109 20553 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:00.834719 20553 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.835122 20553 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.838124 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1715) took 1154 ms. Trace:
W20260709 13:18:00.838562 19061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 692) took 1751 ms (client timeout 2122 ms). Trace:
I20260709 13:18:00.838696 18486 rpcz_store.cc:276] 0709 13:17:59.683702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.750759 (+1067057us) service_pool.cc:224] Handling call
0709 13:18:00.838058 (+ 87299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.811929 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 791) took 1345 ms. Trace:
I20260709 13:18:00.812657 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.812922 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.814218 20588 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:00.774376 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.817535 18340 raft_consensus.cc:2410] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:00.818109 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 410) took 1094 ms. Trace:
I20260709 13:18:00.817126 18491 rpcz_store.cc:276] 0709 13:17:59.684855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.680942 (+996087us) service_pool.cc:224] Handling call
0709 13:18:00.776262 (+ 95320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.847080 18410 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.818245 18335 rpcz_store.cc:276] 0709 13:17:59.744707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.536004 (+791297us) service_pool.cc:224] Handling call
0709 13:18:00.790934 (+254930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.819557 18343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 1727) took 1071 ms. Trace:
I20260709 13:18:00.822693 18337 rpcz_store.cc:276] 0709 13:17:59.515543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.692686 (+1177143us) service_pool.cc:224] Handling call
0709 13:18:00.782212 (+ 89526us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.827167 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.827378 18493 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:18:00.824002 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 384) took 3459 ms. Trace:
I20260709 13:18:00.831413 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.832798 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1806) took 1186 ms. Trace:
I20260709 13:18:00.850330 18418 rpcz_store.cc:276] 0709 13:17:59.646512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.791761 (+1145249us) service_pool.cc:224] Handling call
0709 13:18:00.832680 (+ 40919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.834136 18489 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:18:00.829512 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:00.839059 19061 rpcz_store.cc:269] 0709 13:17:59.089060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.353269 (+1264209us) service_pool.cc:224] Handling call
0709 13:18:00.838333 (+485064us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54006617d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.838489 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741136256}
I20260709 13:18:00.821233 18344 rpcz_store.cc:276] 0709 13:17:59.744465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.687722 (+943257us) service_pool.cc:224] Handling call
0709 13:18:00.798519 (+110797us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.849334 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 407) took 1127 ms. Trace:
I20260709 13:18:00.851063 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:00.870102 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.848662 18343 rpcz_store.cc:276] 0709 13:17:59.748536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.357683 (+609147us) service_pool.cc:224] Handling call
0709 13:18:00.804091 (+446408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.870435 18493 rpcz_store.cc:276] 0709 13:17:59.721425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.775131 (+1053706us) service_pool.cc:224] Handling call
0709 13:18:00.849246 (+ 74115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.871258 19060 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:00.872403 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.848526 18484 rpcz_store.cc:276] 0709 13:17:59.724196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.684473 (+960277us) service_pool.cc:224] Handling call
0709 13:18:00.818051 (+133578us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.873378 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1769) took 1516 ms. Trace:
I20260709 13:18:00.873795 18340 rpcz_store.cc:276] 0709 13:17:59.356985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.751274 (+1394289us) service_pool.cc:224] Handling call
0709 13:18:00.873306 (+122032us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.833421 20341 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:00.849720 18490 rpcz_store.cc:276] 0709 13:17:57.331571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.514775 (+2183204us) service_pool.cc:224] Handling call
0709 13:17:59.515082 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.629229 (+114147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.629259 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.629298 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:59.629326 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.790692 (+1161366us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400437e54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:00.790757 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.790974 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262104448}
I20260709 13:18:00.876279 18415 raft_consensus.cc:2410] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:00.846112 19053 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:00.846057 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.877148 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 395) took 1260 ms. Trace:
I20260709 13:18:00.875254 18492 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:00.879205 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:00.881410 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1796) took 1376 ms. Trace:
I20260709 13:18:00.881731 18415 rpcz_store.cc:276] 0709 13:17:59.505475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.812566 (+1307091us) service_pool.cc:224] Handling call
0709 13:18:00.881357 (+ 68791us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:00.882580 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 459577us
W20260709 13:18:00.882970 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 147559us
W20260709 13:18:00.884100 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.886067 20303 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:00.886528 20303 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:00.886375 20359 raft_consensus.cc:359] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:00.886986 20303 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.850739 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:00.877590 18485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1717) took 1189 ms (client timeout 1565 ms). Trace:
I20260709 13:18:00.887665 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:00.880163 18339 rpcz_store.cc:276] 0709 13:17:59.616771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.541222 (+924451us) service_pool.cc:224] Handling call
0709 13:18:00.831121 (+289899us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b5800002a98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:18:00.877080 (+ 45959us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11995520}
I20260709 13:18:00.902690 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.907246 18488 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:00.822489 19056 rpcz_store.cc:276] 0709 13:17:59.058314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.752264 (+1693950us) service_pool.cc:224] Handling call
0709 13:18:00.799073 (+ 46809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.799479 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.799507 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.799551 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:00.799618 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.799685 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.799805 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.886108 20323 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:00.893026 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:00.894260 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:00.896422 20345 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:00.911195 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:00.897182 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:00.905469 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.901022 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.905839 18414 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
I20260709 13:18:00.910596 20548 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:00.897451 20486 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:00.905656 18413 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.887383 20359 raft_consensus.cc:740] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:18:00.916213 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1721) took 1200 ms. Trace:
W20260709 13:18:00.901502 18485 rpcz_store.cc:269] 0709 13:17:59.685145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.723722 (+ 38577us) service_pool.cc:224] Handling call
0709 13:18:00.846703 (+1122981us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54000dd4d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.874823 (+ 28120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091658624}
W20260709 13:18:00.902571 18419 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1795) took 1397 ms (client timeout 1708 ms). Trace:
I20260709 13:18:00.919610 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.922266 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:00.924017 18491 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.920378 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:00.920117 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.921030 18488 rpcz_store.cc:276] 0709 13:17:59.707044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.626564 (+919520us) service_pool.cc:224] Handling call
0709 13:18:00.907656 (+281092us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.919544 18457 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:00.925422 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.924806 18340 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.816751 19058 rpcz_store.cc:276] 0709 13:17:59.466006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.755967 (+1289961us) service_pool.cc:224] Handling call
0709 13:18:00.756479 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.756972 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.756999 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.757060 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:00.757092 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.757148 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.757269 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.899713 20341 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:00.922062 18419 rpcz_store.cc:269] 0709 13:17:59.505210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.508606 (+  3396us) service_pool.cc:224] Handling call
0709 13:18:00.902131 (+1393525us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54001c52d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.902340 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285984000}
I20260709 13:18:00.930864 19025 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:00.930909 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.933101 18412 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 5: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:00.935369 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 420) took 1203 ms. Trace:
I20260709 13:18:00.935827 18412 rpcz_store.cc:276] 0709 13:17:59.732255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.900619 (+1168364us) service_pool.cc:224] Handling call
0709 13:18:00.935310 (+ 34691us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.937052 18489 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:00.937081 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 411) took 3278 ms. Trace:
I20260709 13:18:00.938524 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.938936 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:00.939572 18419 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.939783 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:00.940917 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.942179 20345 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:00.943449 19025 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:00.945075 20345 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:00.928656 20516 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:00.946287 18335 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:00.946223 20504 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:00.937472 20364 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:00.947384 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.948527 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:00.949486 19062 raft_consensus.cc:1813] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Handling vote request from an unknown peer 20e06cff39b649c48d342b7431135303
I20260709 13:18:00.950479 19062 raft_consensus.cc:2410] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:00.938122 18411 rpcz_store.cc:276] 0709 13:17:57.597368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.073603 (+1476235us) service_pool.cc:224] Handling call
0709 13:17:59.073967 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.074189 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.074216 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:00.659803 (+1585587us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b2c001026c8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:18:00.660798 (+   995us) log.cc:844] Serialized 26 byte log entry
0709 13:18:00.775238 (+114440us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:00.777381 (+  2143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.816478 (+ 39097us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.816522 (+    44us) raft_consensus.cc:1685] finished
0709 13:18:00.816539 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.875728 (+ 59189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22139648,"thread_start_us":113938,"threads_started":1,"wal-append.queue_time_us":145972}
I20260709 13:18:00.950934 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 571) took 1373 ms. Trace:
I20260709 13:18:00.920384 20548 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:00.921875 20486 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:00.951462 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.952004 20486 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:00.952440 18411 raft_consensus.cc:2368] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3.
I20260709 13:18:00.952869 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 421) took 1220 ms. Trace:
I20260709 13:18:00.953253 18411 rpcz_store.cc:276] 0709 13:17:59.732493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.951144 (+1218651us) service_pool.cc:224] Handling call
0709 13:18:00.952797 (+  1653us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:00.951313 20587 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.285s	user 0.000s	sys 0.002s
I20260709 13:18:00.949378 20364 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:00.844384 19055 rpcz_store.cc:276] 0709 13:17:59.466321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.781970 (+1315649us) service_pool.cc:224] Handling call
0709 13:18:00.811017 (+ 29047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.811372 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.811420 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.811467 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:00.811522 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.811600 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.811734 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.960549 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 698) took 1058 ms. Trace:
I20260709 13:18:00.960479 20359 consensus_queue.cc:260] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:00.961062 19054 rpcz_store.cc:276] 0709 13:17:59.902514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.826557 (+924043us) service_pool.cc:224] Handling call
0709 13:18:00.916159 (+ 89602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.960137 (+ 43978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.960188 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.960265 (+    77us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:00.960297 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.960355 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.960453 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.949404 18335 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 2: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:00.965201 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:00.966167 19026 leader_election.cc:336] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.510s (SENT)
I20260709 13:18:00.966403 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:00.966672 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:00.967278 18414 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 418) took 1235 ms (client timeout 1530 ms). Trace:
W20260709 13:18:00.967438 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 48053us
W20260709 13:18:00.967845 18414 rpcz_store.cc:269] 0709 13:17:59.731733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.812124 (+1080391us) service_pool.cc:224] Handling call
0709 13:18:00.967095 (+154971us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b5400109354. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:00.967190 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139643776}
I20260709 13:18:00.969260 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.898089 18416 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:18:00.964293 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:00.970124 20548 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.970227 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1807) took 1323 ms. Trace:
I20260709 13:18:00.970510 18343 raft_consensus.cc:2376] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3. Re-sending same reply.
I20260709 13:18:00.970747 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:00.970692 18416 rpcz_store.cc:276] 0709 13:17:59.646804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.847448 (+1200644us) service_pool.cc:224] Handling call
0709 13:18:00.970158 (+122710us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.971478 18493 raft_consensus.cc:2376] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2. Re-sending same reply.
I20260709 13:18:00.952776 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:00.967278 18335 raft_consensus.cc:2368] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3.
I20260709 13:18:00.935258 19057 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:00.951303 19062 rpcz_store.cc:276] 0709 13:17:59.577490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.744431 (+1166941us) service_pool.cc:224] Handling call
0709 13:18:00.879111 (+134680us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7eee 0000000000375939 00007f40a3e2b1e0 00007f40a3ef40c4 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:18:00.950864 (+ 71753us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43603840}
I20260709 13:18:00.974135 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:00.974284 19057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 798) took 1464 ms. Trace:
I20260709 13:18:00.974609 19057 rpcz_store.cc:276] 0709 13:17:59.510236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.821899 (+1311663us) service_pool.cc:224] Handling call
0709 13:18:00.906372 (+ 84473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.974042 (+ 67670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.974231 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.945421 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:00.974690 18493 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.962736 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:00.975737 18414 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:00.995582 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1764) took 1480 ms. Trace:
I20260709 13:18:00.995924 18414 rpcz_store.cc:276] 0709 13:17:59.515215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.968931 (+1453716us) service_pool.cc:224] Handling call
0709 13:18:00.995524 (+ 26593us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.997051 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:00.997501 18341 raft_consensus.cc:2368] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5.
I20260709 13:18:00.997694 18411 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.971973 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:00.998274 18415 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:01.004563 18418 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:01.005328 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1803) took 1498 ms. Trace:
I20260709 13:18:01.005636 18418 rpcz_store.cc:276] 0709 13:17:59.507105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.875015 (+1367910us) service_pool.cc:224] Handling call
0709 13:18:01.005255 (+130240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.006196 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.006637 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:01.006891 18488 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:01.007462 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1770) took 1457 ms. Trace:
I20260709 13:18:01.007874 18418 rpcz_store.cc:276] 0709 13:17:59.549948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.006345 (+1456397us) service_pool.cc:224] Handling call
0709 13:18:01.007407 (+  1062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.008898 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:01.009081 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:00.997048 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.009778 18343 raft_consensus.cc:2393] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:01.021858 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:01.022387 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 699) took 1087 ms. Trace:
I20260709 13:18:01.022526 18343 raft_consensus.cc:2376] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3. Re-sending same reply.
I20260709 13:18:01.022802 19061 rpcz_store.cc:276] 0709 13:17:59.934629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.875899 (+941270us) service_pool.cc:224] Handling call
0709 13:18:00.921178 (+ 45279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.998143 (+ 76965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.998169 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.022132 (+ 23963us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.022181 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.022239 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.022337 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.023370 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.024096 18343 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:01.015822 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.027544 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 700) took 1092 ms. Trace:
I20260709 13:18:01.027609 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.028097 19060 rpcz_store.cc:276] 0709 13:17:59.934949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.875989 (+941040us) service_pool.cc:224] Handling call
0709 13:18:00.958449 (+ 82460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.958657 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.958692 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.958774 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:00.958826 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.958884 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.027365 (+ 68481us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b54006c0a50. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:01.027478 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161397120}
I20260709 13:18:01.029047 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:01.016119 18416 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:00.965500 18240 catalog_manager.cc:5697] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 4 to 5, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 5 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:01.031529 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 220837us
I20260709 13:18:01.031262 18240 catalog_manager.cc:5697] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 3, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.945775 20345 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:01.026467 18485 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:01.034839 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.034719 20548 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:01.035827 18485 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:01.017098 18486 raft_consensus.cc:2368] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5.
I20260709 13:18:01.036706 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.036839 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 793) took 1563 ms. Trace:
I20260709 13:18:01.037016 20548 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:01.033778 20345 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:01.046968 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:01.050820 18410 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:01.037333 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:01.037781 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 71769.8us
I20260709 13:18:01.015974 18337 raft_consensus.cc:2368] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4.
I20260709 13:18:01.020049 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.017247 18492 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
W20260709 13:18:01.040587 20592 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:18:01.051371 18490 raft_consensus.cc:2376] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3. Re-sending same reply.
I20260709 13:18:01.009400 20303 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:01.042335 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 44925us
I20260709 13:18:01.037384 18485 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:00.960536 19055 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:00.963703 20323 ts_tablet_manager.cc:1434] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.570s	user 0.019s	sys 0.004s
W20260709 13:18:01.079931 20323 ts_tablet_manager.cc:1467] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Tablet startup took 687ms
I20260709 13:18:01.037281 19053 rpcz_store.cc:276] 0709 13:17:59.474034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.795135 (+1321101us) service_pool.cc:224] Handling call
0709 13:18:00.844702 (+ 49567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.885730 (+ 41028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.036647 (+150917us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b54006617d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:01.036783 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101788032}
I20260709 13:18:01.015694 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1770) took 1425 ms. Trace:
I20260709 13:18:00.962877 20359 ts_tablet_manager.cc:1434] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.283s	user 0.005s	sys 0.004s
I20260709 13:18:01.024295 18413 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:01.015549 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:01.016956 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 71734.3us
I20260709 13:18:01.024211 20423 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:01.009719 18489 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:00.973063 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:00.998823 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 419) took 1266 ms. Trace:
I20260709 13:18:01.084791 18415 rpcz_store.cc:276] 0709 13:17:59.732017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.889692 (+1157675us) service_pool.cc:224] Handling call
0709 13:18:00.998772 (+109080us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:01.051435 18410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1769) took 1509 ms (client timeout 1823 ms). Trace:
I20260709 13:18:01.035617 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 396) took 1409 ms. Trace:
I20260709 13:18:01.052582 18342 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:01.045884 18343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 397) took 1413 ms. Trace:
W20260709 13:18:01.085803 18410 rpcz_store.cc:269] 0709 13:17:59.542148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.742787 (+1200639us) service_pool.cc:224] Handling call
0709 13:18:01.051373 (+308586us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.016348 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:01.014890 19058 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:18:01.077108 18416 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:01.115319 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.116568 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.117134 18416 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:18:01.033066 18240 catalog_manager.cc:5697] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 4 to 5, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 5 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:01.077587 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 248199us
I20260709 13:18:00.951364 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.078117 18340 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:01.015683 20362 tablet_bootstrap.cc:492] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:01.126814 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.128271 20362 tablet_bootstrap.cc:492] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:18:01.129374 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:01.041349 18411 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:01.130414 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1778) took 1458 ms. Trace:
I20260709 13:18:01.130815 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:01.130882 18411 rpcz_store.cc:276] 0709 13:17:59.672382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.953847 (+1281465us) service_pool.cc:224] Handling call
0709 13:18:01.130336 (+176489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.131507 18490 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:01.132373 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:01.133059 18411 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.082715 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1798) took 1576 ms. Trace:
I20260709 13:18:01.134110 18413 rpcz_store.cc:276] 0709 13:17:59.505950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.829178 (+1323228us) service_pool.cc:224] Handling call
0709 13:18:01.082641 (+253463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.135259 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.135994 18413 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:01.137045 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.082311 18493 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:01.086448 18343 rpcz_store.cc:276] 0709 13:17:59.632600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.044990 (+1412390us) service_pool.cc:224] Handling call
0709 13:18:01.045352 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.045535 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.045564 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.045616 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:01.045643 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.045692 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.045804 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.087509 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.137890 18490 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:01.081198 18336 rpcz_store.cc:276] 0709 13:17:59.508986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.802409 (+1293423us) service_pool.cc:224] Handling call
0709 13:18:00.831047 (+ 28638us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:00.831404 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.831428 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:00.831908 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:18:00.872451 (+ 40543us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:00.872487 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.872550 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.904476 (+ 31926us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:00.930335 (+ 25859us) raft_consensus.cc:1685] finished
0709 13:18:00.930355 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.934712 (+  4357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16138112,"thread_start_us":39978,"threads_started":1,"wal-append.queue_time_us":40406}
I20260709 13:18:01.087211 18412 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:01.016851 20486 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:01.071961 18491 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:01.139196 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.140555 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1722) took 1420 ms. Trace:
I20260709 13:18:01.095959 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:01.096616 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.097893 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.140947 18491 rpcz_store.cc:276] 0709 13:17:59.720348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.875746 (+1155398us) service_pool.cc:224] Handling call
0709 13:18:01.140504 (+264758us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.137976 18485 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:18:01.139777 18414 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:01.141857 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:01.142552 18491 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:01.098784 20517 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:01.098989 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 126083us
I20260709 13:18:01.099458 19025 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:01.100124 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.086510 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1771) took 1531 ms. Trace:
I20260709 13:18:01.145260 18342 rpcz_store.cc:276] 0709 13:17:59.554828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.747474 (+1192646us) service_pool.cc:224] Handling call
0709 13:18:01.086454 (+338980us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.100378 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 400) took 1435 ms. Trace:
I20260709 13:18:01.145804 18419 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:01.146559 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1779) took 1455 ms. Trace:
I20260709 13:18:01.146119 18339 rpcz_store.cc:276] 0709 13:17:59.665167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.099591 (+1434424us) service_pool.cc:224] Handling call
0709 13:18:01.099887 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.100085 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.100108 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.100147 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.100184 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.100236 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.100329 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.101822 18242 catalog_manager.cc:5697] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 2, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:01.104370 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.147184 18419 rpcz_store.cc:276] 0709 13:17:59.691406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.938650 (+1247244us) service_pool.cc:224] Handling call
0709 13:18:01.146487 (+207837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.105260 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:01.106132 19026 leader_election.cc:336] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.530s (SENT)
I20260709 13:18:01.107661 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.149034 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1709) took 1480 ms. Trace:
I20260709 13:18:01.149345 18488 rpcz_store.cc:276] 0709 13:17:59.668670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.107322 (+1438652us) service_pool.cc:224] Handling call
0709 13:18:01.148980 (+ 41658us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.117878 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:01.150151 18416 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:01.118829 18240 catalog_manager.cc:5697] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 3, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.125510 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:01.126667 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 45129us
I20260709 13:18:01.084122 20423 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:01.085884 18341 rpcz_store.cc:276] 0709 13:17:59.626383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.034557 (+1408174us) service_pool.cc:224] Handling call
0709 13:18:01.034956 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.035249 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.035273 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.035332 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.035360 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.035419 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.035534 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.129400 20362 ts_tablet_manager.cc:1403] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 2.796s	user 0.052s	sys 0.054s
I20260709 13:18:01.153347 18489 raft_consensus.cc:2368] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3.
I20260709 13:18:01.148267 18415 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:18:01.156780 18418 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:01.159214 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1775) took 1533 ms. Trace:
I20260709 13:18:01.159698 18415 rpcz_store.cc:276] 0709 13:17:59.626081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.104857 (+1478776us) service_pool.cc:224] Handling call
0709 13:18:01.159102 (+ 54245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.151183 18492 raft_consensus.cc:2376] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4. Re-sending same reply.
I20260709 13:18:01.160861 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1713) took 1491 ms. Trace:
I20260709 13:18:01.160897 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.161253 18492 rpcz_store.cc:276] 0709 13:17:59.669758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.125214 (+1455456us) service_pool.cc:224] Handling call
0709 13:18:01.160808 (+ 35594us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.161792 18413 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
W20260709 13:18:01.143850 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 48008.2us
I20260709 13:18:01.092368 20303 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:01.154371 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1718) took 1469 ms. Trace:
I20260709 13:18:01.163923 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.164268 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:01.164805 18491 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:01.164732 18417 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:01.163682 18484 rpcz_store.cc:276] 0709 13:17:59.685425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.097596 (+1412171us) service_pool.cc:224] Handling call
0709 13:18:01.154300 (+ 56704us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.175633 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.178346 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:01.158664 20423 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:01.143987 20517 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.194267 18340 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:18:01.195465 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.186287 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.197403 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.198199 18488 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:18:01.198796 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1725) took 1425 ms. Trace:
I20260709 13:18:01.199167 18488 rpcz_store.cc:276] 0709 13:17:59.774343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.156340 (+1381997us) service_pool.cc:224] Handling call
0709 13:18:01.198713 (+ 42373us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.187614 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:01.192086 20362 raft_consensus.cc:359] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:01.155663 20548 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:01.202307 18490 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:01.144560 18487 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:18:01.185124 18308 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:01.205082 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1717) took 1451 ms. Trace:
I20260709 13:18:01.207937 18340 rpcz_store.cc:276] 0709 13:17:59.744182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.142532 (+1398350us) service_pool.cc:224] Handling call
0709 13:18:01.193982 (+ 51450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.194797 (+   815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.195063 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.207540 18413 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:01.212203 18410 raft_consensus.cc:2393] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:01.212631 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1802) took 1705 ms. Trace:
I20260709 13:18:01.212936 18410 rpcz_store.cc:276] 0709 13:17:59.506888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.142292 (+1635404us) service_pool.cc:224] Handling call
0709 13:18:01.212580 (+ 70288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.214475 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.215286 18418 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:18:01.215888 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1809) took 1129 ms. Trace:
I20260709 13:18:01.216260 18418 rpcz_store.cc:276] 0709 13:18:00.086506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.168447 (+1081941us) service_pool.cc:224] Handling call
0709 13:18:01.215822 (+ 47375us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.220338 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:01.196379 20303 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:01.220338 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 1801) took 1704 ms. Trace:
I20260709 13:18:01.224776 18413 rpcz_store.cc:276] 0709 13:17:59.506674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.168724 (+1662050us) service_pool.cc:224] Handling call
0709 13:18:01.207372 (+ 38648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.211000 (+  3628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.211126 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.217720 18242 catalog_manager.cc:5697] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 3 to 4, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 4 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:01.221589 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.225843 18485 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:01.208213 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1723) took 1471 ms. Trace:
I20260709 13:18:01.226368 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1712) took 1556 ms. Trace:
I20260709 13:18:01.226728 18490 rpcz_store.cc:276] 0709 13:17:59.736632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.154119 (+1417487us) service_pool.cc:224] Handling call
0709 13:18:01.208150 (+ 54031us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.227432 18485 rpcz_store.cc:276] 0709 13:17:59.669501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.173595 (+1504094us) service_pool.cc:224] Handling call
0709 13:18:01.226318 (+ 52723us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.203007 20517 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:01.223678 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 80925.1us
I20260709 13:18:01.226922 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:01.219784 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 307223us
I20260709 13:18:01.182788 18338 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
W20260709 13:18:01.230487 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 64258us
W20260709 13:18:01.226336 19026 leader_election.cc:336] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.929s (SENT)
W20260709 13:18:01.233233 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 144843us
I20260709 13:18:01.206686 20548 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:01.231123 18484 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:18:01.208467 20362 raft_consensus.cc:740] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:18:01.236089 19026 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:01.238770 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 1797) took 1733 ms. Trace:
I20260709 13:18:01.239450 18415 rpcz_store.cc:276] 0709 13:17:59.505707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.170376 (+1664669us) service_pool.cc:224] Handling call
0709 13:18:01.219323 (+ 48947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.238339 (+ 19016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.238382 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.238440 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.238487 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.238566 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.238702 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.242584 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.237787 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1767) took 1699 ms. Trace:
I20260709 13:18:01.226563 20303 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:01.243304 18417 rpcz_store.cc:276] 0709 13:17:59.535209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.173007 (+1637798us) service_pool.cc:224] Handling call
0709 13:18:01.213063 (+ 40056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.222200 (+  9137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.222233 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.229381 (+  7148us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:01.233983 (+  4602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.234046 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.234146 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.238389 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1768) took 1699 ms. Trace:
I20260709 13:18:01.245589 18419 rpcz_store.cc:276] 0709 13:17:59.539082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.171001 (+1631919us) service_pool.cc:224] Handling call
0709 13:18:01.213301 (+ 42300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.232726 (+ 19425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.232757 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.238121 (+  5364us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:01.238169 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.238227 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.238339 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2544}
I20260709 13:18:01.250044 18492 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:01.251554 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 1708) took 1583 ms. Trace:
I20260709 13:18:01.251888 18492 rpcz_store.cc:276] 0709 13:17:59.668395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.250721 (+1582326us) service_pool.cc:224] Handling call
0709 13:18:01.251056 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.251236 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.251260 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.251314 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.251347 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.251402 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.251491 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.253255 18492 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:01.238014 20548 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.258033 20484 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:01.258451 20484 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.258801 20484 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:01.262029 20480 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:01.262970 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1772) took 1690 ms. Trace:
I20260709 13:18:01.263383 18410 rpcz_store.cc:276] 0709 13:17:59.572977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.238247 (+1665270us) service_pool.cc:224] Handling call
0709 13:18:01.262314 (+ 24067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.262565 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.262587 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.262626 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:01.262672 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.262742 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.262884 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:01.236853 18338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 391) took 1737 ms (client timeout 2069 ms). Trace:
I20260709 13:18:01.266433 18457 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:01.266687 18416 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:01.253700 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 1714) took 1570 ms. Trace:
I20260709 13:18:01.269969 18492 rpcz_store.cc:276] 0709 13:17:59.683358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.252676 (+1569318us) service_pool.cc:224] Handling call
0709 13:18:01.252971 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.253517 (+   546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.253656 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.273509 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:01.269294 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.266963 18382 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:01.277491 18414 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:01.279489 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1749) took 1196 ms. Trace:
I20260709 13:18:01.284053 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 392) took 2367 ms. Trace:
I20260709 13:18:01.284564 18487 rpcz_store.cc:276] 0709 13:17:58.916273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.238061 (+2321788us) service_pool.cc:224] Handling call
0709 13:18:01.283386 (+ 45325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.283636 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.283677 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.283739 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.283791 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.283856 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.283970 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.286831 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 1707) took 1618 ms. Trace:
I20260709 13:18:01.286907 19025 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:01.287343 18489 rpcz_store.cc:276] 0709 13:17:59.668079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.237272 (+1569193us) service_pool.cc:224] Handling call
0709 13:18:01.286218 (+ 48946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.286483 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.286505 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.286562 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:01.286609 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.286661 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.286761 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.288394 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:01.291298 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 61971.5us
I20260709 13:18:01.247351 20303 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:01.297967 18412 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:01.298666 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1771) took 1743 ms. Trace:
I20260709 13:18:01.299021 18412 rpcz_store.cc:276] 0709 13:17:59.555270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.995190 (+1439920us) service_pool.cc:224] Handling call
0709 13:18:01.298602 (+303412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.295907 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1774) took 1674 ms. Trace:
I20260709 13:18:01.280019 18490 rpcz_store.cc:276] 0709 13:18:00.082630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.227973 (+1145343us) service_pool.cc:224] Handling call
0709 13:18:01.279418 (+ 51445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.267954 20345 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:01.312291 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1777) took 1680 ms. Trace:
I20260709 13:18:01.312711 18415 rpcz_store.cc:276] 0709 13:17:59.632252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.245678 (+1613426us) service_pool.cc:224] Handling call
0709 13:18:01.280100 (+ 34422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.306329 (+ 26229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.306360 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.312042 (+  5682us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.312083 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.312148 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.312240 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:01.309826 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 62910.9us
W20260709 13:18:01.080338 20323 ts_tablet_manager.cc:1469] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Trace:
0709 13:17:49.914492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.919401 (+  4909us) service_pool.cc:224] Handling call
0709 13:17:50.157980 (+238579us) ts_tablet_manager.cc:934] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809)
0709 13:17:51.550611 (+1392631us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:51.851393 (+300782us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:51.851521 (+   128us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:52.362682 (+511161us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:52.362968 (+   286us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:52.378055 (+ 15087us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:52.379179 (+  1124us) inbound_call.cc:177] Queueing success response
0709 13:17:53.715756 (+1336577us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:18:00.393680 (+6677924us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:18:00.427255 (+ 33575us) tablet_replica.cc:261] Starting instrumentation
0709 13:18:00.613300 (+186045us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":98768,"mutex_wait_us":10667,"raft.queue_time_us":6567,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":31154,"tablet-copy.queue_time_us":226488,"tablet-download-pool.queue_time_us":3911,"tablet-download-pool.run_cpu_time_us":1477,"tablet-download-pool.run_wall_time_us":284669,"thread_start_us":215356,"threads_started":2}
I20260709 13:18:01.303966 18414 rpcz_store.cc:276] 0709 13:17:59.621862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.231607 (+1609745us) service_pool.cc:224] Handling call
0709 13:18:01.272536 (+ 40929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.295592 (+ 23056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.295834 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.314914 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 394) took 2286 ms. Trace:
I20260709 13:18:01.320470 18492 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:01.321053 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1739) took 1243 ms. Trace:
I20260709 13:18:01.322220 18492 rpcz_store.cc:276] 0709 13:18:00.077509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.274751 (+1197242us) service_pool.cc:224] Handling call
0709 13:18:01.317419 (+ 42668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.320841 (+  3422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.321005 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.319638 18484 rpcz_store.cc:276] 0709 13:17:59.022644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.235349 (+2212705us) service_pool.cc:224] Handling call
0709 13:18:01.280422 (+ 45073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.308603 (+ 28181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.308630 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.308670 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:01.308703 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.308765 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.308884 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10610,"raft.queue_time_us":28656,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3799}
I20260709 13:18:01.325376 20480 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:01.305359 20553 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:01.328209 20553 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:01.329039 18344 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:01.329944 20529 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:01.331485 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 111425us
W20260709 13:18:01.331992 19026 connection.cc:256] RPC call timeout handler was delayed by -1.1454347900000812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
I20260709 13:18:01.333559 18308 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:01.334627 18308 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:01.335460 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:01.342314 18457 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:01.268545 18338 rpcz_store.cc:269] 0709 13:17:59.497242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.051267 (+1554025us) service_pool.cc:224] Handling call
0709 13:18:01.234544 (+183277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.346154 20558 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:01.347595 18484 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:18:01.351541 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 113523us
I20260709 13:18:01.348052 20553 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:01.319437 20408 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:01.343961 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:01.325788 20480 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:01.360628 18308 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:01.362726 19026 leader_election.cc:400] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3.
I20260709 13:18:01.365844 19026 leader_election.cc:403] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.365139 18491 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:01.366358 19025 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:01.371349 18411 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:01.350935 20486 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:01.296929 20362 consensus_queue.cc:260] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:18:01.378733 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 72113.4us
I20260709 13:18:01.363195 20408 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.363701 20480 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:01.424383 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 101211us
I20260709 13:18:01.426276 18382 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:01.435648 20455 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:01.436300 20455 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.436728 20455 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:01.372952 20484 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:01.442319 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 697) took 1568 ms. Trace:
W20260709 13:18:01.443034 18384 leader_election.cc:336] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.535s (SENT)
W20260709 13:18:01.444128 18384 leader_election.cc:336] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.634s (SENT)
I20260709 13:18:01.442893 19059 rpcz_store.cc:276] 0709 13:17:59.874067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.821378 (+947311us) service_pool.cc:224] Handling call
0709 13:18:00.834439 (+ 13061us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:00.894493 (+ 60054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.894547 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:00.895220 (+   673us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.220281 (+325061us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.220341 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.220442 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.441982 (+221540us) raft_consensus.cc:1685] finished
0709 13:18:01.442010 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.442215 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59420,"raft.queue_time_us":60932,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":157,"thread_start_us":324535,"threads_started":1,"wal-append.queue_time_us":527284}
W20260709 13:18:01.445062 18384 leader_election.cc:336] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.770s (SENT)
W20260709 13:18:01.446681 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 94845.2us
W20260709 13:18:01.449604 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 91599.3us
W20260709 13:18:01.451750 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 319516us
I20260709 13:18:01.462530 18335 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:01.380085 20364 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:01.378381 20553 raft_consensus.cc:697] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:01.368276 20558 raft_consensus.cc:697] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:01.441715 20484 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:01.447583 20408 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.471240 18308 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:01.368654 20548 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:01.472795 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 113708us
I20260709 13:18:01.462950 20486 raft_consensus.cc:2764] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:18:01.447788 20345 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3.
I20260709 13:18:01.478089 20521 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:01.479400 20553 consensus_queue.cc:237] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:01.481383 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:01.480515 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:01.481026 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 103982us
I20260709 13:18:01.453579 20529 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:01.482400 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:01.483927 18344 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:01.486450 19025 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:01.488209 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:01.496709 19060 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:01.488262 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:01.489071 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:01.489732 20601 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:01.489867 18382 leader_election.cc:400] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5.
I20260709 13:18:01.503794 18382 leader_election.cc:403] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.490406 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:01.491472 20455 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:01.480262 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 48231.4us
I20260709 13:18:01.494843 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:01.496748 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:01.506744 19061 raft_consensus.cc:2393] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:01.453362 20423 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:01.511598 20548 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:01.505977 20601 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:01.532226 19059 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:01.546120 19054 raft_consensus.cc:1217] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:18:01.531047 20558 consensus_queue.cc:237] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:01.545575 19057 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:01.495697 20529 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.545679 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:01.505070 18382 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:01.502511 20588 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.581800 18308 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:01.584514 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 79619.7us
I20260709 13:18:01.586889 18493 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:01.587527 18382 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:01.547824 19055 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:01.586889 20548 raft_consensus.cc:2764] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:01.596165 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.597060 18344 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
W20260709 13:18:01.598403 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 92964.3us
I20260709 13:18:01.567193 20601 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:01.582756 20529 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.606307 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.609885 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.594300 20484 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:01.609578 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.616503 18411 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:01.626127 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 399) took 1968 ms. Trace:
I20260709 13:18:01.626938 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.587352 20364 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:01.630331 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.605225 20548 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:01.629276 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:01.631647 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1747) took 1549 ms. Trace:
W20260709 13:18:01.632110 20600 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:18:01.632740 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:01.618611 20484 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.634953 20521 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.643044 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:01.645525 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 99920.1us
I20260709 13:18:01.646085 18412 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:01.585994 20588 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:01.634167 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.646262 18382 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:01.650354 18344 raft_consensus.cc:2393] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 4: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:01.650899 18457 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:01.651861 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.652364 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1781) took 1295 ms. Trace:
I20260709 13:18:01.654546 18335 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:01.659451 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.659651 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.660187 18414 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:01.660282 18339 raft_consensus.cc:2368] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:01.648626 20341 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:01.642359 18487 rpcz_store.cc:276] 0709 13:18:00.082125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.285762 (+1203637us) service_pool.cc:224] Handling call
0709 13:18:01.316586 (+ 30824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.611677 (+295091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.615380 (+  3703us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.624539 (+  9159us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.627664 (+  3125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.631428 (+  3764us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.631573 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":274159,"thread_start_us":132171,"threads_started":1}
I20260709 13:18:01.662261 18308 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:01.650588 20523 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5.
I20260709 13:18:01.671345 19060 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
W20260709 13:18:01.665282 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 55607.6us
I20260709 13:18:01.677125 18382 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:01.677501 20341 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:01.678042 18382 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:01.678143 20341 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.678573 19060 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEARNER]: Advancing to term 4
I20260709 13:18:01.659757 20607 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:01.648963 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:01.681151 19056 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:01.665082 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:01.653541 20484 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:01.695746 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.657567 18418 rpcz_store.cc:276] 0709 13:18:00.351144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.248619 (+897475us) service_pool.cc:224] Handling call
0709 13:18:01.248970 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.249232 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:01.463630 (+214398us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.645876 (+182246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.645944 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.645999 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.646082 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.646331 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31108,"raft.queue_time_us":33738,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":23589,"thread_start_us":364573,"threads_started":3}
I20260709 13:18:01.659134 20613 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:01.656359 20521 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.701864 19057 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:01.703637 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.704811 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.705536 18417 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:18:01.706539 20605 log.cc:927] Time spent T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:18:01.706643 20423 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:01.707019 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.653136 20548 raft_consensus.cc:697] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:01.707765 18411 raft_consensus.cc:2393] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:01.708168 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:01.710343 18384 leader_election.cc:400] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4.
I20260709 13:18:01.718045 19061 raft_consensus.cc:2393] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:01.719810 19059 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:01.659138 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.763382 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:01.721710 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:01.723097 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 97173.2us
I20260709 13:18:01.749814 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.769861 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:01.757695 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 51758.6us
I20260709 13:18:01.770164 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.771231 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:01.770640 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:01.771442 18416 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:01.774773 19054 raft_consensus.cc:2393] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:01.784343 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:01.784447 18417 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:01.626950 18337 rpcz_store.cc:276] 0709 13:17:59.649005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.098090 (+1449085us) service_pool.cc:224] Handling call
0709 13:18:01.098409 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.100928 (+  2519us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:01.366899 (+265971us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.617279 (+250380us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.617410 (+   131us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.617483 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.617592 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.617745 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":388346,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":22888,"thread_start_us":416289,"threads_started":2}
I20260709 13:18:01.676014 20486 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:01.795918 20604 log.cc:927] Time spent T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:01.796434 20362 ts_tablet_manager.cc:1434] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.631s	user 0.023s	sys 0.046s
I20260709 13:18:01.796977 20480 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:01.802237 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:01.847486 18411 raft_consensus.cc:2393] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 4: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:01.806061 20408 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:01.826606 20621 raft_consensus.cc:2764] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:01.827386 20614 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:01.770882 20523 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:01.798098 20364 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:01.831048 20486 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:01.707356 20423 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.799147 20548 consensus_queue.cc:237] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:01.870743 20423 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:01.874177 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 48802.7us
I20260709 13:18:01.858232 20614 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.832336 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:01.749728 20606 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:18:01.715734 20345 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:01.850415 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 122549us
I20260709 13:18:01.772261 20455 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:01.749169 20141 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:01.858443 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 180503us
W20260709 13:18:01.839130 20362 ts_tablet_manager.cc:1467] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Tablet startup took 680ms
W20260709 13:18:01.785391 19027 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 2.069s (SENT) [suppressed 56 similar messages]
W20260709 13:18:01.847627 20517 consensus_meta.cc:287] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.601s	user 0.006s	sys 0.008s
I20260709 13:18:01.846632 20480 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:01.862541 19053 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:01.850119 20607 raft_consensus.cc:697] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:01.910545 20517 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:01.917169 20517 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:01.918808 20303 consensus_meta.cc:287] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.008s
I20260709 13:18:01.919217 20303 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:01.920415 18384 leader_election.cc:400] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3.
I20260709 13:18:01.920760 18384 leader_election.cc:403] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.917438 20607 consensus_queue.cc:237] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:01.928537 18488 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:01.930022 19025 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:01.830199 18457 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:01.796087 20504 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:01.829385 18410 raft_consensus.cc:2368] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:01.862927 20523 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:01.866639 20486 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.846105 20521 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:01.897336 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 234107us
W20260709 13:18:01.911569 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 126263us
I20260709 13:18:01.930209 18382 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:01.921559 20303 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:01.921527 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:01.889210 20614 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:01.942781 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 1810) took 1847 ms. Trace:
W20260709 13:18:01.944666 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 114564us
I20260709 13:18:01.912365 20141 raft_consensus.cc:697] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:01.927476 20345 raft_consensus.cc:697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:01.950390 18413 rpcz_store.cc:276] 0709 13:18:00.086810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.275701 (+1188891us) service_pool.cc:224] Handling call
0709 13:18:01.309339 (+ 33638us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.315742 (+  6403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.315770 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.322796 (+  7026us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.454954 (+132158us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.455021 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.455140 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.933531 (+478391us) raft_consensus.cc:1685] finished
0709 13:18:01.933560 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.933733 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6109,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7127,"thread_start_us":77144,"threads_started":1,"wal-append.queue_time_us":255873}
I20260709 13:18:01.942622 20523 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:01.960243 20548 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:01.960840 20548 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:01.961782 20548 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:01.947455 19056 raft_consensus.cc:1240] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:01.958864 20588 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:01.956127 20341 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:01.934407 20621 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3.
W20260709 13:18:02.001291 18458 connection.cc:256] RPC call timeout handler was delayed by -1.4066612759997952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 13:18:01.989745 20345 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:01.990233 18457 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:02.002233 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 44192.4us
I20260709 13:18:02.002146 20601 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:02.002673 20341 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:01.953168 20455 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:01.995988 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 48129.5us
W20260709 13:18:02.001700 18458 connection.cc:256] RPC call timeout handler was delayed by -1.4048612759997923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 13:18:02.007234 18458 connection.cc:256] RPC call timeout handler was delayed by -1.1321612759998061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 13:18:02.007565 18458 connection.cc:256] RPC call timeout handler was delayed by -1.1267612759997974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 13:18:02.007927 18458 connection.cc:256] RPC call timeout handler was delayed by -1.1267612759997974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260709 13:18:02.007578 19027 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:01.958261 20613 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:02.011059 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 391) took 3124 ms. Trace:
W20260709 13:18:02.016085 18458 connection.cc:256] RPC call timeout handler was delayed by -1.0691612759999316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 13:18:02.016453 18458 connection.cc:256] RPC call timeout handler was delayed by -1.0691612759999316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 13:18:02.016806 18458 connection.cc:256] RPC call timeout handler was delayed by -1.0655612759999258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 13:18:02.018329 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 119505us
I20260709 13:18:02.011631 18485 rpcz_store.cc:276] 0709 13:17:58.883082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.236872 (+2353790us) service_pool.cc:224] Handling call
0709 13:18:01.237256 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.369422 (+132166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.369452 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.426437 (+ 56985us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.493404 (+ 66967us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.617563 (+124159us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.655469 (+ 37906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.655542 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.006816 (+351274us) raft_consensus.cc:1685] finished
0709 13:18:02.006835 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.006941 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11771,"prepare.queue_time_us":7239,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":168720,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":26344,"thread_start_us":239426,"threads_started":4,"wal-append.queue_time_us":75759}
W20260709 13:18:02.052412 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 48154.4us
I20260709 13:18:02.006456 20455 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.018133 20588 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:18:02.088407 20626 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:02.089464 20523 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:02.090953 20486 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:02.091969 20408 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:02.092811 20484 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:02.092705 20141 consensus_queue.cc:237] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:02.008637 20517 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:02.095150 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 47752us
I20260709 13:18:02.051592 18308 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:02.100044 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:02.102639 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 172491us
I20260709 13:18:02.017995 20601 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:02.089488 20630 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:18:02.102912 19025 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:02.112404 18382 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:02.113162 20621 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:02.113359 20628 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:02.113683 20621 raft_consensus.cc:697] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:02.113837 18382 leader_election.cc:400] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3.
I20260709 13:18:02.113996 20628 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:02.114784 20621 consensus_queue.cc:237] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:02.115274 18382 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:02.115069 20628 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:02.118232 18485 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:02.096529 20455 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.096654 20480 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:02.126101 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 118630us
I20260709 13:18:02.124004 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.135887 18492 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:02.129698 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 78213.1us
I20260709 13:18:02.136660 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.011137 20529 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:02.131039 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:02.139276 18489 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:02.139503 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:02.139864 18307 leader_election.cc:336] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.820s (SENT)
W20260709 13:18:02.140190 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 135726us
I20260709 13:18:02.142185 18384 leader_election.cc:400] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5.
I20260709 13:18:02.142498 18384 leader_election.cc:403] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:02.151497 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.152220 18485 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:02.154265 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.154829 18493 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:02.155150 18382 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:02.140646 20423 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:02.097798 18488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:18:02.158233 18488 raft_consensus.cc:606] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:02.159045 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.144637 20521 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:02.157989 20627 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:18:02.165122 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.146071 20517 raft_consensus.cc:697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:02.160799 18338 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:02.146853 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:02.172075 18487 raft_consensus.cc:2393] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:02.172128 18382 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:02.098287 20608 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:18:02.190997 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:02.196314 20548 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:02.196844 20548 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:02.197242 20548 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.198308 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.198983 18413 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:02.209632 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:02.210465 18413 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.210577 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:02.215320 18410 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:02.216444 18384 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:02.216603 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 50893.6us
I20260709 13:18:02.220242 20638 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:02.223315 18309 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:02.224433 20614 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:02.226073 20612 log.cc:927] Time spent T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 13:18:02.230053 20634 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:02.230568 20523 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:02.231256 20341 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:02.231583 20486 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:02.232206 20486 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:02.216627 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:02.238646 18485 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
W20260709 13:18:02.241169 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 50444.6us
I20260709 13:18:02.242246 18384 leader_election.cc:400] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4.
I20260709 13:18:02.242604 18384 leader_election.cc:403] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:02.244143 18493 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:02.209844 20621 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5.
I20260709 13:18:02.248824 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:02.220875 20638 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.251830 18492 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:02.253624 18490 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:02.287628 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 69915.8us
I20260709 13:18:02.241408 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.242654 20626 raft_consensus.cc:697] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:02.313970 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 71921.4us
I20260709 13:18:02.314673 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.315485 18492 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:18:02.315989 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 97395.2us
W20260709 13:18:02.288476 20640 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
W20260709 13:18:02.336253 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 45473.5us
I20260709 13:18:02.253675 20638 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:02.345402 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:02.349860 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.350378 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:02.289459 20618 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:02.351217 18410 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:02.351573 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:02.355968 18337 raft_consensus.cc:2368] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 3. Current term is 4.
I20260709 13:18:02.287442 20621 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4.
I20260709 13:18:02.353598 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:02.355607 19026 leader_election.cc:336] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.514s (SENT)
I20260709 13:18:02.358336 18490 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:02.291563 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:02.359651 18492 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:02.343397 18486 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.290992 20634 raft_consensus.cc:697] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:02.362962 19026 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:02.364743 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:02.365329 18485 raft_consensus.cc:2376] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3. Re-sending same reply.
I20260709 13:18:02.367302 18413 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:02.360008 20618 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.358284 20523 raft_consensus.cc:2764] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:02.371147 20628 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:02.407935 20618 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:02.371621 20626 consensus_queue.cc:237] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:02.418393 20634 consensus_queue.cc:237] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:02.373340 18384 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:02.420837 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 74771.8us
I20260709 13:18:02.345110 20548 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:02.358245 20480 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.376199 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:02.405278 20517 consensus_queue.cc:237] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:02.421573 19026 leader_election.cc:336] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.559s (SENT)
I20260709 13:18:02.428948 18309 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:02.437844 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 72921.7us
I20260709 13:18:02.438339 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:02.448581 20603 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:02.449064 20603 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:02.450424 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 77198.9us
I20260709 13:18:02.450682 20603 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.451251 20652 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:02.454674 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:02.456863 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:02.471283 20521 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:02.471840 20521 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:02.457154 18384 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:02.476508 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:02.472986 20521 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:02.477303 20621 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:02.509583 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:02.512390 19027 leader_election.cc:400] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 3. Current term is 4.
I20260709 13:18:02.512696 19027 leader_election.cc:403] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:02.447031 20480 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:02.491305 20484 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:02.517526 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 66779.3us
I20260709 13:18:02.494468 20622 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:02.518709 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:02.522243 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 45868.2us
I20260709 13:18:02.522644 18485 raft_consensus.cc:2376] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4. Re-sending same reply.
W20260709 13:18:02.515339 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 58256us
I20260709 13:18:02.519670 20588 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:02.523967 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:02.498720 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.528971 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:02.529614 18492 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
W20260709 13:18:02.528896 20647 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:18:02.527899 18354 tablet_copy_service.cc:342] P d03b672b2ff044b8bc2a0dfd8180ee19: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-bb654ec8beb54a539b5b6b44aa5181c3 received from {username='slave'} at 127.0.0.1:53812
I20260709 13:18:02.553062 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:02.553835 18485 raft_consensus.cc:2376] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6. Re-sending same reply.
I20260709 13:18:02.528227 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:02.510895 20303 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:02.510987 20529 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:02.526929 20480 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:02.514392 20614 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:02.525473 20634 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:18:02.595641 18308 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:02.548331 18417 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:02.548465 20648 raft_consensus.cc:2764] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:18:02.548871 20548 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:02.549214 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:02.550678 20645 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:02.520768 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:02.551627 18411 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:02.554137 18487 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:02.519593 20616 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 3. Current term is 4.
I20260709 13:18:02.582921 18412 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:01.895301 20362 ts_tablet_manager.cc:1469] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Trace:
0709 13:17:51.060020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.060880 (+   860us) service_pool.cc:224] Handling call
0709 13:17:51.190547 (+129667us) ts_tablet_manager.cc:934] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
0709 13:17:51.637499 (+446952us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:51.921536 (+284037us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:51.921654 (+   118us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:52.313069 (+391415us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:52.337939 (+ 24870us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:52.371349 (+ 33410us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:52.377541 (+  6192us) inbound_call.cc:177] Queueing success response
0709 13:17:53.708181 (+1330640us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b4c000d2540. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d1a8a20 00007f409d1b9a29 00007f409d1ba13f 00007f409d17e2ab 00007f409d1abf3c 00007f409d1ac461 00007f409d1ac768 00007f40a2f3266b 00007f40a3e6f15b 00007f40a3e6ef98 00007f40a3e60322
0709 13:17:58.333246 (+4625065us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:18:01.165733 (+2832487us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:18:01.188964 (+ 23231us) tablet_replica.cc:261] Starting instrumentation
0709 13:18:01.189750 (+   786us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":4979,"mutex_wait_us":23887,"raft.queue_time_us":52060,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":3764,"spinlock_wait_cycles":68698880,"tablet-copy.queue_time_us":115591,"tablet-download-pool.queue_time_us":2663,"tablet-download-pool.run_cpu_time_us":5852,"tablet-download-pool.run_wall_time_us":2172125,"thread_start_us":283707,"threads_started":3}
I20260709 13:18:02.631816 18308 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:02.624243 18354 tablet_copy_service.cc:434] P d03b672b2ff044b8bc2a0dfd8180ee19: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-bb654ec8beb54a539b5b6b44aa5181c3 on tablet bb654ec8beb54a539b5b6b44aa5181c3 with peer 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:02.642328 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 121591us
I20260709 13:18:02.629165 20608 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:02.535099 20627 consensus_queue.cc:1059] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:18:02.583770 20303 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:02.608228 20553 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:18:02.552510 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:02.637866 20558 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:02.641746 20621 raft_consensus.cc:697] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:02.675935 18382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.004s	sys 0.017s
W20260709 13:18:02.676570 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 148427us
W20260709 13:18:02.677035 18382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.005s	sys 0.017s
W20260709 13:18:02.677521 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 504417us
I20260709 13:18:02.686354 18486 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:18:02.687330 18489 raft_consensus.cc:1240] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:02.693570 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 169959us
I20260709 13:18:02.673359 20652 raft_consensus.cc:697] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:02.678005 20558 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:02.697804 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:02.698853 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 66712.9us
W20260709 13:18:02.698292 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 57442.4us
I20260709 13:18:02.702582 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:02.704948 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:02.705803 18337 raft_consensus.cc:2368] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:02.706511 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:02.706812 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:02.677959 20634 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:18:02.708037 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:02.710741 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:02.711547 18335 raft_consensus.cc:2368] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:02.712986 18339 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:18:02.690866 20626 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 13:18:02.703614 20643 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:18:02.709335 20642 log.cc:927] Time spent T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:18:02.695621 20484 consensus_queue.cc:1059] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:18:02.730007 18384 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:02.732213 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:02.788609 18337 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:02.792254 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:02.792904 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:02.707765 20609 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:02.722728 20607 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:02.717221 20608 raft_consensus.cc:697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:02.812633 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 80939.5us
I20260709 13:18:02.711251 20517 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:02.761598 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:02.818756 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 111274us
W20260709 13:18:02.818086 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 88178.3us
I20260709 13:18:02.824579 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.733584 20663 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:02.784046 20651 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:02.828634 19026 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:02.830920 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.831670 18492 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.811439 20548 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:02.835587 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.836249 18488 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:02.831025 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:02.806156 20609 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:02.839236 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.794147 20625 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:02.840031 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.811247 20607 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:02.840867 18484 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.843250 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:02.828300 20653 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:18:02.844033 18485 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.842669 20423 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:02.846992 20660 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:02.848516 20671 consensus_queue.cc:1059] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:02.822196 20517 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.814342 20667 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:02.843158 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:02.864923 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:02.865172 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 45549us
I20260709 13:18:02.866007 18384 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:02.838843 19053 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:18:02.839411 20548 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:02.829471 20663 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:02.851089 20616 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:02.866670 18492 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:02.875448 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:02.872030 18457 leader_election.cc:336] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.708s (SENT)
I20260709 13:18:02.878279 18457 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:02.865017 18429 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-2b12e68055d54f32b4b3e7d0d0c76af4 received from {username='slave'} at 127.0.0.1:44916
I20260709 13:18:02.880213 18412 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:02.880548 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:02.881693 18411 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 5: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:02.864259 20517 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:02.887049 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 63503.3us
I20260709 13:18:02.890146 20625 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:02.869725 20660 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:02.892114 20660 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:02.892321 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:02.892967 18418 raft_consensus.cc:2376] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4. Re-sending same reply.
I20260709 13:18:02.894205 18429 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-2b12e68055d54f32b4b3e7d0d0c76af4 on tablet 2b12e68055d54f32b4b3e7d0d0c76af4 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:02.894385 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:02.895134 18428 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b345033a56994fff90990b7d03324074 received from {username='slave'} at 127.0.0.1:44916
W20260709 13:18:02.895458 20654 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:18:02.895618 18428 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-b345033a56994fff90990b7d03324074 on tablet b345033a56994fff90990b7d03324074 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:02.895967 20607 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:02.898458 20671 raft_consensus.cc:3055] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:02.898934 20671 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:02.899972 20671 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:02.901467 20671 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:02.902261 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.902966 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.905187 20674 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:02.906173 20608 consensus_queue.cc:237] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:02.908430 18427 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-02f16ac6b95a48868f83cdf22debb207 received from {username='slave'} at 127.0.0.1:44916
I20260709 13:18:02.909003 18427 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-02f16ac6b95a48868f83cdf22debb207 on tablet 02f16ac6b95a48868f83cdf22debb207 with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:02.910254 18418 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:02.910849 18413 raft_consensus.cc:1240] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:02.910283 20662 consensus_queue.cc:1059] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:02.911759 20662 raft_consensus.cc:3055] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:02.912124 20662 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:02.906195 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:02.895620 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:02.916330 18484 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:02.914820 18240 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42292 (request call id 340) took 2107 ms. Trace:
I20260709 13:18:02.815327 20621 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:02.871819 20303 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:02.939911 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 51896.8us
I20260709 13:18:02.876852 20548 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.872816 20626 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:02.877774 20663 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.962616 19026 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:02.937490 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 65518.3us
I20260709 13:18:02.937877 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:02.966614 20644 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.652s	user 0.008s	sys 0.009s
I20260709 13:18:02.966840 18384 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:02.967515 20523 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:02.942214 20657 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:18:02.968034 20523 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:02.968606 20523 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:02.942523 20656 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:18:02.883193 20616 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:02.970335 20616 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:02.972744 20618 consensus_meta.cc:287] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.000s
I20260709 13:18:02.828804 20558 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:02.973178 20618 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:02.974123 18458 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:02.975375 18458 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:02.976246 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:02.981590 20614 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:02.913168 20662 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:02.947971 20609 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:02.905722 20674 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:02.843390 20652 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:02.968098 20670 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:02.990073 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 436811us
I20260709 13:18:02.991621 18485 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
W20260709 13:18:02.993559 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 52936.6us
I20260709 13:18:03.015328 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:02.961238 20655 log.cc:927] Time spent T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:18:02.998023 20341 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:03.000479 19025 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:02.968158 18384 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:03.020210 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:03.019131 20455 consensus_meta.cc:287] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.875s	user 0.009s	sys 0.002s
I20260709 13:18:03.024765 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:02.926615 18240 rpcz_store.cc:276] 0709 13:18:00.793198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.798105 (+  4907us) service_pool.cc:224] Handling call
0709 13:18:02.900077 (+2101972us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:01.542479 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:01.549297 (+  6818us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:01.549341 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:18:01.549382 (+    41us) tablet.cc:662] Decoding operations
0709 13:18:01.550034 (+   652us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:01.550097 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:01.550127 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:18:01.550634 (+   507us) tablet.cc:701] Row locks acquired
0709 13:18:01.550679 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:18:01.550836 (+   157us) write_op.cc:270] Start()
0709 13:18:01.550979 (+   143us) write_op.cc:276] Timestamp: P: 1783603081550769 usec, L: 0
0709 13:18:01.551001 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:01.551863 (+   862us) log.cc:844] Serialized 1670 byte log entry
0709 13:18:02.139980 (+588117us) op_driver.cc:464] REPLICATION: finished
0709 13:18:02.367266 (+227286us) write_op.cc:301] APPLY: starting
0709 13:18:02.374645 (+  7379us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:02.374880 (+   235us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:02.405137 (+ 30257us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:02.524267 (+119130us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:02.637129 (+112862us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:18:02.653218 (+ 16089us) write_op.cc:312] APPLY: finished
0709 13:18:02.662935 (+  9717us) log.cc:844] Serialized 41 byte log entry
0709 13:18:02.663138 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:02.663237 (+    99us) write_op.cc:454] Released schema lock
0709 13:18:02.663317 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:02.663737 (+   420us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:02.663770 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":165728,"apply.run_cpu_time_us":5365,"apply.run_wall_time_us":309227,"num_ops":4,"prepare.queue_time_us":286131,"prepare.run_cpu_time_us":19341,"prepare.run_wall_time_us":155968,"raft.queue_time_us":160433,"replication_time_us":550143,"spinlock_wait_cycles":170853760,"thread_start_us":373724,"threads_started":4,"wal-append.queue_time_us":231594}]]}
I20260709 13:18:03.006667 20613 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:02.868362 20667 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.016636 19026 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:03.048606 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:03.049546 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:03.049811 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:03.133116 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 196269us
I20260709 13:18:03.047422 20341 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:18:03.135449 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.137202 19027 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:03.137818 20661 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 13:18:03.142560 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 125966us
W20260709 13:18:03.056771 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 81503us
I20260709 13:18:03.017450 20670 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:03.052150 20455 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:03.139027 20660 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:03.149762 18335 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:03.149704 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:03.154906 18485 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:18:03.055078 20613 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:03.051663 20625 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:03.142136 20341 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.140022 20504 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:03.167171 18337 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:03.158061 20662 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.182358 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:03.185153 18493 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:03.166579 20660 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:03.192525 18485 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:03.170080 20613 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.202127 20516 consensus_queue.cc:1059] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:03.205384 18458 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:03.182786 20692 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:03.213426 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 76335us
I20260709 13:18:03.193370 20480 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:03.215646 18485 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:03.197474 20660 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.206863 20628 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.214083 20614 raft_consensus.cc:2764] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:18:03.238628 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 270534us
I20260709 13:18:03.203986 20677 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.226s
I20260709 13:18:03.218006 20618 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:03.217705 20679 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:03.194872 20675 consensus_queue.cc:1059] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.244s
I20260709 13:18:03.231247 20504 raft_consensus.cc:697] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:03.282600 20686 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:03.283516 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:03.302510 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:03.283404 20685 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:18:03.283023 20603 consensus_meta.cc:287] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.832s	user 0.008s	sys 0.004s
I20260709 13:18:03.330449 20603 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.333256 20480 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:18:03.343895 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 117409us
W20260709 13:18:03.315631 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 315239us
I20260709 13:18:03.301772 20523 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.273890 20692 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:03.233474 20628 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.328169 20504 consensus_queue.cc:237] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.328518 20341 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:03.379786 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 96360.4us
I20260709 13:18:03.383703 18458 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:03.229094 20668 consensus_queue.cc:1059] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.215s
I20260709 13:18:03.392462 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:03.396291 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.374413 20614 raft_consensus.cc:2764] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:03.398556 20679 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.382362 20692 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:03.410557 20697 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.411398 20341 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:03.411115 20697 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.412793 20626 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:03.413275 20626 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:03.413683 20626 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.415529 20694 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:03.416044 20694 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:03.416486 20694 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:03.333884 20480 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:03.422585 20690 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:18:03.426689 20609 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.433568 19027 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:03.434531 20700 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:18:03.436913 20691 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:18:03.385535 20674 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:03.452854 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 65846.6us
I20260709 13:18:03.453686 18384 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:03.454457 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 310982us
I20260709 13:18:03.455407 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:03.466418 18485 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:03.408792 20684 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:03.490362 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:03.409293 20455 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:03.498368 20711 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:03.451576 20303 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:03.501506 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 47916.8us
W20260709 13:18:03.502007 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 100859us
W20260709 13:18:03.504571 18487 consensus_meta.cc:287] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.868s	user 0.013s	sys 0.000s
I20260709 13:18:03.499310 20711 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.500653 20341 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:03.518491 20695 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.495328 20667 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:03.503844 20303 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:18:03.515046 20663 consensus_meta.cc:287] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
W20260709 13:18:03.524718 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 69249.3us
I20260709 13:18:03.521222 20341 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:03.526636 20692 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.527856 20692 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.534958 20523 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:03.536011 20638 consensus_meta.cc:287] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.171s	user 0.008s	sys 0.002s
I20260709 13:18:03.536494 20638 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:03.408649 20679 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.514586 20700 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.539880 18414 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:18:03.547207 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.540330 19026 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:03.542610 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:03.561777 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.524573 20303 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.520318 18487 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:03.564682 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:03.511240 20613 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.526652 20341 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.568352 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:03.547830 20480 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:03.566699 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:03.541636 20679 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:03.562662 20523 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:03.582736 19026 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:03.541783 20455 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:18:03.591569 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:03.566905 20710 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:03.554456 20695 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.597213 20660 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.547070 20663 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.605110 20660 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:03.602115 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:03.605868 18418 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:03.606024 20663 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:03.571604 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1747) took 1140 ms. Trace:
I20260709 13:18:03.606693 20663 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:03.606657 18487 rpcz_store.cc:276] 0709 13:18:02.430959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.438065 (+  7106us) service_pool.cc:224] Handling call
0709 13:18:03.568091 (+1130026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:03.607529 20663 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:03.607582 20708 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:03.608289 20638 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:03.608623 20663 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:03.610001 20665 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:03.606756 18382 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:03.611948 19026 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:03.588619 20621 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:03.614084 18382 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:03.616580 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:03.610499 20665 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:03.614944 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:03.615793 20711 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:03.567586 20614 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:18:03.602130 19056 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:03.617244 20671 consensus_meta.cc:287] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.715s	user 0.014s	sys 0.000s
W20260709 13:18:03.625391 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.618671 20665 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:03.621317 20638 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:03.617583 20480 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:03.616731 20679 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:03.618161 20660 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:03.616873 20621 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:03.634258 20621 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.635416 20709 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:03.637277 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:03.637933 19059 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:03.625752 20517 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.002s
I20260709 13:18:03.618296 20710 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:03.622479 20667 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:03.611367 20523 consensus_queue.cc:1059] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:18:03.642786 19057 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Advancing to term 4
I20260709 13:18:03.643216 20669 raft_consensus.cc:3055] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:03.644930 20548 consensus_meta.cc:287] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.661s	user 0.002s	sys 0.006s
I20260709 13:18:03.645083 20694 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.639408 20695 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:03.653242 19059 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:03.645994 20521 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:03.659723 19061 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:03.662900 19059 raft_consensus.cc:1240] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.662035 18309 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:03.654678 20553 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:03.671082 20693 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:18:03.671695 20694 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:03.679068 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:03.636046 20709 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.654819 20669 raft_consensus.cc:740] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:03.651837 20517 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.676734 20553 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:03.700875 20341 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.701373 20553 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:03.702455 20553 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.697202 20638 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:03.704222 20638 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:03.702944 20341 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:03.676579 20609 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:03.681079 20616 consensus_meta.cc:287] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.002s
I20260709 13:18:03.659499 20548 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.727977 19057 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:03.733613 20645 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:03.757179 18410 raft_consensus.cc:2393] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 3: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:03.760227 20303 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:03.767163 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 96179.3us
I20260709 13:18:03.732419 20609 raft_consensus.cc:697] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:03.768538 18384 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:03.771944 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:03.755908 20613 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:03.772837 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 154933us
W20260709 13:18:03.775858 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 145827us
I20260709 13:18:03.731282 20616 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.779798 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:03.780380 18340 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.773983 20523 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.734747 20710 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.778184 20669 consensus_queue.cc:260] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.793820 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:03.805379 18340 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:03.784212 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:03.805164 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:03.844367 18344 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:03.775444 20621 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.849560 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:03.791126 20607 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.783958 20715 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:03.786017 20684 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:03.810830 20627 raft_consensus.cc:3055] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:03.800688 20603 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:03.792928 20303 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:03.811131 20669 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:03.851872 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 67770.9us
I20260709 13:18:03.854552 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:03.792096 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 820) took 1079 ms. Trace:
I20260709 13:18:03.805691 20548 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:03.792788 20616 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:03.804447 20628 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:03.845302 19055 raft_consensus.cc:1240] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:03.855906 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:03.862304 18491 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:03.862082 20720 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:03.862608 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:03.863078 20719 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:03.861521 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:03.863219 20670 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.864004 18415 raft_consensus.cc:2393] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 2: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:03.862313 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:03.864368 20670 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.862985 20720 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:03.864750 18412 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:03.865001 20720 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:03.845549 20638 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:18:03.860466 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:03.840400 20663 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:18:03.856774 20684 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.859902 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:03.810233 20716 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:18:03.790213 20609 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.795153 20626 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.883502 20621 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:03.884130 20626 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:03.884776 20722 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:18:03.859177 19056 rpcz_store.cc:276] 0709 13:18:02.712893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.713666 (+   773us) service_pool.cc:224] Handling call
0709 13:18:03.125374 (+411708us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:18:03.125655 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.627564 (+501909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.791797 (+164233us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54006f77d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:03.792007 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140112640}
I20260709 13:18:03.866647 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:03.853581 18338 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:18:03.887059 18338 pending_rounds.cc:85] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 6
I20260709 13:18:03.887198 18411 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:03.887307 18338 pending_rounds.cc:107] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:18:03.856554 20627 raft_consensus.cc:740] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:03.880613 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:03.861189 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:03.887831 18338 raft_consensus.cc:2889] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:03.876066 20517 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:03.888420 20548 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.870992 20720 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:03.943723 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.955381 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 74836.7us
I20260709 13:18:03.967716 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:03.970196 19060 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:03.967430 20719 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.966845 20626 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:03.975953 20548 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.973405 20710 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:03.976100 19058 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:03.987048 20716 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.986907 20627 consensus_queue.cc:260] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:03.987689 20716 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:03.988726 20627 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.989581 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:03.991297 20710 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.993494 20710 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:03.980285 20665 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:03.979954 20719 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:03.999208 20684 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.001730 20720 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:04.001958 18414 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1790) took 1838 ms (client timeout 1710 ms). Trace:
W20260709 13:18:04.002436 18414 rpcz_store.cc:269] 0709 13:18:02.163214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.163474 (+   260us) service_pool.cc:224] Handling call
0709 13:18:04.001740 (+1838266us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540025c1d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:04.001869 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3088424704}
I20260709 13:18:04.001962 20700 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:04.000010 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.000010 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.999909 20665 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:04.000654 20716 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:04.007275 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.000448 20719 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:04.002295 20548 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:04.012495 20684 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:04.011428 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 823) took 1295 ms. Trace:
I20260709 13:18:04.015811 19054 rpcz_store.cc:276] 0709 13:18:02.716026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.716158 (+   132us) service_pool.cc:224] Handling call
0709 13:18:03.804936 (+1088778us) spinlock_profiling.cc:243] Waited 971 us on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:18:03.805146 (+   210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:03.838892 (+ 33746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.838938 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:03.847181 (+  8243us) log.cc:844] Serialized 26 byte log entry
0709 13:18:03.971567 (+124386us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:03.971625 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.971722 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:04.003434 (+ 31712us) raft_consensus.cc:1685] finished
0709 13:18:04.003454 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.011355 (+  7901us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":2232576,"thread_start_us":110743,"threads_started":1,"wal-append.queue_time_us":136046}
I20260709 13:18:04.005820 20710 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:18:04.015146 18458 connection.cc:256] RPC call timeout handler was delayed by -2.172074301000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 13:18:04.018976 18458 connection.cc:256] RPC call timeout handler was delayed by -2.1657743010000559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
I20260709 13:18:04.019104 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:04.019349 18458 connection.cc:256] RPC call timeout handler was delayed by -2.0892743010001595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 13:18:04.013649 20548 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:04.021623 20710 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.029084 20710 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:04.029410 20700 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.030186 20700 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:03.980732 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 120472us
W20260709 13:18:04.036494 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 67121us
I20260709 13:18:04.040202 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.041101 18492 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:04.042804 18484 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:04.050379 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 1752) took 1523 ms. Trace:
I20260709 13:18:04.050611 20625 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:04.050830 18489 rpcz_store.cc:276] 0709 13:18:02.526680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.528422 (+  1742us) service_pool.cc:224] Handling call
0709 13:18:02.687122 (+158700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.690631 (+  3509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.050164 (+1359533us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54003fc350. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:04.050315 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363882240}
I20260709 13:18:04.052232 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.052909 18489 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:04.061625 18489 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:18:04.064901 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.068182 20734 consensus_queue.cc:1059] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:04.069706 18382 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:04.051067 20625 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:04.059470 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.072091 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.032722 20660 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:04.053553 20700 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:04.086448 18489 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:04.082448 18485 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
W20260709 13:18:04.088654 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 67043.2us
I20260709 13:18:04.083352 18382 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:04.089716 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:04.090528 18340 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:04.087844 20734 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:04.110499 20734 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.110941 20734 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:04.120152 18458 connection.cc:256] RPC call timeout handler was delayed by -2.0631816050001817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33740000000000003s for a response
I20260709 13:18:04.120537 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.122226 18382 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:04.125238 18342 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:04.127684 18339 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:04.128458 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1751) took 1408 ms. Trace:
I20260709 13:18:04.128801 18339 rpcz_store.cc:276] 0709 13:18:02.719745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.719951 (+   206us) service_pool.cc:224] Handling call
0709 13:18:04.126112 (+1406161us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b5800002a98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:18:04.127499 (+  1387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.128125 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.128351 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3110784}
I20260709 13:18:04.129513 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:04.129863 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.129954 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:04.130374 18414 raft_consensus.cc:2368] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:04.130427 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:04.130864 18415 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:04.131702 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:04.133374 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:04.134142 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:04.133369 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.132053 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.135164 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:04.133598 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.132071 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.136824 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:04.136904 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.138516 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.138682 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.111563 20733 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.140801 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.141624 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.141765 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.139559 18336 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:04.137485 19054 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:04.138439 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.088248 20616 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:18:04.111392 20663 consensus_queue.cc:1059] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:18:04.143963 18411 raft_consensus.cc:2393] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:04.144297 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.134347 20548 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.140801 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:04.145648 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.151041 18414 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:04.143735 18485 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:04.146416 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.127017 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:04.147099 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.147303 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.147380 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.147975 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:04.145514 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.155019 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.152298 18485 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:04.155242 18419 raft_consensus.cc:2368] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:04.148566 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.157071 19060 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:04.143421 20733 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.158753 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:04.160537 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:04.161154 19060 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.162199 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.163646 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:04.164111 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:04.164386 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:04.161679 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.150693 20548 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.166282 18414 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 4: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:04.166626 18411 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:04.168133 18491 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:04.170565 20719 consensus_queue.cc:1059] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:04.172207 20722 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:04.172569 20722 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:04.173482 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:04.174055 19061 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:04.175495 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.177109 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:04.184993 18493 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1741) took 1936 ms (client timeout 1854 ms). Trace:
W20260709 13:18:04.185424 18493 rpcz_store.cc:269] 0709 13:18:02.248111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.248577 (+   466us) service_pool.cc:224] Handling call
0709 13:18:04.184816 (+1936239us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54001b7954. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:04.184929 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2151039360}
I20260709 13:18:04.187611 20709 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:04.190758 20341 raft_consensus.cc:3055] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:04.191176 20341 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:04.177865 18336 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:18:04.192783 20739 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:18:04.192865 18410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 439) took 1301 ms (client timeout 1568 ms). Trace:
W20260709 13:18:04.193513 18410 rpcz_store.cc:269] 0709 13:18:02.891115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.894050 (+  2935us) service_pool.cc:224] Handling call
0709 13:18:04.192633 (+1298583us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b540011c6d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:04.192795 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981960960}
I20260709 13:18:04.193986 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 819) took 1482 ms. Trace:
I20260709 13:18:04.194446 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:04.194411 19058 rpcz_store.cc:276] 0709 13:18:02.712087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.714287 (+  2200us) service_pool.cc:224] Handling call
0709 13:18:03.697123 (+982836us) spinlock_profiling.cc:243] Waited 8.35 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7eee 0000000000375939 00007f40a3e2b1e0 00007f40a3ef40c4 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:18:03.728725 (+ 31602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.002381 (+273656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.193746 (+191365us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54007602d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:04.193904 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447757952}
I20260709 13:18:04.195798 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:04.196600 19056 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:04.198488 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 415) took 1055 ms. Trace:
I20260709 13:18:04.198982 18338 rpcz_store.cc:276] 0709 13:18:03.143451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.146942 (+  3491us) service_pool.cc:224] Handling call
0709 13:18:03.192025 (+ 45083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.977269 (+785244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.198189 (+220920us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54002d14d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:04.198409 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1411424000}
I20260709 13:18:04.200461 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.201167 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:04.201690 19054 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.165822 20663 consensus_queue.cc:1059] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:18:04.153306 20660 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.161715 20733 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.213683 18419 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:04.220559 18344 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:04.226887 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:04.222313 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.223978 18337 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:04.174744 20548 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:04.224888 18458 connection.cc:256] RPC call timeout handler was delayed by -1.9848743009999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
W20260709 13:18:04.235746 18458 connection.cc:256] RPC call timeout handler was delayed by -1.0938743010001417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32380000000000003s for a response
I20260709 13:18:04.215710 19025 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:04.192963 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.225350 19060 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:18:04.227950 18491 raft_consensus.cc:2410] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:04.224284 18340 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:04.234382 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.272385 18344 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:04.274643 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:04.279737 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:04.281963 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 47531.4us
I20260709 13:18:04.201843 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.195812 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:04.310899 19060 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:04.313519 20345 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:04.283167 20709 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.228672 20700 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:18:04.302503 19058 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.283923 20516 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:18:04.361109 18384 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.364722 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:04.366393 18384 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:04.384016 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.387542 18338 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:04.390758 18338 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:04.393177 18457 leader_election.cc:400] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:04.393512 18457 leader_election.cc:403] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:04.394793 18384 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.398572 19061 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
W20260709 13:18:04.409348 18307 connection.cc:256] RPC call timeout handler was delayed by -1.0129046340000514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:18:04.341457 19056 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:04.410820 18457 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:04.411736 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:04.301337 20740 consensus_queue.cc:1059] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
W20260709 13:18:04.416105 18307 leader_election.cc:336] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.600s (SENT)
I20260709 13:18:04.416700 18307 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.419584 18458 leader_election.cc:400] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:04.420051 18458 leader_election.cc:403] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:04.327360 20455 consensus_queue.cc:1059] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
W20260709 13:18:04.408634 20609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.024s	sys 0.055s
I20260709 13:18:04.374862 20719 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.371390 20648 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.429116 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:04.412809 20626 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.422616 20718 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:04.431237 20732 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.422375 20673 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.465809 18335 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:04.466398 20684 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:04.408707 20616 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.467521 20616 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:04.430215 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.469952 20455 raft_consensus.cc:3055] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:04.470216 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.470511 20455 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:18:04.470831 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.471465 20455 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.473012 20455 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.474615 20364 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.475134 20364 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.438782 18457 leader_election.cc:400] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:04.443940 20626 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:04.444079 19061 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:18:04.444571 20718 raft_consensus.cc:697] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:04.420637 20720 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
W20260709 13:18:04.431053 20609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.025s	sys 0.055s
I20260709 13:18:04.486876 18307 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:04.440450 20708 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:04.436296 20648 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:18:04.499318 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 60695.9us
I20260709 13:18:04.503769 18457 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:04.501812 18337 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:04.461354 20734 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:04.508488 18458 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:04.433728 20638 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:18:04.486027 20732 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:04.489368 20626 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:04.517707 18457 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:04.498713 20627 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:04.506291 20648 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.520830 18458 leader_election.cc:400] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:04.521180 18458 leader_election.cc:403] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:04.507223 20720 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.525993 18458 leader_election.cc:400] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:04.526993 18458 leader_election.cc:403] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:04.520496 20716 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:04.535439 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 106413us
I20260709 13:18:04.536978 18457 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:04.523727 20627 raft_consensus.cc:697] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:04.516129 20732 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:04.532886 20731 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:04.664379 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 130104us
I20260709 13:18:04.665316 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:18:04.640220 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 347508us
I20260709 13:18:04.666145 20680 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.666638 20680 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.667023 20680 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:04.586778 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.525727 20740 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.603434 19054 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:04.580281 18488 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:04.563891 18492 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:18:04.580658 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 54857.2us
I20260709 13:18:04.640198 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:04.536676 20517 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:04.672971 18491 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:04.631692 20745 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:18:04.669711 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 132797us
I20260709 13:18:04.532369 20708 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
W20260709 13:18:04.610445 20746 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:18:04.677261 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:04.641552 20614 raft_consensus.cc:3055] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:04.692157 20614 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:04.693007 20614 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.694197 20614 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:04.694609 20731 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.695665 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.696451 18339 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:04.698006 18339 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:04.669624 20455 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.625670 19058 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:18:04.642944 20341 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:04.687775 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.704107 20423 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:04.704784 18343 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:04.704480 20755 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:04.634943 20734 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:04.708101 18457 leader_election.cc:336] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.562s (SENT)
I20260709 13:18:04.709520 20658 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.710773 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.711810 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:04.713290 18307 leader_election.cc:336] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.529s (SENT)
I20260709 13:18:04.704595 20719 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:18:04.704099 20341 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.718175 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.710216 20658 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.720021 20733 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:04.721210 18413 raft_consensus.cc:2368] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:04.688004 20709 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.532781 20718 consensus_queue.cc:237] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.730880 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:04.689209 20697 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:04.539850 20716 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.689704 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.609144 20626 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.700176 18491 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:04.732789 18419 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:04.733783 20716 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:04.734079 18419 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:04.735316 20732 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:04.735675 18412 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:04.723706 20750 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.736635 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.736404 20750 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.585872 20722 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.738739 20750 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:04.739099 20658 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:04.741560 18307 leader_election.cc:336] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.541s (SENT)
I20260709 13:18:04.714802 18489 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:04.724733 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1810) took 1816 ms. Trace:
I20260709 13:18:04.690219 20627 consensus_queue.cc:237] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:04.676149 20548 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:04.746052 18415 raft_consensus.cc:2368] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:04.746315 20548 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:04.728412 20733 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:04.747145 18414 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:04.747686 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:04.748782 18413 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:04.688658 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:04.536715 20625 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.742725 18418 rpcz_store.cc:276] 0709 13:18:02.907954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.911061 (+  3107us) service_pool.cc:224] Handling call
0709 13:18:02.911349 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.606385 (+695036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.724505 (+1118120us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b54000a78d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:04.724680 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596830080}
I20260709 13:18:04.727458 20693 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.743641 18307 leader_election.cc:336] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.565s (SENT)
I20260709 13:18:04.739012 18411 raft_consensus.cc:1240] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:04.726406 19026 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.729058 20648 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.750506 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:04.761611 18410 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:04.758702 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:04.752394 18414 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:04.752338 20672 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:04.766292 19026 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.764262 18411 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:04.769974 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.770545 18485 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:04.772508 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.772708 20748 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.773288 20749 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.773679 20749 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:04.774080 20749 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.776803 19026 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:04.753584 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 50017.2us
I20260709 13:18:04.756888 18419 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:04.758180 19027 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.760628 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.763511 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.764236 20693 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:04.778512 18458 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:04.778787 19027 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:04.784775 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:04.794642 20694 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.795475 20694 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:04.799414 18490 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:04.800937 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 128766us
I20260709 13:18:04.816785 20694 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:04.826377 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.844398 18410 raft_consensus.cc:2393] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 2: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:04.845252 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:04.824663 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 81046.4us
W20260709 13:18:04.846141 18307 leader_election.cc:336] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.715s (SENT)
I20260709 13:18:04.846544 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:04.824565 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 46411.9us
I20260709 13:18:04.826241 18491 raft_consensus.cc:2410] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:18:04.828969 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 52240.9us
I20260709 13:18:04.831112 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:04.831233 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:04.831604 18382 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:04.849283 18419 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 5: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:18:04.831817 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 47787us
I20260709 13:18:04.776172 20750 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.833160 18412 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:04.833981 18457 leader_election.cc:400] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:04.853175 18457 leader_election.cc:403] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:04.799589 20622 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.861877 18485 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:04.796727 20516 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:04.866235 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:04.859737 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 75027.2us
I20260709 13:18:04.867015 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.867702 18419 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:04.868099 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:04.877033 20680 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:04.877882 20772 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:04.848376 19026 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:04.796886 20740 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.863332 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:04.826607 20455 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:04.869817 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:04.893625 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.894694 18484 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:18:04.895457 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 98438.7us
I20260709 13:18:04.897076 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.898010 18484 raft_consensus.cc:2376] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4. Re-sending same reply.
I20260709 13:18:04.899326 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.901603 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.799732 20672 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:18:04.896425 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:04.902730 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 54413.1us
I20260709 13:18:04.861512 20709 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.871536 20622 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.862331 20658 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.904917 18414 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 1.
I20260709 13:18:04.912037 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:04.912902 18485 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:04.913518 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.847801 20670 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:18:04.880156 20423 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.873028 20614 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.872762 20761 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:04.905380 19026 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.915072 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.915377 20673 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:04.916195 20516 raft_consensus.cc:697] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:04.916707 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 66195us
I20260709 13:18:04.851576 20609 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:18:04.910923 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:04.907133 20627 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:04.923949 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 77776.1us
W20260709 13:18:04.924420 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 140836us
W20260709 13:18:04.928236 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 55261us
I20260709 13:18:04.903609 20628 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:04.935429 18307 leader_election.cc:336] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.823s (SENT)
I20260709 13:18:04.935961 18384 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.931154 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:04.936767 19027 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:04.937784 18307 leader_election.cc:336] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.803s (SENT)
I20260709 13:18:04.937649 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.938889 18489 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:04.873251 20626 consensus_queue.cc:1059] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:18:04.939083 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.938819 18493 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:04.903668 20740 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:04.943849 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:04.945287 18493 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.936205 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.922516 20622 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.881270 20720 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:18:04.889930 20718 consensus_queue.cc:1059] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:18:04.881521 20755 consensus_queue.cc:1059] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:18:04.952977 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 75451.7us
I20260709 13:18:04.950330 18484 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:04.951331 18384 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.952049 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.944286 20608 raft_consensus.cc:3055] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:04.954648 20776 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:04.954895 20608 raft_consensus.cc:740] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:04.955279 20776 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.955644 20776 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:04.955835 20608 consensus_queue.cc:260] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:04.957077 20608 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.950573 20516 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.960829 18493 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:04.961809 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:04.962545 20673 raft_consensus.cc:3055] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:04.962988 20673 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:04.963110 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:04.963562 18307 leader_election.cc:336] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.854s (SENT)
I20260709 13:18:04.964143 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:04.964370 18307 leader_election.cc:336] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.873s (SENT)
I20260709 13:18:04.964761 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.954744 18489 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:04.966358 18384 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.961804 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:04.968429 18493 raft_consensus.cc:2376] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6. Re-sending same reply.
I20260709 13:18:04.966008 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.971396 18489 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:04.972105 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.969583 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.946630 20761 raft_consensus.cc:697] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:04.974761 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:04.975577 18307 leader_election.cc:336] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.065s (SENT)
I20260709 13:18:04.980077 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:04.974908 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:04.977360 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:04.977852 18493 raft_consensus.cc:2393] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:04.985481 18490 raft_consensus.cc:2410] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:18:04.985507 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 47525.8us
I20260709 13:18:04.986874 18489 raft_consensus.cc:2368] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4.
I20260709 13:18:04.964882 20645 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:04.994761 18490 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:04.973408 20486 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:04.998494 18489 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:04.999557 18414 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:04.963798 20673 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.943164 20770 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:18:04.976714 20670 consensus_queue.cc:1059] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:18:04.999555 18490 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:18:05.002367 18307 leader_election.cc:336] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.208s (SENT)
I20260709 13:18:05.003048 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:04.976569 20627 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:05.035929 20345 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:05.036515 18485 raft_consensus.cc:1240] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:05.037369 18307 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:05.039321 18489 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:04.980732 20680 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:04.986624 20697 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.973587 20773 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.985148 20626 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.047472 18490 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:05.018925 20609 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.074019 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:05.075012 18489 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:04.998880 20423 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.979864 20672 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:18:05.023514 20645 raft_consensus.cc:697] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:05.081758 18489 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:05.096109 18414 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.049006 20303 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:18:05.078305 18490 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:04.985478 20676 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:18:05.095613 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 190348us
W20260709 13:18:05.097930 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.098407 20749 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:04.995622 20769 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:18:05.098481 20645 consensus_queue.cc:237] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.049986 20486 raft_consensus.cc:697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:05.047416 20755 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:05.037423 20625 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:05.114116 20761 consensus_queue.cc:237] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:05.112797 19053 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:05.114209 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 111862us
I20260709 13:18:05.122131 19059 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:05.122328 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.125458 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:05.105525 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 129350us
I20260709 13:18:05.129123 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:05.105950 19026 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:05.130142 18337 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
W20260709 13:18:05.132066 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 111729us
I20260709 13:18:05.139809 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:05.104419 20673 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.143103 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:05.143066 19026 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:05.104826 20680 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:05.106681 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:05.145820 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:05.144896 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:05.085875 20658 consensus_queue.cc:1059] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:18:05.107275 20693 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:05.115339 20676 raft_consensus.cc:3055] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:05.148522 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:05.150624 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.150452 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:05.136612 20715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.001s	sys 0.020s
I20260709 13:18:05.154160 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:05.154922 18339 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:18:05.154973 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 242556us
I20260709 13:18:05.115567 20749 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:05.156629 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.095876 20423 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.158264 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:05.162314 18342 raft_consensus.cc:2368] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:05.165993 20693 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.166224 20759 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:05.160634 18307 leader_election.cc:336] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.001s (SENT)
I20260709 13:18:05.155819 19025 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:05.166949 20759 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:05.166788 20693 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:05.167793 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:05.146103 20750 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:05.169283 20759 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:05.154557 20715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.001s	sys 0.020s
I20260709 13:18:05.184538 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:05.185022 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:05.185678 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:05.186309 18485 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:05.187214 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:05.187721 18485 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:05.189518 20423 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:05.178586 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:05.191334 18418 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:05.170809 20769 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:05.162300 20627 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.192934 20627 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:05.179517 19055 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:05.179385 20622 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.114615 20486 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.170128 20614 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:05.182258 19053 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:05.154750 20676 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:05.183979 18490 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:05.142280 20672 consensus_queue.cc:1059] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:18:05.188040 20740 raft_consensus.cc:3055] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:05.178242 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:05.213976 19061 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:05.189601 18485 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:05.145360 20776 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.194312 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:05.174461 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:05.200470 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:05.203758 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:05.211840 18342 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:05.212018 18344 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:05.212302 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:05.217635 18336 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:05.217859 19060 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.222645 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:05.213653 18382 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:05.221012 19057 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:05.226469 18340 raft_consensus.cc:2410] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:05.209805 20748 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:05.214828 20715 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:05.115971 20755 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.215339 20769 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:05.235678 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:05.258052 19054 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:05.258065 18411 raft_consensus.cc:1240] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:05.261430 18382 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:05.213644 20740 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:05.217247 20638 consensus_queue.cc:1059] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:18:05.301970 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 141394us
W20260709 13:18:05.304191 18307 leader_election.cc:336] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.013s (SENT)
W20260709 13:18:05.299993 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 64406.9us
W20260709 13:18:05.303257 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 46737.4us
I20260709 13:18:05.306229 18486 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:05.306695 18382 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:05.308198 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:05.309015 18307 leader_election.cc:336] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.034s (SENT)
I20260709 13:18:05.309459 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:05.260319 20693 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:05.314510 18382 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:05.232708 20715 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:05.300258 18338 raft_consensus.cc:1240] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.260475 20626 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:05.256790 20733 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.300745 20672 raft_consensus.cc:3055] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:05.317572 19026 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:05.330122 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:05.330933 20773 raft_consensus.cc:3055] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:05.331322 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:05.331410 20773 raft_consensus.cc:740] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:05.332350 20761 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:05.332751 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:05.332412 20773 consensus_queue.cc:260] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.333287 20638 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:05.334940 20638 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:05.329376 20672 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:05.318084 18382 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:05.315198 20759 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:05.322758 18309 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:05.324049 20791 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.303011 20645 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.341172 20645 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:05.341517 20645 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.285249 20609 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.342921 20609 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.344882 20609 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:05.336827 18489 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:18:05.320086 18307 leader_election.cc:336] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.164s (SENT)
I20260709 13:18:05.260864 20716 consensus_queue.cc:1059] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:18:05.347249 18307 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:05.319188 20694 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:05.326411 20693 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:05.352442 20651 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:05.325881 20626 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:05.341845 20645 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.350476 20773 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.339334 20665 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:05.353749 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:05.360687 20759 raft_consensus.cc:697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:05.359012 20651 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.364912 20791 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:18:05.353762 20658 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:18:05.361021 20626 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.414285 20616 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:05.416100 20785 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:05.352610 20740 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.361737 20715 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.383476 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:05.418731 20715 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.419528 18341 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:05.335954 20672 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.356673 20693 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.420917 20693 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.416853 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:05.423091 18418 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:05.355746 20733 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:18:05.363816 20770 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:05.416797 20364 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:05.443673 20693 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:05.358165 20609 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:05.423775 20627 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:05.395704 19060 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:05.354579 20694 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:05.438808 20789 log.cc:927] Time spent T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:05.439687 20740 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.440675 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1795) took 1322 ms. Trace:
I20260709 13:18:05.442577 20755 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:05.443298 20759 consensus_queue.cc:237] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:05.417845 20790 log.cc:927] Time spent T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:05.406158 20651 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.424640 20622 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:05.450071 18335 rpcz_store.cc:276] 0709 13:18:04.118451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.124877 (+  6426us) service_pool.cc:224] Handling call
0709 13:18:05.440452 (+1315575us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54000e9cd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:05.440572 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724826368}
I20260709 13:18:05.447340 20694 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.446754 20749 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:05.460856 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 143334us
I20260709 13:18:05.461696 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:05.463171 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:05.462575 20622 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:05.465138 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 133885us
I20260709 13:18:05.476703 18485 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:05.477792 18416 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:05.478605 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:05.476759 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 140307us
I20260709 13:18:05.479247 18485 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:05.483914 20770 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:05.484344 20770 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:05.484727 20770 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.454484 20645 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:05.463938 20749 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.489485 20645 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:05.501684 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:05.502496 19060 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:05.474870 20761 raft_consensus.cc:697] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:05.512332 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:05.514250 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.514873 18309 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:05.516283 18484 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:05.517228 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:05.517444 18382 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:05.517767 18484 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.496199 20645 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.498121 20801 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:05.518404 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:05.526969 19061 raft_consensus.cc:2376] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5. Re-sending same reply.
I20260709 13:18:05.480094 20548 consensus_queue.cc:1059] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:18:05.499763 20662 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:05.542889 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:05.529011 20645 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.535351 20616 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:05.535265 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:05.538077 20627 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:05.541239 18484 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:05.542534 20665 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:05.548676 20548 consensus_queue.cc:1243] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:05.551862 18382 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:05.553211 20665 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:05.554335 20627 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.556828 20665 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:05.557008 20627 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.522393 20668 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.561967 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:05.543087 20662 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.565973 20791 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:05.566651 20791 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:05.567833 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:05.567627 20791 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.568378 18492 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.556119 20616 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.563932 20798 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:05.576272 18485 raft_consensus.cc:2410] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:05.513700 20786 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
W20260709 13:18:05.579668 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.560245 20787 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.561690 20693 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:05.590736 18485 raft_consensus.cc:3055] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:05.591367 18485 raft_consensus.cc:740] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:05.593822 18492 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:05.594952 18382 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:05.578035 20755 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.583954 20658 raft_consensus.cc:1064] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:18:05.581852 20798 raft_consensus.cc:697] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:05.600405 20797 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:05.603242 20616 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:05.616166 20693 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.584419 20761 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:05.616703 20693 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.618858 20693 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:05.619837 18384 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:05.620359 19053 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEARNER]: Advancing to term 4
I20260709 13:18:05.620738 20760 raft_consensus.cc:1064] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:18:05.623018 20754 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:05.626765 20798 consensus_queue.cc:237] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:05.629423 18415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1834) took 1495 ms (client timeout 1562 ms). Trace:
I20260709 13:18:05.604001 20749 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:05.611459 18307 leader_election.cc:336] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.397s (SENT)
I20260709 13:18:05.592463 20645 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:05.614104 20797 raft_consensus.cc:697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:05.630451 18413 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:05.629830 18415 rpcz_store.cc:269] 0709 13:18:04.134052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.134173 (+   121us) service_pool.cc:224] Handling call
0709 13:18:05.629243 (+1495070us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b540025c6d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:05.629365 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385879296}
I20260709 13:18:05.597719 18485 consensus_queue.cc:260] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.646373 20722 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.628857 20760 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.621457 20665 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:05.654121 20769 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:05.654687 20769 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.641849 20651 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.644809 18485 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.659538 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:05.610113 20658 raft_consensus.cc:1068] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: Unable to promote non-voter 31ab487dc52e4f608b39df0fae2fdfa5: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:05.638041 20616 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:05.687656 20775 raft_consensus.cc:3055] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:05.688354 20775 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:05.690472 20665 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:05.687793 20651 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:05.658577 20787 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.600790 20755 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.712981 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:05.713799 19059 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.689198 20775 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:05.691979 20628 consensus_meta.cc:287] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.748s	user 0.005s	sys 0.007s
I20260709 13:18:05.702425 18485 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:05.732039 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:05.732860 18492 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:18:05.737351 18485 raft_consensus.cc:1275] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:05.740058 19059 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:05.718793 20787 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.746270 18309 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:05.748850 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 183677us
I20260709 13:18:05.700506 20616 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.744565 20628 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:05.748010 20775 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.769568 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:05.762763 20651 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:05.771338 20758 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 1.150s	user 0.000s	sys 0.005s
W20260709 13:18:05.772303 20812 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:18:05.774510 20787 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:05.794015 20627 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.800416 20662 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:05.812350 19062 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:05.839826 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:05.838447 18417 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:05.841310 18484 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:05.829464 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:05.839428 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:05.854869 18489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:18:05.855877 18489 raft_consensus.cc:606] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:18:05.854156 18458 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:05.859704 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:05.860553 18492 raft_consensus.cc:2410] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:05.765843 20770 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.815305 20651 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:05.851365 20625 consensus_queue.cc:1059] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:18:05.837595 20341 raft_consensus.cc:3055] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:05.864859 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:05.852411 20740 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:05.834147 20660 raft_consensus.cc:3055] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:05.870878 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:05.784983 20797 consensus_queue.cc:237] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:05.871948 20740 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:05.875607 20740 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.868358 20341 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:05.857103 20722 consensus_queue.cc:1059] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:18:05.872898 20660 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:05.878762 20517 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:05.878945 20722 raft_consensus.cc:3055] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:05.879431 20722 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:05.879222 20660 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.880484 20660 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.880198 20722 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:05.880674 20773 consensus_meta.cc:287] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.005s
I20260709 13:18:05.881349 20722 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.882094 20627 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:05.877692 20341 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.882848 20770 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:05.884850 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:05.902921 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:05.843461 20626 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:05.861586 20423 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:18:05.883899 19053 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEARNER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:05.884500 20616 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:05.867167 20694 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:05.917464 20670 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.001s	sys 0.015s
I20260709 13:18:05.832927 20676 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:05.924823 18489 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:05.929226 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 75186.8us
I20260709 13:18:05.917654 20341 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.930202 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:05.928783 20670 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.001s	sys 0.016s
I20260709 13:18:05.940973 18418 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:05.974725 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1826) took 1221 ms. Trace:
I20260709 13:18:05.975183 18412 rpcz_store.cc:276] 0709 13:18:04.753417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.753627 (+   210us) service_pool.cc:224] Handling call
0709 13:18:04.753881 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.853044 (+ 99163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.974458 (+1121414us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b5400177ad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:05.974655 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181337856}
I20260709 13:18:05.976536 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:06.042881 18412 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:06.042811 20817 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:18:06.109701 20811 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.426s	user 0.000s	sys 0.001s
W20260709 13:18:06.110941 20819 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:18:06.115734 20825 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:18:06.120581 20769 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:06.127450 20694 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:06.128974 20626 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:06.129822 20625 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.940452 20710 raft_consensus.cc:3055] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:06.141228 18412 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:18:06.238174 18412 pending_rounds.cc:85] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 6
I20260709 13:18:06.238520 18412 pending_rounds.cc:107] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:06.238802 18412 raft_consensus.cc:2889] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:05.927044 20651 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:06.262614 20627 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.263356 20627 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:06.235854 20787 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.286108 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 360593us
I20260709 13:18:06.282207 20670 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:06.292757 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.242847 20710 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:06.317304 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 235711us
I20260709 13:18:06.278999 20625 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:06.282179 19055 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:06.300660 20822 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.378867 20773 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.418390 20773 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:06.421025 20773 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:06.318109 20787 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:06.321130 20670 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:06.499739 20820 log.cc:927] Time spent T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.561s	user 0.001s	sys 0.000s
I20260709 13:18:06.463129 20710 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:06.704152 20676 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:06.705730 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.708825 20625 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.709426 20625 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:06.712014 20625 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:06.715369 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.716280 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 456) took 1953 ms. Trace:
I20260709 13:18:06.726847 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1818) took 1526 ms. Trace:
I20260709 13:18:06.727612 18491 rpcz_store.cc:276] 0709 13:18:04.763177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.763296 (+   119us) service_pool.cc:224] Handling call
0709 13:18:06.716071 (+1952775us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b5400374bd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:06.716218 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109006208}
I20260709 13:18:06.728083 18340 rpcz_store.cc:276] 0709 13:18:05.200051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.200164 (+   113us) service_pool.cc:224] Handling call
0709 13:18:06.726594 (+1526430us) spinlock_profiling.cc:243] Waited 8.08 ms on lock 0x7b54002d0ad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:06.726769 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18591488}
W20260709 13:18:06.720026 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.718104 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 741629us
I20260709 13:18:06.734753 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:06.734839 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:06.735419 18340 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:06.736171 20625 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:06.736747 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:06.738201 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:06.739389 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:06.739622 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:06.740677 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:06.741456 20625 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:06.741669 18335 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:06.743040 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:06.749416 18340 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:06.765393 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:06.766408 18337 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:06.806543 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.807487 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.442658 20822 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:06.696750 20722 consensus_meta.cc:287] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.815s	user 0.012s	sys 0.000s
I20260709 13:18:06.809156 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:06.812820 18338 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:06.687976 20787 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:06.818296 20670 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:06.681365 20769 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:06.832803 20722 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:06.820287 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:06.833446 20722 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:06.833959 19058 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:06.744234 20625 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:06.724831 20662 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.823757 20694 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.828606 18337 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:06.831862 18415 raft_consensus.cc:2410] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:06.839994 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:06.842537 20827 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:06.844849 20824 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.841614 20662 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:06.852653 20740 consensus_meta.cc:287] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.977s	user 0.013s	sys 0.000s
I20260709 13:18:06.842239 20694 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:06.848743 20627 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:06.851347 20625 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:06.854955 20722 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:06.861315 20694 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:06.854921 20824 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:06.862063 18384 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 2.030s (SENT) [suppressed 56 similar messages]
I20260709 13:18:06.862804 20740 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:06.868207 20341 consensus_meta.cc:287] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.931s	user 0.009s	sys 0.001s
I20260709 13:18:06.872907 20662 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:06.931205 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 716) took 1902 ms. Trace:
I20260709 13:18:06.931793 19054 rpcz_store.cc:276] 0709 13:18:05.028413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.028549 (+   136us) service_pool.cc:224] Handling call
0709 13:18:05.028952 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.258536 (+229584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.930892 (+1672356us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54006a2f54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:06.931110 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526390144}
I20260709 13:18:06.933128 20663 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.934481 20824 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:06.936642 20829 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:18:06.938632 18419 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:06.939352 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1836) took 1738 ms. Trace:
I20260709 13:18:06.939661 18419 rpcz_store.cc:276] 0709 13:18:05.200859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.938113 (+1737254us) service_pool.cc:224] Handling call
0709 13:18:06.938449 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.939098 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.939291 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:06.941246 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1837) took 1686 ms. Trace:
I20260709 13:18:06.943655 20668 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.904313 20822 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:06.944254 20668 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:06.943655 20740 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:06.946928 20648 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:06.950868 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:06.951335 18490 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:06.951476 18491 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:06.952574 18490 raft_consensus.cc:3055] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:06.952960 18490 raft_consensus.cc:740] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:06.953748 18490 consensus_queue.cc:260] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:06.954721 18490 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.957464 20303 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.958125 20303 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:06.958609 18491 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:06.959879 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:06.960507 18491 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:06.963047 18490 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:06.963308 20663 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:06.958513 18492 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:06.970491 18491 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:06.941555 18419 rpcz_store.cc:276] 0709 13:18:05.255389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.940411 (+1685022us) service_pool.cc:224] Handling call
0709 13:18:06.940734 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.940919 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:06.940948 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:06.940989 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:06.941035 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.941089 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.941196 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:06.972157 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1833) took 1822 ms. Trace:
W20260709 13:18:06.978434 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.994371 18419 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:06.993300 18418 rpcz_store.cc:276] 0709 13:18:05.150234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.434557 (+284323us) service_pool.cc:224] Handling call
0709 13:18:05.446842 (+ 12285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:06.036197 (+589355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.971846 (+935649us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b54000a91d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:06.972071 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128256256}
I20260709 13:18:06.995170 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 457) took 1488 ms. Trace:
I20260709 13:18:06.995728 18419 rpcz_store.cc:276] 0709 13:18:05.506959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.993475 (+1486516us) service_pool.cc:224] Handling call
0709 13:18:06.993930 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.994859 (+   929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.995102 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:06.996742 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 460) took 1480 ms. Trace:
I20260709 13:18:06.997273 18418 rpcz_store.cc:276] 0709 13:18:05.515844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.995677 (+1479833us) service_pool.cc:224] Handling call
0709 13:18:06.996047 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.996277 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:06.996318 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:06.996379 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:06.996445 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.996522 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.996672 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:07.009800 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:07.010329 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:07.010510 18491 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.012012 18343 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:07.012418 18489 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:18:07.010438 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.019237 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.020155 18489 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:07.022393 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:07.023725 18493 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:07.022447 18486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1809) took 2174 ms (client timeout 2041 ms). Trace:
I20260709 13:18:07.025005 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:07.025275 18486 rpcz_store.cc:269] 0709 13:18:04.848521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.848678 (+   157us) service_pool.cc:224] Handling call
0709 13:18:07.022237 (+2173559us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b5400240254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:07.022366 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":813345536}
I20260709 13:18:07.026544 19062 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:07.026706 20341 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.027693 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:07.027451 20341 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.028913 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:07.030159 20341 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:07.029487 19062 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:18:07.031070 20722 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:07.031613 20722 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.032562 20517 raft_consensus.cc:3055] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:07.032972 20517 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:07.033162 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 450) took 2320 ms. Trace:
I20260709 13:18:07.033808 20517 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.034601 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:07.035126 20517 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:07.035485 19061 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:07.033558 18488 rpcz_store.cc:276] 0709 13:18:04.712560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.712692 (+   132us) service_pool.cc:224] Handling call
0709 13:18:04.716212 (+  3520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.629282 (+913070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.629309 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.629753 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:18:05.721680 (+ 91927us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:05.721735 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.796550 (+ 74815us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:07.032859 (+1236309us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54003fbe54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:07.032914 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.032960 (+    46us) raft_consensus.cc:1685] finished
0709 13:18:07.032973 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.033106 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":556,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"spinlock_wait_cycles":2114254080,"thread_start_us":91509,"threads_started":1,"wal-append.queue_time_us":127613,"wal-append.run_cpu_time_us":11608,"wal-append.run_wall_time_us":1051451}
I20260709 13:18:06.970089 19058 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:07.036649 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 1855) took 2052 ms. Trace:
W20260709 13:18:07.036772 19058 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 714) took 2009 ms (client timeout 1834 ms). Trace:
I20260709 13:18:07.036940 20341 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:18:07.037298 19058 rpcz_store.cc:269] 0709 13:18:05.027188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.048092 (+ 20904us) service_pool.cc:224] Handling call
0709 13:18:06.820127 (+1772035us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:18:07.036659 (+216532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12943616}
I20260709 13:18:07.033754 20722 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:07.039944 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:07.060006 18410 raft_consensus.cc:2410] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:07.042322 19059 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:07.042532 18491 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:07.042739 18416 rpcz_store.cc:276] 0709 13:18:04.983710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.098193 (+114483us) service_pool.cc:224] Handling call
0709 13:18:05.098551 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.478302 (+379751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.036421 (+1558119us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54002a5b54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:07.036584 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871760256}
I20260709 13:18:07.045315 19062 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:07.061674 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:07.062036 18382 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:07.062794 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:07.060709 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:07.064128 19054 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:07.063439 19062 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:07.008699 20774 raft_consensus.cc:3055] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:06.967190 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 853) took 1174 ms. Trace:
I20260709 13:18:06.965868 20663 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:07.077275 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:07.070752 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:06.960546 20303 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:07.078823 19062 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:18:07.078856 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:07.080655 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:07.081121 18336 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:07.083319 19054 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:07.084506 18491 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:07.085163 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:07.070900 20722 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:07.038035 20341 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.069314 20774 raft_consensus.cc:740] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:07.112385 19054 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:07.088351 19062 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:07.089236 18343 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:18:07.093885 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 253935us
I20260709 13:18:07.099447 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 458) took 1592 ms. Trace:
I20260709 13:18:07.124307 18415 rpcz_store.cc:276] 0709 13:18:05.508508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.902665 (+394157us) service_pool.cc:224] Handling call
0709 13:18:07.099248 (+1196583us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54002a6554. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:07.099386 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2125498112}
I20260709 13:18:07.101725 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 1763) took 2208 ms. Trace:
I20260709 13:18:07.068234 20694 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:18:07.097674 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 1852) took 2114 ms. Trace:
I20260709 13:18:07.125731 18493 rpcz_store.cc:276] 0709 13:18:04.892907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.983421 (+ 90514us) service_pool.cc:224] Handling call
0709 13:18:07.023516 (+2040095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:07.024360 (+   844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.101525 (+ 77165us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b5400240250. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:07.101661 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4691080064}
I20260709 13:18:07.125972 18414 rpcz_store.cc:276] 0709 13:18:04.983038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.023224 (+ 40186us) service_pool.cc:224] Handling call
0709 13:18:05.051543 (+ 28319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.103974 (+ 52431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.097436 (+1993462us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b54003624d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:07.097608 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102009728}
W20260709 13:18:07.103443 20777 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 2.027s	user 0.010s	sys 0.018s
I20260709 13:18:07.092360 20722 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.134029 20722 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.136636 20423 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:07.137234 20423 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:07.104147 20616 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:07.138362 20423 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.129190 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:07.139747 20423 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.139771 18342 raft_consensus.cc:2376] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5. Re-sending same reply.
I20260709 13:18:07.129513 20774 consensus_queue.cc:260] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:07.162115 20774 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.163961 20668 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:07.130101 20719 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:07.130788 20835 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:07.132609 20779 log.cc:927] Time spent T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 2.056s	user 0.007s	sys 0.016s
I20260709 13:18:07.139120 20776 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:07.105429 20672 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.169808 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:07.170706 19062 raft_consensus.cc:2393] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:07.167066 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:07.087430 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 196407us
I20260709 13:18:07.161094 19027 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:07.168152 18382 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:07.175611 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:07.176445 18410 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:07.167217 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:07.176395 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:07.183228 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:07.180109 18382 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:07.186086 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.186839 18307 leader_election.cc:336] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.777s (SENT)
I20260709 13:18:07.187985 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:07.188616 18307 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:07.188966 18414 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:07.189563 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:07.186134 19027 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:07.191184 19054 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEARNER]: Advancing to term 4
W20260709 13:18:07.192734 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.193262 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.187525 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:07.072063 19055 rpcz_store.cc:276] 0709 13:18:05.792635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.792969 (+   334us) service_pool.cc:224] Handling call
0709 13:18:05.793296 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.401971 (+608675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.966924 (+564953us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b540055a5d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:06.967122 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111932672}
I20260709 13:18:07.212452 19062 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:07.219858 18410 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
W20260709 13:18:07.225124 18307 leader_election.cc:336] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.833s (SENT)
I20260709 13:18:07.227049 18458 leader_election.cc:400] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
W20260709 13:18:07.227907 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 49899.2us
I20260709 13:18:07.228495 20847 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.228924 18382 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:07.229044 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:07.230060 18493 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.167243 20710 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.185292 20622 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.181718 20638 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:07.239319 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 149194us
I20260709 13:18:07.248389 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:07.251166 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:07.252413 20836 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:07.212035 20708 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.211863 20837 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:07.254141 20708 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.256459 20708 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:07.211407 20817 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:07.257483 18458 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:07.211220 20768 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.181308 20663 consensus_queue.cc:1059] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:18:07.181823 20733 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:18:07.223016 20748 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:07.289089 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.313360 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:07.289707 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:07.290812 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:07.291169 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:07.289654 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.291994 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:07.286907 19054 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:07.316776 18485 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:07.319977 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.320748 18485 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:07.259174 20670 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:07.317394 18486 raft_consensus.cc:2368] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6.
I20260709 13:18:07.321768 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:07.323473 18485 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.323388 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.281960 20616 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:07.335958 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 107097us
I20260709 13:18:07.313681 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:07.250497 20668 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:07.292464 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.316820 18488 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:07.324817 18486 raft_consensus.cc:2410] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:07.309500 18493 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:07.258989 20341 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:07.326815 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.261713 20797 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:07.329849 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:07.350598 18491 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
W20260709 13:18:07.332981 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.352201 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.288087 20836 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.336890 18382 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:07.292057 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.294107 20708 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.351536 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.350876 18419 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:07.262094 20622 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.318594 20719 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.172s
I20260709 13:18:07.229035 20847 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:07.511747 19026 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:07.518054 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.358685 20776 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:07.518993 20776 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.519431 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.414674 18414 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:07.359350 18307 leader_election.cc:336] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.641s (SENT)
I20260709 13:18:07.520792 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.522648 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.522235 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:07.523878 20677 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:07.512691 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 1853) took 2515 ms. Trace:
I20260709 13:18:07.524902 18411 rpcz_store.cc:276] 0709 13:18:04.983265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.076319 (+ 93054us) service_pool.cc:224] Handling call
0709 13:18:05.078835 (+  2516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.259251 (+180416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.498256 (+2239005us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540011c6d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:07.498451 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411819776}
I20260709 13:18:07.526268 20778 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:07.526947 20778 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.527580 20670 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:07.528483 19026 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:07.511654 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:07.529076 20670 consensus_queue.cc:1059] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:07.530537 18410 raft_consensus.cc:2410] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:07.416359 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.531447 18488 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:18:07.531530 20783 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:07.532160 20783 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:07.534183 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 175213us
I20260709 13:18:07.489683 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:07.528053 20847 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:07.517199 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.346968 20850 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:07.539073 20776 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:07.539494 20849 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:18:07.541319 20842 log.cc:927] Time spent T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 13:18:07.417013 20668 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:07.372856 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.485447 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:07.557212 18416 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:07.557907 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:07.533670 20780 raft_consensus.cc:3055] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:07.522500 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:07.571609 20780 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:07.526373 20822 consensus_queue.cc:1059] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:18:07.559059 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:07.559348 20846 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:07.559540 20776 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:07.578881 20776 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:07.579581 20776 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:07.579840 20778 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:07.562263 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:07.580530 20778 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.581202 18242 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54880 (request call id 256) took 9592 ms. Trace:
I20260709 13:18:07.581113 20778 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.572518 20780 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.584177 20780 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.581650 18242 rpcz_store.cc:276] 0709 13:17:57.988683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.988870 (+   187us) service_pool.cc:224] Handling call
0709 13:18:00.331077 (+2342207us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b5400270010. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb80b2 00007f40a4d31a89 00007f40a4cc9da6 00007f40a4c9b088 00007f40a4d9937e 00007f40a325a2a4 00007f40a325a232 00007f40a325a161 00007f40a325a0dc
0709 13:18:07.581100 (+7250023us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:01.790022 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:01.797377 (+  7355us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:01.797408 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:18:01.797427 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:01.839182 (+ 41755us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:01.850464 (+ 11282us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:01.857585 (+  7121us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:01.895347 (+ 37762us) tablet.cc:701] Row locks acquired
0709 13:18:01.898296 (+  2949us) write_op.cc:260] PREPARE: finished
0709 13:18:01.935169 (+ 36873us) write_op.cc:270] Start()
0709 13:18:01.948333 (+ 13164us) write_op.cc:276] Timestamp: P: 1783603081932870 usec, L: 0
0709 13:18:01.949767 (+  1434us) op_driver.cc:348] REPLICATION: starting
0709 13:18:02.087977 (+138210us) log.cc:844] Serialized 913 byte log entry
0709 13:18:03.618980 (+1531003us) op_driver.cc:464] REPLICATION: finished
0709 13:18:03.861319 (+242339us) write_op.cc:301] APPLY: starting
0709 13:18:03.863441 (+  2122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:03.863554 (+   113us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:03.863684 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:03.864036 (+   352us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:03.864210 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:18:03.864266 (+    56us) write_op.cc:312] APPLY: finished
0709 13:18:03.864480 (+   214us) log.cc:844] Serialized 29 byte log entry
0709 13:18:03.978145 (+113665us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:03.980119 (+  1974us) write_op.cc:454] Released schema lock
0709 13:18:04.002486 (+ 22367us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:04.020392 (+ 17906us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:04.024241 (+  3849us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":653,"reported_tablets":9,"spinlock_wait_cycles":143924096,"child_traces":[["op",{"apply.queue_time_us":236318,"apply.run_cpu_time_us":46417,"apply.run_wall_time_us":153106,"num_ops":2,"prepare.queue_time_us":441311,"prepare.run_cpu_time_us":4063,"prepare.run_wall_time_us":318599,"replication_time_us":1662447,"thread_start_us":266649,"threads_started":2,"wal-append.queue_time_us":127269,"wal-append.run_cpu_time_us":970,"wal-append.run_wall_time_us":1004800}]]}
I20260709 13:18:07.556267 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:07.420799 18485 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:07.490062 20769 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:07.414952 20770 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.570961 18491 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:18:07.572898 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 213566us
I20260709 13:18:07.358914 20616 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.359110 18418 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:07.590642 18238 catalog_manager.cc:5697] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:07.624012 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.574410 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:07.572525 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:07.626117 18419 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.539439 20850 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.639605 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:07.558890 20851 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.414813 20748 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:07.542073 20709 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.562969 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:07.543569 20733 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:07.314175 20840 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.259s
I20260709 13:18:07.588253 18488 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:07.587742 18411 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:07.555411 20852 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.590117 20769 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.546051 20797 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:07.573431 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:07.608409 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.627285 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.628750 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1825) took 2875 ms. Trace:
W20260709 13:18:07.662703 18307 leader_election.cc:336] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.736s (SENT)
I20260709 13:18:07.662952 18413 rpcz_store.cc:276] 0709 13:18:04.753006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.757205 (+  4199us) service_pool.cc:224] Handling call
0709 13:18:05.630279 (+873074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.642198 (+ 11919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.628474 (+1986276us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b540025c6d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:07.628659 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006791040}
I20260709 13:18:07.626348 18414 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:07.659265 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:07.664856 18418 raft_consensus.cc:2410] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:07.667379 18418 raft_consensus.cc:1240] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:07.668300 18419 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:07.625846 20719 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:07.666105 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 329263us
I20260709 13:18:07.672212 18413 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:07.577402 20836 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:07.677296 18414 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:07.638975 18238 catalog_manager.cc:5697] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 3 to 4, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 4 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.647140 20850 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:07.686609 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.610442 20770 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.692992 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:07.685169 20847 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:18:07.694415 19061 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 2: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:07.687654 18238 catalog_manager.cc:5697] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:07.696455 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.676369 20681 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.734848 18336 raft_consensus.cc:2410] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:18:07.736992 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 206918us
I20260709 13:18:07.738214 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:07.745939 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.747290 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:07.748301 19061 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:07.750844 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:07.751874 19054 raft_consensus.cc:2368] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6.
I20260709 13:18:07.749693 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:07.790740 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 52595.4us
I20260709 13:18:07.802961 19061 raft_consensus.cc:2410] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:07.804108 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:07.656090 20709 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.682063 20638 raft_consensus.cc:697] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:07.818614 19062 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:07.805788 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 470) took 2325 ms. Trace:
I20260709 13:18:07.806543 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:07.807029 19057 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:07.623386 20783 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:07.657323 20851 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:07.876087 18335 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.014s	sys 0.018s
W20260709 13:18:07.890594 18335 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.014s	sys 0.018s
I20260709 13:18:07.892158 19054 raft_consensus.cc:2393] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:07.661311 20733 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.682256 20677 consensus_queue.cc:1059] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
W20260709 13:18:07.894171 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 219155us
I20260709 13:18:07.892488 18484 rpcz_store.cc:276] 0709 13:18:05.480126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.552239 (+ 72113us) service_pool.cc:224] Handling call
0709 13:18:05.552511 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.846369 (+293858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.805550 (+1959181us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b5400137754. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:07.805730 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663346560}
W20260709 13:18:07.869876 20787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.015s	sys 0.046s
I20260709 13:18:07.667582 20852 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.990074 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:07.994472 19062 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:07.995107 20860 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:18:07.996995 20770 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:07.808557 20708 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:07.997650 20814 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 2.306s	user 0.003s	sys 0.019s
I20260709 13:18:07.995265 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:07.998781 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:08.006863 19054 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:07.999529 18411 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:08.000108 19061 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:18:08.001616 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:08.005437 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:07.807355 20857 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:07.977936 20663 consensus_queue.cc:1059] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 13:18:08.013130 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 129055us
I20260709 13:18:08.013477 18492 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:08.014415 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:08.016320 18343 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:08.002246 19053 raft_consensus.cc:1240] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:08.002718 20622 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:08.019678 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:08.021757 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 346706us
I20260709 13:18:07.931455 20822 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:18:07.810562 20681 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:07.892763 20748 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.029551 18343 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:08.013327 19056 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.990485 20859 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:18:08.046830 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:07.943979 20797 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:08.057250 20672 consensus_meta.cc:287] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.878s	user 0.001s	sys 0.006s
I20260709 13:18:08.057837 18341 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:08.060323 20625 raft_consensus.cc:993] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:18:08.040583 20778 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:08.073469 18340 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:08.088950 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:08.093545 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 847) took 2570 ms. Trace:
I20260709 13:18:08.094859 19060 rpcz_store.cc:276] 0709 13:18:05.510960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.511077 (+   117us) service_pool.cc:224] Handling call
0709 13:18:07.640790 (+2129713us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:18:07.641034 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.641342 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.641384 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.652944 (+ 11560us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.934087 (+281143us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:07.934445 (+   358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.935329 (+   884us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.069370 (+134041us) raft_consensus.cc:1685] finished
0709 13:18:08.069397 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.080766 (+ 11369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6500736,"thread_start_us":242455,"threads_started":1,"wal-append.queue_time_us":350349}
I20260709 13:18:08.047506 20668 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.050671 20616 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:08.109462 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1828) took 1125 ms. Trace:
W20260709 13:18:08.110113 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.112063 18335 rpcz_store.cc:276] 0709 13:18:06.983861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.984261 (+   400us) service_pool.cc:224] Handling call
0709 13:18:07.023773 (+ 39512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.024175 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.024203 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.134376 (+110173us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b2c000014c8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:18:07.134832 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.288455 (+153623us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:07.891068 (+602613us) log.cc:844] Serialized 14 byte log entry
0709 13:18:08.078408 (+187340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.078503 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.079358 (+   855us) raft_consensus.cc:1685] finished
0709 13:18:08.109263 (+ 29905us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.109407 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54917,"prepare.queue_time_us":708375,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":394,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":16412928,"thread_start_us":840665,"threads_started":3,"wal-append.queue_time_us":187905}
I20260709 13:18:08.114228 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:08.109422 18384 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.019s	sys 0.003s
W20260709 13:18:08.116283 18384 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.020s	sys 0.004s
I20260709 13:18:08.074942 20672 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:08.116668 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 549207us
I20260709 13:18:08.076022 20755 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:08.186889 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.119182 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 72764.4us
I20260709 13:18:08.121526 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:08.207696 18308 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:08.210533 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1835) took 3010 ms. Trace:
W20260709 13:18:08.150013 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.213675 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 183272us
I20260709 13:18:08.209717 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:08.088356 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 448) took 1338 ms. Trace:
I20260709 13:18:08.037417 20638 consensus_queue.cc:237] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.217301 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:08.215381 18343 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:08.218451 18308 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:08.114593 20719 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:08.208662 20677 raft_consensus.cc:3055] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:08.211174 18412 rpcz_store.cc:276] 0709 13:18:05.199969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.046382 (+846413us) service_pool.cc:224] Handling call
0709 13:18:06.046733 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.239583 (+192850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.210177 (+1970594us) spinlock_profiling.cc:243] Waited 94 ms on lock 0x7b54001c43d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:08.210457 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216182656}
W20260709 13:18:08.208284 20774 consensus_meta.cc:287] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.046s	user 0.007s	sys 0.003s
I20260709 13:18:08.223567 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:08.224843 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:08.224903 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:08.209367 20862 raft_consensus.cc:3055] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:08.227301 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:08.232734 18335 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:08.233652 18343 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:08.235459 18414 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
W20260709 13:18:08.240160 20722 consensus_meta.cc:287] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.106s	user 0.009s	sys 0.015s
I20260709 13:18:08.239375 18339 raft_consensus.cc:1275] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:08.268421 18339 pending_rounds.cc:85] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 2
I20260709 13:18:08.268707 18339 pending_rounds.cc:107] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:08.268965 18339 raft_consensus.cc:2889] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:08.220428 20871 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.217159 18338 rpcz_store.cc:276] 0709 13:18:06.736376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.736499 (+   123us) service_pool.cc:224] Handling call
0709 13:18:08.067713 (+1331214us) spinlock_profiling.cc:243] Waited 75.4 ms on lock 0x7b5400057dd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:08.075207 (+  7494us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173336320}
I20260709 13:18:08.237905 20878 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:08.235258 20862 raft_consensus.cc:740] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:08.246001 20709 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:08.226893 20677 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:08.287590 20722 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.290236 20871 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.298686 20677 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.299975 20677 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.300539 20722 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.300766 20871 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.303665 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1804) took 3765 ms. Trace:
I20260709 13:18:08.250378 20884 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:18:08.305562 20884 consensus_queue.cc:1243] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:08.246138 20719 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.306176 20884 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:08.306624 20884 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.307010 20884 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:08.247411 20852 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:08.251344 18342 raft_consensus.cc:2955] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:18:08.254776 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 719718us
W20260709 13:18:08.253796 18341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 455) took 1515 ms (client timeout 1899 ms). Trace:
I20260709 13:18:08.217034 20672 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.263705 20694 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.222569 20872 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:18:08.277745 20616 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:08.240835 20876 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:18:08.293386 20875 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:08.278172 20865 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.250182 20851 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:08.318234 20817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.011s	sys 0.015s
I20260709 13:18:08.243423 20836 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:08.242583 20681 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:08.311559 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 93167.6us
W20260709 13:18:08.313767 18341 rpcz_store.cc:269] 0709 13:18:06.738362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.739415 (+  1053us) service_pool.cc:224] Handling call
0709 13:18:08.253579 (+1514164us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54000e10d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:08.253721 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3030210944}
W20260709 13:18:08.245548 20866 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:18:08.120678 20769 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:08.248121 20663 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.319886 18458 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:18:08.321808 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 102288us
W20260709 13:18:08.319242 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 87532.2us
I20260709 13:18:08.353029 18384 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:08.310612 20768 consensus_meta.cc:287] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.016s	user 0.020s	sys 0.000s
I20260709 13:18:08.263365 20847 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 13:18:08.327976 18417 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1820) took 3598 ms (client timeout 1609 ms). Trace:
I20260709 13:18:08.328395 18418 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:08.289759 20517 raft_consensus.cc:1081] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:18:08.287987 20878 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.278563 20708 consensus_queue.cc:1059] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:18:08.287919 20822 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:18:08.304153 18487 rpcz_store.cc:276] 0709 13:18:04.537879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.539215 (+  1336us) service_pool.cc:224] Handling call
0709 13:18:04.610410 (+ 71195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:07.084813 (+2474403us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:07.230069 (+145256us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.362896 (+132827us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:07.414674 (+ 51778us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:07.490877 (+ 76203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.062502 (+571625us) spinlock_profiling.cc:243] Waited 6.65 ms on lock 0x7b1800254800. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdbd2a6 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdbd2a6 00007f409bdbd240
0709 13:18:08.064071 (+  1569us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800254800. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:18:08.252847 (+188776us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b1800254800. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f40a2db058f 00007f409bdef571 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd
0709 13:18:08.303382 (+ 50535us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b54000dd4d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:08.303441 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.303595 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57714,"prepare.queue_time_us":142830,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":61427,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":57220,"spinlock_wait_cycles":5694109696,"thread_start_us":201573,"threads_started":2,"wal-append.queue_time_us":129109}
I20260709 13:18:08.351179 18308 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:08.341578 20879 consensus_queue.cc:1059] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
W20260709 13:18:08.342486 20780 consensus_meta.cc:287] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.758s	user 0.015s	sys 0.001s
W20260709 13:18:08.355234 18417 rpcz_store.cc:269] 0709 13:18:04.729290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.730615 (+  1325us) service_pool.cc:224] Handling call
0709 13:18:08.327745 (+3597130us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540010ac54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:08.327895 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2528908160}
W20260709 13:18:08.340499 20817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.011s	sys 0.015s
I20260709 13:18:08.319182 20885 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:18:08.374536 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:08.323589 20694 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.341872 20865 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.379027 20883 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:08.382778 20836 consensus_queue.cc:1059] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:08.375576 20882 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:18:08.330651 20616 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.386061 18337 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:08.390412 18384 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:08.392908 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.357141 20768 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:08.398910 20837 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.399121 20851 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:08.403923 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:08.406584 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:08.384102 20341 raft_consensus.cc:3055] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:08.356729 20878 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:08.413523 18417 raft_consensus.cc:2393] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:08.415778 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:08.416676 18413 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:08.375301 20817 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:08.411435 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:08.356568 20663 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.413563 18414 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:08.412961 20883 raft_consensus.cc:697] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:08.423254 20517 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:08.412374 20850 consensus_meta.cc:287] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.000s
I20260709 13:18:08.394445 20875 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:08.404399 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:08.430519 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 77550us
I20260709 13:18:08.410988 20890 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.413182 20851 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:08.436332 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 116570us
I20260709 13:18:08.435261 18307 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:08.415867 20341 raft_consensus.cc:740] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:08.440755 18458 leader_election.cc:400] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6.
I20260709 13:18:08.442936 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:08.444794 18458 leader_election.cc:403] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:08.445026 18414 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:08.354784 20862 consensus_queue.cc:260] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:08.443782 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.449416 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.434792 20894 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:08.439719 20851 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.417301 20887 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:18:08.444082 20768 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.466454 18417 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:08.473465 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:08.473996 18384 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:08.436620 20517 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.459332 20898 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.467410 20894 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.450012 20891 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:08.460078 20648 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.487571 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:08.463518 20871 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:08.464665 20875 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.491906 18412 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:08.436436 20850 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.478890 20722 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:08.482992 20865 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.439862 20890 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.482788 20681 raft_consensus.cc:3055] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:08.478078 20862 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:08.495973 20895 log.cc:927] Time spent T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:08.495379 20898 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:08.527202 20850 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.527596 20894 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.528234 20894 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6.
I20260709 13:18:08.529115 20898 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:08.528851 20894 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:08.507154 20341 consensus_queue.cc:260] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.530731 20341 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.514348 20875 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:08.532101 20846 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.532534 20846 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:08.533351 20875 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:08.497426 20901 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.481134 20860 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:18:08.534418 19057 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEARNER]: Advancing to term 5
I20260709 13:18:08.499850 20888 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:08.530339 20894 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.535140 20888 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:08.430410 20837 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:08.535980 20888 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.496554 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:08.482087 20710 consensus_meta.cc:287] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.243s	user 0.007s	sys 0.005s
I20260709 13:18:08.464684 20897 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:08.503733 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:08.534474 20901 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.482048 20670 raft_consensus.cc:3055] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:08.537545 20837 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:08.540073 20882 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:08.506618 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 120964us
I20260709 13:18:08.478739 20672 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.537839 20897 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:08.540665 20882 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:08.541137 20882 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:08.541229 20672 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:08.541414 20897 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.489349 19056 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:08.493681 20891 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:08.545239 20891 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:08.548003 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:08.508595 20884 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.508795 20876 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:08.517446 20836 consensus_queue.cc:1243] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:08.519089 20865 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.545424 20663 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.526793 20423 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.509891 20648 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:08.534664 20907 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:18:08.500577 20517 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.540140 20901 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:08.500933 20817 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.539031 19026 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:08.510986 18414 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34458
I20260709 13:18:08.541249 18308 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:08.591970 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 50786.3us
I20260709 13:18:08.592121 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:08.592974 18489 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
W20260709 13:18:08.538318 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 103137us
I20260709 13:18:08.517198 20681 raft_consensus.cc:740] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:08.511646 20616 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:08.529645 20898 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.549870 19062 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:08.557557 19057 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:18:08.518256 20708 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.565136 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:08.526675 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1841) took 1196 ms. Trace:
I20260709 13:18:08.604979 18411 rpcz_store.cc:276] 0709 13:18:07.330749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.658670 (+327921us) service_pool.cc:224] Handling call
0709 13:18:07.676974 (+ 18304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.007824 (+330850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.526468 (+518644us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54003629d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:08.526614 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741350656}
I20260709 13:18:08.479015 20768 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.537519 20903 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.539461 20710 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:08.579633 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.584009 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1859) took 1294 ms. Trace:
I20260709 13:18:08.512253 20871 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.604787 20898 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.539274 20670 raft_consensus.cc:740] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:08.613386 20670 consensus_queue.cc:260] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.613902 20871 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:08.614154 20898 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:08.614602 20670 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:08.616803 20899 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:08.588106 20423 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.618124 20710 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:08.560657 20894 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:08.598335 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:08.598846 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 59883.8us
I20260709 13:18:08.568956 20870 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:08.583678 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:08.601936 19027 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:08.577033 20876 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:08.602331 19057 pending_rounds.cc:85] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 3
I20260709 13:18:08.585471 20694 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:08.606164 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.655311 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 53443.9us
I20260709 13:18:08.604795 19054 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:08.610749 18410 rpcz_store.cc:276] 0709 13:18:07.289362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.289511 (+   149us) service_pool.cc:224] Handling call
0709 13:18:08.583758 (+1294247us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540011bcd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:08.583932 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492499712}
I20260709 13:18:08.609068 20681 consensus_queue.cc:260] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.600723 20836 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:08.595947 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:08.641908 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:08.584230 20865 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.604099 20748 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:08.509078 20883 consensus_queue.cc:237] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.653505 19057 pending_rounds.cc:107] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:18:08.667191 19057 raft_consensus.cc:2889] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:08.619493 20710 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:08.661706 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 65848.3us
I20260709 13:18:08.658165 19027 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:08.669821 18307 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:08.653877 19056 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.659250 20616 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:08.643473 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:08.608429 20708 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.644253 20898 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:08.681324 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:08.681890 18410 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
W20260709 13:18:08.681125 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 241847us
W20260709 13:18:08.680217 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.630339 20903 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.666272 20672 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:08.660164 20836 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:08.715137 20836 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:08.718490 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:08.681689 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:08.719808 18411 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:08.666582 20628 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:08.665040 20748 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.698567 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:08.698875 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.697558 18458 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:08.722510 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:08.673430 20681 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.667752 20893 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.728017 18414 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:08.736754 18414 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:08.670828 20774 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:08.680835 20769 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:08.733631 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:08.730871 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:08.729940 18336 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:08.740195 18335 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:08.698098 20708 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:08.689487 20900 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:08.646090 20870 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.732020 20748 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:08.729471 20628 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:08.780045 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:08.730098 20901 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:08.729693 20913 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:08.732170 20894 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:08.732218 20897 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:08.697896 20898 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.739225 20769 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.746912 18487 raft_consensus.cc:2376] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4. Re-sending same reply.
I20260709 13:18:08.749516 20909 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:08.757225 20708 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.790246 20894 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.747754 20893 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.782660 20628 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:08.785537 20648 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.749989 20774 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.847023 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:08.847652 18484 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:08.848539 20774 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.850754 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1851) took 1327 ms. Trace:
I20260709 13:18:08.779726 20884 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:08.788610 20897 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.756755 20900 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.789902 20769 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:08.841048 20851 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.842326 20870 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.845568 20912 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:08.787019 20901 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.851141 18418 rpcz_store.cc:276] 0709 13:18:07.523106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.668182 (+145076us) service_pool.cc:224] Handling call
0709 13:18:08.327966 (+659784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.355378 (+ 27412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.850567 (+495189us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b540010ac50. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:08.850698 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1492172544}
I20260709 13:18:08.851838 18382 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:08.852355 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1827) took 1868 ms. Trace:
I20260709 13:18:08.976547 18340 rpcz_store.cc:276] 0709 13:18:06.983491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.983656 (+   165us) service_pool.cc:224] Handling call
0709 13:18:08.068337 (+1084681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.074010 (+  5673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.852149 (+778139us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400057dd0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:08.852270 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2493519104}
I20260709 13:18:08.848559 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:08.905112 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.955976 20927 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:09.015250 20927 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.017565 20927 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:09.018657 20903 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:08.958035 20917 log.cc:927] Time spent T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:18:09.020251 20894 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.854401 20909 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.021098 20909 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.969416 20628 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:08.958673 20922 log.cc:927] Time spent T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:18:08.958911 20914 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:18:08.735634 20876 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:08.960666 20916 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:18:08.957338 20836 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:08.963371 20897 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.951462 20865 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.967751 19056 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:08.839758 20708 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.080075 20851 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:08.971032 18414 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:09.086941 18341 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
W20260709 13:18:08.972966 20878 consensus_meta.cc:287] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.000s
I20260709 13:18:09.011854 20912 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:09.012766 20893 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:09.012444 20748 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.014092 20890 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:09.073697 20708 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.969238 20882 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:18:09.030400 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 296812us
I20260709 13:18:09.040037 20927 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:09.023168 20909 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:09.041684 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 189915us
I20260709 13:18:08.932869 20423 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:08.953570 20768 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:08.790717 20913 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:08.953958 20900 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:08.968410 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:09.024457 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.102852 18337 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:09.210424 18307 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.016s	sys 0.052s
I20260709 13:18:09.367170 18419 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:09.104264 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:09.372056 18484 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:09.372234 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.157174 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1832) took 2094 ms. Trace:
W20260709 13:18:09.366711 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 172847us
I20260709 13:18:09.373027 18339 rpcz_store.cc:276] 0709 13:18:07.063210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.063335 (+   125us) service_pool.cc:224] Handling call
0709 13:18:07.078486 (+ 15151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.269468 (+1190982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.156900 (+887432us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400401d54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:09.157108 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2668905344}
W20260709 13:18:09.119915 18384 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.000s	sys 0.010s
I20260709 13:18:09.374068 18490 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
W20260709 13:18:09.374398 18384 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.002s	sys 0.024s
W20260709 13:18:09.374733 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 898447us
W20260709 13:18:09.375178 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.193629 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.371315 18307 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.021s	sys 0.063s
W20260709 13:18:09.376945 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 698986us
I20260709 13:18:09.369837 18493 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:18:09.095476 20846 consensus_meta.cc:287] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.000s
W20260709 13:18:09.274577 20616 consensus_meta.cc:287] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.002s
I20260709 13:18:09.395404 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:09.341789 20932 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.212744 20862 consensus_meta.cc:287] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.000s
I20260709 13:18:09.212548 20933 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.397878 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:09.407691 18307 leader_election.cc:336] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.556s (SENT)
I20260709 13:18:09.408187 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:09.244783 20628 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:09.271175 19055 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:09.158742 20341 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:09.155375 20901 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:09.245427 20897 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.414444 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.272136 20836 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:09.421478 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:09.424729 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.395021 20909 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.423614 18309 connection.cc:256] RPC call timeout handler was delayed by -1.6741325020000204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
I20260709 13:18:09.094661 20891 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.098533 20878 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.397336 20616 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:09.409900 20423 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:09.403770 20708 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.410894 20932 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.461460 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.411775 20839 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:18:09.414502 20886 consensus_queue.cc:1059] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:18:09.370270 20769 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.463358 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.096771 20912 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:09.160836 20898 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:09.410945 20670 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:09.412868 20625 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:09.396147 20846 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.390841 20927 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.482833 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 1798) took 1986 ms. Trace:
I20260709 13:18:09.478618 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.506176 18488 rpcz_store.cc:276] 0709 13:18:07.496485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.533104 (+ 36619us) service_pool.cc:224] Handling call
0709 13:18:07.587930 (+ 54826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:07.649711 (+ 61781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.482573 (+1832862us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b5400122d50. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:09.482757 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125437312}
I20260709 13:18:09.506176 18490 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:09.488061 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.505602 18338 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
W20260709 13:18:09.481052 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 819842us
I20260709 13:18:09.470327 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:09.506559 18343 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:09.422540 20893 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:09.463236 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.461199 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.461858 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.510361 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:09.515532 18339 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
W20260709 13:18:09.507510 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 128433us
I20260709 13:18:09.511510 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:09.508498 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.517184 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:09.517647 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:09.512408 18484 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:09.513089 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.519358 18339 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:18:09.519692 18339 pending_rounds.cc:85] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 1
I20260709 13:18:09.519919 18339 pending_rounds.cc:107] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:18:09.520143 18339 raft_consensus.cc:2889] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:09.521095 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.521617 18339 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:09.522401 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:09.522432 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.523013 18486 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.525203 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.525980 18340 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:09.523360 18339 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:09.529273 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:09.479523 20783 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:09.476344 20891 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:09.425930 20897 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:09.473228 20882 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:09.486263 20733 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:09.566331 18338 raft_consensus.cc:3055] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:09.567584 18338 raft_consensus.cc:740] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:09.461054 20909 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.560117 18490 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:09.563242 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:09.570046 18484 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:18:09.571051 18484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:18:09.571738 18484 raft_consensus.cc:606] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:18:09.572162 18484 raft_consensus.cc:614] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:09.523742 20886 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.575017 20886 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:09.575978 20932 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:09.577950 20912 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:09.579082 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.523429 20836 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.517136 20616 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:09.561223 18339 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:18:09.476953 20862 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:18:09.573704 18484 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:09.524375 20748 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:09.590847 18486 raft_consensus.cc:2410] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:09.507304 20936 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:18:09.416056 20933 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.579640 18340 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
W20260709 13:18:09.568276 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 189140us
I20260709 13:18:09.570164 18338 consensus_queue.cc:260] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:09.534091 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.593775 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.514279 20708 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:09.598518 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 75235.8us
I20260709 13:18:09.601691 18335 raft_consensus.cc:2410] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:09.602128 18338 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.603653 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.583211 20625 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.513051 20670 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:09.603147 18384 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:09.608971 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.607203 18339 raft_consensus.cc:2410] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:09.611815 18488 raft_consensus.cc:2393] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:09.614950 18484 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:09.617803 20670 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:09.599731 20948 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:09.619505 20946 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:09.631482 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.632364 18339 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:09.613173 20945 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:18:09.640204 20945 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.640764 20945 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:09.643337 20787 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:09.643893 20787 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.592368 20836 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.648113 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:09.641611 20897 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:09.651723 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.652650 18344 raft_consensus.cc:2410] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:09.654978 18340 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:09.611357 20625 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.658720 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:09.645888 20945 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:09.646405 20878 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:09.688915 20836 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:09.653483 20913 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:09.689644 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.690567 18335 raft_consensus.cc:2393] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 4: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:09.661279 20933 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:09.662920 20638 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:09.664789 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1844) took 1079 ms. Trace:
I20260709 13:18:09.691592 20638 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.692176 20638 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:09.691630 18487 rpcz_store.cc:276] 0709 13:18:08.586038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.587963 (+  1925us) service_pool.cc:224] Handling call
0709 13:18:09.664608 (+1076645us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b5400240254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:09.664726 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124017536}
I20260709 13:18:09.693116 18487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:18:09.693418 20927 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:09.666106 18492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1797) took 2181 ms (client timeout 1832 ms). Trace:
W20260709 13:18:09.694078 18492 rpcz_store.cc:269] 0709 13:18:07.484932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.520498 (+ 35566us) service_pool.cc:224] Handling call
0709 13:18:09.665929 (+2145431us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400259254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:09.666037 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1129950592}
I20260709 13:18:09.695464 18492 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:09.695914 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1859) took 1082 ms. Trace:
I20260709 13:18:09.696205 18492 rpcz_store.cc:276] 0709 13:18:08.613022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.694868 (+1081846us) service_pool.cc:224] Handling call
0709 13:18:09.695154 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.695751 (+   597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.695876 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:09.670555 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.699007 18340 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:09.670645 18307 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:09.671592 20846 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:09.672250 20769 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:09.654043 20797 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:18:09.648046 20787 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:09.682029 20748 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.682508 20616 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.683336 20628 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:09.684214 20919 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.900s	user 0.000s	sys 0.003s
I20260709 13:18:09.684264 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:09.684720 19056 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:09.685223 19062 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEARNER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:09.686393 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:09.686691 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:09.687229 20936 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:09.687400 20833 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 2.187s	user 0.011s	sys 0.026s
I20260709 13:18:09.687937 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:09.652490 20889 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:09.703222 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:09.855664 20783 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:09.704077 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1857) took 1099 ms. Trace:
I20260709 13:18:09.705072 18338 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:18:09.871407 18338 pending_rounds.cc:85] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 3
I20260709 13:18:09.871198 20952 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:09.871773 18338 pending_rounds.cc:107] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:18:09.872054 18338 raft_consensus.cc:2889] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:09.871022 18486 rpcz_store.cc:276] 0709 13:18:08.604633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.592059 (+987426us) service_pool.cc:224] Handling call
0709 13:18:09.592674 (+   615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.593064 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.593100 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.596728 (+  3628us) log.cc:844] Serialized 556 byte log entry
0709 13:18:09.637317 (+ 40589us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:09.637368 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.637456 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:09.703886 (+ 66430us) raft_consensus.cc:1685] finished
0709 13:18:09.703904 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.704026 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":40030,"threads_started":1,"wal-append.queue_time_us":81454}
I20260709 13:18:09.693728 18487 raft_consensus.cc:606] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
W20260709 13:18:09.771253 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 169957us
I20260709 13:18:09.780504 20882 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:09.782217 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.797991 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 86929.1us
I20260709 13:18:09.768501 20836 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:09.874348 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1867) took 1019 ms. Trace:
W20260709 13:18:09.871014 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 167868us
I20260709 13:18:09.836021 19054 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:09.767786 20817 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.893414 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 170845us
I20260709 13:18:09.911687 18382 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:09.722075 20710 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.887274 18486 rpcz_store.cc:276] 0709 13:18:08.855319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.873559 (+1018240us) service_pool.cc:224] Handling call
0709 13:18:09.873852 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.874040 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.874065 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:09.874107 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:09.874148 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.874198 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.874298 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:09.915553 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:09.783663 20878 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:09.873416 20936 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.920696 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.917675 19025 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:09.920972 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.923543 18335 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:09.924362 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.923689 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:09.924698 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.925257 18342 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:09.921525 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:09.926370 18382 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:09.917721 18486 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:09.872030 20952 raft_consensus.cc:697] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:09.927580 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.928299 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:09.710242 20945 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.206s
I20260709 13:18:09.928843 18486 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:09.876591 18487 raft_consensus.cc:614] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:09.695472 20900 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:09.912878 20927 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:09.989926 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:09.833957 20748 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.873268 20616 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.876364 20783 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:09.963691 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.914172 20893 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:18:09.912400 20628 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:10.016083 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:10.015347 19056 raft_consensus.cc:2393] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:09.914165 20882 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.922195 20710 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:10.015952 20952 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.916870 20876 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:18:09.926616 20878 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:09.921366 20769 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:10.208930 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:10.208806 18384 connection.cc:256] RPC call timeout handler was delayed by -1.1333920590000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 13:18:10.212070 18384 connection.cc:256] RPC call timeout handler was delayed by -1.1234920590000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
I20260709 13:18:10.210322 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:09.926390 20862 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:09.923432 20936 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.116477 20616 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:10.213521 20862 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:09.934957 20787 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:10.214130 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:10.182530 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 242245us
I20260709 13:18:10.215675 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:10.216192 20628 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:10.217386 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:10.212996 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:10.217555 19057 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
W20260709 13:18:10.114674 20962 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:18:10.116173 20900 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:10.219208 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:10.220005 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:10.017293 20927 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:10.242831 18417 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.242916 19056 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:10.220090 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:10.181614 20890 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:10.220477 20710 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:10.181661 20722 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.933975 18486 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:18:10.051501 20951 log.cc:927] Time spent T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:18:10.256270 18486 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:10.084990 20638 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:10.221324 18412 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:10.000622 20955 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.230s
I20260709 13:18:10.000922 20847 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:10.222136 18411 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:09.918154 20817 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:10.060051 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1856) took 1459 ms. Trace:
I20260709 13:18:10.223017 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:10.264716 18484 rpcz_store.cc:276] 0709 13:18:08.600766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.584757 (+983991us) service_pool.cc:224] Handling call
0709 13:18:09.585114 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.615501 (+ 30387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.059746 (+444245us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b5400437954. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:10.059962 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64801536}
I20260709 13:18:10.224004 18338 raft_consensus.cc:2368] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7.
W20260709 13:18:09.988818 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 56371.4us
W20260709 13:18:10.255673 20954 log.cc:927] Time spent T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.186s	user 0.009s	sys 0.000s
I20260709 13:18:09.931948 20852 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:10.256395 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:10.115207 19061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 727) took 2362 ms (client timeout 1770 ms). Trace:
W20260709 13:18:10.277447 19061 rpcz_store.cc:269] 0709 13:18:07.752356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.803810 (+ 51454us) service_pool.cc:224] Handling call
0709 13:18:10.114969 (+2311159us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54006f8454. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:10.115099 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449130368}
I20260709 13:18:10.214315 20787 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.283726 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:10.015974 20949 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.218s
I20260709 13:18:10.228214 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:10.286587 18418 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.287850 18382 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:10.116753 18490 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:18:10.012468 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 124460us
I20260709 13:18:10.244112 18415 raft_consensus.cc:2410] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:10.246325 18308 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:10.256086 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1860) took 1642 ms. Trace:
I20260709 13:18:10.259377 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:10.242043 20625 consensus_meta.cc:287] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.000s
I20260709 13:18:10.049829 19053 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:10.043053 20697 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.219s
I20260709 13:18:10.161346 20517 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:10.317790 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 71409.7us
I20260709 13:18:10.048425 19060 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:10.239462 20783 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:10.241873 20885 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.020296 18340 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:10.281291 20865 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:10.275439 18484 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:10.112396 18416 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:18:10.282107 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:10.282967 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:10.320083 20946 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.008s	sys 0.031s
I20260709 13:18:10.326232 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:10.326812 18484 raft_consensus.cc:1813] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Handling vote request from an unknown peer 20e06cff39b649c48d342b7431135303
I20260709 13:18:10.327104 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1855) took 2802 ms. Trace:
I20260709 13:18:10.312129 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:10.284499 20852 raft_consensus.cc:697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:10.214170 20862 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.290828 20847 raft_consensus.cc:697] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:10.285406 20864 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:18:10.315182 20625 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:10.411206 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1802) took 1002 ms. Trace:
I20260709 13:18:10.412109 18418 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:10.365687 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:10.311583 18492 rpcz_store.cc:276] 0709 13:18:08.613289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.696909 (+1083620us) service_pool.cc:224] Handling call
0709 13:18:09.697182 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.697382 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:09.921098 (+223716us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.255773 (+334675us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.255823 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:10.255874 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.255935 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.256035 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":291898,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":1116,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4174,"thread_start_us":555222,"threads_started":2}
I20260709 13:18:10.319289 18308 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:10.434530 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 115420us
I20260709 13:18:10.289202 20787 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.321503 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:10.381703 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:10.437984 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:10.438309 18338 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
W20260709 13:18:10.363078 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 75313.7us
I20260709 13:18:10.438930 18418 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:10.257216 20890 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:10.271327 18417 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:10.441304 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:10.324683 19056 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:10.441818 18308 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:10.442166 18418 raft_consensus.cc:2393] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:10.327345 18484 raft_consensus.cc:2410] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:10.260113 20722 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:10.327960 18415 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.441576 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:10.443980 18417 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
W20260709 13:18:10.326469 20946 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.008s	sys 0.031s
I20260709 13:18:10.326536 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:10.447803 18410 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:10.374004 20884 raft_consensus.cc:3055] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:10.448330 20884 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:10.448915 18410 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:10.294242 18412 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 2: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:10.284662 19058 raft_consensus.cc:2376] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6. Re-sending same reply.
I20260709 13:18:10.432888 18488 rpcz_store.cc:276] 0709 13:18:09.408972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.518247 (+109275us) service_pool.cc:224] Handling call
0709 13:18:10.410967 (+892720us) spinlock_profiling.cc:243] Waited 81.7 ms on lock 0x7b5400122354. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:10.411129 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187846016}
I20260709 13:18:10.438349 18335 raft_consensus.cc:1813] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Handling vote request from an unknown peer 20e06cff39b649c48d342b7431135303
I20260709 13:18:10.333865 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:10.322721 20900 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:10.327572 18416 rpcz_store.cc:276] 0709 13:18:07.524244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.670899 (+146655us) service_pool.cc:224] Handling call
0709 13:18:07.671308 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.112045 (+2440737us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b540008cda0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee53dc0 00007f409eede1c0 00007f409eedf231 00007f409eedbd8f 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c
0709 13:18:10.326851 (+214806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.327050 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26871040}
I20260709 13:18:10.452879 18335 raft_consensus.cc:2393] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:10.453231 20900 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.312625 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:10.453881 18490 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:10.449263 20884 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:10.436517 18336 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.454744 20884 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.453680 20900 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.372387 20975 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:10.411615 20740 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.444912 20878 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:10.458470 20847 consensus_queue.cc:237] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:10.459968 20975 raft_consensus.cc:697] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:10.460881 20975 consensus_queue.cc:237] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:10.383883 20882 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:10.462044 20876 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:10.383147 20817 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:10.462498 20876 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.462940 20876 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.463588 18418 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:18:10.463965 18418 pending_rounds.cc:85] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 4
I20260709 13:18:10.464213 18418 pending_rounds.cc:107] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:18:10.464452 18418 raft_consensus.cc:2889] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:10.469393 20722 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:10.458827 20740 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:10.471576 20740 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:10.475402 20966 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:10.533648 18415 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:10.327116 20865 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:10.564743 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 120603us
W20260709 13:18:10.590749 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 361129us
I20260709 13:18:10.393832 20638 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:10.373631 20927 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:10.322455 20517 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:10.393410 20748 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:10.328171 20885 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:10.446317 20947 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.285s
W20260709 13:18:10.835121 20883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.358s	user 0.019s	sys 0.029s
I20260709 13:18:10.377559 20936 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:10.446519 20955 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.512s
I20260709 13:18:10.604678 18492 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:10.983314 18308 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:10.394704 18487 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:10.699257 18336 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:10.394349 20852 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.048990 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1863) took 1117 ms. Trace:
I20260709 13:18:11.050519 18336 rpcz_store.cc:276] 0709 13:18:09.931563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.341879 (+410316us) service_pool.cc:224] Handling call
0709 13:18:11.048907 (+707028us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:11.043772 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 60547.4us
I20260709 13:18:11.052930 18308 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:10.959524 20969 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:10.963642 20900 consensus_meta.cc:287] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
I20260709 13:18:10.375276 20341 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:18:10.964504 20883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.487s	user 0.027s	sys 0.029s
I20260709 13:18:10.602854 20740 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.080910 18411 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:10.957459 20303 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:11.078289 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.047911 20865 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.476238 20879 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.591s
W20260709 13:18:11.090713 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 105642us
I20260709 13:18:10.645270 20982 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:10.647257 20890 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:11.065274 20836 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:11.073840 20887 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:10.603047 20878 consensus_queue.cc:1059] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.484s
I20260709 13:18:11.084889 20341 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.056597 20893 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:18:11.101060 20783 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.185452 20878 consensus_queue.cc:1243] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:11.101752 20889 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.137s
I20260709 13:18:11.082084 20969 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.162050 20303 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.101588 20740 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:11.086792 20900 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:11.321255 18418 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:11.212078 20890 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:18:11.308674 20878 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.290056 20783 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.365345 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:11.367066 18491 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:11.298853 20722 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 13:18:11.358934 20847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.040s	sys 0.080s
I20260709 13:18:11.289100 20982 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.377669 18491 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:11.302865 20974 consensus_queue.cc:1059] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
W20260709 13:18:11.398813 18457 connection.cc:256] RPC call timeout handler was delayed by -1.4750426309999511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 13:18:11.399260 18457 connection.cc:256] RPC call timeout handler was delayed by -1.4066426310000679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 13:18:11.399844 18457 connection.cc:256] RPC call timeout handler was delayed by -1.2152473260000534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260709 13:18:11.392268 18491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 1862) took 2778 ms (client timeout 1631 ms). Trace:
W20260709 13:18:11.401039 18491 rpcz_store.cc:269] 0709 13:18:08.613774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.641014 (+ 27240us) service_pool.cc:224] Handling call
0709 13:18:11.365197 (+2724183us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b5800143198. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:18:11.392190 (+ 26993us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5809024}
W20260709 13:18:11.387473 20847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.040s	sys 0.080s
I20260709 13:18:11.389624 20748 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.391208 20878 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.426872 20878 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:11.404098 20927 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.411949 20885 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:11.422452 20946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.007s	sys 0.035s
I20260709 13:18:11.428171 20936 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:11.451438 20981 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:18:11.459877 20862 consensus_meta.cc:287] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.095s	user 0.008s	sys 0.001s
I20260709 13:18:11.460533 20862 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:11.446699 20984 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:18:11.462754 20995 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.463311 20995 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.463861 20865 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.464047 20862 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:11.465358 20995 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:11.448334 20985 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:18:11.465862 20865 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:11.446236 20946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.007s	sys 0.037s
W20260709 13:18:11.466574 20876 consensus_meta.cc:287] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.003s	user 0.002s	sys 0.008s
I20260709 13:18:11.466992 20876 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.468984 20876 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:11.440881 20927 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:11.471168 20927 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:11.474910 20900 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:11.400290 18457 connection.cc:256] RPC call timeout handler was delayed by -1.079654894000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:18:11.508394 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 326261us
I20260709 13:18:11.510210 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:11.512084 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:11.512282 18488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.002s	sys 0.023s
W20260709 13:18:11.512954 18488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.003s	sys 0.023s
I20260709 13:18:11.514477 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1874) took 1238 ms. Trace:
I20260709 13:18:11.514909 18488 rpcz_store.cc:276] 0709 13:18:10.276170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.450417 (+174247us) service_pool.cc:224] Handling call
0709 13:18:10.450717 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.450924 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:10.451207 (+   283us) log.cc:844] Serialized 14 byte log entry
0709 13:18:11.513523 (+1062316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.513649 (+   126us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:11.513753 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.513938 (+   185us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.514331 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":805,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":164543,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":10421,"thread_start_us":1061681,"threads_started":2,"wal-append.queue_time_us":784159}
W20260709 13:18:11.516438 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 499992us
I20260709 13:18:11.508400 18457 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:11.522315 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.529557 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.530588 18410 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:18:11.532408 18384 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:11.535355 18384 leader_election.cc:400] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7.
I20260709 13:18:11.535717 18384 leader_election.cc:403] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:11.540938 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:11.554147 20303 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:11.544080 18384 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:11.548316 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:11.550880 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:11.556423 18416 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:11.557008 20783 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:11.430172 20748 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.445771 20836 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:11.559598 20847 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.560281 20847 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.554425 18488 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:11.560734 20847 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.578423 20862 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.578903 20862 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.579249 20862 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.583901 20903 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:11.584867 20903 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.586369 20936 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:11.586503 20946 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7.
I20260709 13:18:11.588809 20936 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.589308 20936 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.561441 20517 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:11.590446 20995 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:11.591238 20995 raft_consensus.cc:697] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:11.592890 20995 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.570796 20783 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:11.607988 20783 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:11.609601 18382 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.165s	user 0.002s	sys 0.010s
I20260709 13:18:11.609449 20927 consensus_queue.cc:1059] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:18:11.610194 18382 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.003s	sys 0.010s
I20260709 13:18:11.608856 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:11.611351 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 1.16701e+06us
I20260709 13:18:11.474561 20886 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:11.623732 18488 raft_consensus.cc:2410] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:18:11.630221 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 85422.8us
W20260709 13:18:11.630091 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 47844.7us
I20260709 13:18:11.589744 20936 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:11.583302 20670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.107s	user 0.002s	sys 0.008s
I20260709 13:18:11.605651 20740 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:11.478907 20982 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:11.633664 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 74154.6us
I20260709 13:18:11.560846 20836 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:11.636230 20937 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 2.161s	user 0.011s	sys 0.035s
I20260709 13:18:11.643003 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 475) took 2948 ms. Trace:
I20260709 13:18:11.644568 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1857) took 1724 ms. Trace:
I20260709 13:18:11.611606 20927 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:11.646790 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:11.648893 18344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1842) took 4104 ms (client timeout 2030 ms). Trace:
I20260709 13:18:11.651538 20996 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.651757 18339 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:18:11.654253 20748 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:11.660989 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1851) took 3070 ms. Trace:
I20260709 13:18:11.661623 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1856) took 3437 ms. Trace:
I20260709 13:18:11.655437 18340 rpcz_store.cc:276] 0709 13:18:09.920046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.920156 (+   110us) service_pool.cc:224] Handling call
0709 13:18:09.930781 (+ 10625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.322330 (+391549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.644053 (+1321723us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b54001d1354. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:11.644385 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205254912}
I20260709 13:18:11.661435 18489 rpcz_store.cc:276] 0709 13:18:08.590772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.593892 (+  3120us) service_pool.cc:224] Handling call
0709 13:18:08.594263 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:08.719881 (+125618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.721983 (+  2102us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:08.731448 (+  9465us) log.cc:844] Serialized 26 byte log entry
0709 13:18:09.209278 (+477830us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:09.209331 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.661675 (+452344us) spinlock_profiling.cc:243] Waited 90.5 ms on lock 0x7b54002927d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:09.661724 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.594894 (+1933170us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:11.660573 (+ 65679us) raft_consensus.cc:1685] finished
0709 13:18:11.660610 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.660799 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16897,"raft.queue_time_us":22779,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":241362176,"thread_start_us":425104,"threads_started":1,"wal-append.queue_time_us":722818}
I20260709 13:18:11.665259 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:11.656513 18344 rpcz_store.cc:269] 0709 13:18:07.555688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.555945 (+   257us) service_pool.cc:224] Handling call
0709 13:18:11.648398 (+4092453us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b54000e15d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:11.648644 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4781460224}
I20260709 13:18:11.656243 20927 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:11.662371 18419 rpcz_store.cc:276] 0709 13:18:08.225290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.225482 (+   192us) service_pool.cc:224] Handling call
0709 13:18:08.225786 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.371629 (+1145843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.661135 (+2289506us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001c57d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:11.661430 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2624321792}
I20260709 13:18:11.667963 20927 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.669162 18414 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:11.669806 20927 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.655217 18337 rpcz_store.cc:276] 0709 13:18:08.694500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.694657 (+   157us) service_pool.cc:224] Handling call
0709 13:18:08.694998 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.372102 (+677104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.642446 (+2270344us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54002d0fd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:11.642801 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937431808}
I20260709 13:18:11.657470 18339 pending_rounds.cc:85] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 3
I20260709 13:18:11.658926 20996 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.685832 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.686592 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.687075 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.660043 20740 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.687462 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.688066 20740 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.688776 18416 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:11.688719 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.689594 18412 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:11.689904 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.690461 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.690822 20740 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:11.671319 18484 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:11.691821 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.691933 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:11.691052 18416 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:11.693140 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.693295 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:11.660214 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 1863) took 3194 ms. Trace:
I20260709 13:18:11.694317 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.694073 18413 rpcz_store.cc:276] 0709 13:18:08.465653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.465769 (+   116us) service_pool.cc:224] Handling call
0709 13:18:08.466086 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.614633 (+148547us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:08.614964 (+   331us) log.cc:844] Serialized 14 byte log entry
0709 13:18:08.727799 (+112835us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:08.727845 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:08.727898 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.659643 (+2931745us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54003638d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:11.659724 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.659978 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":635,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":132,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":341168256,"thread_start_us":112438,"threads_started":1,"wal-append.queue_time_us":201793,"wal-append.run_cpu_time_us":1017,"wal-append.run_wall_time_us":1030706}
I20260709 13:18:11.683231 18339 pending_rounds.cc:107] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:18:11.696714 20996 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:11.697883 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 862) took 2015 ms. Trace:
I20260709 13:18:11.698202 18484 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:11.698505 19060 rpcz_store.cc:276] 0709 13:18:09.682547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.682671 (+   124us) service_pool.cc:224] Handling call
0709 13:18:09.682985 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.318586 (+635601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.697210 (+1378624us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b5400489254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:11.697563 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839340416}
I20260709 13:18:11.697218 18339 raft_consensus.cc:2889] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:11.701195 20906 raft_consensus.cc:3055] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:11.655001 20670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.179s	user 0.003s	sys 0.009s
I20260709 13:18:11.701661 20906 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:11.701674 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1867) took 1474 ms. Trace:
I20260709 13:18:11.703233 20906 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.704705 20906 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.674836 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:11.669881 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:34458 (request call id 1865) took 3203 ms. Trace:
I20260709 13:18:11.703701 18484 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:18:11.707876 18484 pending_rounds.cc:85] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 7
I20260709 13:18:11.708904 18484 pending_rounds.cc:107] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:18:11.709242 18484 raft_consensus.cc:2889] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:11.703164 18338 rpcz_store.cc:276] 0709 13:18:10.207859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.571535 (+363676us) service_pool.cc:224] Handling call
0709 13:18:10.647303 (+ 75768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.958762 (+311459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.958793 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.959271 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:18:11.510867 (+551596us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:11.603310 (+ 92443us) log.cc:844] Serialized 14 byte log entry
0709 13:18:11.634947 (+ 31637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.649897 (+ 14950us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.649956 (+    59us) raft_consensus.cc:1685] finished
0709 13:18:11.649967 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.682382 (+ 32415us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10924,"prepare.queue_time_us":71803,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":81104,"raft.run_cpu_time_us":434,"raft.run_wall_time_us":38824,"thread_start_us":484260,"threads_started":2,"wal-append.queue_time_us":366216}
I20260709 13:18:11.672389 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:11.694111 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.707469 18414 rpcz_store.cc:276] 0709 13:18:08.466210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.508302 (+ 42092us) service_pool.cc:224] Handling call
0709 13:18:11.667397 (+3159095us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54003638d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eed3a3d 00007f40a3ea3cd0 00007f409d428254 00007f409d4281e2 00007f409d428111 00007f409d42808c 00007f409d427342 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:11.669731 (+  2334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313156864}
I20260709 13:18:11.708606 20748 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.674140 18308 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:11.675520 20903 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:11.714484 20748 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.723937 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.674288 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1878) took 1103 ms. Trace:
W20260709 13:18:11.734153 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 102757us
I20260709 13:18:11.715919 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:11.736721 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:11.730229 20341 consensus_meta.cc:287] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.007s
I20260709 13:18:11.741966 20341 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:11.735872 18487 rpcz_store.cc:276] 0709 13:18:10.570359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.171022 (+600663us) service_pool.cc:224] Handling call
0709 13:18:11.307668 (+136646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.517685 (+210017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.517761 (+    76us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.517863 (+   102us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:11.517942 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.673786 (+155844us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54003750d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:11.673852 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.674073 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460718336}
I20260709 13:18:11.744295 20341 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:11.744964 18415 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:11.715937 20783 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:11.760121 20883 raft_consensus.cc:3055] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:11.760639 20883 raft_consensus.cc:740] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:11.767550 20996 consensus_queue.cc:1059] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:11.768114 19027 connection.cc:256] RPC call timeout handler was delayed by -1.5028352309998354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 13:18:11.768584 19027 connection.cc:256] RPC call timeout handler was delayed by -1.4569352309997612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 13:18:11.768908 19027 connection.cc:256] RPC call timeout handler was delayed by -1.376835230999859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
I20260709 13:18:11.768850 20996 raft_consensus.cc:3055] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:11.769542 20996 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:11.771173 20748 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:11.770754 20996 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.765139 20883 consensus_queue.cc:260] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.772600 20996 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:11.777972 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.779987 20909 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:11.779898 19027 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:18:11.762895 20787 consensus_meta.cc:287] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.286s	user 0.004s	sys 0.016s
I20260709 13:18:11.785408 20787 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.788004 20787 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:11.793673 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:11.796000 20942 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 2.322s	user 0.020s	sys 0.033s
W20260709 13:18:11.799814 20944 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 2.201s	user 0.004s	sys 0.029s
I20260709 13:18:11.793366 18488 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:11.792219 18489 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:11.803244 18493 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:11.789566 20836 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:11.820151 20886 consensus_queue.cc:1059] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:11.820454 18419 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:11.821101 19025 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:11.814777 20836 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.827684 20852 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:11.837718 19025 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:11.841284 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.846341 18336 raft_consensus.cc:3055] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:11.847879 18336 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:11.834168 20836 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:11.858527 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.857564 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:11.857975 18341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 476) took 3163 ms (client timeout 2039 ms). Trace:
I20260709 13:18:11.833799 20787 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:11.862107 18341 rpcz_store.cc:269] 0709 13:18:08.694861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.695774 (+   913us) service_pool.cc:224] Handling call
0709 13:18:11.856376 (+3160602us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54000582d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:11.857746 (+  1370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822295936}
I20260709 13:18:11.847306 20852 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:11.882138 20852 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.883505 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 722) took 4132 ms. Trace:
I20260709 13:18:11.883921 19055 rpcz_store.cc:276] 0709 13:18:07.750760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.789955 (+ 39195us) service_pool.cc:224] Handling call
0709 13:18:08.715578 (+925623us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:18:08.734986 (+ 19408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.416472 (+681486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.882999 (+2466527us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400682ed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:11.883327 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1240604160}
W20260709 13:18:11.886042 19057 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 865) took 2202 ms (client timeout 1966 ms). Trace:
W20260709 13:18:11.865860 18411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 476) took 1582 ms (client timeout 1950 ms). Trace:
W20260709 13:18:11.889617 18411 rpcz_store.cc:269] 0709 13:18:10.278769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.281774 (+  3005us) service_pool.cc:224] Handling call
0709 13:18:11.861095 (+1579321us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54003629d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:11.861317 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1735941888}
I20260709 13:18:11.859269 20862 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.869647 18410 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:18:11.886443 19057 rpcz_store.cc:269] 0709 13:18:09.683936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.684037 (+   101us) service_pool.cc:224] Handling call
0709 13:18:11.885662 (+2201625us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54005b0ed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:11.885821 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881559424}
I20260709 13:18:11.892102 20862 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:11.870350 18416 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:18:11.870560 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.893944 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.895794 20872 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:11.896339 20625 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:11.896659 20872 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.898937 20681 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.899340 20872 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:11.871299 21003 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:18:11.899524 20681 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:11.871095 20787 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.902727 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:11.903128 20787 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:11.903774 20787 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.904418 20787 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.905220 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:11.858883 20748 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:11.906140 20748 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.906484 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:11.906651 20748 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.907811 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:11.908727 18340 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:11.909073 20879 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:11.909472 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:11.874267 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.876803 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:11.878825 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 863) took 2195 ms. Trace:
W20260709 13:18:11.856976 20884 consensus_meta.cc:287] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.308s	user 0.011s	sys 0.006s
I20260709 13:18:11.850472 20886 consensus_queue.cc:1243] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:11.881407 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1880) took 1189 ms. Trace:
I20260709 13:18:11.869369 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:11.918424 18488 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:11.909546 20879 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:11.919139 20847 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.874142 20900 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.910380 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:11.910912 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.911221 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.911422 18309 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:11.912706 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:11.917143 21005 log.cc:927] Time spent T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:11.917780 18491 rpcz_store.cc:276] 0709 13:18:10.628796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.405963 (+777167us) service_pool.cc:224] Handling call
0709 13:18:11.406308 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.406568 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:11.629794 (+223226us) log.cc:844] Serialized 14 byte log entry
0709 13:18:11.756605 (+126811us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.766306 (+  9701us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:11.792651 (+ 26345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.811375 (+ 18724us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.817777 (+  6402us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174520,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":74,"raft.queue_time_us":8642,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":18734,"thread_start_us":173980,"threads_started":2,"wal-append.queue_time_us":164080}
I20260709 13:18:11.928155 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:11.921284 18457 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 2.124s (SENT) [suppressed 53 similar messages]
I20260709 13:18:11.929183 20847 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:11.929608 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.858701 18336 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:11.920373 20879 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:11.989101 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:11.901768 20681 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:11.954386 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:11.921453 19053 rpcz_store.cc:276] 0709 13:18:09.683388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.683753 (+   365us) service_pool.cc:224] Handling call
0709 13:18:09.684072 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.316546 (+632474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.878349 (+1561803us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b5400750154. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:11.878641 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840178560}
I20260709 13:18:11.931578 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.001730 18337 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:11.996629 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:11.998812 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.003911 18413 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:12.003139 18416 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:11.989351 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:11.989698 20900 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:11.958279 18340 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:11.932564 18344 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
W20260709 13:18:11.958420 21007 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:18:12.002981 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 89702.8us
I20260709 13:18:12.002907 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.006064 18488 raft_consensus.cc:2376] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7. Re-sending same reply.
I20260709 13:18:11.994333 20977 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.012338 20977 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.009655 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:12.010540 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.014146 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.014284 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.004817 20787 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:12.016963 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.019677 18416 raft_consensus.cc:2393] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:12.020149 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.021435 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.022032 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:12.022281 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:12.013564 18487 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.028586 20969 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:12.029546 20681 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:12.032181 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:12.033174 18489 raft_consensus.cc:2410] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:18:12.033694 18344 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:12.022066 18419 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
W20260709 13:18:12.029796 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 134463us
W20260709 13:18:12.044160 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 116347us
I20260709 13:18:12.045635 20836 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.046285 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:12.048255 18382 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:12.052464 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 214920us
I20260709 13:18:12.015097 20879 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.055935 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:12.056989 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:12.058161 18413 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:12.058662 18489 raft_consensus.cc:3055] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:12.059070 18489 raft_consensus.cc:740] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:12.060652 20859 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:12.062619 20862 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:12.061486 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:12.067270 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:12.067864 18410 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.068920 20783 raft_consensus.cc:3055] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:12.069341 20783 raft_consensus.cc:740] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:12.070986 20977 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:12.071218 20900 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:12.071808 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.067315 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 287510us
W20260709 13:18:12.072580 18384 leader_election.cc:336] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 2.030s (SENT)
I20260709 13:18:12.072991 19027 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:12.073172 20888 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.074669 21010 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:12.075090 21010 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.075451 21010 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.070556 20783 consensus_queue.cc:260] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:12.076555 18491 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.056726 21011 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:12.079270 21011 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.064639 20936 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:12.079705 21011 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.079972 20979 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.080570 20979 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.081935 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:12.082170 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:12.082597 18340 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.082983 18488 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:12.086269 18414 raft_consensus.cc:2368] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 4. Current term is 5.
I20260709 13:18:12.094440 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.095389 21012 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:12.096167 20979 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:12.081421 20936 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:12.069715 18487 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:12.104861 18488 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:12.106353 20989 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:12.106912 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:12.107105 20989 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:12.108217 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:12.108860 18343 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.110554 20783 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.116688 20748 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:12.118008 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.118108 20847 consensus_queue.cc:1059] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:12.119649 20847 raft_consensus.cc:3055] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:12.119992 20847 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:12.122189 18489 consensus_queue.cc:260] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:12.123363 18489 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.124782 20969 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:12.126044 20625 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:12.126644 20625 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:12.128026 20995 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:12.128801 20625 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:12.122352 20852 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.131640 20852 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:12.135553 18486 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:12.138442 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:12.138993 18344 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.133163 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.121114 20847 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:18:12.150007 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 75299us
I20260709 13:18:12.151451 18410 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:12.152601 18308 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:12.132019 21011 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.153476 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.153621 20884 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:12.154228 20884 raft_consensus.cc:697] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:12.154573 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 99210.8us
I20260709 13:18:12.154786 21011 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:12.155256 20884 consensus_queue.cc:237] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.156358 18457 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:12.157378 18309 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:12.158650 18457 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:12.160727 18341 raft_consensus.cc:2410] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:12.162973 20625 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:12.163370 20625 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.163710 20625 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.154685 20748 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:12.165514 18342 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:18:12.174472 20887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.954s	user 0.008s	sys 0.016s
I20260709 13:18:12.174865 20847 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:12.175055 20887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.008s	sys 0.017s
I20260709 13:18:12.175539 20887 raft_consensus.cc:697] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:12.178099 18344 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:12.181007 18413 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:12.181481 18343 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
W20260709 13:18:12.177592 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 120962us
I20260709 13:18:12.188733 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.132297 20852 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:12.176730 20982 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:12.196182 18410 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:12.192962 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.196911 18412 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:12.194985 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:12.198237 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 122057us
I20260709 13:18:12.202085 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.189502 20879 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:12.193186 18487 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:12.208352 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.208797 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:12.191979 20852 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:12.204867 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.210489 18413 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:12.211480 18410 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:12.205601 19027 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:12.196274 20982 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.207522 20879 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.225699 20748 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:12.226154 20748 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:18:12.219097 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.220873 18343 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.176748 20887 consensus_queue.cc:237] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.218248 20303 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:18:12.226540 20748 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.239933 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.220633 20982 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.227385 20879 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.242614 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.243433 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:12.243979 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.245970 20708 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:12.247964 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.248571 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.249176 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.252051 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.252589 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:12.254930 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.260406 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1877) took 1694 ms. Trace:
I20260709 13:18:12.239574 20783 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:12.270769 20783 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:12.270121 18492 rpcz_store.cc:276] 0709 13:18:10.565905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.055849 (+489944us) service_pool.cc:224] Handling call
0709 13:18:11.056216 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.359853 (+303637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.359884 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:11.364802 (+  4918us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.259204 (+894402us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b54001f7fa0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee46090 00007f409ee536b8 00007f409eedc92b 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c
0709 13:18:12.259305 (+   101us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:12.259358 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.259967 (+   609us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54003746d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:12.260012 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:12.260053 (+    41us) raft_consensus.cc:1685] finished
0709 13:18:12.260069 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.260240 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":518,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":12402,"spinlock_wait_cycles":813281408,"thread_start_us":313108,"threads_started":1,"wal-append.queue_time_us":266393}
I20260709 13:18:12.273074 20783 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:12.263645 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 106397us
I20260709 13:18:12.265847 20886 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.266371 20625 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:12.267164 20733 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.551s	user 0.019s	sys 0.035s
I20260709 13:18:12.268342 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.275415 18491 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:12.277624 18489 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:12.278262 18340 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:12.279110 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.280082 20886 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:12.282992 19027 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:12.287936 20303 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.290110 18344 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:12.290699 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 1.979e+06us
I20260709 13:18:12.290923 19027 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:18:12.277516 20733 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.648s	user 0.020s	sys 0.035s
I20260709 13:18:12.291109 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1861) took 2365 ms. Trace:
I20260709 13:18:12.303726 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:12.303202 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.303877 18342 rpcz_store.cc:276] 0709 13:18:09.926015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.926384 (+   369us) service_pool.cc:224] Handling call
0709 13:18:09.926620 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.165900 (+2239280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.290848 (+124948us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b54001d0e54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:12.291052 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5147660672}
W20260709 13:18:12.309479 21014 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:18:12.309840 21010 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.312875 21010 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:12.314725 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:12.318127 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 119277us
I20260709 13:18:12.321889 20625 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:12.322461 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:12.323894 19025 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:12.331014 21011 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:12.331568 21011 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.331606 21018 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:12.332123 21011 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.332289 21018 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.332870 21018 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:12.336494 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.337662 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:12.248005 20852 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.339814 20852 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:12.340806 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.341035 20883 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.341776 20989 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:12.341797 21016 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:12.342406 20989 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.342789 20989 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.343621 21016 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:12.344146 21016 raft_consensus.cc:697] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:12.345208 21016 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.346424 19026 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:12.352394 18343 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:12.353097 18344 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:12.355991 19025 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:12.309976 20859 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.357303 18337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:55720
W20260709 13:18:12.357805 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 71830.4us
W20260709 13:18:12.358116 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 43558.9us
I20260709 13:18:12.359015 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:12.359158 20887 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:12.358116 18337 raft_consensus.cc:606] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:18:12.361397 18337 raft_consensus.cc:614] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:12.373207 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:12.375133 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:12.359615 20887 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:12.360435 20900 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.377395 20886 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:12.379460 20748 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.356148 20303 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.383255 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.321580 20982 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.383754 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1874) took 1320 ms. Trace:
I20260709 13:18:12.387952 20670 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:12.394081 20966 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:12.435245 18415 rpcz_store.cc:276] 0709 13:18:11.063167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.063398 (+   231us) service_pool.cc:224] Handling call
0709 13:18:11.063701 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.745863 (+682162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.383466 (+637603us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b540025c1d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:12.383672 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1565871488}
I20260709 13:18:12.396417 20836 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:12.398048 20879 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.404412 20681 raft_consensus.cc:1064] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:18:12.406095 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:18:12.430866 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 55832.4us
I20260709 13:18:12.430528 20887 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.442037 21017 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:12.459682 18340 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.461741 20783 consensus_queue.cc:1059] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:12.466390 18341 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:12.468863 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:12.500090 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.469090 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:12.471834 20625 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.473649 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:12.474606 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:12.491815 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:12.506100 18384 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:12.505254 18493 raft_consensus.cc:2376] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6. Re-sending same reply.
I20260709 13:18:12.508105 18342 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:18:12.426429 21010 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:18:12.521540 18484 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.526180 18382 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:12.494740 21017 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.445744 21018 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:12.527021 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 170954us
I20260709 13:18:12.532166 18384 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:12.533058 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:12.535802 18491 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
I20260709 13:18:12.536999 20864 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:12.543277 20748 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:12.544741 20851 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:12.546238 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 255365us
W20260709 13:18:12.548043 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 44490.7us
W20260709 13:18:12.550187 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 202565us
I20260709 13:18:12.551465 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:12.554401 18493 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:12.555456 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:12.556025 18485 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.552258 18338 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:12.558131 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:12.559204 20722 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:12.558148 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 89157.8us
I20260709 13:18:12.562013 20864 raft_consensus.cc:697] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:12.563014 20864 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.563941 20975 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:12.564450 20975 raft_consensus.cc:697] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:12.565541 20969 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:12.565271 20975 consensus_queue.cc:237] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:12.566134 20969 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:12.567114 20969 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.568390 20851 raft_consensus.cc:697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:12.569327 20851 consensus_queue.cc:237] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:12.549604 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:12.578405 18489 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:12.579700 19026 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:12.560369 20625 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:12.583678 20887 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.585839 20879 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:12.590895 20982 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:12.592094 20883 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:18:12.552068 20906 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:12.531582 21017 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:12.579586 18382 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:12.599529 18485 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
W20260709 13:18:12.609138 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 55964.6us
I20260709 13:18:12.608497 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:12.616878 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 229697us
I20260709 13:18:12.619915 18484 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:18:12.621110 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 84315.6us
I20260709 13:18:12.621887 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:12.626216 18340 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:12.597114 20979 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:12.634546 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 54924.1us
I20260709 13:18:12.636749 19026 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:12.585870 20887 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:12.639727 18335 raft_consensus.cc:1240] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:12.608723 20722 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:12.618072 21010 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:12.641906 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 88074.5us
I20260709 13:18:12.648043 18486 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:12.635876 20748 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:12.659118 19027 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:12.659996 18340 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:12.657531 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:12.657316 20870 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:18:12.653487 20859 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:12.654263 20879 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.653896 21030 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:12.679270 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.695410 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.672920 20859 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.668347 20787 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:12.660900 20748 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:12.667809 20979 raft_consensus.cc:697] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:12.709369 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:12.709045 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:12.663076 21012 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:18:12.710988 18488 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:12.677098 20906 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.709008 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:12.718585 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:12.743395 18489 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:12.741496 18382 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:12.694151 21010 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:12.694684 21030 raft_consensus.cc:697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:12.709075 21016 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:12.718775 20859 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.718554 20787 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.734463 20748 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:12.734304 20625 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:12.755681 18493 raft_consensus.cc:2410] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:12.757467 18382 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:12.762069 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.762559 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.762858 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.760583 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:12.748343 21010 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:12.768224 18490 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:12.763267 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1864) took 2831 ms. Trace:
I20260709 13:18:12.768342 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:12.769018 18484 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:12.752683 20883 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:12.764612 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:12.768810 18339 rpcz_store.cc:276] 0709 13:18:09.932148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.382475 (+450327us) service_pool.cc:224] Handling call
0709 13:18:11.651060 (+1268585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.701300 (+ 50240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.763096 (+1061796us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54000e15d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:12.763217 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2912470272}
I20260709 13:18:12.755820 20787 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.779065 21016 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:12.779831 21016 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.782379 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:12.782979 19062 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 2.
W20260709 13:18:12.786334 21029 log.cc:927] Time spent T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:18:12.742197 20879 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.746579 20989 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.759086 21018 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:12.771977 20975 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:12.771220 21010 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:12.793187 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:12.760512 20817 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:18:12.805981 19053 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:12.806737 21024 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:18:12.774870 20722 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.801797 20975 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.810632 20975 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.811249 20879 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:12.789739 20883 raft_consensus.cc:697] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:12.812613 20883 consensus_queue.cc:237] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:12.814096 18336 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.814766 20979 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.823184 20989 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:12.824177 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:12.760406 20948 consensus_queue.cc:1059] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:18:12.824815 20949 consensus_queue.cc:1059] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:18:12.825421 20948 raft_consensus.cc:3055] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:12.825822 20949 raft_consensus.cc:3055] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:12.825855 20948 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:12.826229 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:12.827533 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.827133 20948 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:12.754320 20906 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.828466 20948 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.828416 21011 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.826385 20949 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:12.824832 19057 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:12.786732 21016 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:12.842555 18336 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:18:12.771183 20847 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 13:18:12.801185 21035 log.cc:927] Time spent T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:18:12.844133 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:12.862809 19053 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:12.865309 18484 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:12.844493 18336 pending_rounds.cc:85] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 3
I20260709 13:18:12.871456 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:12.870643 18336 pending_rounds.cc:107] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:18:12.875371 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:12.821473 20681 consensus_queue.cc:237] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:12.879851 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:12.873723 18336 raft_consensus.cc:2889] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:12.884490 18490 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:12.891717 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:12.891463 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 132832us
I20260709 13:18:12.892282 18415 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.892915 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:12.884318 19057 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:12.897686 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:12.917598 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:12.926259 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:12.927179 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1870) took 2718 ms. Trace:
I20260709 13:18:13.009454 19053 raft_consensus.cc:2368] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7.
I20260709 13:18:12.947933 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:12.948941 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:12.890888 21011 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:12.958755 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:12.959851 21042 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:18:12.975255 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 307747us
W20260709 13:18:12.962914 20822 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:18:13.003720 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:12.805640 21030 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.014670 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:13.009284 18336 rpcz_store.cc:276] 0709 13:18:10.208836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.051677 (+842841us) service_pool.cc:224] Handling call
0709 13:18:11.052070 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.846034 (+793964us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b540018f9a0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee53dc0 00007f409eede1c0 00007f409eedf231 00007f409eedbd8f 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c
0709 13:18:12.769000 (+922966us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b58004a27d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee380aa 00007f409eeba447 00007f409eed2fe7 00007f409eed47de 00007f409eedeb49 00007f409eedf416 00007f409eedbd8f 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4
0709 13:18:12.899757 (+130757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.927113 (+ 27356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358409344}
I20260709 13:18:13.022635 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:13.025076 18493 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:18:13.027150 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:13.030021 18490 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:13.033182 20859 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.013833 18417 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:13.022635 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.043722 18415 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:13.047501 18490 raft_consensus.cc:2410] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:12.918226 20979 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 13:18:13.058879 20887 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:13.063519 21011 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:13.064728 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.070566 18416 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:13.033524 21017 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.063962 20303 raft_consensus.cc:3055] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:12.926569 20949 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.081887 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:13.083117 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:13.081387 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 79005.8us
I20260709 13:18:13.094208 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.097954 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.100039 19053 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:13.095626 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.103783 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:13.103906 18339 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:18:13.104607 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:13.105185 18485 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:13.099366 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.108312 18338 raft_consensus.cc:2410] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:13.090503 20936 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.124341 18336 raft_consensus.cc:2410] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:13.084458 20303 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:13.123907 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:13.131191 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:13.131516 21049 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:18:13.133070 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 491) took 1231 ms. Trace:
I20260709 13:18:13.133565 18341 rpcz_store.cc:276] 0709 13:18:11.901692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.382672 (+480980us) service_pool.cc:224] Handling call
0709 13:18:12.382969 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.496197 (+113228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.132755 (+636558us) spinlock_profiling.cc:243] Waited 83.1 ms on lock 0x7b540007f654. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:13.132963 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191211264}
I20260709 13:18:13.134174 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.135499 20936 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.137598 20936 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:13.140702 20975 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:13.133114 21056 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:18:13.146353 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.147891 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:13.150240 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.137847 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.152498 20787 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.155681 20748 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.170596 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.156304 19061 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:18:13.157707 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.169626 18484 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:13.173549 18335 raft_consensus.cc:2393] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:13.179997 18485 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
W20260709 13:18:13.180688 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 74582.6us
I20260709 13:18:13.181365 18339 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:13.098958 20887 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.185150 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.186036 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.189307 20969 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:13.190356 20969 raft_consensus.cc:3055] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:13.190623 21048 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:13.190678 20969 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:13.191341 21048 raft_consensus.cc:697] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:13.192060 20969 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.192379 21048 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.194279 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.112839 21033 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:18:13.195297 18335 raft_consensus.cc:2410] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:13.196656 18343 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:13.198423 20733 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:13.198174 20797 consensus_queue.cc:1059] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:18:13.171787 21040 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.155s	user 0.001s	sys 0.001s
I20260709 13:18:13.201241 20797 raft_consensus.cc:3055] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:13.201632 20797 raft_consensus.cc:740] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:13.202474 20797 consensus_queue.cc:260] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:13.203037 20887 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:13.203596 20797 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:13.203713 20748 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:13.199198 20303 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.200170 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:13.210124 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.211313 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.212090 18417 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:13.200518 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.198372 19055 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:13.210668 19059 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:18:13.216069 19061 raft_consensus.cc:2376] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7. Re-sending same reply.
I20260709 13:18:13.193755 20969 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:13.238492 20949 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.241015 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.242072 19053 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:13.242959 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.244184 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.244894 19053 raft_consensus.cc:2368] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
W20260709 13:18:13.256786 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.259298 20787 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:13.260357 20859 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:13.262558 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.265233 20975 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:13.266065 20887 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:13.276381 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.283277 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1876) took 1233 ms. Trace:
I20260709 13:18:13.290092 18337 rpcz_store.cc:276] 0709 13:18:12.049898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.405288 (+355390us) service_pool.cc:224] Handling call
0709 13:18:12.405724 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.406232 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.406261 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.406769 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.605524 (+198755us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:12.893440 (+287916us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.282646 (+389206us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540018f4a0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee57733 00007f409eedcdbf 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c
0709 13:18:13.282738 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.282860 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.282916 (+    56us) raft_consensus.cc:1685] finished
0709 13:18:13.283037 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.283202 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14106,"prepare.queue_time_us":165257,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":861,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":29160,"spinlock_wait_cycles":291327872,"thread_start_us":452971,"threads_started":2,"wal-append.queue_time_us":271461}
I20260709 13:18:13.293213 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.293265 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.294410 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.245719 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.311836 19059 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:13.276153 20948 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:18:13.318286 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:13.319005 18417 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:13.321750 21011 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:13.322201 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.322688 19054 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:13.333211 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:13.334225 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.269608 20906 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:13.337445 19061 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:13.339097 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.257627 21010 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.341486 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.357595 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.358522 19053 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:13.359369 21010 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:13.359741 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.359952 19062 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:13.341607 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.342792 18339 raft_consensus.cc:2410] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:13.361371 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:13.363987 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.324187 21017 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:13.367832 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.369305 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.370342 18344 raft_consensus.cc:2368] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 4. Current term is 5.
I20260709 13:18:13.373766 18337 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:13.375782 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.283814 20822 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 13:18:13.377254 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 255680us
I20260709 13:18:13.379765 19025 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:13.377179 18339 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:18:13.378718 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.380493 21010 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:13.389262 18344 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:13.388832 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.280802 20862 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:18:13.386832 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.390899 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:13.392932 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.385368 20900 raft_consensus.cc:3055] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:13.406493 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.407271 18337 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:13.426174 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.434371 19053 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:13.427572 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:13.443549 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.448031 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.448443 18484 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:13.399940 21010 raft_consensus.cc:697] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:13.395332 20733 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:18:13.455705 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:13.459549 18491 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.406035 20900 raft_consensus.cc:740] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:13.457448 19059 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:13.458374 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.464973 19053 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:13.465063 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.466251 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.467140 19056 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:13.467285 19053 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:13.468078 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.468722 18337 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:13.470422 21010 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.405628 20975 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:18:13.466431 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.468528 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.506575 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.508327 20900 consensus_queue.cc:260] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.514293 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.514842 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:13.515497 18340 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:13.516678 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.517520 18340 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:13.518620 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.519887 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.520625 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.521180 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.457763 20979 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.528482 20979 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.529933 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.530458 20979 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:13.530575 19053 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:18:13.531489 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.532119 19053 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:13.537158 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.538308 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.539929 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.519238 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:13.543036 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.545260 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.547462 19059 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:13.532804 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:13.548450 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.515715 18487 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:13.553007 19053 raft_consensus.cc:2368] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4.
I20260709 13:18:13.563185 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.564854 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:13.565330 20906 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.565704 18490 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:13.566104 20906 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.567356 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:13.568933 20906 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:13.566511 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.569221 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:13.579152 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.583478 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:13.584334 18485 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:13.585506 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.588583 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.589468 19059 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:13.543285 18491 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
W20260709 13:18:13.583333 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 48771.8us
I20260709 13:18:13.595860 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:13.597370 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:13.549306 20822 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:13.599673 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.603056 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:13.595876 19053 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:13.604067 18415 raft_consensus.cc:2410] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:18:13.697446 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.604974 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.700313 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:13.662077 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:13.681074 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:13.699728 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.662426 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:13.711262 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.684449 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:13.654716 18337 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:13.710953 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:13.711280 18410 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:18:13.662670 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:13.650549 21049 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:13.663295 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:13.716203 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:13.717819 18418 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:13.719913 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:13.721298 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:13.721323 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:13.723146 18411 raft_consensus.cc:2410] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:13.723371 18418 raft_consensus.cc:2410] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:13.606335 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.712030 19059 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:13.725668 18412 raft_consensus.cc:2368] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3.
I20260709 13:18:13.726910 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.727212 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.719913 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:13.728768 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:13.731472 19059 raft_consensus.cc:2368] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7.
I20260709 13:18:13.733278 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.734004 19054 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:13.737684 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.585114 20887 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.752437 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:13.753775 18490 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.759474 18417 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:13.765880 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.767606 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.768806 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.774046 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.775276 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.775588 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.776430 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.776736 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.777462 19053 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:13.778523 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.779162 19053 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:13.779757 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.780002 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.781076 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.782647 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.783592 19055 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:13.784392 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.785048 19055 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:13.777563 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.786754 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.792507 19056 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:13.793735 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.804621 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.797114 18411 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:13.809492 19056 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:13.822064 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:13.822751 19062 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:13.801790 18415 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:13.823962 18490 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:13.824633 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:13.824875 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 65597.7us
I20260709 13:18:13.825589 19055 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:13.826952 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.828436 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.820233 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:13.830358 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:13.833525 18493 raft_consensus.cc:2368] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5.
W20260709 13:18:13.836671 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.839668 20936 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:13.685045 20822 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.738610 20948 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:18:13.848994 19057 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:13.850879 19062 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
W20260709 13:18:13.859050 21063 log.cc:927] Time spent T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:18:13.859771 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:13.860688 18458 leader_election.cc:336] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 1.576s (SENT)
I20260709 13:18:13.861197 18458 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:13.867913 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 145672us
W20260709 13:18:13.868991 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.873068 19059 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:13.875787 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:13.877950 19057 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:13.876124 18309 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:13.887475 19059 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:13.793432 20887 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:13.893206 19059 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:13.917179 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:13.919251 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.920414 19059 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:13.931622 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:13.932255 18335 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:13.884800 20906 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:13.936203 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:13.937005 19059 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:13.945504 18309 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:13.960155 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:13.960953 18336 raft_consensus.cc:2368] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5.
I20260709 13:18:13.949362 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.961644 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:13.966297 18485 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:13.971580 18343 raft_consensus.cc:2393] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:18:14.025624 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 44280.8us
I20260709 13:18:14.036808 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:14.031395 19025 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:14.042995 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:13.963199 21045 consensus_queue.cc:1059] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:18:14.043846 19059 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:14.013767 21076 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:14.051757 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 212456us
I20260709 13:18:14.053058 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:14.139498 18382 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:14.124946 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 243392us
W20260709 13:18:14.049193 21079 log.cc:927] Time spent T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:18:14.046617 21011 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:14.155442 18458 leader_election.cc:336] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.598s (SENT)
I20260709 13:18:14.157203 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:14.159015 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.190022 19056 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
W20260709 13:18:14.190682 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 278938us
I20260709 13:18:14.191560 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.065049 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:14.194487 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.198649 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.200132 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:14.200249 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:14.201010 19056 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:18:14.193645 21069 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.444s	user 0.001s	sys 0.000s
I20260709 13:18:14.201989 21011 raft_consensus.cc:697] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:14.202661 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 649) took 1127 ms. Trace:
I20260709 13:18:14.147861 20722 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:18:14.203035 21011 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.206638 19026 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.192062 21016 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.197768 18457 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:14.213838 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:14.218364 18336 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.213768 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:14.214977 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 170611us
I20260709 13:18:14.219410 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.195495 18458 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.203051 19060 rpcz_store.cc:276] 0709 13:18:13.075376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.075517 (+   141us) service_pool.cc:224] Handling call
0709 13:18:13.094984 (+ 19467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.120849 (+ 25865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.120882 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.129711 (+  8829us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.441098 (+311387us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:13.441157 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.441225 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.202432 (+761207us) raft_consensus.cc:1685] finished
0709 13:18:14.202460 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.202598 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6057,"raft.queue_time_us":30756,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":42443,"thread_start_us":242060,"threads_started":1,"wal-append.queue_time_us":385762}
I20260709 13:18:14.223373 18415 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:14.143090 21076 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:14.224255 19054 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:14.225014 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:14.232430 19056 raft_consensus.cc:2376] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5. Re-sending same reply.
W20260709 13:18:14.215651 20797 consensus_meta.cc:287] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.012s	user 0.006s	sys 0.008s
W20260709 13:18:14.216188 21071 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.388s	user 0.001s	sys 0.001s
I20260709 13:18:14.263942 19054 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:14.210292 21094 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:14.252830 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 307392us
I20260709 13:18:14.259218 19056 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:14.216306 21085 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:14.207949 21012 consensus_queue.cc:1059] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:18:14.285238 21012 consensus_queue.cc:1243] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:14.221688 21045 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.284570 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:14.285311 21089 log.cc:927] Time spent T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:18:14.263103 21017 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:14.272256 21074 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
W20260709 13:18:14.288787 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.288147 19060 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:14.294409 20906 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:14.294734 21090 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:18:14.295789 21082 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:18:14.339864 18336 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:14.296607 21066 raft_consensus.cc:3055] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:14.298192 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 78854.4us
I20260709 13:18:14.299320 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1896) took 1020 ms. Trace:
W20260709 13:18:14.299619 21087 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:18:14.259233 21098 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:14.335888 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.337700 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 377554us
W20260709 13:18:14.338160 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.342818 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.314594 21094 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:14.356302 18415 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:14.342065 18341 rpcz_store.cc:276] 0709 13:18:13.279189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.279336 (+   147us) service_pool.cc:224] Handling call
0709 13:18:13.279650 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.280036 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.280070 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.280607 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.457814 (+177207us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:13.457869 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.457997 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.299059 (+841062us) raft_consensus.cc:1685] finished
0709 13:18:14.299078 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.299260 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":176778,"threads_started":1,"wal-append.queue_time_us":428179}
I20260709 13:18:14.322633 20822 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:14.362201 18307 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.364400 21093 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.364952 18341 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:14.365011 21093 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:14.368412 20681 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.368548 19058 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:14.368938 20681 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.370352 18341 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:14.371152 20681 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:14.372270 21093 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:14.372519 18341 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:14.374101 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 654) took 1223 ms. Trace:
I20260709 13:18:14.374457 19053 rpcz_store.cc:276] 0709 13:18:13.150753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.854062 (+703309us) service_pool.cc:224] Handling call
0709 13:18:13.878822 (+ 24760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.889383 (+ 10561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.889429 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.959546 (+ 70117us) log.cc:844] Serialized 26 byte log entry
0709 13:18:14.225241 (+265695us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:14.275814 (+ 50573us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.276046 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.276135 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.373890 (+ 97755us) raft_consensus.cc:1685] finished
0709 13:18:14.373928 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.374042 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50367,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1590,"raft.queue_time_us":14861,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":44719,"thread_start_us":190514,"threads_started":1,"wal-append.queue_time_us":384245}
I20260709 13:18:14.377457 18488 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:14.378310 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:14.379838 18336 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:14.345707 21066 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:14.346709 20906 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:18:14.383023 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 227612us
I20260709 13:18:14.384272 18341 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:14.386032 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1899) took 1067 ms. Trace:
W20260709 13:18:14.382191 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 184525us
I20260709 13:18:14.386475 18338 rpcz_store.cc:276] 0709 13:18:13.318980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.319805 (+   825us) service_pool.cc:224] Handling call
0709 13:18:13.320174 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.320572 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.320614 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.321048 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.606575 (+285527us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:13.606642 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.607232 (+   590us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.385773 (+778541us) raft_consensus.cc:1685] finished
0709 13:18:14.385800 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.385962 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1055,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":278603,"threads_started":1,"wal-append.queue_time_us":480380}
I20260709 13:18:14.389739 18415 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:18:14.392081 18458 leader_election.cc:336] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 1.643s (SENT)
I20260709 13:18:14.392664 18458 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:14.230232 21016 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.398094 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 888) took 1135 ms. Trace:
I20260709 13:18:14.398584 19055 rpcz_store.cc:276] 0709 13:18:13.262596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.868855 (+606259us) service_pool.cc:224] Handling call
0709 13:18:13.887745 (+ 18890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.976924 (+ 89179us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:13.980100 (+  3176us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.397174 (+417074us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.397225 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:14.397274 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.397336 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.398015 (+   679us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3002,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":10553,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":409908,"threads_started":2,"wal-append.queue_time_us":302429}
I20260709 13:18:14.397557 19054 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEARNER]: Advancing to term 5
W20260709 13:18:14.405125 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 47790.6us
I20260709 13:18:14.410571 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:14.411389 18415 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:14.423225 18338 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:18:14.425971 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.396950 21098 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.422433 18335 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
W20260709 13:18:14.428457 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 221893us
W20260709 13:18:14.432649 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.448885 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:14.451349 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 109219us
I20260709 13:18:14.452363 18307 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.453985 19054 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:18:14.463364 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.463488 19026 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.461323 18384 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:14.492125 21102 log.cc:927] Time spent T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:18:14.494482 21095 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:18:14.498476 20906 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.506448 21107 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:14.507321 21107 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:14.509414 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 57164.8us
I20260709 13:18:14.510402 18307 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.511380 21098 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:14.511981 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.512931 21098 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.515173 21094 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:14.527686 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 140794us
I20260709 13:18:14.445670 21092 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:14.529414 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.457727 21085 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:14.553581 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 168848us
W20260709 13:18:14.554252 18458 leader_election.cc:336] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 1.666s (SENT)
I20260709 13:18:14.467012 21109 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:14.558341 21109 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:14.554759 18458 leader_election.cc:336] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.666s (SENT)
I20260709 13:18:14.555162 18493 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:14.556734 18488 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:14.557444 19025 leader_election.cc:400] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5.
I20260709 13:18:14.559315 19025 leader_election.cc:403] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:14.559625 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.559880 21017 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5.
I20260709 13:18:14.560390 21109 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.560742 19025 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:14.561417 18458 leader_election.cc:336] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.680s (SENT)
W20260709 13:18:14.562122 18458 leader_election.cc:336] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 1.680s (SENT)
I20260709 13:18:14.562049 21107 consensus_queue.cc:1059] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:14.562356 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:14.562599 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.563308 21109 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:14.564224 18458 leader_election.cc:336] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 1.728s (SENT)
I20260709 13:18:14.564448 21107 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:18:14.564759 18458 leader_election.cc:336] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.728s (SENT)
I20260709 13:18:14.564836 21107 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:14.565191 18458 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.565727 21107 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.566423 21109 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:14.566951 21107 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:14.567974 18458 leader_election.cc:336] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 1.770s (SENT)
I20260709 13:18:14.568369 18458 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:14.568982 21109 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:14.561496 21017 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:14.570021 18458 leader_election.cc:336] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.791s (SENT)
I20260709 13:18:14.570431 21017 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:14.570546 18458 leader_election.cc:336] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 1.791s (SENT)
I20260709 13:18:14.570902 21017 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:14.570936 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.571755 21109 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:14.571923 21017 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:14.573452 18458 leader_election.cc:336] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.821s (SENT)
I20260709 13:18:14.573813 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:14.574401 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 45060.8us
I20260709 13:18:14.575170 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:14.578696 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 115276us
I20260709 13:18:14.579905 19026 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.549894 20883 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:14.590204 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 133111us
I20260709 13:18:14.591212 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.552644 21098 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.596760 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.612411 21016 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:14.613685 21045 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.598513 21116 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:14.600874 18458 leader_election.cc:336] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.865s (SENT)
I20260709 13:18:14.599651 20722 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:14.618309 20722 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:14.618731 20722 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:14.619341 21106 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:18:14.619813 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.602181 20822 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:14.574707 21110 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:18:14.621390 18458 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:14.622218 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 662) took 1469 ms. Trace:
W20260709 13:18:14.622434 21114 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:18:14.622632 19062 rpcz_store.cc:276] 0709 13:18:13.152831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.852231 (+699400us) service_pool.cc:224] Handling call
0709 13:18:13.852789 (+   558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.921396 (+ 68607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.921439 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.955788 (+ 34349us) log.cc:844] Serialized 26 byte log entry
0709 13:18:14.467962 (+512174us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:14.468020 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.468111 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.621986 (+153875us) raft_consensus.cc:1685] finished
0709 13:18:14.622004 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.622156 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10723,"raft.queue_time_us":19065,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":40691,"thread_start_us":486223,"threads_started":1,"wal-append.queue_time_us":596023}
I20260709 13:18:14.459537 21066 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.627581 18458 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:14.628010 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.593209 21085 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:14.631280 21110 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:14.631358 19057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 890) took 1368 ms. Trace:
W20260709 13:18:14.632658 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 69511.7us
I20260709 13:18:14.631811 21118 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.634944 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.635507 18458 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:14.632611 19057 rpcz_store.cc:276] 0709 13:18:13.263098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.881469 (+618371us) service_pool.cc:224] Handling call
0709 13:18:13.907500 (+ 26031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.909416 (+  1916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.909444 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.936022 (+ 26578us) log.cc:844] Serialized 26 byte log entry
0709 13:18:14.426826 (+490804us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:14.455208 (+ 28382us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.455390 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.455477 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.631143 (+175666us) raft_consensus.cc:1685] finished
0709 13:18:14.631161 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.631300 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3786,"prepare.queue_time_us":21646,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2638,"raft.queue_time_us":52667,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":21660,"thread_start_us":411879,"threads_started":1,"wal-append.queue_time_us":659831}
W20260709 13:18:14.637856 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 58011.7us
I20260709 13:18:14.640739 19026 leader_election.cc:400] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3.
I20260709 13:18:14.642953 19026 leader_election.cc:403] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:14.651759 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:14.636833 21109 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:14.658812 18384 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.662520 18307 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.664259 18484 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:14.651283 20883 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:14.657104 21084 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:14.655793 21120 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:18:14.649981 21011 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:18:14.686589 18384 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.688158 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.695622 18307 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.697774 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.698668 20883 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:14.699224 20883 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.699671 20883 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.700981 18384 leader_election.cc:400] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7.
I20260709 13:18:14.704229 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.704947 20969 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:14.705330 20969 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:14.705700 20969 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.710541 18307 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.711849 18242 catalog_manager.cc:5697] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 3 to 4, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 4 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:14.717337 18307 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.719233 19027 leader_election.cc:400] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5.
I20260709 13:18:14.719671 19027 leader_election.cc:403] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:14.722110 21099 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:14.722563 21099 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:14.722805 21108 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.166s	user 0.003s	sys 0.000s
I20260709 13:18:14.724050 21122 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5.
I20260709 13:18:14.721729 19027 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.726850 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1895) took 1001 ms. Trace:
I20260709 13:18:14.727514 19027 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.727347 18414 rpcz_store.cc:276] 0709 13:18:13.725346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.747746 (+ 22400us) service_pool.cc:224] Handling call
0709 13:18:13.802188 (+ 54442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:14.143354 (+341166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.150921 (+  7567us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.191732 (+ 40811us) log.cc:844] Serialized 26 byte log entry
0709 13:18:14.359461 (+167729us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:14.359503 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.359568 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.722190 (+362622us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:14.726496 (+  4306us) raft_consensus.cc:1685] finished
0709 13:18:14.726523 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.726776 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19560,"raft.queue_time_us":31669,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"spinlock_wait_cycles":40554880,"thread_start_us":355859,"threads_started":2,"wal-append.queue_time_us":254305}
I20260709 13:18:14.729221 19027 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.730068 21124 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:14.730665 21010 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:14.731452 21122 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:14.730741 21124 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:14.732355 21124 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:14.734408 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.735844 21124 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:14.739547 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 71959.1us
I20260709 13:18:14.669409 21123 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3.
I20260709 13:18:14.743040 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:14.743213 18414 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:18:14.743542 18414 pending_rounds.cc:85] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 4
I20260709 13:18:14.743786 18414 pending_rounds.cc:107] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:14.743649 18415 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:14.744081 18414 raft_consensus.cc:2889] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:14.746133 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:14.679427 21085 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.719178 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.762316 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:14.763906 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:14.679211 21012 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:18:14.688987 21078 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.746064 20847 consensus_queue.cc:1059] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:18:14.722934 21099 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.755038 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:14.772022 18490 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:14.755445 20969 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.756283 20722 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.757303 21077 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.757941 21086 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:14.775076 19060 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:14.775307 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:14.758358 21109 consensus_queue.cc:1059] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:14.746805 18414 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:14.764822 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:14.781426 19054 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:14.764937 18307 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.765443 19026 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:18:14.766031 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 46918.2us
I20260709 13:18:14.768010 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:14.715919 21084 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:14.769647 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.782454 19053 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:14.782505 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.723234 21065 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.739460 20822 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.773571 19057 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:14.770669 20851 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:14.770167 21107 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:14.779927 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:14.720219 21016 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:18:14.767416 21118 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.771409 20906 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:14.788383 19062 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:14.789481 18384 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.765846 21110 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:18:14.771180 21120 consensus_queue.cc:1059] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:18:14.794800 21078 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.796890 20906 raft_consensus.cc:697] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:14.802239 21078 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:14.803121 20906 consensus_queue.cc:237] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.804399 21078 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:14.806844 18307 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:14.807507 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.811225 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.812944 21084 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:14.774488 20883 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.791080 21123 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:14.794852 20862 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.795789 21077 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.815196 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:14.791209 21012 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:18:14.795311 21116 raft_consensus.cc:2764] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:14.818058 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.807731 21094 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:14.823665 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:14.827304 21066 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.829082 19059 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEARNER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:14.814438 21118 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:14.816213 21123 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.831944 21084 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:14.832386 21098 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:14.832794 20887 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:14.833526 21065 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:14.834040 21093 raft_consensus.cc:3055] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:14.813648 20722 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:14.835423 20969 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:14.835752 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.836447 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:14.836685 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:14.823750 21076 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:14.791216 21107 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.845170 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.858752 19062 raft_consensus.cc:2376] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3. Re-sending same reply.
I20260709 13:18:14.845738 21078 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:14.812031 20822 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:14.847361 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.860973 20681 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:14.861680 21107 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:14.861510 20681 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.863274 20862 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:14.863528 20681 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:14.863816 20862 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:14.864238 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:14.864874 18414 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:14.864730 20862 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.865391 21047 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:14.852998 21092 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.867234 21047 raft_consensus.cc:1064] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:18:14.867290 21092 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.869448 21092 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:14.869601 18411 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:18:14.870090 21116 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.870579 21116 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:14.873008 18490 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:14.848048 21118 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:14.876339 21065 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:14.877822 18491 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:14.878566 21085 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:14.878942 21118 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:14.881104 20900 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.822579 21017 raft_consensus.cc:3055] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:18:14.848526 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 84867.7us
I20260709 13:18:14.847777 21077 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:14.846313 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 897) took 1025 ms. Trace:
I20260709 13:18:14.844520 21094 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:14.908263 19059 rpcz_store.cc:276] 0709 13:18:13.821297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.054526 (+233229us) service_pool.cc:224] Handling call
0709 13:18:14.828748 (+774222us) spinlock_profiling.cc:243] Waited 82 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:18:14.828918 (+   170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.846003 (+ 17085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.846239 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188558720}
I20260709 13:18:14.873407 21078 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.851934 21093 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:14.852190 21086 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.848691 21123 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:14.885844 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:14.922696 18490 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:14.849089 20859 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:18:14.880241 21118 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.864022 20681 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:14.907815 18309 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:14.736791 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:14.858912 19057 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:14.935492 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:14.911350 18458 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.892666 21017 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:14.956561 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 63176.6us
I20260709 13:18:14.977624 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:14.981581 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.922302 21094 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.983752 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.853444 21084 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:14.922875 21078 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:14.922128 21077 raft_consensus.cc:697] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:15.014870 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.016398 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.938244 21132 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:14.927563 21116 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:14.891942 21098 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
W20260709 13:18:14.985256 21130 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:18:14.922348 21085 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:18:14.980096 20887 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:15.029279 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 45605.9us
I20260709 13:18:14.985707 21117 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.036983 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:15.024317 21093 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.043118 21093 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:15.043556 21131 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
W20260709 13:18:15.045244 21133 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:18:15.026113 20906 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.055322 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:14.977245 20681 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:15.067548 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:15.059896 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:15.034834 20887 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.927866 21086 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.021407 20949 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:18:15.073736 18382 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:15.065963 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:15.057772 21116 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.078024 20887 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.075817 21132 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:15.114662 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 48781.8us
I20260709 13:18:15.115624 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:15.079591 20883 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:15.155506 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:15.128258 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 221045us
I20260709 13:18:15.158850 18337 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:15.162781 18338 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:15.103741 20969 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:18:15.131629 20906 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:15.174156 19053 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:18:15.169625 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 55356.7us
I20260709 13:18:15.192101 18457 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:15.195729 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:15.196794 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:15.197546 18335 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:15.077687 21017 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:15.199833 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 44400.9us
I20260709 13:18:15.200726 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:15.201462 18384 connection.cc:256] RPC call timeout handler was delayed by -1.2569480560000557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
I20260709 13:18:15.151044 21110 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:15.199273 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:15.209168 18337 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:15.203488 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:15.205983 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:15.210148 19059 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.207378 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:15.214257 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:15.120955 21143 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:18:15.194041 21076 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.221769 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:15.233057 19056 raft_consensus.cc:2410] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:15.193523 20906 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:15.221385 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:15.228372 19055 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:18:15.235847 21136 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:18:15.236145 21086 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:15.237556 20906 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.231675 18458 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:15.212860 21109 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:15.217449 21117 consensus_queue.cc:1059] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:18:15.254498 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:15.256811 18458 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:15.226433 21116 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.277608 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:15.258423 20303 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.245839 21109 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:15.253367 20862 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.259595 21110 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.135665 21077 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.247669 21076 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.279502 21132 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.306162 21084 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:15.314054 21109 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:15.223605 21099 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:15.362515 18384 leader_election.cc:336] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 1.807s (SENT)
W20260709 13:18:15.363130 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 137010us
W20260709 13:18:15.317476 21137 log.cc:927] Time spent T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:18:15.368428 21132 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.366186 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:15.362962 21102 log.cc:927] Time spent T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:18:15.366250 21071 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:15.361303 21116 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:15.366182 21142 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.369586 21143 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:15.435659 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 138538us
I20260709 13:18:15.366474 20681 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:15.426476 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 63997.8us
I20260709 13:18:15.367911 21117 raft_consensus.cc:3055] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:15.324141 20862 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:15.436465 18491 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:15.474328 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:15.429113 21132 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.456338 21142 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.417309 21134 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:15.482187 21140 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:18:15.482036 21093 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:15.482911 21158 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
W20260709 13:18:15.484025 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.484050 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:15.472061 21064 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.486641 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:15.490688 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.505861 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:15.475641 21138 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 13:18:15.463644 21117 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:18:15.540333 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.503997 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:15.496842 21068 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:15.532100 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:15.541146 18341 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:18:15.533536 21154 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:18:15.493857 21142 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.542073 18414 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:15.543268 18341 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:15.544186 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:15.544929 20969 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:15.541353 18417 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:15.505353 21064 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.547015 19053 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:15.548323 21064 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:15.548991 19061 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:15.535321 20862 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:15.506596 18339 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
W20260709 13:18:15.537506 21118 consensus_meta.cc:287] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.604s	user 0.004s	sys 0.002s
I20260709 13:18:15.539860 21117 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:15.550352 19061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 670) took 2373 ms (client timeout 1807 ms). Trace:
I20260709 13:18:15.550539 21128 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.550774 21117 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:15.550819 19061 rpcz_store.cc:269] 0709 13:18:13.176815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.344161 (+167346us) service_pool.cc:224] Handling call
0709 13:18:15.550172 (+2206011us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b54006f90d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:15.550284 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4996096768}
I20260709 13:18:15.502743 18337 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:18:15.541297 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:15.536885 20900 consensus_meta.cc:287] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
I20260709 13:18:15.536834 18340 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:18:15.545303 21066 consensus_meta.cc:287] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.000s
I20260709 13:18:15.555272 19058 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:18:15.555586 19058 pending_rounds.cc:85] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 4
I20260709 13:18:15.555510 21086 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:15.555968 18342 raft_consensus.cc:2410] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 13:18:15.557333 18342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 1819) took 2043 ms (client timeout 2428 ms). Trace:
I20260709 13:18:15.557487 18344 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:18:15.557926 18344 pending_rounds.cc:85] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 4
I20260709 13:18:15.558328 18344 pending_rounds.cc:107] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
W20260709 13:18:15.557848 18342 rpcz_store.cc:269] 0709 13:18:13.513459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.539714 (+ 26255us) service_pool.cc:224] Handling call
0709 13:18:15.557029 (+2017315us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54000ea6d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:15.557243 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4634410880}
I20260709 13:18:15.558899 18344 raft_consensus.cc:2917] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:18:15.555922 19058 pending_rounds.cc:107] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:18:15.567546 19058 raft_consensus.cc:2889] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:15.571597 19025 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:15.577028 21148 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:18:15.577183 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:15.577814 21151 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:18:15.577992 18344 raft_consensus.cc:2889] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:15.578909 21098 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.579394 21098 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:15.582118 21107 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:15.494177 21134 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.582582 21107 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.583163 21134 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.584829 21107 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:15.586997 21155 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:18:15.581470 21142 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:18:15.589145 21141 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 13:18:15.590893 21142 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:15.600150 21076 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:15.602140 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:15.602957 19060 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:15.604748 21099 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:15.550344 21093 consensus_queue.cc:1243] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:18:15.616416 21149 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.343s	user 0.003s	sys 0.000s
W20260709 13:18:15.621449 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.470324 21143 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.625190 21143 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:15.629678 18309 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:15.632557 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:15.635388 18414 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:18:15.636965 21147 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.399s	user 0.001s	sys 0.000s
W20260709 13:18:15.640766 18385 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.040s	sys 0.050s
I20260709 13:18:15.640995 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:15.642156 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 70634.1us
W20260709 13:18:15.642314 18385 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.040s	sys 0.050s
I20260709 13:18:15.645608 18414 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:18:15.648221 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.640872 21128 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.647392 21066 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:15.652324 18309 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:15.630605 21078 consensus_meta.cc:287] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.000s
I20260709 13:18:15.677316 18486 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:15.655287 18309 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:15.686303 19059 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
W20260709 13:18:15.694887 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 438150us
I20260709 13:18:15.716835 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:15.654150 21076 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.724586 18458 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:15.730646 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:15.656581 20681 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:15.647528 21016 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:18:15.656203 21066 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:15.662338 21085 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:15.694437 20864 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.002s	sys 0.009s
I20260709 13:18:15.745960 18458 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:15.739514 20887 consensus_meta.cc:287] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.001s
I20260709 13:18:15.712320 21084 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:15.767979 18486 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.769093 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:15.741466 21076 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.773633 21076 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:15.658291 20822 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
W20260709 13:18:15.750000 20864 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.003s	sys 0.009s
I20260709 13:18:15.737237 21118 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.741739 21116 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:15.748322 21094 consensus_meta.cc:287] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.003s
I20260709 13:18:15.749277 21066 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.776654 20303 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:15.784379 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 277124us
W20260709 13:18:15.780524 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 93425us
I20260709 13:18:15.677659 21078 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.751180 21099 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:15.792908 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 47065.9us
I20260709 13:18:15.785807 21117 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.633656 21047 consensus_queue.cc:237] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.793012 18384 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:15.775036 21084 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:15.801944 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 297830us
W20260709 13:18:15.802302 19027 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.014s	sys 0.005s
W20260709 13:18:15.806341 19027 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.015s	sys 0.005s
W20260709 13:18:15.806758 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 567062us
I20260709 13:18:15.806834 21085 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:18:15.809598 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.810092 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.810226 20852 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:15.797524 18309 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:15.810796 20852 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.812952 20852 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:15.813361 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:15.779138 21076 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:18:15.782173 20887 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:15.824070 18458 connection.cc:256] RPC call timeout handler was delayed by -1.3412125120000837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24280000000000002s for a response
I20260709 13:18:15.827410 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:15.828182 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:15.830610 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:15.805248 21084 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.835831 18486 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:15.823372 18308 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:15.826627 20864 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:15.853312 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:15.799537 21094 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.856722 18308 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:15.857273 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:15.858512 18335 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:15.859864 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:15.860284 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:15.861238 18486 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:15.833842 21099 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.865839 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:15.862100 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:15.868935 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:15.870119 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:15.835557 21117 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:15.855479 20864 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.875998 19054 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: [4.7-5.8]
I20260709 13:18:15.874145 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:15.862506 21068 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:15.883144 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:15.883955 19059 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.872606 20870 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:15.878795 21123 consensus_meta.cc:287] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.939s	user 0.005s	sys 0.007s
I20260709 13:18:15.896603 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:15.872184 21183 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:15.877070 20864 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.897606 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:15.901943 18337 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:15.897212 18343 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:15.905613 19057 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:15.908421 19059 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
W20260709 13:18:15.910715 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 132610us
I20260709 13:18:15.911971 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:15.912673 18340 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.870026 21099 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.892292 20822 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:15.878598 21117 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.902946 21183 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:15.935278 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 78608.4us
I20260709 13:18:15.945574 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:15.924546 20822 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.916152 21177 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:15.903460 21107 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:18:15.948930 18410 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:15.899842 21123 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:15.952870 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:15.951318 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:15.955838 18412 raft_consensus.cc:1240] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:15.957621 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:15.940970 21183 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.967840 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:15.960227 18340 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:15.934818 21016 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:18:15.949517 20822 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.951776 21177 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:15.950103 21078 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:15.985267 21076 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 13:18:15.996466 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 71929.3us
W20260709 13:18:15.982009 21172 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:18:16.005121 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.004181 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:16.008318 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 47777.4us
W20260709 13:18:15.987310 21109 consensus_meta.cc:287] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.568s	user 0.002s	sys 0.008s
W20260709 13:18:16.039328 18458 leader_election.cc:336] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 2.428s (SENT)
I20260709 13:18:16.039906 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:15.992861 20870 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:18:15.983006 20852 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:18:15.998704 21177 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:16.045490 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:16.036559 21169 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:18:16.011890 20887 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.043805 21118 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:16.074504 21132 consensus_meta.cc:287] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.004s
I20260709 13:18:16.080205 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:16.036051 21109 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.081720 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:16.079551 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:16.085135 21157 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.086732 21068 raft_consensus.cc:1064] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
W20260709 13:18:16.087037 21181 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:18:16.087263 21068 raft_consensus.cc:1068] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: Unable to promote non-voter 31ab487dc52e4f608b39df0fae2fdfa5: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:18:16.087993 21176 log.cc:927] Time spent T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 13:18:16.088404 20906 consensus_meta.cc:287] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.850s	user 0.008s	sys 0.001s
I20260709 13:18:16.088789 20906 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.089399 21109 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.090075 18492 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:16.090457 18485 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:16.085340 21173 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:18:16.085714 21157 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:16.093626 21179 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:18:16.096191 18339 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:18:16.037703 21134 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.098402 21017 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.099337 18490 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:16.099594 21134 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.099673 21157 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.053020 21184 consensus_queue.cc:1059] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:18:16.102169 21143 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:16.102574 21143 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.102922 21143 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:16.103856 21110 consensus_meta.cc:287] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.785s	user 0.006s	sys 0.002s
I20260709 13:18:16.104261 21110 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:16.106242 21117 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.106477 18384 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:16.106871 21168 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:18:16.079048 21146 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:16.076668 21116 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.108711 21116 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.109148 21066 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.110756 21174 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:16.111196 21174 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.111523 21174 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.112980 21098 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:16.110774 21116 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.114523 18308 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:16.117118 21099 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.117277 21184 raft_consensus.cc:3055] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:16.117705 21184 raft_consensus.cc:740] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:16.117938 21146 raft_consensus.cc:697] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:16.118906 21184 consensus_queue.cc:260] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.120241 21184 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:16.118942 21146 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:16.104308 21175 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:18:16.121693 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:16.123296 21180 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:18:16.125031 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1910) took 1730 ms. Trace:
W20260709 13:18:16.113045 18444 heartbeater.cc:646] Failed to heartbeat to 127.16.211.62:40381 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.16.211.62:40381 timed out after 15.000s (SENT)
I20260709 13:18:16.125490 18344 rpcz_store.cc:276] 0709 13:18:14.395054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.395467 (+   413us) service_pool.cc:224] Handling call
0709 13:18:15.557189 (+1161722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.578599 (+ 21410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.124839 (+546240us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000ea6d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:16.124970 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2637455616}
I20260709 13:18:16.126374 21123 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:16.128944 20906 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.125555 20864 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:16.131022 21143 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.142445 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:16.143312 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:16.144115 18339 raft_consensus.cc:2393] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:16.144436 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:16.144680 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:16.145385 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:16.146313 18343 raft_consensus.cc:2410] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:16.146479 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:16.147182 18336 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:16.134182 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:16.135591 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 222361us
I20260709 13:18:16.138993 21085 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:16.167050 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:16.168365 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:16.168499 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:16.169106 18344 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:18:16.170854 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:16.170197 18307 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:16.171764 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 101025us
I20260709 13:18:16.169025 18341 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:16.174594 18307 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:16.175765 20864 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:16.132208 20822 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.179504 19027 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:16.181461 20303 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:16.083948 21132 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.266685 19059 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:18:16.206131 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.253588 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:16.257047 18413 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:16.205096 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1927) took 1295 ms. Trace:
I20260709 13:18:16.183145 18307 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:16.218552 18414 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:16.260147 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:16.215893 18417 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:16.220261 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:16.265606 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.289847 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:16.283519 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 100465us
I20260709 13:18:16.290658 18344 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:16.283070 18491 rpcz_store.cc:276] 0709 13:18:14.910048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.910265 (+   217us) service_pool.cc:224] Handling call
0709 13:18:14.910626 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.456781 (+546155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.204854 (+748073us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54003750d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:16.205031 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208669056}
W20260709 13:18:16.242019 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 58607.5us
I20260709 13:18:16.294222 18307 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:16.235298 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:16.237586 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:16.166867 21085 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:16.292459 21065 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:16.199436 21191 log.cc:927] Time spent T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:16.176258 20681 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:16.268325 21139 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 1.112s	user 0.002s	sys 0.001s
I20260709 13:18:16.296677 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:16.297425 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:16.367173 18491 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:16.297477 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:16.368100 19057 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.298410 18341 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:16.191607 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:16.302548 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:16.370936 18489 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.289495 20900 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.374480 20900 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:16.306489 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:16.376515 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:16.377199 18485 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:16.307216 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:16.378264 18416 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:16.308189 18484 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:16.380749 21160 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:16.255704 21135 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 1.099s	user 0.004s	sys 0.000s
W20260709 13:18:16.257894 21192 log.cc:927] Time spent T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
I20260709 13:18:16.381440 21160 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.316169 19027 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:16.257351 20883 raft_consensus.cc:3055] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:16.384152 20883 raft_consensus.cc:740] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:16.176028 20851 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:16.183534 20906 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.385497 20906 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.353817 18339 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:16.208662 21066 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:16.194677 21143 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.182039 21076 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:16.362367 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:16.190936 20822 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.210920 21128 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:16.390008 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 65184.2us
I20260709 13:18:16.412556 18415 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:16.413394 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:16.217020 20864 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.147s
I20260709 13:18:16.186419 21190 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:16.392607 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 98476.5us
I20260709 13:18:16.361946 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:16.393231 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:16.420047 18413 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:16.215512 21142 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.148s
I20260709 13:18:16.394763 21160 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.252998 21084 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.363497 20681 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:16.396569 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1923) took 1520 ms. Trace:
I20260709 13:18:16.397135 20906 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.397337 20870 consensus_queue.cc:1059] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:16.398293 20797 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:16.399714 21010 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:16.401445 21094 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.217216 20948 consensus_queue.cc:1059] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.145s
I20260709 13:18:16.404843 19026 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:16.194097 21195 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:16.391436 18336 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
W20260709 13:18:16.415973 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 125302us
I20260709 13:18:16.420249 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:16.366364 21065 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.395293 21194 consensus_queue.cc:1059] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:18:16.211357 21174 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:16.427999 18344 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:16.429111 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:16.387749 20879 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:16.430332 18489 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:16.262367 21183 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.295147 21156 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:18:16.362033 21123 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:18:16.291460 21177 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:16.445958 18485 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:16.364763 21098 consensus_queue.cc:1059] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:18:16.431396 21128 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:16.453449 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 48684.5us
W20260709 13:18:16.419091 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 67675.3us
I20260709 13:18:16.549331 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:16.441242 21116 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.461902 18489 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:18:16.471212 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 49449.2us
I20260709 13:18:16.472177 21142 consensus_queue.cc:1243] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:16.472930 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 686) took 2188 ms. Trace:
I20260709 13:18:16.562886 19058 rpcz_store.cc:276] 0709 13:18:14.284933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.369269 (+ 84336us) service_pool.cc:224] Handling call
0709 13:18:14.369523 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.567984 (+1198461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.472717 (+904733us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001473d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:16.472876 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2726208768}
I20260709 13:18:16.473701 20948 raft_consensus.cc:3055] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:16.564029 20948 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:16.481846 20870 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:16.566119 20870 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:16.567013 20870 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.481348 18242 catalog_manager.cc:5697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 2 to 4, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.568204 20870 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.485378 18384 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:16.569067 18242 catalog_manager.cc:5697] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 2 to 3, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:16.570252 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 84973.3us
I20260709 13:18:16.570668 18242 catalog_manager.cc:5697] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:16.572320 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.573514 18335 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:16.439177 21160 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:16.574147 21160 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:16.575646 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:16.576539 21142 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:16.577061 21142 raft_consensus.cc:697] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:16.565279 20948 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.577889 20948 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.577854 21142 consensus_queue.cc:237] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:16.575248 18242 catalog_manager.cc:5697] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 1 to 3, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.509666 21084 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.438961 21085 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.511304 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:16.512946 21132 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:16.449018 20797 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.435559 18487 rpcz_store.cc:276] 0709 13:18:14.875683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.876420 (+   737us) service_pool.cc:224] Handling call
0709 13:18:14.876754 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:14.877142 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.877174 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.877608 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.021494 (+143886us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:15.027253 (+  5759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.034500 (+  7247us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.267111 (+1232611us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:16.396257 (+129146us) raft_consensus.cc:1685] finished
0709 13:18:16.396281 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.396495 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1206,"raft.run_cpu_time_us":43,"raft.run_wall_time_us":43,"spinlock_wait_cycles":6198144,"thread_start_us":107464,"threads_started":1,"wal-append.queue_time_us":199604}
I20260709 13:18:16.429155 21110 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:18:16.523075 18413 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
W20260709 13:18:16.524447 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 104327us
W20260709 13:18:16.506075 18238 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42284 (request call id 333) took 15414 ms (client timeout 15000 ms). Trace:
W20260709 13:18:16.544188 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 228071us
I20260709 13:18:16.554639 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:16.457233 21199 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:16.612442 18340 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:16.665097 19054 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:16.693769 19053 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:18:16.698515 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 145661us
W20260709 13:18:16.654554 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 87569us
I20260709 13:18:16.706557 19055 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:16.556921 20887 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:16.741533 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.742688 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:16.549436 21086 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:16.749866 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:16.748286 18339 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:16.753016 18338 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.754321 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:16.556335 20851 raft_consensus.cc:697] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:16.749567 18242 catalog_manager.cc:5697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 6 to 9, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 9 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:16.610124 21194 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.635880 21107 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.768476 18242 catalog_manager.cc:5697] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 3 to 5, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 5 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.768589 21107 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.770069 18242 catalog_manager.cc:5697] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 4 to 5, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 5 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.771646 18242 catalog_manager.cc:5697] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 4 to 6, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 6 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.657388 21017 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.773631 21017 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.762367 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:16.776134 21017 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:16.777395 19058 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:18:16.777894 19058 pending_rounds.cc:85] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 4
I20260709 13:18:16.778203 19058 pending_rounds.cc:107] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:16.778497 19058 raft_consensus.cc:2889] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:16.781755 21107 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:16.792412 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:16.793541 18491 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:16.794871 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:16.795536 18491 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.801193 21065 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:16.863955 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.053169 21174 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:17.080484 21160 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:16.638737 21116 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:17.614485 21076 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:17.615546 20948 consensus_meta.cc:287] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.037s	user 0.014s	sys 0.003s
I20260709 13:18:16.610538 20681 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:16.762493 21077 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:17.570468 21203 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.901s	user 0.000s	sys 0.009s
W20260709 13:18:17.402523 18491 consensus_meta.cc:287] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.035s
I20260709 13:18:17.627614 18491 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:17.555538 21156 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:17.403726 18338 consensus_meta.cc:287] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.004s
I20260709 13:18:17.649214 18338 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:17.649902 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1959) took 1076 ms. Trace:
I20260709 13:18:17.650348 18338 rpcz_store.cc:276] 0709 13:18:16.573261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.635345 (+ 62084us) service_pool.cc:224] Handling call
0709 13:18:17.649825 (+1014480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.953706 21204 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.292s
W20260709 13:18:17.407500 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 743994us
I20260709 13:18:16.713393 21199 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:17.558678 19055 consensus_meta.cc:287] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.851s	user 0.009s	sys 0.001s
I20260709 13:18:17.663309 19055 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:16.633795 20975 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.156s
I20260709 13:18:17.562947 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:17.669108 19059 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:17.565595 19057 consensus_meta.cc:287] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.197s	user 0.011s	sys 0.006s
I20260709 13:18:17.670680 19057 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:17.671890 19053 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:18:16.767092 20851 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:18:17.585173 18412 consensus_meta.cc:287] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.180s	user 0.012s	sys 0.006s
I20260709 13:18:17.691352 18412 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:17.692072 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 521) took 1395 ms. Trace:
I20260709 13:18:17.697158 19059 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:17.700403 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:17.702243 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:17.703017 18338 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:17.692495 18412 rpcz_store.cc:276] 0709 13:18:16.296484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.297172 (+   688us) service_pool.cc:224] Handling call
0709 13:18:17.691997 (+1394825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.615571 21116 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:17.587211 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 817056us
W20260709 13:18:16.663589 18238 rpcz_store.cc:269] 0709 13:18:01.091142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.091405 (+   263us) service_pool.cc:224] Handling call
0709 13:18:16.505789 (+15414384us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:08.301354 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:08.301958 (+   604us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:08.302010 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:18:08.302035 (+    25us) tablet.cc:662] Decoding operations
0709 13:18:08.302772 (+   737us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:08.302839 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:08.302882 (+    43us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:08.303284 (+   402us) tablet.cc:701] Row locks acquired
0709 13:18:08.303307 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:18:08.303483 (+   176us) write_op.cc:270] Start()
0709 13:18:08.303608 (+   125us) write_op.cc:276] Timestamp: P: 1783603088303426 usec, L: 0
0709 13:18:08.303635 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:18:08.304408 (+   773us) log.cc:844] Serialized 1355 byte log entry
0709 13:18:08.788751 (+484343us) op_driver.cc:464] REPLICATION: finished
0709 13:18:09.598543 (+809792us) write_op.cc:301] APPLY: starting
0709 13:18:09.604209 (+  5666us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:09.613285 (+  9076us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:09.638943 (+ 25658us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:09.639438 (+   495us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:09.647962 (+  8524us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:18:09.656426 (+  8464us) write_op.cc:312] APPLY: finished
0709 13:18:09.690379 (+ 33953us) log.cc:844] Serialized 35 byte log entry
0709 13:18:09.916507 (+226128us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:09.921893 (+  5386us) write_op.cc:454] Released schema lock
0709 13:18:09.926526 (+  4633us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:10.012435 (+ 85909us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:10.019873 (+  7438us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":687668,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":778599,"apply.run_cpu_time_us":21172,"apply.run_wall_time_us":411922,"num_ops":3,"prepare.queue_time_us":346308,"prepare.run_cpu_time_us":5983,"prepare.run_wall_time_us":48036,"raft.queue_time_us":246270,"raft.run_cpu_time_us":51932,"raft.run_wall_time_us":384062,"replication_time_us":448819,"thread_start_us":805447,"threads_started":5,"wal-append.queue_time_us":463514,"wal-append.run_cpu_time_us":23175,"wal-append.run_wall_time_us":2362709}]]}
W20260709 13:18:17.612115 21202 log.cc:927] Time spent T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.772s	user 0.003s	sys 0.011s
I20260709 13:18:17.615151 21076 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:17.615772 20797 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:17.615918 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:17.742400 19058 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:17.399185 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1950) took 1094 ms. Trace:
I20260709 13:18:16.750051 21185 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.637s
W20260709 13:18:17.569590 21200 log.cc:927] Time spent T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 1.047s	user 0.000s	sys 0.009s
I20260709 13:18:17.617512 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 519) took 1321 ms. Trace:
I20260709 13:18:16.642501 21109 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:17.630954 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:17.634361 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:17.776211 18491 raft_consensus.cc:2368] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6.
I20260709 13:18:17.585347 19062 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:17.640311 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:17.642448 18242 catalog_manager.cc:5697] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 2 to 4, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:17.585881 20847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.177s	user 0.030s	sys 0.065s
I20260709 13:18:17.567734 21084 consensus_queue.cc:1059] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:18:17.674824 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 924) took 1112 ms. Trace:
I20260709 13:18:17.675707 19057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 920) took 1452 ms. Trace:
I20260709 13:18:17.629376 21160 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.725454 21187 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:17.726523 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:17.646590 20887 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.646800 21098 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.727341 21197 raft_consensus.cc:3055] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:17.812564 21216 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.593s	user 0.000s	sys 0.014s
I20260709 13:18:17.812821 21197 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:17.812747 21098 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:17.814175 21197 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:17.671149 21199 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:17.743431 18484 rpcz_store.cc:276] 0709 13:18:16.304386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.430188 (+125802us) service_pool.cc:224] Handling call
0709 13:18:16.447242 (+ 17054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.598206 (+150964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.598252 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.598312 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:16.598342 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.398912 (+800570us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003548d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:17.398967 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.399113 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346544000}
I20260709 13:18:17.758337 18414 rpcz_store.cc:276] 0709 13:18:16.295904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.296592 (+   688us) service_pool.cc:224] Handling call
0709 13:18:16.296898 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.351052 (+ 54154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.351084 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.365100 (+ 14016us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.598506 (+233406us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:16.598541 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.598596 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.617253 (+1018657us) raft_consensus.cc:1685] finished
0709 13:18:17.617283 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.617444 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12760,"raft.queue_time_us":48100,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":33065,"thread_start_us":167381,"threads_started":1,"wal-append.queue_time_us":473209}
W20260709 13:18:17.783989 20847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.378s	user 0.030s	sys 0.066s
I20260709 13:18:17.765535 18338 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:17.766489 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:17.656853 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:17.824967 19058 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:17.657460 21077 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:17.787974 21214 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:17.828205 21197 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.822002 21109 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:17.815857 21184 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:17.788350 21174 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.803261 19055 rpcz_store.cc:276] 0709 13:18:16.551720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.554351 (+  2631us) service_pool.cc:224] Handling call
0709 13:18:17.663875 (+1109524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.843784 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:17.845101 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:17.688001 20859 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:18:17.811933 20887 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:17.841519 21109 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:17.740499 21116 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:17.825074 18340 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
W20260709 13:18:17.855258 20303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.305s	user 0.060s	sys 0.175s
I20260709 13:18:17.789695 20949 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:17.675134 21156 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:17.829665 18382 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:17.833159 17233 debug-util.cc:398] Leaking SignalData structure 0x7b080031cb20 after lost signal to thread 18308
I20260709 13:18:17.833230 21214 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:17.789099 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 158241us
I20260709 13:18:17.836243 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:17.871240 19058 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:17.871781 18384 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:17.858896 20303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.308s	user 0.060s	sys 0.176s
I20260709 13:18:17.838797 18242 catalog_manager.cc:5697] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.834499 21184 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:17.841094 21212 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 13:18:17.846424 19055 raft_consensus.cc:2393] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:17.847384 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:17.851826 21183 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:17.816265 21160 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:17.894639 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.896469 18384 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:17.852443 21204 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:17.886617 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:17.874020 20847 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:17.888365 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:17.910362 19055 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:17.890012 18485 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:17.891170 21207 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:17.886379 21143 consensus_queue.cc:1059] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:18:17.876525 18242 catalog_manager.cc:5697] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 2 to 4, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.897982 19058 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:17.781229 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:17.871105 20859 consensus_queue.cc:1243] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:17.900302 19053 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:17.801884 19057 rpcz_store.cc:276] 0709 13:18:16.219137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.270467 (+ 51330us) service_pool.cc:224] Handling call
0709 13:18:17.671198 (+1400731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.871366 21109 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:17.908113 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 553) took 2335 ms. Trace:
I20260709 13:18:17.885738 21115 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:17.851802 21174 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:17.960238 18242 catalog_manager.cc:5697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 2 to 4, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 4 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:17.962888 18242 catalog_manager.cc:5697] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 2 to 4, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 4 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:17.900712 21128 consensus_meta.cc:287] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.289s	user 0.007s	sys 0.007s
I20260709 13:18:17.892838 21214 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:17.966073 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 695) took 2767 ms. Trace:
I20260709 13:18:17.893029 21184 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:17.908175 21209 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:17.885816 20949 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:17.969926 20979 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:18:18.015357 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1939) took 1732 ms. Trace:
I20260709 13:18:18.014585 20949 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:18.016160 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1954) took 1516 ms. Trace:
I20260709 13:18:18.015808 18488 rpcz_store.cc:276] 0709 13:18:16.283362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.285381 (+  2019us) service_pool.cc:224] Handling call
0709 13:18:16.309376 (+ 23995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.387073 (+ 77697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.387105 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.402265 (+ 15160us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.453499 (+ 51234us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:16.453539 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.491476 (+ 37937us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b5400374bd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:16.491538 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.014629 (+1523091us) raft_consensus.cc:1685] finished
0709 13:18:18.014651 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.015291 (+   640us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":469,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":13988,"spinlock_wait_cycles":177863424,"thread_start_us":50435,"threads_started":1,"wal-append.queue_time_us":347377}
I20260709 13:18:17.968755 18242 catalog_manager.cc:5697] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 3 to 6, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 6 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.966215 21065 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:18.016713 18336 rpcz_store.cc:276] 0709 13:18:16.499699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.501253 (+  1554us) service_pool.cc:224] Handling call
0709 13:18:16.501607 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.548758 (+ 47151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.548795 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.549246 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.576856 (+ 27610us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:16.576892 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.576956 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.015940 (+1438984us) raft_consensus.cc:1685] finished
0709 13:18:18.015959 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.016101 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":214793,"raft.queue_time_us":47308,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":76271,"thread_start_us":27329,"threads_started":1,"wal-append.queue_time_us":1419242}
I20260709 13:18:18.017894 20948 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.018263 21065 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:18.018550 20948 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:17.889012 17233 kernel_stack_watchdog.cc:198] Thread 18308 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 191ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:18:17.872584 21116 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:17.961206 20870 consensus_meta.cc:287] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.393s	user 0.017s	sys 0.000s
I20260709 13:18:18.008075 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:17.851408 21187 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:18.025686 19061 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:17.910089 20847 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.979753 21206 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.019019 21144 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.223s
I20260709 13:18:17.968667 19056 rpcz_store.cc:276] 0709 13:18:15.198576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.279752 (+ 81176us) service_pool.cc:224] Handling call
0709 13:18:15.305845 (+ 26093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.361317 (+ 55472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.361346 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.361808 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.481487 (+1119679us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b18002f84e0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:18:16.496549 (+ 15062us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:16.496599 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.496706 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.960837 (+1464131us) raft_consensus.cc:1685] finished
0709 13:18:17.960868 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.966004 (+  5136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54615,"raft.queue_time_us":55077,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3150,"spinlock_wait_cycles":88017280,"thread_start_us":14850,"threads_started":1,"wal-append.queue_time_us":1263959}
I20260709 13:18:17.955338 21076 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:18.024681 21065 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:18.044615 20887 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:17.979827 20733 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:18:18.047271 21160 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:17.966348 21207 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:17.971473 21115 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:17.978850 21128 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:18.034400 20847 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:18.041813 21206 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:18.012974 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:17.992103 20864 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:18.080397 21174 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:18.081197 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1935) took 2173 ms. Trace:
I20260709 13:18:18.094144 18337 rpcz_store.cc:276] 0709 13:18:15.908111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.908210 (+    99us) service_pool.cc:224] Handling call
0709 13:18:15.908498 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.915502 (+  7004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.915540 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.932940 (+ 17400us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.109759 (+176819us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b480021e7d8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a3e05aa1 00007f40a3dfcb37 00007f40a3dfc9ca 00007f40a3ef426f 00007f40a3ef3f37 00007f40a3f0855c 00007f40a3f08508 00007f40a3f08488 00007f40a3f08443 00007f40a3f076ec 00007f40a2e31a96
0709 13:18:16.487286 (+377527us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b18003ea040. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:18:16.551170 (+ 63884us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:16.551321 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.551611 (+   290us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.080924 (+1529313us) raft_consensus.cc:1685] finished
0709 13:18:18.080953 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.081124 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58354,"raft.queue_time_us":41684,"raft.run_cpu_time_us":1936,"raft.run_wall_time_us":156866,"spinlock_wait_cycles":12523648,"thread_start_us":63241,"threads_started":1,"wal-append.queue_time_us":2133348}
I20260709 13:18:18.082577 21116 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:18.049847 21209 raft_consensus.cc:697] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:17.987883 18493 rpcz_store.cc:276] 0709 13:18:15.572272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.573231 (+   959us) service_pool.cc:224] Handling call
0709 13:18:15.573618 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.574051 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.574090 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.131508 (+557418us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b2c001042f8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:18:16.131877 (+   369us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.368165 (+236288us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:16.368199 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.368262 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.889139 (+1520877us) raft_consensus.cc:1685] finished
0709 13:18:17.889159 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.908025 (+ 18866us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":580,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":65791,"spinlock_wait_cycles":3940992,"thread_start_us":231928,"threads_started":1,"wal-append.queue_time_us":306827}
I20260709 13:18:18.090641 19057 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:18.134994 21206 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:18.138899 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1940) took 1853 ms. Trace:
I20260709 13:18:18.050721 20870 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.141983 21207 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:18.139433 18486 rpcz_store.cc:276] 0709 13:18:16.285664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.286440 (+   776us) service_pool.cc:224] Handling call
0709 13:18:16.286758 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:16.287121 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.287147 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:16.293401 (+  6254us) log.cc:844] Serialized 52 byte log entry
0709 13:18:16.453339 (+159938us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:16.453377 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.453444 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.138600 (+1685156us) raft_consensus.cc:1685] finished
0709 13:18:18.138631 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.138825 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1923,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":53407,"thread_start_us":144962,"threads_started":1,"wal-append.queue_time_us":1791567}
I20260709 13:18:18.047330 21077 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:18.097218 20879 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.157707 20879 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:17.970594 21204 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:18.097124 21160 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:18.100653 20887 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:18.049731 21187 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:18.051100 21109 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:18.144387 21099 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:18.147454 21116 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:18.193725 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1960) took 1418 ms. Trace:
I20260709 13:18:18.208990 18487 rpcz_store.cc:276] 0709 13:18:16.775079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.775198 (+   119us) service_pool.cc:224] Handling call
0709 13:18:16.775476 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.835205 (+1059729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.835270 (+    65us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.835333 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:17.835391 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.193427 (+358036us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001b8354. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:18.193488 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.193653 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436526464}
I20260709 13:18:18.189383 21207 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.304003 21156 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:18.304121 20847 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:18.324360 21156 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:18.325176 21156 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:18.253010 21142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.491s	user 0.015s	sys 0.040s
W20260709 13:18:18.270119 18490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.496s	user 0.021s	sys 0.040s
I20260709 13:18:18.198329 20887 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:18.326428 21142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.574s	user 0.020s	sys 0.041s
I20260709 13:18:18.286000 21209 consensus_queue.cc:237] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:18.328100 20887 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:18.328538 21156 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:18.155439 20870 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:18.219374 21146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.611s	user 0.057s	sys 0.209s
I20260709 13:18:18.331020 20870 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:18.276818 19028 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.566s	user 0.071s	sys 0.203s
W20260709 13:18:18.331939 19028 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.621s	user 0.071s	sys 0.203s
I20260709 13:18:18.226446 21115 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:18.332650 21115 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:18.331122 21146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.802s	user 0.063s	sys 0.216s
I20260709 13:18:18.302508 20948 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:18.216506 21160 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:18.334973 21210 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.335444 21210 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:18.336469 21160 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:18.226902 21116 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:18.337895 21210 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:18.339452 21116 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:18.218713 21099 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:18.305661 20879 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:18.326630 18490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.552s	user 0.022s	sys 0.040s
I20260709 13:18:18.343334 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1959) took 1570 ms. Trace:
W20260709 13:18:18.350927 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.305716 21204 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:18.343763 18490 rpcz_store.cc:276] 0709 13:18:16.772853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.772956 (+   103us) service_pool.cc:224] Handling call
0709 13:18:16.773258 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.773472 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:16.774143 (+   671us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.342921 (+1568778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.342984 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:18.343041 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.343132 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.343270 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":184,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"thread_start_us":1568419,"threads_started":1}
I20260709 13:18:18.326038 20847 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:18.369468 21197 consensus_meta.cc:287] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.000s
I20260709 13:18:18.381024 21210 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.381565 21210 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:18.383646 21210 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:18.394255 20900 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:18.394884 20900 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:18.399039 20681 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:18.396064 21109 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:18.402969 21195 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:18.403527 21195 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:18.415513 21195 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:18.423111 19025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.711s	user 0.019s	sys 0.032s
W20260709 13:18:18.423558 19025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.712s	user 0.019s	sys 0.032s
W20260709 13:18:18.416572 18456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.017s	sys 0.029s
W20260709 13:18:18.424080 18456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.018s	sys 0.030s
W20260709 13:18:18.416702 19026 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.670s	user 0.025s	sys 0.021s
I20260709 13:18:18.415558 21099 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:18.434784 19026 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.688s	user 0.026s	sys 0.021s
I20260709 13:18:18.439404 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:18.439551 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:18.443768 18490 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:18.443707 18487 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
W20260709 13:18:18.436128 18308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.736s	user 0.025s	sys 0.017s
W20260709 13:18:18.444509 18308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.744s	user 0.025s	sys 0.017s
W20260709 13:18:18.444828 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 1.88662e+06us
W20260709 13:18:18.448223 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.425844 21116 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:18.435676 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 1.68941e+06us
W20260709 13:18:18.447818 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:18.454349 18309 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 2.237s (SENT) [suppressed 35 similar messages]
W20260709 13:18:18.436362 18459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.018s	sys 0.019s
W20260709 13:18:18.462208 18459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.018s	sys 0.019s
I20260709 13:18:18.435911 21109 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:18.464710 21109 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:18.449466 18308 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:18.468999 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:18.469880 18493 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:18.461882 19026 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:18.477396 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:18.475071 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:18.452765 21099 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:18.471470 21160 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:18.486968 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:18.472694 21156 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:18.490432 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:18.504873 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:18.513427 18416 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:18.513672 18417 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:18.475167 21197 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:18.480243 21199 consensus_meta.cc:287] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.639s	user 0.011s	sys 0.000s
I20260709 13:18:18.520354 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:18.522301 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:18.523186 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:18.524274 18411 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:18.526312 21099 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:18.485073 21195 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:18.532084 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:18.544584 19060 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.795s	user 0.018s	sys 0.042s
W20260709 13:18:18.545011 19060 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.834s	user 0.018s	sys 0.042s
I20260709 13:18:18.436257 20900 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:18.535806 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:18.471896 21116 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:18.511780 21204 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.511674 21210 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:18.517233 20887 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:18.554593 21197 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:18.517843 21160 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:18.568310 20883 consensus_queue.cc:260] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:18.540695 21156 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:19.136410 20847 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.013s	sys 0.018s
I20260709 13:18:18.783836 21195 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:19.191139 21160 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:19.191506 21064 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:19.113260 18242 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.007s	sys 0.045s
W20260709 13:18:19.192353 18242 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.007s	sys 0.053s
I20260709 13:18:19.191947 21210 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.192209 21064 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.194154 21064 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:19.190038 20847 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.018s	sys 0.019s
I20260709 13:18:19.194547 21210 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:19.187707 21146 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.002s	sys 0.009s
I20260709 13:18:18.798630 21187 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:19.195217 21146 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.002s	sys 0.009s
I20260709 13:18:18.916501 21225 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:19.195518 21187 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.196090 21225 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:19.090807 20851 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.019s	sys 0.023s
W20260709 13:18:19.198163 20851 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.022s	sys 0.031s
I20260709 13:18:19.198565 21187 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:18.916078 20969 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:19.215948 20969 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:18.863010 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:18.629442 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 137515us
W20260709 13:18:18.926131 21143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.017s	sys 0.069s
W20260709 13:18:19.169261 21193 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.016s	sys 0.018s
W20260709 13:18:18.900327 20303 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.000s	sys 0.051s
I20260709 13:18:19.201249 21229 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:19.223531 18309 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.023s	sys 0.029s
W20260709 13:18:19.223869 18309 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.023s	sys 0.029s
W20260709 13:18:19.224197 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 769832us
I20260709 13:18:19.201524 21156 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:18.584230 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:18.823076 21047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.024s	user 0.015s	sys 0.030s
W20260709 13:18:19.020881 17233 debug-util.cc:398] Leaking SignalData structure 0x7b080031cb40 after lost signal to thread 18308
W20260709 13:18:19.221724 21193 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.016s	sys 0.019s
W20260709 13:18:19.012944 21223 log.cc:927] Time spent T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:18:19.242697 18309 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:18.701056 19057 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:19.242178 21047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.452s	user 0.020s	sys 0.031s
W20260709 13:18:18.900436 21012 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.021s	sys 0.023s
I20260709 13:18:19.188561 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:19.203298 20887 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.188071 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:18.798346 21177 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:18.985950 20949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.004s	sys 0.026s
I20260709 13:18:18.660794 21109 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:18.701486 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:18.783237 18458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.228s	user 0.024s	sys 0.033s
W20260709 13:18:19.311146 18458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.756s	user 0.029s	sys 0.038s
W20260709 13:18:19.303985 21220 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
W20260709 13:18:19.125873 18489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.000s	sys 0.013s
W20260709 13:18:19.314426 18489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.001s	sys 0.013s
I20260709 13:18:18.875488 21226 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:18.566082 18385 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.000s	sys 0.038s
W20260709 13:18:19.317548 18385 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.638s	user 0.000s	sys 0.050s
I20260709 13:18:18.673736 21017 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.533s
I20260709 13:18:18.674187 21183 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:18.578097 18492 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.019s	sys 0.018s
W20260709 13:18:19.321821 18492 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.704s	user 0.019s	sys 0.030s
I20260709 13:18:18.549890 21199 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:18.900110 18384 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.014s	sys 0.042s
I20260709 13:18:19.198601 21225 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:19.209838 21160 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:19.209438 21197 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.210548 21204 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.213328 21116 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:19.325541 20975 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.570740 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:19.187232 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:19.191444 21195 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:19.216789 19027 leader_election.cc:336] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.514s (SENT)
W20260709 13:18:19.338485 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 121743us
I20260709 13:18:19.329329 21160 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:19.342527 21160 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:19.332614 21078 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.343789 21078 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.302557 20969 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.216326 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:19.221936 20303 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.325s	user 0.000s	sys 0.057s
W20260709 13:18:19.218312 21207 consensus_meta.cc:287] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.894s	user 0.004s	sys 0.007s
I20260709 13:18:18.587450 21206 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:18:19.221854 21143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.207s	user 0.018s	sys 0.071s
W20260709 13:18:19.244477 18491 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.009s	sys 0.007s
I20260709 13:18:19.248117 19025 leader_election.cc:400] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6.
W20260709 13:18:19.253476 19062 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 704) took 2588 ms (client timeout 2241 ms). Trace:
W20260709 13:18:19.353905 18491 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.009s	sys 0.007s
I20260709 13:18:19.353976 19025 leader_election.cc:403] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:18:19.354127 19062 rpcz_store.cc:269] 0709 13:18:16.665369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.665577 (+   208us) service_pool.cc:224] Handling call
0709 13:18:19.253243 (+2587666us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b5400454cd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:19.253381 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":654521728}
I20260709 13:18:19.254362 21098 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:19.271334 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:19.274494 18484 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:19.278846 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:19.281499 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1963) took 1406 ms. Trace:
I20260709 13:18:18.543761 21099 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:19.224150 21187 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:19.305068 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:19.297703 21221 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:19.301095 21012 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.221s	user 0.021s	sys 0.029s
W20260709 13:18:19.309298 20949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.223s	user 0.005s	sys 0.030s
I20260709 13:18:19.241573 21229 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.316401 21177 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:19.324034 18384 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.415s	user 0.014s	sys 0.050s
W20260709 13:18:19.375835 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 1.47932e+06us
I20260709 13:18:19.376729 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:19.330294 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:19.346694 18486 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:18:19.347000 18307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.003s	sys 0.042s
W20260709 13:18:19.378360 18307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.003s	sys 0.042s
I20260709 13:18:19.352702 21207 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.352962 21204 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:19.354642 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 106660us
W20260709 13:18:19.401466 18308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.020s	sys 0.022s
W20260709 13:18:19.401824 18308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.020s	sys 0.022s
I20260709 13:18:19.263309 19026 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:19.361657 18339 rpcz_store.cc:276] 0709 13:18:17.875263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.875395 (+   132us) service_pool.cc:224] Handling call
0709 13:18:17.875632 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.889227 (+ 13595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.889257 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.889296 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:17.889330 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.281219 (+1391889us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b54000e0bd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:19.281283 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.281430 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30806272}
W20260709 13:18:19.366710 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 95488.1us
I20260709 13:18:19.327472 21183 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:19.368666 18493 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:19.364590 21078 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:19.409101 21194 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:19.409526 21194 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.410012 21194 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.411006 20979 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:19.411669 20979 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:19.322414 21226 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.400512 20887 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:19.388720 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:19.390743 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:19.392230 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:19.402354 19025 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:19.434537 19058 raft_consensus.cc:2393] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:19.357812 21225 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6.
W20260709 13:18:19.406908 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 143685us
I20260709 13:18:19.367555 21206 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.409417 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:19.447852 19057 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:19.404393 21207 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.432262 20949 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.373075 21143 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:19.373297 21098 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:19.335999 20975 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.363453 18487 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:19.368376 21187 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:19.406647 21099 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:19.438633 21227 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.408308 19056 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:19.446079 18486 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:19.385697 18384 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:19.410017 21177 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:19.398583 21221 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.442555 20887 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:19.415122 21204 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:19.485808 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 100201us
W20260709 13:18:19.488050 18458 connection.cc:256] RPC call timeout handler was delayed by -2.1202723920000608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 13:18:19.511972 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:19.512215 18458 connection.cc:256] RPC call timeout handler was delayed by -2.0905723920000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 13:18:19.517079 18458 connection.cc:256] RPC call timeout handler was delayed by -2.0905723920000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 13:18:19.517544 18458 connection.cc:256] RPC call timeout handler was delayed by -1.9267723919999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 13:18:19.519934 18458 connection.cc:256] RPC call timeout handler was delayed by -1.9267723919999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 13:18:19.520473 18458 connection.cc:256] RPC call timeout handler was delayed by -1.9042723919999389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 13:18:19.520927 18458 connection.cc:256] RPC call timeout handler was delayed by -1.8889723920001416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 13:18:19.521365 18458 connection.cc:256] RPC call timeout handler was delayed by -1.8889723920001416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 13:18:19.521763 18458 connection.cc:256] RPC call timeout handler was delayed by -1.8574723920000906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260709 13:18:19.522233 18458 connection.cc:256] RPC call timeout handler was delayed by -1.810672392000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 13:18:19.522655 18458 connection.cc:256] RPC call timeout handler was delayed by -1.7827723919999698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 13:18:19.523063 18458 connection.cc:256] RPC call timeout handler was delayed by -1.696538627000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
I20260709 13:18:19.474897 21143 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:18:19.477141 21209 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.147s	user 0.011s	sys 0.020s
I20260709 13:18:19.526258 20887 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:19.528611 21248 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:18:19.526409 21204 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.530787 21210 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:19.540555 21187 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:19.531560 20859 raft_consensus.cc:3055] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:19.534948 21229 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:19.535634 21084 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:19.509941 21099 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:18:19.536660 21238 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260709 13:18:19.512799 18413 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.010s	sys 0.058s
I20260709 13:18:19.578586 21143 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:19.544245 18458 connection.cc:256] RPC call timeout handler was delayed by -1.6551386270000421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 13:18:19.639667 18458 connection.cc:256] RPC call timeout handler was delayed by -1.5307361560001027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:18:19.640030 18458 connection.cc:256] RPC call timeout handler was delayed by -1.45377786500012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:18:19.640312 18458 connection.cc:256] RPC call timeout handler was delayed by -1.45377786500012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:18:19.640651 18458 connection.cc:256] RPC call timeout handler was delayed by -1.3524850500000412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
W20260709 13:18:19.640949 18458 connection.cc:256] RPC call timeout handler was delayed by -1.3524850500000412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
W20260709 13:18:19.641224 18458 connection.cc:256] RPC call timeout handler was delayed by -1.3521302159999777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
I20260709 13:18:19.480782 21227 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.641435 21183 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:19.481509 21098 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:19.643011 21098 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:19.563014 18457 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.047s	sys 0.094s
W20260709 13:18:19.796725 18457 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.052s	sys 0.094s
I20260709 13:18:19.796744 19059 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:19.476378 20949 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.542078 21094 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:19.510143 21231 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:19.587966 21209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.258s	user 0.012s	sys 0.021s
W20260709 13:18:19.637257 18413 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.112s	user 0.010s	sys 0.058s
W20260709 13:18:19.540673 18485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 576) took 1906 ms (client timeout 1950 ms). Trace:
I20260709 13:18:19.641741 21227 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:19.641494 18458 connection.cc:256] RPC call timeout handler was delayed by -1.3146361639999213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 13:18:19.531437 20681 consensus_meta.cc:287] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.132s	user 0.011s	sys 0.000s
I20260709 13:18:19.609799 21199 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:19.589879 21232 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:19.630976 21210 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:19.629854 21185 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:19.633126 20859 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:19.675868 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1957) took 2904 ms. Trace:
I20260709 13:18:19.676105 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:19.646112 21250 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:19.677798 18337 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:19.678458 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1970) took 1189 ms. Trace:
I20260709 13:18:19.679455 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:19.877214 18336 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:19.680204 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1969) took 1188 ms. Trace:
I20260709 13:18:19.876983 18489 rpcz_store.cc:276] 0709 13:18:18.489456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.493662 (+  4206us) service_pool.cc:224] Handling call
0709 13:18:18.494055 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:18.494438 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.494476 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:18.516610 (+ 22134us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.314873 (+798263us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:19.314927 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.315016 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.678213 (+363197us) raft_consensus.cc:1685] finished
0709 13:18:19.678241 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.678391 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":376704,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":747579,"threads_started":1,"wal-append.queue_time_us":811013}
I20260709 13:18:19.878029 18491 rpcz_store.cc:276] 0709 13:18:18.489154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.489280 (+   126us) service_pool.cc:224] Handling call
0709 13:18:18.489575 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.489773 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:19.354400 (+864627us) log.cc:844] Serialized 14 byte log entry
0709 13:18:19.677621 (+323221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:19.677677 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:19.677721 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.677780 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.677882 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":949285,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":1975,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":11932,"thread_start_us":1136283,"threads_started":2,"wal-append.queue_time_us":425718}
I20260709 13:18:19.681852 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:19.880342 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:19.880605 18340 raft_consensus.cc:2368] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6.
I20260709 13:18:19.881484 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:19.661144 21195 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:19.687039 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.882063 18340 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
W20260709 13:18:19.882423 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.691772 18343 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:19.670492 21085 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.639806 21084 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:19.694902 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 259750us
W20260709 13:18:19.894390 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.895614 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:19.697605 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 454966us
I20260709 13:18:19.702957 21099 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:19.703675 21207 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:19.703889 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:19.704783 18338 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:19.854112 21183 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.698647 21226 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:19.710284 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:19.710963 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:19.676436 21187 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:19.715092 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:19.716610 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:19.717218 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:19.720973 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:19.721506 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:19.722023 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:19.723803 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 319998us
I20260709 13:18:19.914042 18344 raft_consensus.cc:2410] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:18:19.728782 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.910552 19056 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:19.748489 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:19.916368 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:19.749425 21123 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.749612 21206 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:19.752187 21177 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:19.753317 20887 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:19.716974 21194 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.918177 21123 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.754655 20975 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:19.756301 21204 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:19.762467 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:19.763777 21221 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:19.766288 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 701) took 3101 ms. Trace:
I20260709 13:18:19.930076 19060 rpcz_store.cc:276] 0709 13:18:16.664502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.664608 (+   106us) service_pool.cc:224] Handling call
0709 13:18:16.664928 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:18.577507 (+1912579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.577552 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:18.849728 (+272176us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.475340 (+625612us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:19.475379 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.475440 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.766043 (+290603us) raft_consensus.cc:1685] finished
0709 13:18:19.766074 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.766222 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46009,"raft.queue_time_us":120061,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"thread_start_us":2265859,"threads_started":2,"wal-append.queue_time_us":740480}
I20260709 13:18:19.931394 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:19.931931 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:19.768775 21143 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.769606 20847 raft_consensus.cc:1064] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
W20260709 13:18:19.770905 21115 consensus_meta.cc:287] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.438s	user 0.015s	sys 0.000s
I20260709 13:18:19.930790 18382 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:19.792977 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:19.933506 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:19.805948 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:19.797062 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 1.12649e+06us
I20260709 13:18:19.935325 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:19.935935 19057 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:19.900360 21197 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:19.836453 18458 connection.cc:256] RPC call timeout handler was delayed by -1.3146361639999213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 13:18:19.945482 18458 connection.cc:256] RPC call timeout handler was delayed by -1.3059386269999322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
W20260709 13:18:19.945839 18458 connection.cc:256] RPC call timeout handler was delayed by -1.3041386269999293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260709 13:18:19.946128 18458 connection.cc:256] RPC call timeout handler was delayed by -1.2865318260001004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 13:18:19.830618 18485 rpcz_store.cc:269] 0709 13:18:17.634186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.640019 (+  5833us) service_pool.cc:224] Handling call
0709 13:18:19.540427 (+1900408us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400437e54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:19.540557 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259480448}
I20260709 13:18:19.844132 18308 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:19.947285 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 103309us
I20260709 13:18:19.920563 21099 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.850792 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 587) took 1315 ms. Trace:
I20260709 13:18:19.950894 18493 rpcz_store.cc:276] 0709 13:18:18.535392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.413737 (+878345us) service_pool.cc:224] Handling call
0709 13:18:19.413988 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.414181 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:19.668944 (+254763us) log.cc:844] Serialized 14 byte log entry
0709 13:18:19.850182 (+181238us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:19.850266 (+    84us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:19.850343 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.850467 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.850707 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10844,"prepare.queue_time_us":25083,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":12482,"spinlock_wait_cycles":12541824,"thread_start_us":423664,"threads_started":2,"wal-append.queue_time_us":258583}
W20260709 13:18:19.853485 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.853739 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1917) took 1370 ms. Trace:
I20260709 13:18:19.818425 20879 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:19.877157 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:19.870522 18492 rpcz_store.cc:276] 0709 13:18:16.771309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.829173 (+ 57864us) service_pool.cc:224] Handling call
0709 13:18:17.566227 (+737054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.566447 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:19.324774 (+1758327us) log.cc:844] Serialized 14 byte log entry
0709 13:18:19.675290 (+350516us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:19.675355 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:19.675417 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.675708 (+   291us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.675816 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1846412,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":1473,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":12393,"thread_start_us":2054935,"threads_started":2}
I20260709 13:18:19.829574 21231 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.888733 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:19.958210 18343 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:19.881757 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:19.845185 21094 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:19.675560 21110 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:19.875061 21232 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.900985 18309 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:19.874257 20681 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:19.879571 21267 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.972462 19027 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:19.921324 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:19.973744 19027 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:19.927922 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:19.975615 19056 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.925530 18336 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:19.928603 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:19.977041 19055 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:19.977200 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:19.931989 18338 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:19.978403 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:19.767395 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.772874 20883 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.934029 19058 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 3.
I20260709 13:18:19.980346 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:19.795796 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:19.981495 19062 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
W20260709 13:18:19.806854 19054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.040s	sys 0.063s
I20260709 13:18:19.889292 21250 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:19.984552 19054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.040s	sys 0.063s
I20260709 13:18:19.944378 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:19.741959 21157 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:18:19.948948 20303 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.956641 21204 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:19.955587 18458 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:19.875308 21185 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.942154 20859 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.962615 21099 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:19.962742 21110 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:19.960707 21231 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.964561 21143 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:19.965704 21084 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:19.967499 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:20.016989 18343 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
W20260709 13:18:19.967931 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 67024us
I20260709 13:18:19.968458 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:19.904197 18307 leader_election.cc:336] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.780s (SENT)
I20260709 13:18:20.018190 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:20.019070 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 114908us
I20260709 13:18:20.019763 19056 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:19.961046 20722 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:19.917583 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:19.951843 21197 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.919960 21194 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:19.985657 18344 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:20.027993 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:20.028607 18343 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:19.995218 21206 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:19.988854 20303 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.953209 18413 rpcz_store.cc:276] 0709 13:18:18.483501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.483723 (+   222us) service_pool.cc:224] Handling call
0709 13:18:18.485539 (+  1816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.485718 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:19.830109 (+1344391us) log.cc:844] Serialized 14 byte log entry
0709 13:18:19.853401 (+ 23292us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:19.853464 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:19.853513 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.853575 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.853675 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33393,"prepare.queue_time_us":866429,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":208,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":3991,"thread_start_us":1327984,"threads_started":2}
I20260709 13:18:19.921447 21183 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.982107 19025 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:19.960619 20900 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:20.000268 19057 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:19.928020 21187 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:19.927102 21210 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:19.966306 21160 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:20.006836 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:19.975999 21098 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:20.013689 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:19.990296 21221 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:20.062527 18488 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:20.032356 21206 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:20.094576 18484 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:20.031160 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:20.095371 18339 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:20.034086 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:20.097177 18343 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:20.035987 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:20.098708 18491 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:20.037750 18493 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:20.099541 19057 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:20.042587 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:20.100270 18337 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:20.034972 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:19.970963 20879 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:20.052666 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.110760 18413 raft_consensus.cc:2393] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:19.979866 20681 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.054271 19060 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:20.101236 19061 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
W20260709 13:18:20.046084 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 64061.9us
I20260709 13:18:20.024262 20887 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:20.035995 21262 log.cc:927] Time spent T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:18:20.118983 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:20.119628 18339 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:20.058249 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:20.122121 18485 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:20.059475 18338 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:20.030545 20859 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:20.127103 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 171569us
I20260709 13:18:20.052284 21115 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.062880 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:19.987162 19055 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEARNER]: Advancing to term 6
I20260709 13:18:20.062474 18335 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:19.996048 21204 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.038939 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:20.057654 21094 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.061602 21012 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 13:18:20.103958 21261 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:18:20.112517 21206 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:20.106104 21273 log.cc:927] Time spent T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
I20260709 13:18:19.994690 21225 consensus_queue.cc:1059] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:18:19.979715 21267 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.121549 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:20.124554 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:20.062340 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:20.072064 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.053607 20722 raft_consensus.cc:697] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:20.125339 18414 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:20.094673 21257 log.cc:927] Time spent T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.242s	user 0.001s	sys 0.001s
W20260709 13:18:20.104665 21275 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:18:20.151091 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.152519 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:20.153568 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:20.160079 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 186888us
I20260709 13:18:20.104619 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:20.140429 21204 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:20.166852 21277 log.cc:927] Time spent T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:18:20.197503 18344 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:20.197795 19055 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:20.198416 19057 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:20.198594 18491 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:20.164043 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:20.138339 21115 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:18:20.176208 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 47689.8us
I20260709 13:18:20.201983 18485 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:20.209573 18458 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:20.210754 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:20.202781 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 87285.7us
I20260709 13:18:20.095374 21160 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:20.203980 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:20.171823 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:20.242637 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.393548 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:20.393903 18413 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
W20260709 13:18:20.304056 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.225663 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:20.290367 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 45113.8us
I20260709 13:18:20.307623 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 926) took 1734 ms. Trace:
I20260709 13:18:20.398097 19053 rpcz_store.cc:276] 0709 13:18:18.573166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.573628 (+   462us) service_pool.cc:224] Handling call
0709 13:18:18.586779 (+ 13151us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:18.587209 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.587256 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:19.189142 (+601886us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.678118 (+488976us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:19.678154 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.679203 (+  1049us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.307344 (+628141us) raft_consensus.cc:1685] finished
0709 13:18:20.307365 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.307547 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":275,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":47356,"thread_start_us":383408,"threads_started":1,"wal-append.queue_time_us":563311}
I20260709 13:18:20.214751 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:20.401013 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 175397us
I20260709 13:18:20.395220 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:20.174623 21284 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:20.406890 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:20.414407 18485 raft_consensus.cc:2376] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6. Re-sending same reply.
W20260709 13:18:20.220300 21254 log.cc:927] Time spent T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:18:20.409165 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:20.174528 21292 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:20.364600 21221 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.393630 21259 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
I20260709 13:18:20.429013 18343 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:18:20.330675 21279 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:20.364709 18339 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:20.290978 18414 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:20.404227 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:20.420795 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:20.210429 21225 raft_consensus.cc:3055] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:20.422333 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.437505 18413 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:20.226101 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.307391 21270 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.181s
I20260709 13:18:20.438380 18416 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:20.439069 20879 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:20.348002 21232 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:20.392761 21252 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.392593 21211 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.425580 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:20.179548 21224 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:20.411926 21209 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:20.215070 21115 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.444590 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:20.440932 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:20.441099 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.445907 18414 raft_consensus.cc:2393] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:20.418167 21185 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:20.443199 19057 raft_consensus.cc:2376] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6. Re-sending same reply.
I20260709 13:18:20.428162 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.423199 21293 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:20.430150 21197 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:20.447063 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:20.423727 21250 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:20.456606 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:20.426342 21288 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:18:20.467935 21309 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:20.301713 20722 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.412267 21286 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:18:20.436885 21225 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:20.435191 21221 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:20.467715 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 63584.2us
I20260709 13:18:20.440133 20681 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:20.420420 21284 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.569952 21309 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.456259 21211 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:20.570994 21309 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:20.571822 18412 raft_consensus.cc:2410] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:20.501557 21185 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.529515 21197 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:20.447850 21252 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.574306 21221 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:20.574188 18309 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:20.576757 21098 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:20.576900 18309 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:20.577751 21098 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:20.500164 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:20.578387 21098 raft_consensus.cc:697] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:20.444931 21187 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:20.579917 21284 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:20.579802 21098 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.473194 21224 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.581099 21225 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.582286 21225 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:20.582414 21224 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:20.542387 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 711) took 2842 ms. Trace:
I20260709 13:18:20.586112 19054 rpcz_store.cc:276] 0709 13:18:17.700345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.701723 (+  1378us) service_pool.cc:224] Handling call
0709 13:18:17.702078 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.702483 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.702522 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.703058 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.246882 (+1543824us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b18001694e0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:18:19.985116 (+738234us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:19.985177 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.985271 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.534506 (+549235us) raft_consensus.cc:1685] finished
0709 13:18:20.534525 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.542317 (+  7792us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16105,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":6935,"spinlock_wait_cycles":6800768,"thread_start_us":737966,"threads_started":1,"wal-append.queue_time_us":2318352}
I20260709 13:18:20.530928 21250 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.534281 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:20.587826 21250 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.587831 18384 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:20.589859 20883 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:20.591257 20883 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:20.572551 21185 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:20.592526 20883 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:20.593150 21185 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.573001 21197 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.594945 18339 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:20.529294 21293 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.589274 21309 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.639652 21309 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:20.640050 21293 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:20.436820 21292 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:20.633263 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.595587 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 384846us
I20260709 13:18:20.655016 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:20.656255 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:20.650799 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.651840 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 427095us
I20260709 13:18:20.656347 18458 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:20.658802 18458 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:20.644892 19061 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:20.657156 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.660558 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.661818 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:20.596278 21279 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:20.491130 21160 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:20.657666 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:20.822914 21300 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.823223 18342 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:20.823504 21300 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.831388 21197 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:20.833977 21227 consensus_meta.cc:287] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.980s	user 0.007s	sys 0.002s
I20260709 13:18:20.834864 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 525) took 1151 ms. Trace:
I20260709 13:18:20.657279 21292 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:20.836396 21292 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.839551 21286 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:20.792781 21250 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:20.791226 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.448108 21209 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:20.794505 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.796267 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:20.848096 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.798250 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 539) took 1092 ms. Trace:
I20260709 13:18:20.799013 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:20.811587 20859 consensus_meta.cc:287] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.671s	user 0.008s	sys 0.003s
W20260709 13:18:20.814342 21298 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
W20260709 13:18:20.817503 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 162540us
I20260709 13:18:20.849761 18344 rpcz_store.cc:276] 0709 13:18:19.705712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.216242 (+510530us) service_pool.cc:224] Handling call
0709 13:18:20.216577 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.216976 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.217018 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.217593 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.568220 (+350627us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:20.569110 (+   890us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.569592 (+   482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.569696 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.797991 (+228295us) raft_consensus.cc:1685] finished
0709 13:18:20.798017 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.798183 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":181,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":1312,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":190,"thread_start_us":350174,"threads_started":1,"wal-append.queue_time_us":577903}
W20260709 13:18:20.861419 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.819582 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:20.863214 19061 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:20.820271 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:20.820811 21224 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.822220 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:20.595121 20847 consensus_queue.cc:237] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.834534 21227 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.848608 18339 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:20.865767 18309 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:18:20.793092 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 134379us
W20260709 13:18:20.856786 21206 consensus_meta.cc:287] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.000s
I20260709 13:18:20.861260 18342 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:18:20.821202 21221 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.835405 18341 rpcz_store.cc:276] 0709 13:18:19.683737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.683842 (+   105us) service_pool.cc:224] Handling call
0709 13:18:19.684100 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:19.694067 (+  9967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.694096 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:19.694606 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.885971 (+191365us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:20.011467 (+125496us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.011667 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.011741 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.834595 (+822854us) raft_consensus.cc:1685] finished
0709 13:18:20.834623 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.834792 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":728,"prepare.queue_time_us":227095,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":112476,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":17912,"thread_start_us":243939,"threads_started":2,"wal-append.queue_time_us":421514}
I20260709 13:18:20.869642 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:20.871254 19055 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:20.873975 18458 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:20.882308 19026 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:20.825788 21300 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:20.885187 18344 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:20.885831 18458 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:20.851336 18492 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:20.856704 21209 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:20.878690 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:20.889626 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:20.892736 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.885025 21206 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.866655 21224 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:20.894546 21224 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.899664 19062 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:20.901373 18339 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:20.879431 20681 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:20.902433 20681 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.902917 20681 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:20.904171 21231 consensus_meta.cc:287] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.893s	user 0.004s	sys 0.004s
I20260709 13:18:20.904558 21231 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.905579 18410 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:20.907066 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 1930) took 1185 ms. Trace:
I20260709 13:18:20.907387 18410 rpcz_store.cc:276] 0709 13:18:19.721766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.722056 (+   290us) service_pool.cc:224] Handling call
0709 13:18:19.722325 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.905942 (+1183617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.906839 (+   897us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000a82d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:20.907015 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2720714112}
I20260709 13:18:20.908577 21286 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:20.908967 21286 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.909282 21286 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:20.890702 21187 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 13:18:20.912832 21204 consensus_meta.cc:287] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.671s	user 0.004s	sys 0.007s
I20260709 13:18:20.913323 21204 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.891038 21302 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:20.914124 19053 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:20.914722 18336 raft_consensus.cc:2368] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9.
I20260709 13:18:20.915664 21204 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:20.918872 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 727) took 1038 ms. Trace:
I20260709 13:18:20.919394 19058 rpcz_store.cc:276] 0709 13:18:19.880144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.997435 (+117291us) service_pool.cc:224] Handling call
0709 13:18:19.997884 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.178011 (+180127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.178039 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.178473 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.446584 (+268111us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:20.446618 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.918360 (+471742us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001473d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:20.918425 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.918489 (+    64us) raft_consensus.cc:1685] finished
0709 13:18:20.918510 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.918787 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9668,"raft.queue_time_us":10416,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":19541,"spinlock_wait_cycles":390789376,"thread_start_us":155755,"threads_started":1,"wal-append.queue_time_us":384429}
I20260709 13:18:20.891213 21221 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:20.925439 20900 consensus_meta.cc:287] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.872s	user 0.009s	sys 0.002s
I20260709 13:18:20.926295 18340 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:20.928610 21256 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.929281 21256 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.930630 21299 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:20.930616 21115 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:20.927323 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 1968) took 1108 ms. Trace:
I20260709 13:18:20.932205 18340 rpcz_store.cc:276] 0709 13:18:19.819228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.895328 (+ 76100us) service_pool.cc:224] Handling call
0709 13:18:20.927189 (+1031861us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002751d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:20.927273 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2368598272}
I20260709 13:18:20.934052 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:20.934643 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:20.935487 18485 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:20.938180 19061 raft_consensus.cc:2410] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:20.939975 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:20.940546 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.940727 19057 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.943156 19055 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:20.944880 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 728) took 1058 ms. Trace:
I20260709 13:18:20.945408 19062 rpcz_store.cc:276] 0709 13:18:19.886248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.983707 (+ 97459us) service_pool.cc:224] Handling call
0709 13:18:19.984139 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.900254 (+916115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.944546 (+ 44292us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b5400682ed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:20.944814 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104781696}
I20260709 13:18:20.948836 18458 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:20.950177 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 56666.7us
I20260709 13:18:20.954840 18458 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:20.956370 18458 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:20.983983 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.985348 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.985973 18410 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:20.986797 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.987484 18419 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:20.988502 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.990643 18414 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:20.992069 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:20.993172 18416 raft_consensus.cc:2410] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:20.986918 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:21.005889 21241 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.286s	user 0.002s	sys 0.003s
I20260709 13:18:21.013532 21267 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:20.985831 18382 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:20.951035 21293 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:21.039132 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 53389.4us
I20260709 13:18:21.049752 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:21.051574 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:21.056684 19057 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
W20260709 13:18:21.057081 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.982465 21160 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:20.998629 21232 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:20.997150 21047 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:21.114108 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.950690 21299 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:18:21.053750 21307 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:21.047052 21302 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:21.064862 21232 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:21.130592 21311 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:21.129505 21306 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:21.152704 21306 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.153198 21306 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:21.156112 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.059250 20859 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:18:21.033982 21185 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:21.157449 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 732) took 1246 ms. Trace:
I20260709 13:18:21.158761 19056 rpcz_store.cc:276] 0709 13:18:19.911277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.473395 (+562118us) service_pool.cc:224] Handling call
0709 13:18:20.492627 (+ 19232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.492833 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:20.535763 (+ 42930us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.157098 (+621335us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.157149 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:21.157197 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.157266 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.157390 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111367,"prepare.queue_time_us":43199,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":5600,"thread_start_us":417164,"threads_started":1,"wal-append.queue_time_us":608901}
W20260709 13:18:21.160599 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 201966us
I20260709 13:18:21.162478 18458 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:21.132412 21307 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:21.165764 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 97771us
I20260709 13:18:21.159545 21232 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.175495 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 527) took 1489 ms. Trace:
I20260709 13:18:21.163406 21311 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:21.166512 21299 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:21.120214 21047 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:21.151645 21231 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:21.227677 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.211746 18335 rpcz_store.cc:276] 0709 13:18:19.685759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.686551 (+   792us) service_pool.cc:224] Handling call
0709 13:18:21.175279 (+1488728us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400058cd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:21.175427 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359544192}
I20260709 13:18:21.236253 21311 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:21.239200 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.241865 21185 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:21.158252 21293 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:18:21.171767 21307 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.171720 21305 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.162111 21252 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:21.260874 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 724) took 1414 ms. Trace:
I20260709 13:18:21.634359 19060 rpcz_store.cc:276] 0709 13:18:19.846782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.931696 (+ 84914us) service_pool.cc:224] Handling call
0709 13:18:21.260662 (+1328966us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400643a54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:21.260800 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279602560}
W20260709 13:18:21.555333 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.617877 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.636861 18490 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:21.638244 18489 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:18:21.645833 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 411705us
I20260709 13:18:21.647399 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:21.653980 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:21.672646 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.676100 18338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.027s
W20260709 13:18:21.676537 18338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.000s	sys 0.027s
I20260709 13:18:21.267433 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.678906 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:21.680306 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 422473us
W20260709 13:18:21.688694 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.654873 21323 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.412s	user 0.000s	sys 0.001s
I20260709 13:18:21.713446 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.150499 21302 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:21.723559 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.244259 20847 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.440s
W20260709 13:18:21.679983 21284 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.008s
W20260709 13:18:21.760164 18484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.026s	sys 0.014s
I20260709 13:18:21.693529 21309 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:21.694552 21185 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:21.247450 21299 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:21.648324 21327 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:18:21.742429 21320 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:18:21.742378 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:21.747085 21310 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.570s	user 0.000s	sys 0.000s
I20260709 13:18:21.748831 21123 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:21.789099 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.789952 18491 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:21.755909 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.467116 21115 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:21.760522 18484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.026s	sys 0.014s
W20260709 13:18:21.464257 21313 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.300s	user 0.000s	sys 0.000s
I20260709 13:18:21.769865 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.729147 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:21.539779 21322 log.cc:927] Time spent T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:18:21.771287 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1976) took 2506 ms. Trace:
W20260709 13:18:21.760044 21284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.002s	sys 0.009s
I20260709 13:18:21.791352 18493 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:21.792865 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:21.767247 21312 log.cc:927] Time spent T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.648s	user 0.000s	sys 0.001s
I20260709 13:18:21.795023 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1991) took 1149 ms. Trace:
I20260709 13:18:21.772287 21299 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.796648 18490 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:21.804551 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.765956 21309 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.840723 21309 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.808905 18484 rpcz_store.cc:276] 0709 13:18:20.645471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.645598 (+   127us) service_pool.cc:224] Handling call
0709 13:18:20.790590 (+144992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.790802 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:21.046713 (+255911us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.794567 (+747854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.794637 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:21.794721 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.794810 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.794959 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":441707,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":1440,"thread_start_us":998306,"threads_started":2}
I20260709 13:18:21.803417 18486 rpcz_store.cc:276] 0709 13:18:19.265300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.482709 (+217409us) service_pool.cc:224] Handling call
0709 13:18:19.483011 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.661855 (+178844us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:19.672453 (+ 10598us) log.cc:844] Serialized 14 byte log entry
0709 13:18:19.834386 (+161933us) log.cc:844] Serialized 14 byte log entry
0709 13:18:19.849519 (+ 15133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:19.849567 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:19.849613 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.746356 (+1896743us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b1800487ba0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef522 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:18:21.771071 (+ 24715us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400354dd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:21.771126 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.771241 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14882,"prepare.queue_time_us":12921,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":41500,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":30309,"spinlock_wait_cycles":457986688,"thread_start_us":135100,"threads_started":1,"wal-append.queue_time_us":288153,"wal-append.run_cpu_time_us":1407,"wal-append.run_wall_time_us":1019361}
I20260709 13:18:21.843246 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.814734 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:21.770434 21185 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:21.840103 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.826840 21324 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:21.845623 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.846398 18493 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:21.844241 18491 raft_consensus.cc:2368] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6.
I20260709 13:18:21.844064 18486 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:21.801389 21296 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:21.788450 21327 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:21.861459 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.857358 20949 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:21.712190 21305 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:21.882828 21327 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:21.883203 21210 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:21.884951 21209 consensus_meta.cc:287] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.976s	user 0.006s	sys 0.002s
I20260709 13:18:21.886838 21209 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:21.888810 21274 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 1.879s	user 0.005s	sys 0.007s
W20260709 13:18:21.890146 21224 consensus_meta.cc:287] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.995s	user 0.010s	sys 0.002s
W20260709 13:18:21.880360 21286 consensus_meta.cc:287] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.971s	user 0.008s	sys 0.004s
I20260709 13:18:21.890610 21224 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:21.891654 21232 consensus_meta.cc:287] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.000s
I20260709 13:18:21.892105 21232 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:21.892835 21290 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.603s	user 0.007s	sys 0.004s
I20260709 13:18:21.891198 21286 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:21.894793 21232 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:21.894876 21211 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:21.895764 21307 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:21.885844 21306 consensus_meta.cc:287] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.732s	user 0.008s	sys 0.000s
I20260709 13:18:21.898021 21307 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:21.898386 21306 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:21.901033 21306 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:21.902103 21272 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 1.892s	user 0.005s	sys 0.006s
I20260709 13:18:21.894999 21286 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:21.903715 21280 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 1.894s	user 0.000s	sys 0.034s
I20260709 13:18:21.905170 21309 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:21.907209 21309 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:21.909570 21305 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:21.909355 21299 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:21.892864 21224 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:21.911749 21299 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:21.945158 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 297614us
I20260709 13:18:21.947126 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1989) took 1283 ms. Trace:
I20260709 13:18:21.947286 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:21.947718 18338 rpcz_store.cc:276] 0709 13:18:20.663200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.920256 (+257056us) service_pool.cc:224] Handling call
0709 13:18:20.920711 (+   455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:20.921151 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.921186 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:20.921846 (+   660us) log.cc:844] Serialized 52 byte log entry
0709 13:18:21.676985 (+755139us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:21.677041 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.677128 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.946206 (+269078us) raft_consensus.cc:1685] finished
0709 13:18:21.946297 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.946864 (+   567us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1731,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":526239,"threads_started":1,"wal-append.queue_time_us":781276}
W20260709 13:18:21.767127 18382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.032s	sys 0.047s
W20260709 13:18:21.950548 18382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.032s	sys 0.047s
I20260709 13:18:21.950735 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1990) took 1286 ms. Trace:
W20260709 13:18:21.951249 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 899707us
I20260709 13:18:21.951282 18342 rpcz_store.cc:276] 0709 13:18:20.663983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.923017 (+259034us) service_pool.cc:224] Handling call
0709 13:18:20.923374 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:20.923738 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.923771 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:20.924362 (+   591us) log.cc:844] Serialized 52 byte log entry
0709 13:18:21.160609 (+236247us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:21.160648 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.160713 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.950200 (+789487us) raft_consensus.cc:1685] finished
0709 13:18:21.950241 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.950559 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2300,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":143794,"threads_started":1,"wal-append.queue_time_us":248945}
W20260709 13:18:21.754195 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.957427 18335 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:18:21.835683 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 106625us
I20260709 13:18:21.962714 18458 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:21.964977 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.974886 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.975663 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 734) took 1156 ms. Trace:
I20260709 13:18:21.976284 18484 raft_consensus.cc:2410] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:21.976470 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.978021 20847 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:21.978667 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.978838 20847 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:21.979328 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.979578 18486 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:21.980296 18491 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:21.980772 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.980602 20847 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:21.982595 18492 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:21.982398 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.984404 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.987548 18489 raft_consensus.cc:2393] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:21.978703 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.988688 21047 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:21.989171 18490 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:21.976132 19054 rpcz_store.cc:276] 0709 13:18:20.818592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.821619 (+  3027us) service_pool.cc:224] Handling call
0709 13:18:20.843210 (+ 21591us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:20.843848 (+   638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.843892 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:20.844597 (+   705us) log.cc:844] Serialized 52 byte log entry
0709 13:18:21.053300 (+208703us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:21.120745 (+ 67445us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.164355 (+ 43610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.164454 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.909404 (+744950us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:21.974957 (+ 65553us) raft_consensus.cc:1685] finished
0709 13:18:21.975096 (+   139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.975359 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43276,"prepare.queue_time_us":64723,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":49765,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":15330,"spinlock_wait_cycles":7101696,"thread_start_us":207868,"threads_started":1,"wal-append.queue_time_us":971765}
I20260709 13:18:21.977638 18485 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:21.993567 19062 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:21.993698 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:21.994381 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:21.994850 19058 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:21.995337 18493 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:18:21.995411 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:21.995661 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1997) took 1044 ms. Trace:
I20260709 13:18:21.996274 19060 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.996073 18485 rpcz_store.cc:276] 0709 13:18:20.951135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.994149 (+1043014us) service_pool.cc:224] Handling call
0709 13:18:21.994678 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.995270 (+   592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.995303 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.995378 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:21.995417 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.995489 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.995591 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.997267 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1998) took 1038 ms. Trace:
I20260709 13:18:21.998695 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:21.999877 21047 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:21.969448 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:21.997686 18493 rpcz_store.cc:276] 0709 13:18:20.958793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.996069 (+1037276us) service_pool.cc:224] Handling call
0709 13:18:21.996545 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.996863 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.996894 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.996962 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:21.997002 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.997078 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.997219 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.965560 18458 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.020099 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:22.020758 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:22.000896 21107 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.021656 19062 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.022246 21107 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.026029 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:22.027151 18336 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:22.028267 21209 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:22.030525 21293 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:22.031685 21299 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:22.032620 21299 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.034721 19054 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:18:22.035470 18493 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:22.056052 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2000) took 1058 ms. Trace:
I20260709 13:18:22.056454 18493 rpcz_store.cc:276] 0709 13:18:20.996694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.028182 (+1031488us) service_pool.cc:224] Handling call
0709 13:18:22.028706 (+   524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.054351 (+ 25645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.054578 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.058667 18486 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:18:22.064172 18486 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:22.068719 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1999) took 1075 ms. Trace:
I20260709 13:18:22.009478 21047 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.071318 19056 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.069351 18485 rpcz_store.cc:276] 0709 13:18:20.990822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.997466 (+1006644us) service_pool.cc:224] Handling call
0709 13:18:21.997821 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.059580 (+ 61759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.059620 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.065988 (+  6368us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:22.066041 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.066120 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.066249 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.055117 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.069942 18342 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:22.076671 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:22.059353 21293 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.092835 18336 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:22.102945 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 137600us
I20260709 13:18:22.103374 21047 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:22.103924 21185 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:22.104177 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.105479 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2001) took 1073 ms. Trace:
I20260709 13:18:22.105964 18493 rpcz_store.cc:276] 0709 13:18:21.032595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.057254 (+1024659us) service_pool.cc:224] Handling call
0709 13:18:22.091857 (+ 34603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.105020 (+ 13163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.105049 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.105120 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:22.105168 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.105254 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.105380 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.107635 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 947) took 1246 ms. Trace:
I20260709 13:18:22.107877 18493 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:22.108060 19061 rpcz_store.cc:276] 0709 13:18:20.860974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.864026 (+  3052us) service_pool.cc:224] Handling call
0709 13:18:22.107177 (+1243151us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b54005ff5d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:22.107404 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108919680}
W20260709 13:18:22.112643 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.113802 21293 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.114789 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:22.115509 18338 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.123008 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 604) took 1284 ms. Trace:
I20260709 13:18:22.123577 18492 rpcz_store.cc:276] 0709 13:18:20.838366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.933742 (+ 95376us) service_pool.cc:224] Handling call
0709 13:18:22.122676 (+1188934us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002201d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:22.122907 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2408116480}
I20260709 13:18:22.124262 21293 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.124908 21293 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:22.127827 21293 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:22.132217 21299 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:22.135475 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:22.138770 18414 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:22.097736 18412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1922) took 3576 ms (client timeout 2888 ms). Trace:
W20260709 13:18:22.141768 18412 rpcz_store.cc:269] 0709 13:18:18.520966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.535590 (+ 14624us) service_pool.cc:224] Handling call
0709 13:18:22.097165 (+3561575us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540011c1d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:22.097459 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2850398080}
I20260709 13:18:22.153825 19062 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:22.153831 18336 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:22.158815 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:22.165040 20681 consensus_meta.cc:287] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.261s	user 0.012s	sys 0.007s
I20260709 13:18:22.165879 19060 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:22.166410 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:22.166219 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 151335us
W20260709 13:18:22.169239 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.166394 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.176017 18418 raft_consensus.cc:2410] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:22.169714 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.177484 18338 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:22.179488 19056 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:22.181180 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.184520 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:22.186340 18458 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.186834 21293 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.187160 21152 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.187536 21292 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:22.187760 21152 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:22.188148 21292 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:22.188270 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:22.188627 21292 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.192425 21299 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:22.193224 21299 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:22.194628 21299 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.195613 20883 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:22.188299 21152 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.197777 21206 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:22.192471 21183 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:22.201452 18414 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:22.206089 21047 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:22.206686 21234 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.207391 21234 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.208714 21286 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.209774 21234 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:22.217132 21183 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.217624 21267 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.218103 21183 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:22.218477 21267 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:22.219473 21321 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.604s	user 0.002s	sys 0.000s
I20260709 13:18:22.220947 21183 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:22.221174 21267 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:22.222429 18308 connection.cc:256] RPC call timeout handler was delayed by -1.1388161979998586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2888s for a response
I20260709 13:18:22.224287 21183 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.225045 21183 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.227483 21183 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:22.222929 21267 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.230240 21183 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.232465 21183 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.230366 21267 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:22.228204 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:22.231011 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:22.176597 20681 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.228171 21292 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.237739 18339 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:22.244263 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:22.248560 18340 raft_consensus.cc:2393] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:22.236508 21152 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.249351 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:22.254019 18342 raft_consensus.cc:2368] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6.
I20260709 13:18:22.255381 18341 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [5.8-7.9]
I20260709 13:18:22.255276 18339 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:22.258165 20303 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:22.259933 20681 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:22.260987 21099 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:22.263341 21110 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:22.264935 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.266829 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:22.268527 21221 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:22.272068 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 83949.1us
I20260709 13:18:22.273285 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:22.273770 21160 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:22.274199 21160 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:22.274554 21110 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:22.275383 21110 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:22.275432 21160 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.275378 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:18:22.284938 21347 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:18:22.285224 21258 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 2.275s	user 0.037s	sys 0.064s
I20260709 13:18:22.286073 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:22.287595 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1994) took 1399 ms. Trace:
I20260709 13:18:22.288005 18487 rpcz_store.cc:276] 0709 13:18:20.887894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.015623 (+127729us) service_pool.cc:224] Handling call
0709 13:18:21.015912 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.112399 (+1096487us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b18004876c0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409ea844bc 00007f409bdd248b 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdec455 00007f409eed4060 00007f409eed4bfb 00007f409eedf64b
0709 13:18:22.112749 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:22.112786 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:22.113458 (+   672us) log.cc:844] Serialized 26 byte log entry
0709 13:18:22.149397 (+ 35939us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:22.149435 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.149525 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:22.286375 (+136850us) raft_consensus.cc:1685] finished
0709 13:18:22.286393 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.287384 (+   991us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13777,"raft.queue_time_us":103806,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4318,"spinlock_wait_cycles":7282048,"thread_start_us":142106,"threads_started":2,"wal-append.queue_time_us":35900}
I20260709 13:18:22.289237 21267 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:22.289577 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 946) took 1428 ms. Trace:
I20260709 13:18:22.291692 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 611) took 1048 ms. Trace:
I20260709 13:18:22.292078 18489 rpcz_store.cc:276] 0709 13:18:21.242954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.653676 (+410722us) service_pool.cc:224] Handling call
0709 13:18:22.291480 (+637804us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54003fb454. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:22.291617 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750040448}
I20260709 13:18:22.293046 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:22.293665 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 1984) took 2220 ms. Trace:
I20260709 13:18:22.293834 18340 raft_consensus.cc:2368] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7.
I20260709 13:18:22.294133 21107 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:22.294420 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:22.295004 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:22.295753 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:22.296638 18337 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:22.296483 18491 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:22.297711 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:22.298511 18338 raft_consensus.cc:2368] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9.
I20260709 13:18:22.298075 19055 rpcz_store.cc:276] 0709 13:18:20.860698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.880390 (+ 19692us) service_pool.cc:224] Handling call
0709 13:18:20.880756 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.943679 (+ 62923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.289190 (+1345511us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b54000bf754. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:22.289415 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142862592}
I20260709 13:18:22.294034 18488 rpcz_store.cc:276] 0709 13:18:20.072706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.132788 (+ 60082us) service_pool.cc:224] Handling call
0709 13:18:20.150586 (+ 17798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.414698 (+264112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.414729 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.414771 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:20.414803 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.293235 (+1878432us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54001b7954. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:22.293295 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.293471 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606913408}
I20260709 13:18:22.293890 21293 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:22.302868 21183 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:22.304153 20969 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:22.305528 18307 connection.cc:256] RPC call timeout handler was delayed by -1.072132431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 13:18:22.305969 18307 connection.cc:256] RPC call timeout handler was delayed by -1.0127324310001313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:18:22.306262 18307 connection.cc:256] RPC call timeout handler was delayed by -1.0064324310001211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
I20260709 13:18:22.308748 21256 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:22.310357 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:22.310707 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:22.311566 18484 raft_consensus.cc:2410] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:22.311801 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:22.279445 21110 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.314059 21292 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:22.315672 20975 consensus_queue.cc:1059] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:22.318444 21285 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:22.318863 21285 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:22.319027 21160 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.319800 21285 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.321381 21285 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.322415 18384 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:22.323565 20859 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:22.324070 21078 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:22.324607 21078 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:22.325081 21078 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.325776 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.328923 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 1988) took 1721 ms. Trace:
W20260709 13:18:22.334573 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 59364.1us
I20260709 13:18:22.335421 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:22.336364 21099 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:22.336921 21099 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.337368 21099 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.338065 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:22.338668 18339 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:22.340161 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:22.340813 18341 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:22.335574 21286 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:22.336936 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.348143 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:22.348734 21227 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:22.351432 21152 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:22.352692 21199 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:22.358434 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:22.311934 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1851) took 1144 ms. Trace:
I20260709 13:18:22.356882 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.357160 19027 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:22.357240 21286 raft_consensus.cc:697] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:22.357692 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.357932 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.358085 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:22.364296 18484 rpcz_store.cc:276] 0709 13:18:21.167469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.993957 (+826488us) service_pool.cc:224] Handling call
0709 13:18:22.310536 (+316579us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b5800143198. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:18:22.311883 (+  1347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15668480}
I20260709 13:18:22.375030 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.329268 18344 rpcz_store.cc:276] 0709 13:18:20.607712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.885859 (+278147us) service_pool.cc:224] Handling call
0709 13:18:20.888927 (+  3068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.889102 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:21.162516 (+273414us) log.cc:844] Serialized 14 byte log entry
0709 13:18:22.328191 (+1165675us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b18003e9260. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409ea844bc 00007f409bdd248b 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c23a
0709 13:18:22.328435 (+   244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.328504 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:22.328572 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.328658 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.328766 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61676,"prepare.queue_time_us":205760,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"spinlock_wait_cycles":47809280,"thread_start_us":194265,"threads_started":2,"wal-append.queue_time_us":74709,"wal-append.run_cpu_time_us":1167,"wal-append.run_wall_time_us":1001487}
W20260709 13:18:22.379176 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 72323.7us
I20260709 13:18:22.381402 21299 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.381788 18491 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:22.383102 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:22.383558 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.384279 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:22.384763 20862 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:22.385931 21068 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:22.386935 21346 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.141s	user 0.000s	sys 0.003s
I20260709 13:18:22.386484 21068 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.388820 19027 leader_election.cc:400] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7.
I20260709 13:18:22.389109 19027 leader_election.cc:403] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:22.390587 21304 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:22.377432 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.405072 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:22.418618 21199 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.436697 18419 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:22.436851 21199 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.419152 20859 raft_consensus.cc:2955] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 3 to 5, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:22.437732 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.418596 21068 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:22.412166 21094 consensus_queue.cc:1059] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:18:22.403715 20979 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:18:22.419486 21128 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.439914 21094 consensus_queue.cc:1243] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:22.440367 21128 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.414839 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:22.410843 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.398419 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:22.396284 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:22.404503 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.395898 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:22.397318 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:22.390995 21304 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.397948 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:22.398921 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:22.392027 18413 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:22.393702 21225 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:22.443123 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 49729.6us
I20260709 13:18:22.404141 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:22.412860 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.412755 21012 raft_consensus.cc:3055] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:22.406678 18418 raft_consensus.cc:2410] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:22.449994 18412 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:22.456715 18410 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:22.399160 18414 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:22.393524 21296 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.403545 18384 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:22.450657 18415 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:22.390977 19027 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.451694 21199 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:22.401378 21286 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.456449 21012 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:22.394665 19026 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.422537 19025 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:22.460705 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 123915us
I20260709 13:18:22.461519 18491 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.464519 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:22.465925 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 62508.2us
I20260709 13:18:22.466145 18489 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:22.465085 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:22.456058 21304 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.471463 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:22.464428 21296 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.471311 20979 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:22.484243 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:22.492938 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 98563.8us
I20260709 13:18:22.482612 21199 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.498802 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:22.501289 21068 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:22.500332 18240 catalog_manager.cc:5697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.483402 21078 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.505566 21094 raft_consensus.cc:3055] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:22.510968 21094 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:22.511983 21094 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.513262 21094 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.505728 20979 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:22.506332 21068 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:22.518643 21068 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.522850 21128 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:22.524121 21078 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:22.526574 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 135692us
I20260709 13:18:22.527592 19027 leader_election.cc:400] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9.
I20260709 13:18:22.527936 19027 leader_election.cc:403] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:22.529588 21194 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9.
I20260709 13:18:22.507846 18485 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:22.505621 21099 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:22.533978 21099 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:22.505617 18309 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:22.536108 21348 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:22.536643 21348 raft_consensus.cc:697] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:22.537530 21348 consensus_queue.cc:237] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:22.548360 18242 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42278 (request call id 369) took 12335 ms (client timeout 15000 ms). Trace:
I20260709 13:18:22.543850 18240 catalog_manager.cc:5697] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 4 to 5, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 5 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:22.556406 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:22.557262 18487 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:22.507139 21123 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:22.558413 21123 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.558828 21123 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.510478 21110 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:22.559783 21110 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:22.560197 21110 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.515072 18416 raft_consensus.cc:2410] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:22.509711 18384 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:18:22.562650 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 66325.4us
I20260709 13:18:22.517021 20979 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.530189 21012 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.509814 18458 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:22.552874 18240 catalog_manager.cc:5697] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 3 to 6, term changed from 3 to 4, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to <none>, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 4 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:22.566443 19027 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:22.493677 21227 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.566941 18382 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:22.570358 19027 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:22.573724 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:22.577629 18307 leader_election.cc:336] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.779s (SENT)
I20260709 13:18:22.571894 18240 catalog_manager.cc:5697] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:18:22.583041 19026 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:22.586613 18240 catalog_manager.cc:5697] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 4 to 5, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 5 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:18:22.585608 18307 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:22.590106 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 80417.4us
I20260709 13:18:22.589567 18491 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:22.590464 18489 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:22.593837 18308 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:22.594209 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 171912us
I20260709 13:18:22.580157 20975 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:22.580152 21099 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.582947 21194 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:22.549207 18242 rpcz_store.cc:269] 0709 13:18:10.212544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.239352 (+ 26808us) service_pool.cc:224] Handling call
0709 13:18:22.548116 (+12308764us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:19.479202 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:19.528602 (+ 49400us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:19.528661 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:18:19.528676 (+    15us) tablet.cc:662] Decoding operations
0709 13:18:19.530040 (+  1364us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:19.530113 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:19.530145 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:18:19.531344 (+  1199us) tablet.cc:701] Row locks acquired
0709 13:18:19.531393 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:18:19.531562 (+   169us) write_op.cc:270] Start()
0709 13:18:19.531698 (+   136us) write_op.cc:276] Timestamp: P: 1783603099531491 usec, L: 0
0709 13:18:19.531717 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:19.532484 (+   767us) log.cc:844] Serialized 5946 byte log entry
0709 13:18:20.811082 (+1278598us) op_driver.cc:464] REPLICATION: finished
0709 13:18:21.166420 (+355338us) write_op.cc:301] APPLY: starting
0709 13:18:21.177206 (+ 10786us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:21.403628 (+226422us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:21.465619 (+ 61991us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:21.885367 (+419748us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:21.885737 (+   370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:18:21.885783 (+    46us) write_op.cc:312] APPLY: finished
0709 13:18:21.886248 (+   465us) log.cc:844] Serialized 107 byte log entry
0709 13:18:22.207463 (+321215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:22.209270 (+  1807us) write_op.cc:454] Released schema lock
0709 13:18:22.210037 (+   767us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:22.216805 (+  6768us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b54000497d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eed932a 00007f409ee5ef14 00007f409ee5eec3 00007f409ee5ee38 00007f409ee5edf3 00007f409ee5e0dc 00007f409ee87e16 00007f409ee6fcbb 00007f409ee5a39d 00007f409ee5dd75
0709 13:18:22.289977 (+ 73172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:22.290026 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4364274,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":315364,"apply.run_cpu_time_us":26882,"apply.run_wall_time_us":1101961,"num_ops":15,"prepare.queue_time_us":1217428,"prepare.run_cpu_time_us":26634,"prepare.run_wall_time_us":325232,"raft.queue_time_us":211735,"raft.run_cpu_time_us":19923,"raft.run_wall_time_us":1578447,"replication_time_us":1126506,"spinlock_wait_cycles":29358848,"thread_start_us":1736181,"threads_started":5,"wal-append.queue_time_us":594693,"wal-append.run_cpu_time_us":25935,"wal-append.run_wall_time_us":1763472}]]}
I20260709 13:18:22.601401 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.601693 19026 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.606702 20303 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:22.607142 20303 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.607488 20303 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.590106 21128 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:22.598443 21099 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.613600 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:22.611097 21017 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:22.616456 20975 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:22.616771 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:22.616928 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:22.617499 19056 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.617597 18335 raft_consensus.cc:2393] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:22.617908 20975 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.618994 21099 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.620847 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:22.621851 19055 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:22.602993 21194 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.627913 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:22.628690 19062 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:22.625146 21299 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.616509 21017 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:22.632057 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.642212 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:22.635365 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 44553.2us
I20260709 13:18:22.651126 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:22.643021 18340 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:18:22.642374 18488 raft_consensus.cc:2410] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:22.652842 19056 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:22.613013 21128 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:22.655267 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 75075.4us
I20260709 13:18:22.613549 18240 catalog_manager.cc:5697] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 2, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:22.622678 21078 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:22.692598 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:22.622052 21288 consensus_queue.cc:1059] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:18:22.627220 21012 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.625682 21183 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.623814 20681 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:22.696777 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.698597 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 97017.5us
W20260709 13:18:22.699155 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 47523.5us
W20260709 13:18:22.699596 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 64362.6us
I20260709 13:18:22.630935 21194 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:22.703758 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 135223us
I20260709 13:18:22.629513 21199 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.689284 21128 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:22.707803 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:22.633852 21017 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:22.709023 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:22.694631 21078 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.720083 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.735090 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.634387 21256 consensus_queue.cc:1059] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:18:22.687572 21234 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:18:22.707450 21160 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:22.737267 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:22.718041 21078 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.748761 18458 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:22.749235 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.750167 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:22.750469 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.751221 21293 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:22.758666 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:22.755479 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 157100us
I20260709 13:18:22.760471 18308 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:22.740343 21299 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:22.762212 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:22.758548 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:22.753733 21293 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.774736 21293 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.775736 21123 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.781131 21304 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.767012 19054 raft_consensus.cc:2955] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 3 to 5, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:22.743614 21160 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.772348 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.784313 21296 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.785635 21292 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:22.809799 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 95734.6us
W20260709 13:18:22.786055 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 47594.4us
I20260709 13:18:22.786222 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:22.756719 21183 raft_consensus.cc:3055] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:22.765396 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:22.770148 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:22.806802 20303 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.814563 19062 raft_consensus.cc:2410] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:18:22.790100 21123 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:22.817684 19059 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:18:22.818707 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 58313.9us
I20260709 13:18:22.819509 20303 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:22.797148 21099 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:22.823267 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.764595 21229 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:22.795670 21299 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.856997 18410 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:22.857232 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.811061 21160 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.852473 21229 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.858261 21229 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.858453 21099 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:22.858837 19062 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:18:22.859681 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:22.861959 21017 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.862427 21128 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.864457 21128 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:22.810253 21292 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.869110 21225 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7.
I20260709 13:18:22.813650 21183 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:22.872046 21296 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:22.872651 18492 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:22.874370 18417 raft_consensus.cc:2410] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:18:22.874667 21299 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.906092 18415 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:22.875277 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:22.875699 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:22.876669 20949 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:22.851683 21348 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.878654 21304 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:22.878080 18339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:18:22.877041 18384 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.901726 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:22.827776 20681 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:22.789332 21194 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:22.878077 21146 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:22.911845 18339 raft_consensus.cc:606] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:22.918881 18339 raft_consensus.cc:614] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:22.898765 21292 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.917801 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:22.921051 19062 raft_consensus.cc:2368] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6.
W20260709 13:18:22.919297 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 221118us
I20260709 13:18:22.904136 21256 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:22.908352 20949 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:22.930156 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.906454 21267 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:18:22.923179 20969 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.917228 21293 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:22.964632 19026 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.966625 19027 leader_election.cc:400] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6.
I20260709 13:18:22.940938 21267 consensus_queue.cc:1243] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:22.993521 19026 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:22.995118 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 62093.9us
I20260709 13:18:22.996116 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:22.996779 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 57073.6us
I20260709 13:18:22.962015 21225 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.966037 21304 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.998229 18382 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:23.010099 21183 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.011524 21183 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.010356 21304 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.014631 21194 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:23.015568 21304 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:22.997512 21256 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:23.010165 20949 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.018991 20949 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:23.019858 21292 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.017714 21256 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:22.913887 21229 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:23.030871 19025 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:23.035023 18382 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:23.034060 19026 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:22.938153 21348 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:23.045051 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 294984us
I20260709 13:18:22.970245 21078 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:23.053010 18413 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:23.063320 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.100427 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.129215 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 94285.8us
W20260709 13:18:23.159587 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 125609us
I20260709 13:18:23.132165 18458 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:23.166630 21194 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:23.174115 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 143343us
I20260709 13:18:23.042220 21304 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:23.176437 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 44404.3us
W20260709 13:18:23.171311 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 175244us
I20260709 13:18:23.128790 21068 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:23.133638 21047 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:23.187273 18307 leader_election.cc:336] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.811s (SENT)
I20260709 13:18:23.158872 21288 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:23.187922 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:23.167732 21221 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:23.190135 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 224354us
I20260709 13:18:23.191782 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:23.199119 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:23.199779 18335 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:23.200899 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.201516 18343 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:23.202739 19062 raft_consensus.cc:2393] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:23.204083 18458 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:23.206064 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.206298 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:23.181433 21286 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:23.206974 18342 raft_consensus.cc:2393] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:23.207841 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:23.210383 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.210558 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:23.214246 18335 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:23.213410 19059 raft_consensus.cc:2393] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:23.218539 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:23.224782 18412 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:23.205804 20681 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:23.192719 21288 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.242691 19058 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:23.244819 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:23.249589 19027 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:23.253450 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 47231us
I20260709 13:18:23.219305 21286 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:23.257793 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 74289.2us
I20260709 13:18:23.231045 21047 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:23.261207 19062 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:23.242303 21288 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:23.268555 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:23.268632 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:23.269503 19058 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:23.263451 19059 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:23.279978 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:23.276886 21296 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:23.281347 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:23.262619 21286 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:23.287488 19062 raft_consensus.cc:2410] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:23.291309 21368 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:23.291790 21368 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.292192 21368 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:23.293347 21229 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:23.294462 21361 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:18:23.316332 21356 log.cc:927] Time spent T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:18:23.323901 21193 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:23.324465 21193 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.324900 21193 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:23.262519 20859 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:18:23.290244 21293 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:23.349460 21301 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:23.357283 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:23.358989 19062 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:18:23.364704 21160 consensus_meta.cc:287] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.000s
I20260709 13:18:23.365108 21160 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:23.368144 21367 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 13:18:23.355944 21369 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:18:23.281992 20681 consensus_queue.cc:1059] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:18:23.372948 18341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:18:23.373582 18341 raft_consensus.cc:606] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:18:23.376005 21292 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:23.378929 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.384881 20681 consensus_queue.cc:1243] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:18:23.362210 21110 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.802s	user 0.012s	sys 0.008s
I20260709 13:18:23.391907 18485 raft_consensus.cc:1240] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:23.392016 18492 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:23.393098 18489 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:23.393370 18484 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:23.391853 21078 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:23.399972 21373 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 13:18:23.398514 21377 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:18:23.398485 20969 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:23.399744 21160 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:23.412514 18489 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:23.402982 21386 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.427340 18343 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:18:23.428748 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:23.439824 18489 raft_consensus.cc:1240] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:23.442114 21372 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:18:23.391569 21110 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.446756 21386 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.448385 21110 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:23.448972 21386 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:23.393218 21047 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.451503 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:23.450507 21221 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:23.453169 20303 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:23.455986 21348 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:23.459986 21068 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:23.463641 18335 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:23.429337 21193 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.476436 21193 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:23.477960 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:23.401052 21288 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.511961 21378 raft_consensus.cc:3055] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:23.493552 21299 consensus_meta.cc:287] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.573s	user 0.007s	sys 0.004s
I20260709 13:18:23.513669 21378 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:23.514376 21299 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:23.515628 18491 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:23.496346 21286 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:23.515152 21378 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.507128 21064 raft_consensus.cc:3055] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:23.517099 21064 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:23.517248 18341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:18:23.517549 21299 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:23.483067 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:23.500597 18492 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:23.518683 18486 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:23.518554 18335 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:23.517978 18341 raft_consensus.cc:606] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:18:23.522686 18341 raft_consensus.cc:614] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:23.523046 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.521338 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:23.525398 18415 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:23.551415 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:23.553305 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 307370us
W20260709 13:18:23.498005 21379 log.cc:927] Time spent T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:18:23.549494 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:23.554939 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 300764us
I20260709 13:18:23.555099 19056 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:23.556488 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:23.557140 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:23.557452 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 349571us
I20260709 13:18:23.553465 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:23.486667 21152 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.562669 18416 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:23.562922 19062 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:23.562395 19025 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:23.571326 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:23.486688 21368 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:23.573937 18418 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:23.574352 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:23.574481 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:23.576315 18417 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:23.576799 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:23.577010 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:23.577564 18489 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:23.576319 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:23.586068 18484 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:18:23.586513 18484 pending_rounds.cc:85] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 6
I20260709 13:18:23.587183 18414 pending_rounds.cc:85] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 7
I20260709 13:18:23.590335 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:23.593279 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:23.595348 18411 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:23.596558 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:23.597258 18416 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:18:23.587489 18414 pending_rounds.cc:107] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:18:23.600061 18414 raft_consensus.cc:2889] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:23.586745 18484 pending_rounds.cc:107] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:23.603550 18484 raft_consensus.cc:2889] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:23.603201 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.610950 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.644156 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 49678.9us
I20260709 13:18:23.706409 18335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:18:23.518162 21064 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:23.734679 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.766010 19025 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:23.592942 21152 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.766796 21064 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:23.767009 21225 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:23.767644 21225 raft_consensus.cc:697] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:23.768613 21225 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.769109 21152 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:23.770416 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 65382.8us
I20260709 13:18:23.771201 19025 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:23.772053 21012 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:23.772214 18307 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.506s (SENT) [suppressed 34 similar messages]
I20260709 13:18:23.707118 18335 raft_consensus.cc:606] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:18:23.730823 21194 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:23.761081 21288 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:23.782404 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 173552us
I20260709 13:18:23.604044 18309 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:23.785686 21391 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:23.785760 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 198728us
I20260709 13:18:23.788700 21391 consensus_queue.cc:1059] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:23.790010 21391 raft_consensus.cc:3055] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:23.790426 21391 raft_consensus.cc:740] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:23.790663 21378 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:23.791510 21391 consensus_queue.cc:260] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.793012 21391 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.776649 18415 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:23.794708 18309 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:23.796934 21256 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:23.797361 21256 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.797748 21256 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:23.799057 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:23.778627 18418 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:23.781596 18416 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
W20260709 13:18:23.783510 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 186891us
I20260709 13:18:23.761468 21368 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:23.804157 18309 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:23.804030 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 101942us
I20260709 13:18:23.804435 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:23.809554 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:23.785200 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:23.818883 19056 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:18:23.819890 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.820510 18343 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:23.819914 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:23.823808 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:23.824003 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:23.827116 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:23.828305 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:23.832556 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:23.833514 19056 raft_consensus.cc:2393] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:23.838186 18416 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:23.839006 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.839778 18340 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:23.842938 18309 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:23.843904 19054 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:23.845676 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:23.852691 18343 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:23.822538 21286 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:23.857161 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:23.855747 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.857969 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.858875 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.859804 18490 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:23.861663 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.863162 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.866668 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:23.848771 21368 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.866051 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:23.869194 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.817054 21047 consensus_queue.cc:1059] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:18:23.870848 19054 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:23.862551 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.867671 21368 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.874549 21362 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:23.875485 21362 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:23.876315 21368 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:23.876516 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 753) took 1133 ms. Trace:
I20260709 13:18:23.878289 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.876996 19053 rpcz_store.cc:276] 0709 13:18:22.696531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.696716 (+   185us) service_pool.cc:224] Handling call
0709 13:18:22.716538 (+ 19822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.739803 (+ 23265us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:22.998869 (+259066us) log.cc:844] Serialized 14 byte log entry
0709 13:18:23.166863 (+167994us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:23.166916 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:23.168919 (+  2003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.460024 (+291105us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b1800418cc0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef522 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:18:23.820459 (+360435us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b54004f4054. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:23.820513 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.829596 (+  9083us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37272,"prepare.queue_time_us":428809,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":774,"raft.queue_time_us":38801,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":4432,"spinlock_wait_cycles":52544256,"thread_start_us":332971,"threads_started":2,"wal-append.queue_time_us":216241}
I20260709 13:18:23.879473 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.880698 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:23.880853 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.881397 18486 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:23.854596 21386 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:23.882594 21386 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:23.884999 21386 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:23.848443 20862 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:18:23.893503 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.895016 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.895655 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.896279 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.897068 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:23.865175 21183 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:23.900391 19056 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:23.863829 21267 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:23.901685 21267 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:23.902179 21267 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.860229 21348 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:23.908874 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.909982 18492 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:23.910770 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.910975 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.911456 18490 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:23.912500 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.913286 18492 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
W20260709 13:18:23.918291 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 133429us
I20260709 13:18:23.918488 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.919754 18486 raft_consensus.cc:2410] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:23.870154 20949 consensus_queue.cc:1059] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:18:23.925402 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.926398 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:23.927520 18342 raft_consensus.cc:2410] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:23.930014 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:23.931932 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.932621 18337 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:23.935746 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:23.936100 21368 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:23.936902 18342 raft_consensus.cc:2410] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:18:23.936753 21368 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:23.939035 18489 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:23.932612 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.948482 18488 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:18:23.940451 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.940491 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.912526 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.943269 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.943529 21368 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:23.943805 21047 raft_consensus.cc:3055] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:23.951706 21047 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:23.951982 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.952657 21047 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:23.953397 18335 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.944676 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.897624 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.953260 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.955057 18487 raft_consensus.cc:2410] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:18:23.947256 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 81136.6us
I20260709 13:18:23.960330 19061 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:23.960165 18335 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:23.973030 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.973973 18336 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:23.953855 21047 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.977478 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:23.977759 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:23.978957 18492 raft_consensus.cc:2393] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 3: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:18:23.954380 21384 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.600s	user 0.005s	sys 0.012s
I20260709 13:18:23.983470 19056 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:23.986984 18343 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:23.989486 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:23.989776 18340 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:23.960803 21288 consensus_queue.cc:1059] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:18:23.994268 21288 raft_consensus.cc:3055] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:23.994607 21288 raft_consensus.cc:740] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:23.988230 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.011649 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:24.016312 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:24.021251 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:24.021961 18458 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:23.990541 21348 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:24.024807 19054 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:24.024902 18307 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:23.991283 21389 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:24.028779 19055 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:24.029837 19053 raft_consensus.cc:1240] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:24.030202 19027 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:24.033972 19058 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:24.034916 20303 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:18:24.035228 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 168108us
I20260709 13:18:23.988155 21068 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:18:24.035506 20303 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:24.036235 18309 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:24.034469 19027 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:24.039587 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:24.038657 19062 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:24.041757 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:24.042605 19061 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:24.044888 18492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:56024
I20260709 13:18:24.045580 18492 raft_consensus.cc:606] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:24.046054 18492 raft_consensus.cc:614] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:24.047672 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.051180 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:24.052168 18491 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
I20260709 13:18:24.024308 21183 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:24.018608 20949 consensus_queue.cc:1059] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:18:24.056926 19060 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:23.997193 21393 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:18:24.049050 21368 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:24.050207 21386 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:24.051405 21221 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:24.062055 18344 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:24.070036 20303 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.050096 20979 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 13:18:24.082572 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 62596.1us
W20260709 13:18:24.091565 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.038903 21348 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.069957 21386 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.075269 21183 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:24.116151 18336 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:24.051119 21288 consensus_queue.cc:260] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:24.090792 21358 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.962s	user 0.000s	sys 0.014s
I20260709 13:18:24.064668 21365 consensus_queue.cc:1059] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:18:24.088887 21221 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:24.057904 21152 consensus_queue.cc:1059] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:18:24.134107 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.094930 21364 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.111148 21386 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:24.147981 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 101907us
I20260709 13:18:24.133713 21391 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:24.141749 20949 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:24.145751 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 95727.6us
W20260709 13:18:24.151191 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 110678us
I20260709 13:18:24.142192 21368 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.155262 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:24.158253 18493 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:24.149891 18457 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:24.168720 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 133949us
I20260709 13:18:24.172151 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:24.178757 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:24.133884 21256 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.183900 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:24.185462 18491 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:24.185716 18490 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:24.179593 18485 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:24.188023 18492 raft_consensus.cc:1813] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Handling vote request from an unknown peer 20e06cff39b649c48d342b7431135303
I20260709 13:18:24.188735 18492 raft_consensus.cc:2410] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:18:24.193413 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 101772us
I20260709 13:18:24.194574 19027 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:24.196759 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:24.180548 21299 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:24.188333 21396 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:18:24.183898 21183 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:24.150430 21364 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.151994 21143 consensus_queue.cc:1059] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.164s
I20260709 13:18:24.210180 18307 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.213064 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:24.215399 21221 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.176191 21368 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.168833 20949 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.224475 18491 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:24.226500 18337 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:24.227752 18338 raft_consensus.cc:1240] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:24.227973 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 206094us
I20260709 13:18:24.209075 21299 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:24.242187 21393 raft_consensus.cc:2764] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:18:24.244766 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.214115 21407 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:24.245556 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.245498 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:24.247900 21406 consensus_queue.cc:1059] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:24.248368 21407 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.250090 21256 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:24.250934 21256 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:24.252758 21394 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.304s	user 0.000s	sys 0.002s
I20260709 13:18:24.246867 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:24.255105 18491 raft_consensus.cc:2368] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7.
W20260709 13:18:24.255497 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 98616.9us
I20260709 13:18:24.256264 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:24.230268 21183 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:18:24.262004 20949 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:24.262202 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:24.262439 21183 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.262939 21183 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.250983 21407 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:24.265098 21183 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:24.241541 21299 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.266183 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:24.266938 21386 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.270502 18484 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:24.270612 21368 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:24.271623 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:24.272194 21417 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:24.272679 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:24.274051 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:24.274883 18489 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:24.274137 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 77744.1us
I20260709 13:18:24.303682 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.305008 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:24.272686 21064 consensus_meta.cc:287] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
W20260709 13:18:24.309721 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 53371.8us
I20260709 13:18:24.310839 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:24.310762 19026 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:24.270502 21386 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:24.312990 19026 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:24.302412 21417 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:24.318300 21417 raft_consensus.cc:697] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:24.319736 21416 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:24.320850 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:24.321450 19060 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.312175 21183 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:24.322168 21408 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:24.323351 21417 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.307099 21368 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:24.326134 21414 raft_consensus.cc:3055] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:24.326265 21408 raft_consensus.cc:697] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:24.326848 21392 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.558s	user 0.000s	sys 0.003s
I20260709 13:18:24.326576 21414 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:24.367715 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:24.370286 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:24.327737 21408 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.320328 21416 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:24.321537 21390 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:24.328609 20949 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:24.326316 21368 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:24.399132 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:24.402185 19061 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.403935 21368 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:24.316958 21267 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.367149 21143 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.409739 21064 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.440778 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:24.441432 19057 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
W20260709 13:18:24.442404 21425 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:24.442792 18309 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:24.443405 20859 raft_consensus.cc:3055] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:24.443845 20859 raft_consensus.cc:740] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:24.433288 20949 raft_consensus.cc:697] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:24.470950 21267 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:24.419576 21390 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.460754 20859 consensus_queue.cc:260] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:24.444818 21414 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.476311 21388 raft_consensus.cc:3055] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:24.455863 21064 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.476689 21414 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:24.480118 21416 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.476927 21388 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:24.485137 21388 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:24.486620 21388 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.487066 20949 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.457310 20681 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:24.493957 20681 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:24.494465 20681 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.497383 21064 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:24.504477 21419 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.505141 21419 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.514904 21194 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:24.518677 21194 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.530616 21146 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:24.531250 21146 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:24.533077 21146 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:24.534075 21146 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:24.535862 20851 raft_consensus.cc:3055] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:24.536283 20851 raft_consensus.cc:740] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:24.537067 20851 consensus_queue.cc:260] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.540772 21410 raft_consensus.cc:3055] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:24.541344 21410 raft_consensus.cc:740] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:24.542619 20979 raft_consensus.cc:3055] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:24.543061 20979 raft_consensus.cc:740] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:24.543958 20979 consensus_queue.cc:260] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.545574 20979 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:24.551230 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:24.553311 21410 consensus_queue.cc:260] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:24.554703 21410 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.558869 20851 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.559727 21288 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:24.587091 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.598055 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 155385us
I20260709 13:18:24.598481 21348 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:24.599901 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:24.600396 21435 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:24.600543 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:24.601227 19062 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:24.601040 21435 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.603367 21435 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:24.603790 21364 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:24.598110 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 322391us
I20260709 13:18:24.612890 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:24.613581 18492 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:24.615581 18488 raft_consensus.cc:1240] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:24.616546 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.617998 18488 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:24.620465 19060 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:24.622052 19025 leader_election.cc:400] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7.
I20260709 13:18:24.622372 18492 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:24.622766 18307 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.627808 18490 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:24.633006 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:24.631155 18309 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:24.631253 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:24.629297 18242 catalog_manager.cc:5697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 4 to 5, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 5 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.635114 18490 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
W20260709 13:18:24.635161 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 440632us
W20260709 13:18:24.629515 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 373354us
I20260709 13:18:24.633849 18487 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:24.647257 18491 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:24.636059 18242 catalog_manager.cc:5697] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 5 to 7, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 7 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:24.636453 19027 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:24.635367 19025 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.629477 21433 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:24.638906 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 399695us
I20260709 13:18:24.611303 21406 consensus_queue.cc:1243] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:24.645594 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:24.623806 20859 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.650914 18242 catalog_manager.cc:5697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 4 to 5, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2), now has a pending config: VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1), VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2), VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3), VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 5 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:24.662470 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.666433 18242 catalog_manager.cc:5697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 4 to 7, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 7 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.670437 18458 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:24.667773 18242 catalog_manager.cc:5697] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: leader changed from <none> to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 4 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.673574 20303 consensus_queue.cc:1059] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:18:24.674309 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.675065 18384 leader_election.cc:400] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6.
I20260709 13:18:24.675534 18384 leader_election.cc:403] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:18:24.676188 18242 catalog_manager.cc:5697] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 2 to 3, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:24.646401 21391 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:24.678399 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 55722.1us
I20260709 13:18:24.679708 18382 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:24.680363 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:24.681440 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:24.655472 21348 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:24.685868 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.658972 21193 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:24.701331 18339 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:24.687631 18343 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:24.702814 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:24.687525 18242 catalog_manager.cc:5697] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:18:24.694190 18340 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
W20260709 13:18:24.694160 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.665221 21123 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:24.690606 21094 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:18:24.705422 21348 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:24.706610 21348 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.710562 21412 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:24.711349 18384 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.711809 21078 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:24.712214 21412 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:24.712689 21365 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:24.713431 21078 raft_consensus.cc:1064] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:18:24.714020 21385 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:24.714461 21285 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:24.715062 21285 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:24.715987 21221 consensus_queue.cc:1059] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:24.717433 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:24.718026 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.718680 19060 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:24.697113 20303 consensus_queue.cc:1059] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:24.694202 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.719451 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:24.720472 18307 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.679821 21068 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:24.725047 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:24.724056 18242 catalog_manager.cc:5697] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 3 to 5, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 5 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.726677 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:24.727195 18242 catalog_manager.cc:5697] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 5 to 7, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 7 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:24.722105 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:24.730826 18417 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 6: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:24.731340 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:24.729211 18242 catalog_manager.cc:5697] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 2, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:24.713372 21012 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.749339 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:24.697969 21406 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:24.685678 21225 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:24.738554 18242 catalog_manager.cc:5697] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 5 to 7, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 7 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:24.740203 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.745752 18339 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:24.747792 18416 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:24.743794 18340 raft_consensus.cc:2955] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 3 to 5, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:24.762751 18242 catalog_manager.cc:5697] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.764670 18242 catalog_manager.cc:5697] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 6 to 7, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 7 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.767206 18242 catalog_manager.cc:5697] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:24.759438 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:24.771065 21012 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.679704 21143 consensus_queue.cc:1059] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:18:24.750733 18414 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:24.751268 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:24.686429 21152 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6.
I20260709 13:18:24.774472 21435 consensus_queue.cc:1059] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:18:24.783891 18240 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42292 (request call id 341) took 12673 ms (client timeout 15000 ms). Trace:
W20260709 13:18:24.784837 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 83654.4us
I20260709 13:18:24.755966 18307 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.760053 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:24.748006 18458 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:24.731876 21047 consensus_meta.cc:287] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.752s	user 0.013s	sys 0.005s
I20260709 13:18:24.730700 21267 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:24.769068 18242 catalog_manager.cc:5697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 1 to 3, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 3 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.782461 18343 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:18:24.717886 21390 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:24.786062 18382 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:24.759606 21391 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:24.752055 21408 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:24.784118 21431 raft_consensus.cc:3055] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:24.822214 21431 raft_consensus.cc:740] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:24.823148 21431 consensus_queue.cc:260] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.824385 21431 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:24.665120 21433 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.828603 21433 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:24.829358 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 73498.4us
I20260709 13:18:24.830237 18307 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.831509 18307 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.832612 18307 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:24.834365 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 86481us
W20260709 13:18:24.835078 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.835031 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:24.836067 18489 consensus_meta.cc:287] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.012s
I20260709 13:18:24.836409 18489 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
W20260709 13:18:24.784361 18240 rpcz_store.cc:269] 0709 13:18:12.110707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.119025 (+  8318us) service_pool.cc:224] Handling call
0709 13:18:24.783806 (+12664781us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:23.366280 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:23.366989 (+   709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:23.367041 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:18:23.367060 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:23.368053 (+   993us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:23.368129 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:23.368158 (+    29us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:18:23.369009 (+   851us) tablet.cc:701] Row locks acquired
0709 13:18:23.369061 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:18:23.369225 (+   164us) write_op.cc:270] Start()
0709 13:18:23.369413 (+   188us) write_op.cc:276] Timestamp: P: 1783603103369166 usec, L: 0
0709 13:18:23.369436 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:23.419352 (+ 49916us) log.cc:844] Serialized 2415 byte log entry
0709 13:18:24.190041 (+770689us) op_driver.cc:464] REPLICATION: finished
0709 13:18:24.460290 (+270249us) write_op.cc:301] APPLY: starting
0709 13:18:24.468166 (+  7876us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:24.479217 (+ 11051us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:24.479415 (+   198us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:24.480431 (+  1016us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:24.480794 (+   363us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:18:24.480853 (+    59us) write_op.cc:312] APPLY: finished
0709 13:18:24.481190 (+   337us) log.cc:844] Serialized 53 byte log entry
0709 13:18:24.481367 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:24.481477 (+   110us) write_op.cc:454] Released schema lock
0709 13:18:24.481534 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:24.587037 (+105503us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:24.587084 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":303708,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":268026,"apply.run_cpu_time_us":3253,"apply.run_wall_time_us":21704,"num_ops":6,"prepare.queue_time_us":485589,"prepare.run_cpu_time_us":20171,"prepare.run_wall_time_us":401373,"raft.queue_time_us":232191,"raft.run_cpu_time_us":22507,"raft.run_wall_time_us":453005,"replication_time_us":782597,"thread_start_us":812265,"threads_started":4,"wal-append.queue_time_us":487749}]]}
I20260709 13:18:24.842202 21152 raft_consensus.cc:3055] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:18:24.842479 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 56542.1us
I20260709 13:18:24.844326 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:24.844571 21047 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:24.845012 21047 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.845248 18382 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:24.846441 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet 21b9264b0a434b79b6292c2ed23bbae0 with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34454
W20260709 13:18:24.847580 18291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 43917.5us
I20260709 13:18:24.847937 18384 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.842648 21152 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:24.849249 21152 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:24.850039 21421 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:24.850589 21152 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:24.850816 21421 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:24.848403 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:24.852910 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:24.716032 21285 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.845446 21047 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.833451 21423 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:24.858768 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 201068us
I20260709 13:18:24.861863 19061 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
W20260709 13:18:24.863443 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.786859 21419 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:24.871445 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 114051us
I20260709 13:18:24.878819 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:24.833559 20949 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:24.884536 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 163814us
I20260709 13:18:24.893404 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:24.880784 18309 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:24.899910 18492 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:24.901058 18489 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:24.901332 18489 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:24.868885 20975 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:24.871481 21430 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:24.900357 18492 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:24.902920 18411 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:24.866168 21406 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.905797 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:24.906526 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:24.914656 18414 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
W20260709 13:18:24.886955 21299 consensus_meta.cc:287] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.621s	user 0.012s	sys 0.008s
I20260709 13:18:24.909935 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:24.874071 21435 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:24.924451 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 91901.2us
I20260709 13:18:24.925381 18307 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.869014 21288 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:18:24.897635 21431 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:24.916539 21433 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.916409 21420 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:24.925858 18458 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:24.879256 21123 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.886620 20949 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:24.914746 21430 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.865849 21408 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.902968 21423 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:24.921424 18492 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.902204 18489 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.940524 21417 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.940507 21193 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:25.014635 18489 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:25.015184 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 69683.2us
I20260709 13:18:25.015977 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:24.949883 21430 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:24.921130 21194 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.940963 21225 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:25.048283 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.942833 21420 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.945937 21267 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.075810 18492 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:25.081382 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 177623us
I20260709 13:18:24.937745 21299 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:24.946341 20975 raft_consensus.cc:697] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:25.123001 18418 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
W20260709 13:18:25.127379 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.126677 19026 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:18:25.076092 21436 log.cc:927] Time spent T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:18:25.153584 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 137646us
I20260709 13:18:25.155884 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:25.110903 21420 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.949884 21123 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.163653 18484 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:25.165169 18307 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:25.056715 18489 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:18:25.166306 18489 pending_rounds.cc:85] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 7
I20260709 13:18:25.166616 18489 pending_rounds.cc:107] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:18:25.166905 18489 raft_consensus.cc:2889] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:25.007390 21446 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.076404 21234 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.148983 21450 tablet_replica.cc:333] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:18:25.008498 21431 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:25.161443 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.115540 21407 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:25.075683 21433 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.111140 21423 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:25.027951 21417 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.110512 21388 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:18:25.124329 21444 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.284s
W20260709 13:18:25.183975 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 233923us
I20260709 13:18:25.157083 21267 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:25.189296 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 62736.9us
I20260709 13:18:25.172503 21362 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.208184 18307 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:25.112227 21225 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:25.216548 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.215241 21183 raft_consensus.cc:993] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:18:25.182595 21234 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.025808 20949 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.202979 21348 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.240721 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:25.246196 21234 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.248586 18413 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:25.253813 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:25.239495 20975 consensus_queue.cc:237] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:25.256111 21146 consensus_meta.cc:287] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.722s	user 0.004s	sys 0.010s
I20260709 13:18:25.266414 18457 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:25.272205 18412 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:25.202795 21433 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.234877 21407 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:25.238586 21378 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.236258 21391 raft_consensus.cc:1081] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:18:25.176904 21446 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.204082 21267 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:25.320410 21448 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:18:25.320726 21408 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:25.277585 21407 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:25.322917 21407 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.323160 21423 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:25.329245 21256 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.078s	user 0.014s	sys 0.005s
W20260709 13:18:25.334034 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.336707 21446 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:25.339246 21417 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:25.340310 21449 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:25.340986 21449 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:25.341498 21449 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:25.345256 21455 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:18:25.346735 21194 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:25.352483 20979 consensus_meta.cc:287] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.806s	user 0.012s	sys 0.000s
I20260709 13:18:25.356117 21225 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:25.234190 21431 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:18:25.358533 21431 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:25.359211 21431 raft_consensus.cc:697] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:25.360461 21431 consensus_queue.cc:237] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:25.313896 21285 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
W20260709 13:18:25.370249 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 129648us
I20260709 13:18:25.371881 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:25.372501 21433 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.373296 21433 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:25.217856 21193 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.381315 18414 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:18:25.373363 18307 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:25.401759 18415 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:25.404206 21183 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:25.287811 21348 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.405877 18492 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
W20260709 13:18:25.406009 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.389271 20681 consensus_meta.cc:287] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.894s	user 0.009s	sys 0.006s
I20260709 13:18:25.407996 18492 pending_rounds.cc:85] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 8
I20260709 13:18:25.410339 18492 pending_rounds.cc:107] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 13:18:25.410629 18492 raft_consensus.cc:2889] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:25.411123 18307 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:25.329761 21256 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.373816 21391 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:25.378638 21299 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.379410 21123 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:25.424796 18412 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:18:25.412966 21047 consensus_meta.cc:287] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
W20260709 13:18:25.415695 21286 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:18:25.430806 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:25.431449 18335 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:25.427738 18416 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:25.429275 18414 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:25.429716 18338 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:25.416414 21368 consensus_meta.cc:287] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 1.012s	user 0.007s	sys 0.011s
I20260709 13:18:25.427361 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:25.438864 18343 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:18:25.433722 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 507871us
I20260709 13:18:25.436991 18307 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:25.441073 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:25.441620 18307 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:25.415150 21391 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:25.403084 21433 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:25.444190 18458 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:25.444010 19027 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.006s
I20260709 13:18:25.423211 21183 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.428125 21123 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:25.447575 19027 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.000s	sys 0.007s
I20260709 13:18:25.449474 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:25.448733 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:25.449950 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 546035us
I20260709 13:18:25.450697 18414 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:25.451701 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:25.448352 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:25.455205 19027 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:25.414897 20681 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:25.499010 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 43916us
I20260709 13:18:25.506218 18335 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:18:25.505544 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 81551.5us
I20260709 13:18:25.447058 21391 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:25.510381 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 68844.1us
I20260709 13:18:25.511237 18307 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:25.512504 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:25.515914 19061 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:25.517712 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:25.518477 19061 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:25.518831 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:25.519670 19060 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
W20260709 13:18:25.520666 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.498620 21194 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:18:25.524957 20975 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.525440 20975 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.449117 21362 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:25.536598 18342 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:25.496088 21462 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.438447 21047 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:25.537835 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 93740.3us
I20260709 13:18:25.541677 18458 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:18:25.507107 21410 consensus_meta.cc:287] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.952s	user 0.013s	sys 0.003s
I20260709 13:18:25.508957 21225 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:25.554425 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:25.555261 19060 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:25.555197 19058 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:18:25.445243 21368 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.496544 21152 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:18:25.564589 19054 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:25.496949 21123 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.574520 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:25.586393 19056 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:25.558028 21225 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:25.590448 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 78016.2us
I20260709 13:18:25.591972 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:25.560688 21256 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:25.593009 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:25.594261 18337 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:25.593554 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:25.596594 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:25.573187 21472 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:25.582285 21183 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.602206 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:25.603510 21267 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:25.603745 21465 log.cc:927] Time spent T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:18:25.603238 21457 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:18:25.602296 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:25.545746 21462 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.595921 21225 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:25.593606 21194 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:25.612949 19053 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:25.629452 21123 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:25.592046 21299 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:18:25.639540 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:25.640275 19058 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:25.611174 20975 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.612139 21474 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:25.655915 21469 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:25.630788 21194 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.657897 21457 consensus_queue.cc:1059] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:25.623639 21267 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:25.650152 21429 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:25.650442 21433 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:25.614149 21183 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:25.651825 21395 log.cc:927] Time spent T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: Append to log took a long time: real 0.200s	user 0.002s	sys 0.000s
I20260709 13:18:25.598605 21420 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.689697 18344 raft_consensus.cc:2410] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:18:25.653990 21430 consensus_meta.cc:287] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.541s	user 0.003s	sys 0.008s
I20260709 13:18:25.654371 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:25.654531 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:25.655048 21476 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.606276 21467 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:25.659039 18410 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:25.610126 21472 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:25.630460 21462 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:25.691238 19058 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:25.657897 21368 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.655089 21478 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:25.666960 21474 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:25.665283 21267 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:25.657998 21123 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:25.711918 18340 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:18:25.713012 18411 raft_consensus.cc:2368] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8.
I20260709 13:18:25.687443 21183 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.697178 21433 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:25.719563 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 139782us
I20260709 13:18:25.712823 21267 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.708861 21478 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:25.726176 21457 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.726899 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:25.727169 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1964) took 1008 ms. Trace:
I20260709 13:18:25.731163 18458 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:18:25.734928 21471 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:18:25.745280 18458 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:25.743841 18415 rpcz_store.cc:276] 0709 13:18:24.719095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.719219 (+   124us) service_pool.cc:224] Handling call
0709 13:18:25.727015 (+1007796us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b5400177ad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:25.727111 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456329088}
I20260709 13:18:25.724599 21485 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:25.748454 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:25.749035 18492 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
W20260709 13:18:25.751096 18458 connection.cc:256] RPC call timeout handler was delayed by -1.00664205399994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:18:25.752209 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.752526 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.752998 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:25.754057 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:25.710129 20851 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:18:25.755398 21467 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:25.756136 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:25.765767 20949 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:25.767144 20851 consensus_queue.cc:1243] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:25.767740 21467 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:25.768151 21467 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:25.769254 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:25.770022 18342 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 6: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:25.770890 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:25.770589 21472 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.772053 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:25.767041 18307 leader_election.cc:336] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.506s (SENT)
I20260709 13:18:25.773164 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:25.755430 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:25.774629 19054 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.719393 21468 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:25.774966 19056 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:25.762392 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:25.762492 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:25.763391 21424 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:25.757531 21368 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:25.764073 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:25.697234 21430 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.764319 18493 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:25.764884 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:25.778669 18485 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:25.778754 18486 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:25.780349 21477 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:25.735538 21047 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.794899 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1965) took 1075 ms. Trace:
I20260709 13:18:25.799223 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:25.786962 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1970) took 1065 ms. Trace:
I20260709 13:18:25.807529 19057 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.794281 20303 raft_consensus.cc:3055] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:25.797744 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:25.803411 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:25.765825 21420 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.808226 20303 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:25.767009 21194 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:25.742976 21478 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.731839 21433 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:25.854549 19055 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:25.712976 21474 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.807118 18418 rpcz_store.cc:276] 0709 13:18:24.719386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.731124 (+ 11738us) service_pool.cc:224] Handling call
0709 13:18:25.794739 (+1063615us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b540025c6d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:25.794840 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645460736}
I20260709 13:18:25.808060 18410 rpcz_store.cc:276] 0709 13:18:24.724397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.724535 (+   138us) service_pool.cc:224] Handling call
0709 13:18:25.786765 (+1062230us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54001c57d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:25.786870 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1770497280}
I20260709 13:18:25.874688 19054 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:25.777755 21368 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:25.862746 19057 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
W20260709 13:18:25.797842 21481 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:25.783254 20851 raft_consensus.cc:3055] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:25.881697 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:25.882611 18335 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.883051 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:25.758111 21457 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.790949 21487 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:25.791553 21430 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.886700 21485 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:25.901079 20303 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.886822 21434 raft_consensus.cc:3055] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:25.887245 21450 raft_consensus.cc:2243] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:25.890080 18339 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:25.889763 21474 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.879861 21385 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.909948 21385 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:25.912019 21385 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:25.896901 18384 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:25.885607 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:25.799682 21378 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.912736 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:25.903899 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:25.878129 21476 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.789354 21407 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.906829 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:25.905330 18335 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:25.894497 21225 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.919516 18337 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
W20260709 13:18:25.919903 21449 consensus_meta.cc:287] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.000s
I20260709 13:18:25.920168 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:25.906498 21450 raft_consensus.cc:2272] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:25.920812 19059 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:25.883648 21368 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.908025 20303 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.909130 21467 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.916217 18384 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:25.903697 21434 raft_consensus.cc:740] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:25.885421 20851 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:25.900906 21348 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.922483 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:25.927296 18344 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:25.903439 21267 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.929857 21267 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.931999 21434 consensus_queue.cc:260] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.932835 20851 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.934041 20851 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:25.934612 18344 raft_consensus.cc:1240] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:25.935639 21407 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.938495 18337 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:25.801419 21391 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.939174 21433 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:25.940469 21457 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.940569 21391 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.941481 18337 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:25.942978 18337 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:25.949786 21467 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:25.921073 21420 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:25.950708 21420 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.951144 21420 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:25.920300 21449 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.944444 18337 raft_consensus.cc:1240] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:25.954111 21449 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:25.955456 18337 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:25.959640 20975 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:25.960078 20975 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:25.960371 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:25.960923 20975 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.962098 18343 raft_consensus.cc:1240] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:25.964365 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:25.933815 21434 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.967531 21450 ts_tablet_manager.cc:1916] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:25.969761 21385 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:25.970420 21385 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:25.971490 21385 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.973764 20975 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:25.980705 21442 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 1.211s	user 0.005s	sys 0.000s
I20260709 13:18:25.973449 21078 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.983431 21012 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:25.987650 21420 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:25.991313 18339 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:25.995612 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:25.995658 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:26.000160 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:26.025797 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 271763us
I20260709 13:18:26.027455 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.029335 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.030864 18458 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:26.032445 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.037060 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:26.037930 18411 raft_consensus.cc:2376] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6. Re-sending same reply.
I20260709 13:18:26.037235 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:26.041740 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:26.042006 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:26.039031 18414 raft_consensus.cc:2376] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5. Re-sending same reply.
I20260709 13:18:26.046259 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:26.046810 18458 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.046902 18410 raft_consensus.cc:2376] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8. Re-sending same reply.
I20260709 13:18:26.052412 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.039543 21433 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:26.061193 21433 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:26.062252 21433 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:26.067032 18343 pending_rounds.cc:85] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 5
I20260709 13:18:26.067411 18343 pending_rounds.cc:107] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:18:26.067683 18343 raft_consensus.cc:2889] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:26.068926 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:26.035348 21467 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.057050 18457 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.051955 21472 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.055851 21492 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:26.035929 21406 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.035424 21391 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.075963 18457 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:26.077024 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.046252 21286 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.088465 18493 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:26.049189 21493 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:26.070442 21285 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.093097 18457 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.087517 21487 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:26.105047 21451 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.088s	user 0.003s	sys 0.000s
I20260709 13:18:26.106710 21143 raft_consensus.cc:2955] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:26.110688 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.094400 21467 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.096500 21406 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:26.096415 21485 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:26.133522 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 78946.6us
I20260709 13:18:26.092099 21391 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.139092 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:26.137629 21493 raft_consensus.cc:697] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:26.099653 21487 raft_consensus.cc:697] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:26.094588 21285 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.142745 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:26.145687 18307 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:26.147457 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:26.151163 21474 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.151579 21474 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:26.151937 21474 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.142674 21348 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.122488 21478 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.142619 21406 raft_consensus.cc:697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:26.147812 21407 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.171697 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:26.173003 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:26.173971 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:26.176174 21391 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:26.178166 21499 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:18:26.178990 21497 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:26.181866 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:26.182210 21450 ts_tablet_manager.cc:1929] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:18:26.182647 21450 log.cc:1199] T 21b9264b0a434b79b6292c2ed23bbae0 P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/21b9264b0a434b79b6292c2ed23bbae0
I20260709 13:18:26.183758 18337 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:26.184365 21450 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34454 (request call id 87) took 1341 ms. Trace:
I20260709 13:18:26.184738 21450 rpcz_store.cc:276] 0709 13:18:24.843426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.846093 (+  2667us) service_pool.cc:224] Handling call
0709 13:18:24.949516 (+103423us) ts_tablet_manager.cc:1151] Deleting tablet 21b9264b0a434b79b6292c2ed23bbae0
0709 13:18:25.016918 (+ 67402us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:26.112828 (+1095910us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:26.182080 (+ 69252us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:26.184294 (+  2214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":674955,"tablet-delete.queue_time_us":77876,"thread_start_us":53924,"threads_started":1}
I20260709 13:18:26.186090 21493 consensus_queue.cc:237] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:26.186959 21495 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:18:26.158886 21385 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.188995 18344 raft_consensus.cc:1240] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:26.143062 21485 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.189725 21487 consensus_queue.cc:237] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:26.192263 21285 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.171173 21407 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:26.193639 21431 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:26.194175 21431 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:26.195045 21485 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.195205 21431 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.167630 21368 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.200625 21368 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.196673 21431 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:26.195259 21385 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:26.205564 21385 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:26.193686 21407 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.207401 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 627) took 1939 ms. Trace:
I20260709 13:18:26.208439 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:26.195593 21406 consensus_queue.cc:237] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:26.209170 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:26.210363 18486 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:26.220477 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.221127 18486 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:26.221160 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.212378 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.212945 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:26.217399 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.223136 18488 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:26.218268 18484 rpcz_store.cc:276] 0709 13:18:24.267964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.273316 (+  5352us) service_pool.cc:224] Handling call
0709 13:18:24.273585 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.164171 (+890586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.207165 (+1042994us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b5400437954. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:26.207344 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2046523136}
I20260709 13:18:26.225067 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.226735 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.226763 18493 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:26.227437 18488 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:26.231374 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.195045 21478 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.227101 21419 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:26.247751 21419 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.252017 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:26.245009 18487 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:26.234889 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.254742 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.255414 18340 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:26.255548 18486 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:26.220686 20681 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.231961 18491 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:26.264333 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:26.265048 18493 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.266860 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.267594 18487 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:26.252720 21417 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:18:26.270848 18340 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:26.272125 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.273118 18490 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 4.
I20260709 13:18:26.275051 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:26.277774 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:26.278549 18487 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.281358 18490 raft_consensus.cc:1275] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:26.229346 21432 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.268990 21285 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:18:26.298105 21285 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:26.298491 21285 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:26.299324 21285 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.300536 21285 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.301049 21474 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.306111 21432 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.308729 21432 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:26.310093 18493 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:26.317078 21407 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.318462 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.319372 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.319733 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.320515 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.320928 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:26.325096 21421 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:26.326259 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.326862 18419 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:26.327975 21407 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.334581 18492 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 7: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:26.336488 18458 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:26.329862 18411 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:26.338857 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:26.346500 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.347848 21421 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:26.348277 18341 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:26.348518 21421 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:26.349784 18337 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:26.346833 21407 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:26.351115 21421 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:26.351264 21390 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:26.358925 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:26.366492 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:26.367079 19026 leader_election.cc:400] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8.
I20260709 13:18:26.367425 19026 leader_election.cc:403] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:26.370044 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:26.367260 18342 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:26.365659 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:26.373956 18343 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:26.374275 18341 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:26.374172 19027 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.283319 21419 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:26.345058 21431 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.377761 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.377588 19026 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:26.378404 18485 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
W20260709 13:18:26.379742 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.381120 18490 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:26.274016 21064 consensus_queue.cc:1059] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:18:26.353433 21407 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:26.383455 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:26.385411 20303 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.385618 19025 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:26.385859 20303 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.386515 20303 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.365528 21429 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.391227 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:26.396310 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.396922 18419 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:26.393548 19027 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:26.401381 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.397058 19025 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:26.405007 20303 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.407241 18308 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:26.377544 21443 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.381883 20949 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.415957 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.416313 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:26.420658 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:26.383963 21458 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:26.423998 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:26.385207 21417 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.421530 19053 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
W20260709 13:18:26.429802 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.372812 21390 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:18:26.384907 21012 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:26.424619 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.425249 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:26.384406 18411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34462
I20260709 13:18:26.377259 21444 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:18:26.435652 20303 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:26.395278 21470 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:26.430234 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.394846 21461 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.430004 18410 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:26.421631 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.420015 21443 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.408020 21449 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:26.427699 18413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1966) took 1708 ms (client timeout 1705 ms). Trace:
I20260709 13:18:26.436441 20303 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:26.430228 21458 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.440166 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:26.424134 20681 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.448988 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.440775 18308 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:26.442224 18410 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
W20260709 13:18:26.442233 18413 rpcz_store.cc:269] 0709 13:18:24.719664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.722192 (+  2528us) service_pool.cc:224] Handling call
0709 13:18:26.427527 (+1705335us) spinlock_profiling.cc:243] Waited 65.8 ms on lock 0x7b54001c52d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:26.427628 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151370624}
I20260709 13:18:26.450161 18410 pending_rounds.cc:85] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 8
I20260709 13:18:26.450423 18418 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:26.450466 18410 pending_rounds.cc:107] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:18:26.450874 18410 raft_consensus.cc:2889] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:26.433185 21432 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.451768 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:26.441977 21443 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.454272 21421 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:26.456501 21225 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:26.409080 21429 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.471561 18411 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:26.472046 18411 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:26.427923 20949 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.448632 20681 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.446385 21470 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:26.480199 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 86717.4us
I20260709 13:18:26.487942 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:26.488838 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:26.491624 19027 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.492429 21390 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.494990 21390 consensus_queue.cc:1059] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:26.495559 21432 consensus_queue.cc:1059] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:26.496286 21390 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:26.496750 21432 raft_consensus.cc:3055] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:18:26.496863 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 70589.4us
I20260709 13:18:26.497303 21444 raft_consensus.cc:3055] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:26.497824 21444 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:26.498657 21444 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.499022 21456 consensus_queue.cc:1059] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:26.499914 21444 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.501502 18418 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:26.501821 18384 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:26.502614 18417 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:26.503046 21518 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:26.502137 21449 consensus_queue.cc:1059] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:26.501569 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:26.503506 21518 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:26.504036 21449 raft_consensus.cc:3055] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:26.504259 21518 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.504446 21449 raft_consensus.cc:740] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:26.499796 21456 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:26.509369 20303 consensus_queue.cc:1059] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:26.510538 20303 consensus_queue.cc:1059] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:26.512137 21461 raft_consensus.cc:3055] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:26.512524 21461 raft_consensus.cc:740] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:26.497238 21432 raft_consensus.cc:740] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:26.516825 21487 consensus_queue.cc:1059] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:26.517997 21487 consensus_queue.cc:1243] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:26.518683 21487 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:26.520382 21487 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:26.520774 21487 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:26.521653 21487 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.522617 21524 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:26.523219 21487 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.505316 21449 consensus_queue.cc:260] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.526686 21449 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.524360 21225 raft_consensus.cc:3055] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:26.530102 21225 raft_consensus.cc:740] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:26.530951 21225 consensus_queue.cc:260] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.532258 21225 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:26.524616 21525 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:26.525527 19027 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.537700 21524 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.539016 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:26.539584 19058 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.539858 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:26.542290 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:26.542963 19054 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.547459 19058 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:26.548202 19053 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:26.550963 19054 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:26.553136 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:26.553853 19058 raft_consensus.cc:2393] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:26.554752 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:26.555505 19058 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.558794 18336 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:26.551995 21518 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.567368 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:26.568152 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:26.570218 18336 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.575750 19058 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:26.577064 21518 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.577450 18336 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:26.579131 18458 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:26.580190 18384 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:26.585852 18419 raft_consensus.cc:2410] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
W20260709 13:18:26.593902 21509 log.cc:927] Time spent T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:18:26.465986 21362 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:18:26.481715 20681 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.600858 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.601786 21456 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:26.603497 18384 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:26.606119 21152 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:26.606627 21152 raft_consensus.cc:697] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:26.607530 21152 consensus_queue.cc:237] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:26.593978 21512 log.cc:927] Time spent T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:18:26.514835 21432 consensus_queue.cc:260] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.617064 21432 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:26.513370 21461 consensus_queue.cc:260] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.618567 18309 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:26.618891 21461 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:26.623492 21511 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:18:26.628947 21458 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.630545 21407 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:26.632232 21429 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.474090 21421 raft_consensus.cc:697] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:26.633435 21421 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.638471 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:26.639202 18487 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:26.640353 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:26.614558 21516 consensus_queue.cc:1059] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:26.646714 21474 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.648065 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.591732 18411 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.653354 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:26.584087 21406 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:26.691929 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:26.695583 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 298594us
I20260709 13:18:26.649065 21518 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:26.703374 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:26.704785 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:26.708326 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.710958 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:26.711002 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 585) took 2035 ms. Trace:
I20260709 13:18:26.712193 18338 rpcz_store.cc:276] 0709 13:18:24.675301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.675415 (+   114us) service_pool.cc:224] Handling call
0709 13:18:24.682893 (+  7478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.441872 (+758979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.710803 (+1268931us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54001662d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:26.710950 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716976384}
I20260709 13:18:26.694216 21420 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.714216 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:26.716638 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:26.721284 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.717273 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:26.717778 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.722470 18457 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.723644 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.724584 21493 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.728557 21435 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:18:26.730542 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.730931 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:26.702765 21485 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:26.733366 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.706560 21406 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:26.738415 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:26.746349 18335 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:26.740468 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.708181 21064 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:26.730185 21368 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:26.750447 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:26.714208 21518 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:26.758504 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 776) took 1212 ms. Trace:
I20260709 13:18:26.760110 19054 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:26.752560 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.721799 21487 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:26.762295 18458 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.759034 19061 rpcz_store.cc:276] 0709 13:18:25.546686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.546899 (+   213us) service_pool.cc:224] Handling call
0709 13:18:25.547207 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.547407 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:25.591662 (+ 44255us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.482213 (+890551us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b180029e480. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c23a 00007f409eee6a2a
0709 13:18:26.733105 (+250892us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.758039 (+ 24934us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.758107 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:26.758171 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.758282 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.758436 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24642,"prepare.queue_time_us":82322,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":80,"raft.queue_time_us":92,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":227123840,"thread_start_us":286789,"threads_started":3,"wal-append.queue_time_us":901723}
I20260709 13:18:26.732650 21431 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:26.767088 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:26.696556 21470 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.757434 21485 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.771943 21485 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.763839 21517 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:26.743667 21407 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:26.773720 21517 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:26.755381 21420 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:26.774199 21407 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:26.776659 21407 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:26.779028 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.779951 19061 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:26.782833 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.786307 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.758577 21435 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:26.789243 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.766496 21368 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.759256 21064 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:26.784873 21475 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:18:26.795806 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:26.766112 21362 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:26.778185 21487 raft_consensus.cc:697] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:26.774196 21517 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.793242 21525 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:18:26.777453 21518 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.781317 21524 consensus_queue.cc:1059] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:18:26.795205 21364 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:26.794304 20949 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.784679 21458 consensus_queue.cc:1059] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:18:26.834486 20681 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.835654 18343 raft_consensus.cc:1275] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:26.842374 18485 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
W20260709 13:18:26.848232 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 86011.6us
I20260709 13:18:26.853255 18485 pending_rounds.cc:85] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 8
I20260709 13:18:26.853547 18485 pending_rounds.cc:107] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:18:26.853832 18485 raft_consensus.cc:2889] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:26.854804 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:26.855325 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:26.855989 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.856263 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.856952 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:26.857170 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.858397 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:26.858968 18484 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.793818 21443 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.860404 21444 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:26.894336 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 772) took 1378 ms. Trace:
I20260709 13:18:26.894769 19059 rpcz_store.cc:276] 0709 13:18:25.515806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.516030 (+   224us) service_pool.cc:224] Handling call
0709 13:18:25.516312 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.921244 (+404932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.894084 (+972840us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54006f77d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:26.894278 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929829248}
I20260709 13:18:26.896083 19055 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:26.828030 21362 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:26.808944 21406 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.897042 21444 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.916015 21444 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.927832 21536 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.923031 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:26.938719 21520 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:18:26.940415 21435 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.941000 21435 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.942126 19053 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:26.942358 20681 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.943269 21435 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.944487 20681 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:18:26.947144 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.947472 21443 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:26.945992 21362 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:26.944057 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:26.950335 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:26.948616 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:26.951175 18418 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.951658 21493 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:26.945055 21536 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.956290 18411 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:26.956580 21417 consensus_meta.cc:287] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.000s
I20260709 13:18:26.957048 21417 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8.
I20260709 13:18:26.961548 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:26.962178 18416 raft_consensus.cc:2376] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6. Re-sending same reply.
I20260709 13:18:26.959107 21444 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:26.993703 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.995105 18411 raft_consensus.cc:2410] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:26.975370 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:26.971282 18457 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:26.973894 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:27.009536 18338 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:26.987876 18418 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:27.001173 18484 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:26.996292 18410 raft_consensus.cc:2393] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:26.916615 21487 consensus_queue.cc:237] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.023142 21432 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:18:26.960259 21511 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:27.012006 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:27.017714 19058 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:27.029196 18343 raft_consensus.cc:3055] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:26.996764 21536 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.965250 19056 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:26.964702 19057 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
W20260709 13:18:26.965071 21521 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.471s	user 0.000s	sys 0.003s
I20260709 13:18:26.972146 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:26.993543 21474 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.915808 21393 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:18:26.996392 18341 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:27.029776 18343 raft_consensus.cc:740] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:27.062611 21393 consensus_queue.cc:1243] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:27.063153 21393 raft_consensus.cc:3055] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:27.063506 21393 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:27.063242 18343 consensus_queue.cc:260] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.011705 21430 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.966701 21478 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:27.051337 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:27.052166 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.052448 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:27.017158 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 45943.3us
I20260709 13:18:27.026266 21538 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:27.068363 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.032612 21064 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:27.029129 21432 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:18:27.076232 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.082002 18307 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.077232 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:27.077785 18340 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:27.066913 21434 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:27.084942 20681 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:27.086102 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.091259 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.066025 21474 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.077844 21536 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:27.079425 21546 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:27.076082 21550 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:27.080147 21538 raft_consensus.cc:697] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:27.066833 21430 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.087145 21362 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:27.081171 21421 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.098011 21221 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:27.184156 21221 raft_consensus.cc:697] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:27.185037 21221 consensus_queue.cc:237] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.124894 21365 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.189198 21365 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:27.191084 21461 raft_consensus.cc:3055] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:27.191608 21461 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:27.191929 21365 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:27.125197 21516 consensus_queue.cc:1059] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:18:27.192653 21461 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.194060 21516 raft_consensus.cc:3055] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:27.194530 21516 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:27.195653 21516 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.196844 21143 raft_consensus.cc:3055] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:27.197403 21143 raft_consensus.cc:740] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:27.135335 21474 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:27.097694 21434 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.136680 18416 raft_consensus.cc:2410] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:27.138394 21517 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.076313 21393 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.144279 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:27.150576 21506 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.149219 21406 raft_consensus.cc:2955] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:18:27.178722 21548 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:18:27.182919 21547 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:18:27.183256 21421 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:27.105780 21546 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.124646 20681 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:27.202953 18410 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:27.223222 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:27.240944 18337 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:27.224866 19060 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:27.232779 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.233455 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:27.198379 21444 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:27.136673 21430 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:27.242617 18490 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.200049 21549 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:27.232825 21365 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:27.251708 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.235343 21461 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:27.238783 21393 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.260686 18341 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:27.254511 19060 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:27.263446 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:27.263648 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:27.255371 21365 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:27.264906 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:27.267258 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 176089us
I20260709 13:18:27.198453 21143 consensus_queue.cc:260] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.268013 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:27.268061 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.269506 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.271303 21549 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:27.272387 21554 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:18:27.273379 20681 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.270712 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.274724 21549 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:27.276067 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:27.276679 19053 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:27.199940 21538 consensus_queue.cc:237] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:27.280284 18458 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:18:27.280823 21513 log.cc:927] Time spent T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.683s	user 0.003s	sys 0.000s
I20260709 13:18:27.281098 21435 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:27.281533 21435 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:27.281884 21435 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.282292 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 641) took 1070 ms. Trace:
I20260709 13:18:27.282793 18337 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:18:27.282658 18489 rpcz_store.cc:276] 0709 13:18:26.211791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.214068 (+  2277us) service_pool.cc:224] Handling call
0709 13:18:26.214388 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:26.214641 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.214657 (+    16us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:26.218469 (+  3812us) log.cc:844] Serialized 52 byte log entry
0709 13:18:26.446222 (+227753us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:26.446279 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.446371 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.280274 (+833903us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:27.281989 (+  1715us) raft_consensus.cc:1685] finished
0709 13:18:27.282009 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.282220 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":8756,"spinlock_wait_cycles":59660160,"thread_start_us":186371,"threads_started":1,"wal-append.queue_time_us":249976}
I20260709 13:18:27.284597 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:27.284806 18337 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:27.285877 21434 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:27.286258 18337 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.287354 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:27.282183 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:27.277627 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:27.269657 19060 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:27.292559 18490 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:27.293704 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:27.298208 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:27.246650 21506 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.303768 21449 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:27.293130 21549 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.318228 21549 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.318562 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:27.319262 18414 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:27.320293 21549 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:27.294507 21418 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.262626 21487 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:18:27.317642 21421 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:27.300349 21493 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:27.306149 21368 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:27.324411 19060 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:27.344110 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:27.344931 19060 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:27.345871 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:27.315229 21449 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:27.330860 21556 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:27.330035 21434 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.349668 19060 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:18:27.352434 21434 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.352829 21449 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.353493 19060 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:27.350526 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:27.330786 21546 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:27.362370 21365 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:27.363036 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:27.364029 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:27.348852 18309 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:27.325600 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:27.351147 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:27.365440 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.356179 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:27.366401 18489 raft_consensus.cc:2393] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:27.360991 21517 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:27.367939 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:27.368942 18414 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:27.354555 21434 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:26.357367 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:27.331881 21418 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:27.355340 19060 raft_consensus.cc:2955] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:27.385463 19053 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:27.386503 18337 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:27.390456 19053 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:27.391867 19053 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:27.396164 21557 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:27.396620 21557 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.396982 21557 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:27.404036 21523 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.888s	user 0.005s	sys 0.000s
I20260709 13:18:27.391855 21418 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:27.366498 21368 consensus_queue.cc:1059] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:18:27.418273 21299 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:27.421829 18486 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:27.438930 18489 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:27.425578 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:27.443226 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:27.410174 21506 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:27.454128 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.452605 21557 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.458130 18493 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:27.458473 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 158787us
I20260709 13:18:27.460781 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:27.462632 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.463670 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:27.444485 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:27.466450 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:27.473013 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.465484 21506 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:18:27.468358 21421 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:27.471854 21393 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.472322 21047 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:27.491359 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:27.476573 21064 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:27.468148 21492 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:18:27.478888 21549 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:27.498883 20681 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:27.498113 21064 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.513355 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:27.513710 18337 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:27.514744 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:27.515517 18490 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:27.509465 21267 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:27.516389 21064 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:27.500520 21393 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.535326 21557 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:27.537451 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 73894.9us
I20260709 13:18:27.500780 21047 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.536382 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:27.538861 19060 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:27.539211 21515 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 1.047s	user 0.005s	sys 0.000s
I20260709 13:18:27.540439 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 656) took 1177 ms. Trace:
I20260709 13:18:27.540804 18491 rpcz_store.cc:276] 0709 13:18:26.363351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.363465 (+   114us) service_pool.cc:224] Handling call
0709 13:18:26.377857 (+ 14392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.382649 (+  4792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.382682 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:26.385453 (+  2771us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.470468 (+ 85015us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:26.470528 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.470623 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.538683 (+1068060us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:27.540174 (+  1491us) raft_consensus.cc:1685] finished
0709 13:18:27.540194 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.540381 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4546,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":7392,"spinlock_wait_cycles":214390016,"thread_start_us":84715,"threads_started":1,"wal-append.queue_time_us":106361}
I20260709 13:18:27.543602 18458 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:27.544796 21299 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:27.545313 21299 raft_consensus.cc:697] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:27.545897 21443 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:27.546173 21299 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.546482 21443 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.549279 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:27.550343 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.551005 20969 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:27.551594 18491 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:27.551982 21078 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:27.552925 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:27.553879 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 975) took 1155 ms. Trace:
I20260709 13:18:27.554263 19056 rpcz_store.cc:276] 0709 13:18:26.398680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.398807 (+   127us) service_pool.cc:224] Handling call
0709 13:18:26.420169 (+ 21362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.047252 (+627083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.553665 (+506413us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54005582d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:27.553826 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253089536}
I20260709 13:18:27.555310 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:27.555787 18382 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:27.556371 18417 raft_consensus.cc:1240] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:27.556703 21385 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:27.556922 18382 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:27.559405 21457 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:27.559787 21457 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.560194 21457 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.560678 21418 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:27.562736 20969 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:27.568110 19060 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:27.554759 19059 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:27.557142 21385 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.575595 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:27.577311 18308 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.591434 18491 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:27.508047 21549 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:27.600675 18339 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:18:27.549271 21443 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:27.575394 18309 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:27.592346 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:27.555861 18335 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:27.604184 18382 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.608799 19061 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:27.609308 18382 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.605110 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.612490 18308 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:27.615890 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:27.616564 18458 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:27.601202 21385 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:27.585016 21430 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:27.604645 21378 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:27.628574 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:27.629480 18415 raft_consensus.cc:2410] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:27.613286 21418 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:27.613721 20681 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:27.538363 21435 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.599081 20969 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:18:27.600626 21557 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:18:27.611457 21388 consensus_queue.cc:1059] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:18:27.617800 21421 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:27.620316 21299 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.611194 21420 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:18:27.643836 19055 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 972) took 1254 ms (client timeout 1648 ms). Trace:
W20260709 13:18:27.652587 19055 rpcz_store.cc:269] 0709 13:18:26.388991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.389130 (+   139us) service_pool.cc:224] Handling call
0709 13:18:27.643561 (+1254431us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b5400558054. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:27.643747 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1091427584}
I20260709 13:18:27.645645 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 794) took 1092 ms. Trace:
I20260709 13:18:27.650993 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 1967) took 1252 ms. Trace:
I20260709 13:18:27.657538 18492 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:27.655608 19058 rpcz_store.cc:276] 0709 13:18:26.555486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.952909 (+397423us) service_pool.cc:224] Handling call
0709 13:18:26.953175 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.029528 (+ 76353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.645365 (+615837us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b54006f90d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:27.645575 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147930880}
I20260709 13:18:27.655822 18419 rpcz_store.cc:276] 0709 13:18:26.399082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.399430 (+   348us) service_pool.cc:224] Handling call
0709 13:18:27.647818 (+1248388us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001784d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:27.650915 (+  3097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334938880}
W20260709 13:18:27.660288 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 48025.4us
I20260709 13:18:27.664765 18308 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.671828 18308 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:27.681365 19058 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.650684 21378 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:27.642661 21569 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:27.684803 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:27.708427 18418 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:27.643128 20681 raft_consensus.cc:697] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:27.698802 18419 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
W20260709 13:18:27.698078 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 84619.8us
I20260709 13:18:27.709118 18419 pending_rounds.cc:85] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 8
I20260709 13:18:27.709424 18419 pending_rounds.cc:107] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 13:18:27.709661 18419 raft_consensus.cc:2889] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:27.710199 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:27.713304 18490 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:27.670460 21418 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:27.698352 21568 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:27.682299 21430 raft_consensus.cc:697] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:27.727676 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:27.734849 19058 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:27.715991 21536 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:27.680935 21285 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:18:27.715462 21378 raft_consensus.cc:697] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:27.750204 18418 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:18:27.725263 21565 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:27.755863 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:27.740929 21536 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.755072 21568 consensus_queue.cc:1059] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
W20260709 13:18:27.765470 18342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 1866) took 2132 ms (client timeout 1885 ms). Trace:
I20260709 13:18:27.765718 18336 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:18:27.785722 18342 rpcz_store.cc:269] 0709 13:18:25.633067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.771853 (+138786us) service_pool.cc:224] Handling call
0709 13:18:27.765182 (+1993329us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b540028e6d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:27.765361 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223912832}
I20260709 13:18:27.794464 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:27.797636 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:27.801728 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 91653.8us
W20260709 13:18:27.811834 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.759268 21047 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:27.823091 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:27.764629 21536 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:27.774750 21529 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.219s	user 0.005s	sys 0.000s
I20260709 13:18:27.783067 21393 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:27.770085 21234 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:27.782363 21435 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:27.767633 21478 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:27.841593 18490 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:27.781628 21570 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:18:27.765288 21576 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:18:27.842702 21443 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.855397 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:27.843582 21583 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:27.796037 21549 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:27.844818 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:27.867806 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 192300us
I20260709 13:18:27.792449 21457 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.773773 21064 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:27.847836 19026 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:27.869105 18308 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:27.871419 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:27.875967 18413 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:27.850155 21593 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:27.851522 21519 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 1.241s	user 0.000s	sys 0.004s
I20260709 13:18:27.854297 18490 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:27.836310 21234 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.762198 21565 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.855656 21435 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.865823 18419 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:18:27.847334 21575 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:18:27.900382 18414 raft_consensus.cc:2393] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 5: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:27.846135 21478 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:27.869235 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 132390us
I20260709 13:18:27.773964 20681 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.869076 21583 consensus_queue.cc:1243] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:27.878649 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:27.868296 18384 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:27.873903 19026 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:27.891714 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 1990) took 1358 ms. Trace:
I20260709 13:18:27.879218 21582 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:27.778201 21430 consensus_queue.cc:237] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.878091 21434 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:27.905061 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:27.923417 18490 raft_consensus.cc:2393] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:27.911549 18412 rpcz_store.cc:276] 0709 13:18:26.533750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.533875 (+   125us) service_pool.cc:224] Handling call
0709 13:18:26.534240 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.534599 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.534633 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:26.535114 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.555862 (+ 20748us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:26.555907 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.555979 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.774174 (+1218195us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:27.878328 (+104154us) raft_consensus.cc:1685] finished
0709 13:18:27.878354 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.891603 (+ 13249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":72021248,"thread_start_us":20118,"threads_started":1,"wal-append.queue_time_us":19717}
W20260709 13:18:27.912106 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 43885.6us
I20260709 13:18:27.831503 21378 consensus_queue.cc:237] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:27.901934 21461 consensus_meta.cc:287] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
I20260709 13:18:27.916318 20303 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:27.895731 21234 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.878324 21419 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:27.946518 21474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.011s	sys 0.017s
I20260709 13:18:27.949216 21143 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:27.950289 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:28.012372 18490 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:27.918881 21393 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:27.894212 21225 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:18:27.894124 21446 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:18:27.866775 21443 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:28.011901 21474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.011s	sys 0.017s
I20260709 13:18:28.017134 21586 raft_consensus.cc:3055] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:28.019059 21549 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.892835 21593 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:27.904901 21435 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:27.974349 21449 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.942314 21047 consensus_queue.cc:1059] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:18:28.043047 18490 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:28.014024 21538 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:28.044238 21406 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:28.033160 21586 raft_consensus.cc:740] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:28.016245 21393 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.013408 21579 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.013048 21590 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:28.031301 21418 raft_consensus.cc:697] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:28.141819 20303 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.084396 21474 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:28.142536 20303 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:28.080539 21549 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:28.140347 21393 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:28.229730 21418 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:28.233328 21588 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:18:28.090368 21449 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:28.242758 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:28.243494 18342 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:28.048275 21234 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:28.101819 21406 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:28.097745 21538 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:28.145655 21579 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:28.215962 21474 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:28.285185 20303 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:28.661849 18307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.032s	sys 0.101s
W20260709 13:18:29.099694 18307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.032s	sys 0.140s
W20260709 13:18:29.101190 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.768260 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:29.102586 18490 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
W20260709 13:18:28.964758 18342 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.010s	sys 0.025s
W20260709 13:18:29.103528 18342 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.013s	sys 0.027s
I20260709 13:18:29.103622 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:29.104254 18490 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
W20260709 13:18:28.680135 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.549264 18489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.000s	sys 0.013s
W20260709 13:18:29.111680 18489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.231s	user 0.000s	sys 0.027s
I20260709 13:18:28.644315 18343 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:29.101612 18416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 1992) took 2129 ms (client timeout 2685 ms). Trace:
I20260709 13:18:29.107911 20303 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:29.122884 20303 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.100149 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:28.455704 21597 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:18:29.109984 21012 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:18:29.110786 19025 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.558s (SENT) [suppressed 10 similar messages]
I20260709 13:18:28.307133 21586 consensus_queue.cc:260] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:29.101630 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.233606 21532 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 1.651s	user 0.010s	sys 0.021s
I20260709 13:18:28.628826 21580 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.233556 21407 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:28.279385 21299 consensus_meta.cc:287] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.624s	user 0.014s	sys 0.005s
I20260709 13:18:29.226604 21299 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:29.115777 21593 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:29.137523 20303 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:28.748271 21385 consensus_meta.cc:287] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.112s	user 0.008s	sys 0.005s
I20260709 13:18:29.237890 21385 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:28.240949 21598 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:28.757880 21478 consensus_meta.cc:287] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.844s	user 0.008s	sys 0.000s
I20260709 13:18:29.239732 21478 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.239645 21598 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:28.976100 21393 consensus_meta.cc:287] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.001s
W20260709 13:18:28.456336 21595 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:18:28.277781 21461 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.156313 18309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.011s	sys 0.014s
W20260709 13:18:29.289094 18309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.011s	sys 0.014s
I20260709 13:18:28.241374 21064 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:28.905495 21536 consensus_meta.cc:287] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.071s	user 0.006s	sys 0.006s
W20260709 13:18:28.549513 21194 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.039s	user 0.003s	sys 0.014s
I20260709 13:18:28.513554 21569 raft_consensus.cc:3055] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:28.496804 21549 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:28.662926 21435 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:29.114645 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 624) took 1938 ms. Trace:
I20260709 13:18:29.158747 18485 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:18:28.338416 21565 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:28.614071 21443 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:29.332940 21194 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.823s	user 0.010s	sys 0.022s
I20260709 13:18:28.503743 21225 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:28.644755 21599 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.112452 21470 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.122582 18416 rpcz_store.cc:269] 0709 13:18:26.971768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.971913 (+   145us) service_pool.cc:224] Handling call
0709 13:18:29.100880 (+2128967us) spinlock_profiling.cc:243] Waited 89.1 ms on lock 0x7b54003624d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:29.101522 (+   642us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204954496}
I20260709 13:18:29.233521 20303 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:29.227636 21474 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:29.377869 20303 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:29.356374 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 255716us
I20260709 13:18:29.227144 21407 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.356001 18341 rpcz_store.cc:276] 0709 13:18:27.176005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.177655 (+  1650us) service_pool.cc:224] Handling call
0709 13:18:27.178044 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.261268 (+ 83224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.114376 (+1853108us) spinlock_profiling.cc:243] Waited 82.3 ms on lock 0x7b5400235ad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:29.114571 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189390592}
I20260709 13:18:28.335009 21434 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.382835 21434 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.288414 21461 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.387842 21461 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:29.332041 21569 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:29.349359 21478 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:29.169642 21012 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.390913 18490 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:18:29.369949 21378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.016s	sys 0.035s
I20260709 13:18:29.321885 21449 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:29.354591 21362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.075s	user 0.011s	sys 0.049s
I20260709 13:18:29.389448 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2105) took 1548 ms. Trace:
I20260709 13:18:29.354061 21567 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.361387 21549 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:29.269354 21393 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:29.389369 21225 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.404403 21474 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:29.403949 21470 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.391079 21434 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:29.413231 20303 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:29.420878 18491 rpcz_store.cc:276] 0709 13:18:27.841027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.841136 (+   109us) service_pool.cc:224] Handling call
0709 13:18:27.841606 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.841948 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.841972 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.842894 (+   922us) log.cc:844] Serialized 556 byte log entry
0709 13:18:27.914583 (+ 71689us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:27.914619 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.914693 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.389225 (+1474532us) raft_consensus.cc:1685] finished
0709 13:18:29.389244 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.389385 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":71393,"threads_started":1,"wal-append.queue_time_us":240894}
I20260709 13:18:29.347262 21536 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:29.427923 18343 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
W20260709 13:18:29.433053 18337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2082) took 2021 ms (client timeout 1768 ms). Trace:
I20260709 13:18:29.434695 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1882) took 2384 ms. Trace:
W20260709 13:18:29.435500 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.438418 18338 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:29.448762 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 615) took 2889 ms. Trace:
W20260709 13:18:29.412132 21378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.017s	sys 0.035s
W20260709 13:18:29.421543 21362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.142s	user 0.011s	sys 0.049s
I20260709 13:18:29.405570 21407 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:29.482517 18337 rpcz_store.cc:269] 0709 13:18:27.411539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.411657 (+   118us) service_pool.cc:224] Handling call
0709 13:18:29.432796 (+2021139us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b540018bad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:29.432955 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119896960}
I20260709 13:18:29.483278 18336 rpcz_store.cc:276] 0709 13:18:27.050584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.054090 (+  3506us) service_pool.cc:224] Handling call
0709 13:18:27.765370 (+711280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.786399 (+ 21029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.434418 (+1648019us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540028e6d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:29.434603 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1634953600}
I20260709 13:18:29.449472 21478 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.498430 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2104) took 1657 ms. Trace:
W20260709 13:18:29.498970 18310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.034s	sys 0.072s
I20260709 13:18:29.421330 21418 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.501309 18343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2077) took 2508 ms (client timeout 1610 ms). Trace:
I20260709 13:18:29.485417 18344 rpcz_store.cc:276] 0709 13:18:26.558886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.559026 (+   140us) service_pool.cc:224] Handling call
0709 13:18:26.559342 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:26.559702 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.559732 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:26.560364 (+   632us) log.cc:844] Serialized 52 byte log entry
0709 13:18:26.581670 (+ 21306us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:26.765108 (+183438us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.769331 (+  4223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.769410 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.233047 (+1463637us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:29.422377 (+1189330us) raft_consensus.cc:1685] finished
0709 13:18:29.448486 (+ 26109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.448693 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":252332,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":5354,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186,"spinlock_wait_cycles":159001984,"thread_start_us":203914,"threads_started":2,"wal-append.queue_time_us":22135}
I20260709 13:18:29.451490 21461 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:29.504514 18310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.034s	sys 0.072s
W20260709 13:18:29.502861 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 392056us
I20260709 13:18:29.401170 21599 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:29.168226 21605 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.325s
I20260709 13:18:29.510835 18416 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:18:29.451092 21443 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:29.490041 21619 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.577780 19058 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:29.450995 21598 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:29.585968 19059 raft_consensus.cc:1240] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:29.232184 21580 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:29.531037 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.579850 18412 raft_consensus.cc:3055] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:29.579829 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:29.580538 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:29.587992 18412 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:29.503963 18489 rpcz_store.cc:276] 0709 13:18:27.840743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.842534 (+  1791us) service_pool.cc:224] Handling call
0709 13:18:27.858832 (+ 16298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.859062 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:27.880822 (+ 21760us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.498062 (+1617240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:29.498109 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:29.498195 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.498258 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.498376 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61102,"prepare.queue_time_us":33329,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":239541,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":1195,"thread_start_us":1616789,"threads_started":2,"wal-append.queue_time_us":1606378}
W20260709 13:18:29.504304 18343 rpcz_store.cc:269] 0709 13:18:26.973856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.974010 (+   154us) service_pool.cc:224] Handling call
0709 13:18:28.644036 (+1670026us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5800931ad0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee380aa 00007f409eeba447 00007f409eed2fe7 00007f409eed47de 00007f409eee027c 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c
0709 13:18:29.482283 (+838247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2686894464}
I20260709 13:18:29.492168 21449 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.584323 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:29.634793 20303 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.502034 21613 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.641882 18491 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:29.582764 21565 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.454036 21549 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.645823 20303 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.644948 18490 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:18:29.454221 21567 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.588268 21616 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:29.628170 21406 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:29.575387 21418 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:29.650292 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:29.578574 21362 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:29.588323 21532 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:18:29.651254 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:29.513303 21434 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.585696 21607 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.658291 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 158383us
I20260709 13:18:29.581984 21267 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:29.581676 21602 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:29.764380 18344 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:29.479331 21474 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.635495 18412 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.767429 18412 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:29.588923 21619 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.588225 21461 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.511936 21478 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.637285 21407 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.633411 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 45692.3us
I20260709 13:18:29.775182 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:29.643014 21568 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.752760 18489 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:29.757941 21194 raft_consensus.cc:3055] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:29.649850 20681 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.756814 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:29.783032 18341 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:29.683452 21604 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.518s	user 0.001s	sys 0.006s
I20260709 13:18:29.761061 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:29.755585 21596 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.801578 18419 raft_consensus.cc:2410] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:29.758872 21617 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:29.802217 18411 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:29.763259 20303 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:29.804311 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:29.805084 18413 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:29.764281 18343 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:29.764789 18488 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:29.793670 21421 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:29.585695 21443 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:29.766834 18492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 664) took 2475 ms (client timeout 1980 ms). Trace:
W20260709 13:18:29.808947 18492 rpcz_store.cc:269] 0709 13:18:27.286927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.287114 (+   187us) service_pool.cc:224] Handling call
0709 13:18:29.761958 (+2474844us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b5400374bd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:29.762100 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849339136}
I20260709 13:18:29.770421 21626 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.752274 21565 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:29.771267 21611 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.398s	user 0.001s	sys 0.000s
I20260709 13:18:29.771492 21619 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:29.748835 21598 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.642797 21378 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:29.775779 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:29.775774 18487 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:29.506996 21569 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.750720 21614 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.693403 21606 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:29.758209 21412 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.768250 18337 pending_rounds.cc:85] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 1
I20260709 13:18:29.777477 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:29.755483 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:29.691890 21579 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:29.766642 21267 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.768232 21602 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:29.791640 21012 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:29.792649 21225 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:29.689458 21449 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.758033 21362 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.793936 21583 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:29.692821 21613 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:29.794368 21615 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:18:29.795104 21603 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 13:18:29.796885 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 582) took 2182 ms. Trace:
I20260709 13:18:29.805045 20303 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.650620 21538 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:29.807404 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:29.812227 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:29.777593 21629 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:18:29.782725 21194 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:29.763933 21607 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.782419 21407 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:29.761981 21434 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.782207 21047 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:29.931624 18341 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:29.826607 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:29.763015 21616 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.797628 21568 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.810184 21596 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:29.804136 20681 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.130748 21457 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.160437 18414 rpcz_store.cc:276] 0709 13:18:27.614871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.615539 (+   668us) service_pool.cc:224] Handling call
0709 13:18:29.796703 (+2181164us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540011c6d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:29.796832 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651838336}
I20260709 13:18:30.161782 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.162474 18414 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:30.166560 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 581) took 2551 ms. Trace:
I20260709 13:18:30.166971 18417 rpcz_store.cc:276] 0709 13:18:27.614613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.621120 (+  6507us) service_pool.cc:224] Handling call
0709 13:18:29.101043 (+1479923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.165030 (+ 63987us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:29.165066 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.226611 (+ 61545us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.401516 (+174905us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:29.401565 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.401650 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.796254 (+394604us) raft_consensus.cc:1685] finished
0709 13:18:29.796271 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.166315 (+370044us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54003624d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:30.166480 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57749,"raft.queue_time_us":61860,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":63416,"spinlock_wait_cycles":3371177344,"thread_start_us":174479,"threads_started":1,"wal-append.queue_time_us":348328}
I20260709 13:18:30.169258 21362 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:26.199785 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet 21b9264b0a434b79b6292c2ed23bbae0 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:18:30.170215 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:30.132122 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.172617 21613 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:29.867056 18336 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:29.823185 21631 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.201872 21631 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.202741 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.203347 18490 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:30.204030 21631 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:29.820240 21443 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:30.204289 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:30.204664 21550 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:30.205541 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.207289 21613 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:30.208030 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2073) took 3980 ms. Trace:
I20260709 13:18:30.207960 21613 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.208498 18488 rpcz_store.cc:276] 0709 13:18:26.227967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.232151 (+  4184us) service_pool.cc:224] Handling call
0709 13:18:27.309984 (+1077833us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b5800143198. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:18:29.762467 (+2452483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.808012 (+ 45545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.207842 (+399830us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b5400374bd0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:30.207972 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5655707392}
I20260709 13:18:30.210435 21605 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.211021 21454 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.210903 21605 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.211567 21454 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.213044 21605 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.213572 21443 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:30.173318 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:30.205384 21586 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:30.214078 21443 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.215109 21613 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:30.173774 18227 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 3.97377e+06us
I20260709 13:18:30.174232 21225 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:30.217072 21225 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.217609 21225 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.174780 21583 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:30.219914 21583 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.221341 21583 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:30.221558 21569 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.222100 21454 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:30.223773 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 80733.5us
I20260709 13:18:29.932945 18491 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:30.209700 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:29.936121 18337 pending_rounds.cc:107] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:18:30.225549 18488 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:30.226054 18337 raft_consensus.cc:2889] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.175854 18492 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:30.170107 21012 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:18:30.226899 21012 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:30.227259 21012 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:30.227909 21443 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:30.113619 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 204222us
I20260709 13:18:30.227998 21012 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.229208 21012 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:30.230557 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.231083 18492 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:30.232698 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:30.233130 21591 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.234441 18492 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:18:30.234931 21506 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:30.235378 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.235467 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.236035 18489 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:30.247509 18307 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:30.182423 21047 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:30.182686 21516 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.825141 21418 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:30.248538 21639 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:29.808670 21421 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:30.248796 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:30.249029 21639 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:30.250293 21639 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.249692 21421 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.251017 21421 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:30.038640 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1888) took 2540 ms. Trace:
I20260709 13:18:30.286459 18338 rpcz_store.cc:276] 0709 13:18:27.498566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.498714 (+   148us) service_pool.cc:224] Handling call
0709 13:18:29.437892 (+1939178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.484993 (+ 47101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.038425 (+553432us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b540018bad0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:30.038577 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4459008768}
I20260709 13:18:30.287647 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.188550 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2083) took 2683 ms. Trace:
I20260709 13:18:30.189980 21434 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:30.191089 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2103) took 2350 ms. Trace:
I20260709 13:18:30.191663 21607 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:30.298090 18385 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.003s	sys 0.015s
W20260709 13:18:30.048853 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.298503 18385 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.004s	sys 0.015s
I20260709 13:18:30.192395 20303 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.040036 21565 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.063707 21267 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.038049 21567 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.190016 21474 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.196552 21616 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.197175 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:30.308319 18487 raft_consensus.cc:2393] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:30.309172 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.286134 21596 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.198424 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:29.823444 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.267859 21639 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:30.220741 21524 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:30.225977 21631 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.236112 18492 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:30.235425 21506 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.233651 21591 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:18:30.238493 18242 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54880 (request call id 257) took 6658 ms. Trace:
W20260709 13:18:30.178607 21585 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 2.335s	user 0.021s	sys 0.011s
I20260709 13:18:30.242614 21225 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:30.137132 18485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 673) took 1633 ms (client timeout 1780 ms). Trace:
W20260709 13:18:30.316444 18485 rpcz_store.cc:269] 0709 13:18:28.503670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.099777 (+596107us) service_pool.cc:224] Handling call
0709 13:18:30.136882 (+1037105us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b54002922d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:30.137042 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78366976}
I20260709 13:18:30.316830 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 584) took 2680 ms. Trace:
I20260709 13:18:30.314343 18242 rpcz_store.cc:276] 0709 13:18:23.579865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.580098 (+   233us) service_pool.cc:224] Handling call
0709 13:18:23.908043 (+327945us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54000497d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee46090 00007f409eee4f3a 00007f40a4c9b1cc 00007f40a4d9937e 00007f40a325a2a4 00007f40a325a232 00007f40a325a161 00007f40a325a0dc 00007f40a3259392 00007f409d21748c 00007f409d2168c6
0709 13:18:30.238419 (+6330376us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:25.214236 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:25.255449 (+ 41213us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:25.255487 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:18:25.255512 (+    25us) tablet.cc:662] Decoding operations
0709 13:18:25.257006 (+  1494us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:25.277906 (+ 20900us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:25.279153 (+  1247us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:18:25.332560 (+ 53407us) tablet.cc:701] Row locks acquired
0709 13:18:25.332592 (+    32us) write_op.cc:260] PREPARE: finished
0709 13:18:25.332808 (+   216us) write_op.cc:270] Start()
0709 13:18:25.332974 (+   166us) write_op.cc:276] Timestamp: P: 1783603105332741 usec, L: 0
0709 13:18:25.333008 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:18:25.391784 (+ 58776us) log.cc:844] Serialized 6221 byte log entry
0709 13:18:25.884400 (+492616us) op_driver.cc:464] REPLICATION: finished
0709 13:18:26.102406 (+218006us) write_op.cc:301] APPLY: starting
0709 13:18:26.102493 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:26.102795 (+   302us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:26.102926 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:26.104695 (+  1769us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:26.104954 (+   259us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:18:26.105011 (+    57us) write_op.cc:312] APPLY: finished
0709 13:18:26.105335 (+   324us) log.cc:844] Serialized 107 byte log entry
0709 13:18:26.131640 (+ 26305us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:26.143902 (+ 12262us) write_op.cc:454] Released schema lock
0709 13:18:26.146587 (+  2685us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:26.171561 (+ 24974us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:26.174784 (+  3223us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13938,"reported_tablets":34,"spinlock_wait_cycles":278231680,"child_traces":[["op",{"apply.queue_time_us":201686,"apply.run_cpu_time_us":4049,"apply.run_wall_time_us":58924,"num_ops":15,"prepare.queue_time_us":281217,"prepare.run_cpu_time_us":5870,"prepare.run_wall_time_us":216814,"replication_time_us":529636,"thread_start_us":294970,"threads_started":2}]]}
I20260709 13:18:30.243821 20681 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.245054 21362 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.246222 21605 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:29.823068 21625 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.822582 21549 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:29.816052 21587 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.973s	user 0.009s	sys 0.018s
W20260709 13:18:29.816502 21609 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:18:30.249644 21557 raft_consensus.cc:2764] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:30.252728 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.330199 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.330786 18339 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:30.331729 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:29.826313 21393 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:29.817153 21561 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 2.546s	user 0.015s	sys 0.014s
I20260709 13:18:29.821187 21580 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:30.187855 21602 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:29.814420 21385 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:30.034189 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:29.932466 18344 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:30.009625 21378 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.058555 21628 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.346629 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.347259 18337 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:30.347157 21628 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.348151 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.348712 18337 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:30.349480 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.351434 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.351730 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.352551 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:30.199304 18457 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.019s
W20260709 13:18:30.353214 18457 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.000s	sys 0.019s
I20260709 13:18:29.811386 21617 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:30.255697 21047 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:30.175249 21407 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:30.009630 21606 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:29.951273 21412 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.249787 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:30.355356 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 105634us
I20260709 13:18:30.326490 21362 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.356138 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:30.257589 21446 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.357041 21446 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:30.257849 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 58637.4us
I20260709 13:18:30.329382 21625 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:30.358300 18337 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:30.359079 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.359774 18384 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:30.360878 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 585) took 2717 ms. Trace:
I20260709 13:18:30.361058 21393 consensus_queue.cc:1059] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:30.361354 18410 rpcz_store.cc:276] 0709 13:18:27.643782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.644051 (+   269us) service_pool.cc:224] Handling call
0709 13:18:27.644476 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.662029 (+ 17553us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:27.662059 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.672242 (+ 10183us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.796755 (+124513us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:27.796804 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.796894 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.795913 (+1999019us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:30.360533 (+564620us) raft_consensus.cc:1685] finished
0709 13:18:30.360560 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.360815 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73735,"raft.queue_time_us":106548,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":10028,"spinlock_wait_cycles":9491840,"thread_start_us":72451,"threads_started":1,"wal-append.queue_time_us":130749}
I20260709 13:18:30.225565 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:30.363677 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.363844 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.364341 21506 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:29.820451 21470 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:29.824750 21478 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.364895 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.365161 21478 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:30.365554 21478 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:30.365620 18382 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:30.366041 21478 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:30.366739 21047 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:30.183575 21194 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.180701 21568 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.261901 18414 raft_consensus.cc:2393] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 5: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:29.818748 21599 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:29.818902 21461 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:30.263175 21613 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.989373 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.947250 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:29.817411 21234 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:29.812068 21612 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:18:29.930616 21590 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:30.378554 21590 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.379496 21599 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:30.379890 21599 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.380236 21599 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.380812 21590 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:29.863638 18412 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:30.247447 21449 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:30.269462 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.269269 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.382900 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.269877 21299 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:30.282521 18488 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:30.383653 21299 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:30.384209 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.384814 18488 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:30.384971 21583 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:30.385502 21583 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:30.289816 18493 rpcz_store.cc:276] 0709 13:18:27.840424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.842457 (+  2033us) service_pool.cc:224] Handling call
0709 13:18:27.845754 (+  3297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.900594 (+ 54840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.900630 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.922036 (+ 21406us) log.cc:844] Serialized 26 byte log entry
0709 13:18:28.280545 (+358509us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:28.280624 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.280726 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.190828 (+1910102us) raft_consensus.cc:1685] finished
0709 13:18:30.190857 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.191005 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63689,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":27414,"thread_start_us":319134,"threads_started":2,"wal-append.queue_time_us":1550937}
I20260709 13:18:30.385771 21596 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:30.288358 18340 rpcz_store.cc:276] 0709 13:18:27.505598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.505765 (+   167us) service_pool.cc:224] Handling call
0709 13:18:27.506994 (+  1229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.618296 (+111302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.618341 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.618400 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:27.618450 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.188342 (+2569892us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54001653d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:30.188385 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.188498 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255409536}
I20260709 13:18:30.386327 21583 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:30.288043 18240 catalog_manager.cc:5697] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 3 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.044190 21634 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.387440 21578 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 13:18:30.304149 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 130902us
I20260709 13:18:30.385608 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.387971 18240 catalog_manager.cc:5697] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 5 to 6, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 6 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.389060 18488 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
W20260709 13:18:30.303131 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.390834 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.390990 18382 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:30.391497 18412 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:30.309929 18487 raft_consensus.cc:2393] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 4: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:30.310257 20303 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:30.310851 18486 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:30.200323 21633 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:30.311281 21474 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:30.317183 18415 rpcz_store.cc:276] 0709 13:18:27.636901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.640192 (+  3291us) service_pool.cc:224] Handling call
0709 13:18:27.640640 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.707466 (+ 66826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.707601 (+   135us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.711625 (+  4024us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.826645 (+115020us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:27.826705 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.826815 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.178007 (+2351192us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:30.316561 (+138554us) raft_consensus.cc:1685] finished
0709 13:18:30.316582 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.316778 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62934,"raft.queue_time_us":95772,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5809,"spinlock_wait_cycles":6434688,"thread_start_us":134189,"threads_started":2,"wal-append.queue_time_us":117533}
I20260709 13:18:30.401439 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.402281 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.402864 18415 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:30.320393 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.321712 21636 consensus_queue.cc:1059] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:30.322549 19027 connection.cc:256] RPC call timeout handler was delayed by -1.2497558150000714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 13:18:30.322922 21591 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:30.312878 21524 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:30.323470 21645 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.325055 21639 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:30.309453 21365 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:18:30.332254 18339 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:30.425503 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:30.426191 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.318825 21605 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.309587 21418 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:18:30.343364 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 660) took 3263 ms. Trace:
I20260709 13:18:30.352681 18341 raft_consensus.cc:2393] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:29.951013 21614 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.318658 21631 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.364459 18337 raft_consensus.cc:2410] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:29.823567 21626 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.438122 21446 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:29.821624 21536 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:30.367585 21194 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.262542 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.446782 18489 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 2.
W20260709 13:18:30.353564 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 670126us
I20260709 13:18:30.353554 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:30.373576 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.373469 18307 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:30.374902 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.451838 18491 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:30.368659 21613 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:30.386852 18493 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:29.951512 21598 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.392565 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.383647 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.386984 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:30.479329 18340 raft_consensus.cc:2376] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10. Re-sending same reply.
I20260709 13:18:30.394201 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:30.394094 18240 catalog_manager.cc:5697] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.387645 21634 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.386322 21596 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.399940 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.392096 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.401243 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.403766 18485 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
W20260709 13:18:30.408573 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.410338 19058 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:30.491899 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.493271 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:30.412155 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.412644 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:30.494426 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.416599 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.411101 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:30.496196 19061 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:30.497382 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:30.418401 19060 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:30.499416 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:30.500098 19060 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 2.
I20260709 13:18:30.501053 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:30.419337 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.420651 19055 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:30.422787 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:30.426148 19057 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:30.425594 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.425845 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:30.428092 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:30.385649 21299 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:30.426688 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:30.420734 21143 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.509114 19056 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:30.429299 21365 consensus_queue.cc:1243] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:30.430291 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:30.516256 19054 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:30.431066 21641 raft_consensus.cc:3055] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:30.415732 21474 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:30.426142 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:30.434624 18384 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:30.433038 18484 rpcz_store.cc:276] 0709 13:18:27.080201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.080352 (+   151us) service_pool.cc:224] Handling call
0709 13:18:27.088614 (+  8262us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:27.100248 (+ 11634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.100279 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:27.124877 (+ 24598us) log.cc:844] Serialized 52 byte log entry
0709 13:18:27.232951 (+108074us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:27.233134 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.233231 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.807525 (+2574294us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:30.343037 (+535512us) raft_consensus.cc:1685] finished
0709 13:18:30.343057 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.343307 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":963,"raft.queue_time_us":11484,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":21068,"spinlock_wait_cycles":49800576,"thread_start_us":34873,"threads_started":1,"wal-append.queue_time_us":62352}
I20260709 13:18:30.520381 19059 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:30.421065 21385 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:30.527040 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 92485.5us
I20260709 13:18:30.527501 18415 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:30.426694 21633 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.530014 21598 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.530705 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.531525 21633 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.531817 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:30.423111 21524 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:30.490530 21536 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:30.440647 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.544540 18341 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:30.545712 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.422451 21586 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:30.467723 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.553606 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.470264 21378 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.470935 21606 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:30.471056 21628 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.471988 21625 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:30.349671 21457 raft_consensus.cc:2955] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 4 to 7, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:30.433336 21605 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:30.450351 18492 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
W20260709 13:18:30.482951 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 109544us
I20260709 13:18:30.485023 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.421137 21461 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:18:30.416323 18487 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:30.503312 18418 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.503402 19053 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:30.508460 21478 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:30.481976 18240 catalog_manager.cc:5697] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 5, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 5 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:30.506398 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.506735 18413 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:30.507735 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:30.494601 19062 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:30.498093 19061 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:30.518225 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.495571 18412 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:30.520152 18339 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:30.436031 18338 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:30.521128 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.521806 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.532361 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.537056 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.584724 18411 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:30.584985 18340 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
I20260709 13:18:30.584734 18484 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:30.546604 18341 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:30.428189 21645 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.556731 18344 raft_consensus.cc:2410] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:18:30.558677 18342 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:30.519865 21641 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:30.557775 21385 raft_consensus.cc:697] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:30.595134 18240 catalog_manager.cc:5697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.596836 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.596998 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.527467 21143 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.598438 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:30.602155 21613 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:30.552745 21536 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:30.597712 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.504058 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:30.951002 18416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.026s	sys 0.065s
I20260709 13:18:30.993511 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:30.716897 19059 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:31.019055 21449 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:31.016736 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.020182 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.021710 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.027594 19055 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:30.993256 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:31.029140 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.029734 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2092) took 1260 ms. Trace:
I20260709 13:18:31.029856 19055 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:31.030186 18344 rpcz_store.cc:276] 0709 13:18:29.775448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.775553 (+   105us) service_pool.cc:224] Handling call
0709 13:18:31.029675 (+1254122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.030762 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.031317 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:31.031457 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.016834 19027 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:31.032181 18344 raft_consensus.cc:2393] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:31.031354 19055 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:31.025739 18493 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:31.021492 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:31.022202 18489 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:18:31.024194 18484 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
W20260709 13:18:30.717733 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 137750us
I20260709 13:18:31.017016 18487 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.020798 19062 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:31.038595 18415 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:31.039445 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:31.033450 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.037732 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:31.016753 18416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.028s	sys 0.067s
W20260709 13:18:31.036958 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 43793.3us
I20260709 13:18:31.035043 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:31.038681 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.041242 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:31.041776 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:31.042049 21598 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:31.042466 21598 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.042774 21598 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.034516 21576 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.043833 21576 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.808733 21625 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.049749 19060 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:30.581005 21461 consensus_queue.cc:1243] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:31.042963 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.047086 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:31.056727 19025 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:31.057515 20303 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:31.057874 20303 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.058332 20303 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.040477 19055 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 3.
I20260709 13:18:31.059445 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:31.059612 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:31.060407 19055 raft_consensus.cc:2410] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:18:31.060453 18493 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:31.049064 18487 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:31.061798 19027 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:31.049288 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.062567 19059 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:31.050207 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:31.062919 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:31.000331 18486 consensus_meta.cc:287] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.002s
I20260709 13:18:31.063357 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.063597 18490 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 2.
I20260709 13:18:30.605250 21596 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.999059 21478 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:31.051010 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:31.027233 21616 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.088222 18344 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:31.058439 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:31.048455 18417 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:31.061106 19025 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:31.061236 18309 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:31.035013 18240 catalog_manager.cc:5697] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 5 to 7, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 7 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:30.915486 21648 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.431s	user 0.000s	sys 0.001s
I20260709 13:18:31.095057 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:30.983381 18418 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:30.717229 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:31.098658 18417 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:30.840375 21524 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.993201 21012 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.056840 21591 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:31.029400 21536 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:31.081815 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.047339 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:31.063763 18486 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:31.108908 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:31.086318 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:30.761359 21470 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.290s
I20260709 13:18:30.564005 21586 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:30.603955 21474 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:31.099452 21641 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:31.152312 21641 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.153103 18384 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:31.153228 21586 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:30.606010 21631 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:31.154959 21626 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:31.154485 18485 raft_consensus.cc:2955] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:31.157032 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:30.837006 21421 consensus_meta.cc:287] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.545s	user 0.004s	sys 0.001s
W20260709 13:18:30.818001 21621 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:18:31.091003 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.160115 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:31.161353 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:31.162352 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.163534 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.164129 19059 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:31.163915 21598 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:31.165439 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.165692 18382 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:31.166103 19057 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:31.165740 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.167968 19059 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:31.169193 18309 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:31.064085 21516 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:18:31.056941 21613 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:31.063848 18342 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:31.118032 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:31.083643 21639 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:31.115192 21576 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:31.119333 18415 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:31.175855 21285 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:18:31.181517 21285 consensus_queue.cc:1243] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:31.184255 21064 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.184792 21064 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:31.185585 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.186864 21624 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:31.187314 21624 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.187675 21624 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.190032 21410 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:31.190528 21410 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.190663 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:31.190992 21410 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:31.191516 18413 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:31.193586 21617 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:31.193813 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:31.195640 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:31.196394 18484 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:31.109413 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:31.119604 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 72343.8us
I20260709 13:18:31.081861 21644 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:31.096148 18240 catalog_manager.cc:5697] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 4 to 6, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3), now has a pending config: VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1), VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2), VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3), VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 6 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:31.064263 21449 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:31.128363 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:31.094871 21616 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:31.116101 21012 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:31.135154 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.120299 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:31.126502 20303 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:31.089284 21443 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.100646 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:31.098999 21047 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.064020 19062 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:31.165599 21478 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:31.095240 21606 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:31.161755 21605 consensus_meta.cc:287] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.000s
I20260709 13:18:31.117573 21591 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.085909 19027 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:31.178419 18486 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:31.083300 21625 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:31.166649 21385 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:31.197343 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:31.567088 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:31.597312 18344 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:31.598069 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2109) took 1064 ms. Trace:
I20260709 13:18:31.598270 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 686) took 1083 ms. Trace:
I20260709 13:18:31.598847 18486 rpcz_store.cc:276] 0709 13:18:30.515165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.117787 (+602622us) service_pool.cc:224] Handling call
0709 13:18:31.598201 (+480414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.518708 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:31.601260 18491 raft_consensus.cc:2410] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:31.293689 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2119) took 1118 ms. Trace:
I20260709 13:18:31.517930 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:31.603796 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.403784 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2099) took 1019 ms. Trace:
I20260709 13:18:31.607009 18341 rpcz_store.cc:276] 0709 13:18:30.384280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.402661 (+1018381us) service_pool.cc:224] Handling call
0709 13:18:31.403074 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.403323 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.403366 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.403427 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:31.403486 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.403562 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.403706 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.229348 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:31.561144 18309 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:31.609679 18340 raft_consensus.cc:2393] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:18:31.594806 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 508944us
I20260709 13:18:31.224875 18413 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:31.608994 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 1900) took 1006 ms. Trace:
W20260709 13:18:31.174901 21599 consensus_meta.cc:287] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.794s	user 0.012s	sys 0.000s
I20260709 13:18:31.567866 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:31.604621 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:31.598551 18344 rpcz_store.cc:276] 0709 13:18:30.533483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.127992 (+594509us) service_pool.cc:224] Handling call
0709 13:18:31.597987 (+469995us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.172185 21225 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:31.622701 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.660462 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2002) took 1099 ms. Trace:
I20260709 13:18:31.615664 18240 catalog_manager.cc:5697] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.663192 18337 rpcz_store.cc:276] 0709 13:18:30.602989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.089359 (+486370us) service_pool.cc:224] Handling call
0709 13:18:31.608930 (+519571us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.661762 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:31.662801 18487 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:31.174129 21613 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:31.662248 19027 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:31.174487 21421 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:31.697685 18412 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:18:31.666266 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 681) took 1152 ms. Trace:
I20260709 13:18:31.698760 18492 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
W20260709 13:18:31.608862 21651 log.cc:927] Time spent T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:18:31.622356 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 688) took 1106 ms. Trace:
I20260709 13:18:31.636454 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 680) took 1122 ms. Trace:
I20260709 13:18:31.661186 18413 rpcz_store.cc:276] 0709 13:18:30.561028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.192243 (+631215us) service_pool.cc:224] Handling call
0709 13:18:31.192500 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.660164 (+467664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.660394 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.682284 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 1895) took 1112 ms. Trace:
I20260709 13:18:31.667572 18344 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:31.591176 21506 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:31.116372 21634 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:31.667805 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 828) took 1116 ms. Trace:
I20260709 13:18:31.664193 18240 catalog_manager.cc:5697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 7 to 8, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 8 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:31.693513 19055 raft_consensus.cc:2393] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:31.326898 21362 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:31.603497 18488 rpcz_store.cc:276] 0709 13:18:30.175082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.389672 (+214590us) service_pool.cc:224] Handling call
0709 13:18:30.399890 (+ 10218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.401406 (+  1516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.401436 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.414674 (+ 13238us) log.cc:844] Serialized 26 byte log entry
0709 13:18:30.553021 (+138347us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b1800499540. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:18:31.033971 (+480950us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:31.034025 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.034107 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.293357 (+259250us) raft_consensus.cc:1685] finished
0709 13:18:31.293379 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.293605 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9115,"raft.queue_time_us":6345,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":5500,"spinlock_wait_cycles":4347264,"thread_start_us":450896,"threads_started":1,"wal-append.queue_time_us":769575}
I20260709 13:18:31.696111 19027 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:31.116369 21614 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:31.393987 21457 consensus_meta.cc:287] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.795s	user 0.009s	sys 0.002s
I20260709 13:18:31.698928 18487 rpcz_store.cc:276] 0709 13:18:30.513975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.187092 (+673117us) service_pool.cc:224] Handling call
0709 13:18:31.666206 (+479114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.777855 18487 pending_rounds.cc:85] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 6
I20260709 13:18:31.778431 18487 pending_rounds.cc:107] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:18:31.594861 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1008) took 1052 ms. Trace:
I20260709 13:18:31.663398 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:31.778736 18487 raft_consensus.cc:2889] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.464095 21234 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.779125 19062 rpcz_store.cc:276] 0709 13:18:30.542282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.063087 (+520805us) service_pool.cc:224] Handling call
0709 13:18:31.594797 (+531710us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.594049 21478 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:31.787052 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 91025.8us
I20260709 13:18:31.290657 21143 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:31.257182 21576 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:31.724004 18491 rpcz_store.cc:276] 0709 13:18:30.513667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.518407 (+1004740us) service_pool.cc:224] Handling call
0709 13:18:31.636358 (+117951us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.789762 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:31.790644 18491 pending_rounds.cc:85] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 7
W20260709 13:18:31.775750 21654 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:18:31.273643 21586 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:31.789470 21234 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:31.797695 21586 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:31.797312 21576 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:31.799711 21234 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:31.799921 21586 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:31.800410 18411 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:31.800720 21576 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:31.800469 21586 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:31.609701 21449 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.406813 21524 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:31.290678 21645 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:31.594049 21606 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.328233 21365 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:31.789902 21478 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.328274 21569 raft_consensus.cc:3055] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:31.776206 19058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.011s	sys 0.012s
W20260709 13:18:31.836481 19058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.012s	sys 0.012s
W20260709 13:18:31.780853 19056 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.008s	sys 0.016s
W20260709 13:18:31.837468 19056 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.008s	sys 0.016s
I20260709 13:18:31.609364 21461 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:31.595698 21591 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.784013 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 818) took 1235 ms. Trace:
I20260709 13:18:31.804641 21449 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.843511 19062 rpcz_store.cc:276] 0709 13:18:30.548950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.783272 (+1234322us) service_pool.cc:224] Handling call
0709 13:18:31.783538 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.783703 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.783728 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.783767 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:31.783804 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.783854 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.783963 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.179783 21639 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:31.782372 18484 rpcz_store.cc:276] 0709 13:18:30.515604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.197098 (+681494us) service_pool.cc:224] Handling call
0709 13:18:31.622273 (+425175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.788595 18341 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:31.845784 19062 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:31.791054 18491 pending_rounds.cc:107] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:18:31.847545 18491 raft_consensus.cc:2889] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.705148 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:31.848356 18417 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.781164 18240 catalog_manager.cc:5697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 3 to 5, term changed from 5 to 6, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to <none>, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1), VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2), VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3), VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:31.816279 21606 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.795761 19059 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:31.852180 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 817) took 1319 ms. Trace:
I20260709 13:18:31.852479 19059 rpcz_store.cc:276] 0709 13:18:30.532750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.728588 (+1195838us) service_pool.cc:224] Handling call
0709 13:18:31.791749 (+ 63161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.851948 (+ 60199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.852128 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.804435 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:31.775732 21614 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:31.808144 18418 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.021s	sys 0.007s
I20260709 13:18:31.609985 21644 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:18:31.857879 18418 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.021s	sys 0.007s
W20260709 13:18:31.811213 18410 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.009s	sys 0.022s
W20260709 13:18:31.730341 18338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 637) took 1510 ms (client timeout 1584 ms). Trace:
W20260709 13:18:31.858784 18410 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.009s	sys 0.022s
W20260709 13:18:31.858821 18338 rpcz_store.cc:269] 0709 13:18:30.219853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.287381 (+ 67528us) service_pool.cc:224] Handling call
0709 13:18:31.730091 (+1442710us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400417dd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:31.730259 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339943168}
I20260709 13:18:31.813268 19053 rpcz_store.cc:276] 0709 13:18:30.551221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.573181 (+ 21960us) service_pool.cc:224] Handling call
0709 13:18:31.517737 (+944556us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:18:31.667738 (+150001us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655811840}
I20260709 13:18:31.814159 18340 rpcz_store.cc:276] 0709 13:18:30.569814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.092027 (+522213us) service_pool.cc:224] Handling call
0709 13:18:31.682201 (+590174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:31.815145 18419 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.011s	sys 0.015s
W20260709 13:18:31.860445 18419 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.012s	sys 0.016s
I20260709 13:18:31.692893 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:31.671452 21064 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:31.817001 19054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.021s	sys 0.047s
I20260709 13:18:31.608604 21605 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:31.841156 21461 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.503434 21596 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:31.700186 21599 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:31.834945 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:31.838195 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 609) took 1423 ms. Trace:
I20260709 13:18:31.866631 18416 rpcz_store.cc:276] 0709 13:18:30.414687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.417158 (+  2471us) service_pool.cc:224] Handling call
0709 13:18:30.417547 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.431366 (+ 13819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.431401 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.431860 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.046860 (+615000us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:31.046897 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.046958 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.837978 (+791020us) raft_consensus.cc:1685] finished
0709 13:18:31.837999 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.838141 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13418,"raft.queue_time_us":14395,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":1362,"thread_start_us":614654,"threads_started":1,"wal-append.queue_time_us":1085200}
I20260709 13:18:31.637107 21617 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:31.704507 21421 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.722702 21619 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:31.860596 21644 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.846907 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2102) took 1461 ms. Trace:
I20260709 13:18:31.874951 18341 rpcz_store.cc:276] 0709 13:18:30.385010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.788029 (+1403019us) service_pool.cc:224] Handling call
0709 13:18:31.788387 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.846658 (+ 58271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.846854 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.876374 18341 raft_consensus.cc:1240] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:31.877082 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2108) took 1449 ms. Trace:
I20260709 13:18:31.877480 18341 rpcz_store.cc:276] 0709 13:18:30.428088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.875776 (+1447688us) service_pool.cc:224] Handling call
0709 13:18:31.876141 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.876810 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.877017 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.694190 21613 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.792969 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:31.847926 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:31.887429 18413 raft_consensus.cc:1240] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:31.887902 21012 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:31.888033 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2004) took 1308 ms. Trace:
I20260709 13:18:31.888419 18413 rpcz_store.cc:276] 0709 13:18:30.579799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.887011 (+1307212us) service_pool.cc:224] Handling call
0709 13:18:31.887271 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.887824 (+   553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.887986 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.853458 18489 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:31.853401 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 820) took 1303 ms. Trace:
I20260709 13:18:31.890592 19062 rpcz_store.cc:276] 0709 13:18:30.549471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.845130 (+1295659us) service_pool.cc:224] Handling call
0709 13:18:31.845527 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.853096 (+  7569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.853333 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.892025 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 824) took 1341 ms. Trace:
I20260709 13:18:31.892311 19062 rpcz_store.cc:276] 0709 13:18:30.550345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.891304 (+1340959us) service_pool.cc:224] Handling call
0709 13:18:31.891557 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.891734 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.891758 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.891797 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:31.891831 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.891880 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.891977 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.893615 19062 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:31.894116 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 827) took 1343 ms. Trace:
I20260709 13:18:31.894404 19062 rpcz_store.cc:276] 0709 13:18:30.551023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.893088 (+1342065us) service_pool.cc:224] Handling call
0709 13:18:31.893331 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.893894 (+   563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.894071 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.856335 18240 catalog_manager.cc:5697] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:31.895383 21605 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:31.874280 21617 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:31.895957 18240 catalog_manager.cc:5697] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 3 to 6, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 6 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:31.861374 19054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.022s	sys 0.047s
I20260709 13:18:31.897819 21617 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:31.787737 21598 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:31.870482 21596 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:31.861279 18415 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 3.
W20260709 13:18:31.825157 18339 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2103) took 1439 ms (client timeout 1766 ms). Trace:
I20260709 13:18:31.900452 21596 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:31.900367 18339 rpcz_store.cc:269] 0709 13:18:30.385246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.425978 (+ 40732us) service_pool.cc:224] Handling call
0709 13:18:31.824975 (+1398997us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b540028e6d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:31.825097 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214329728}
I20260709 13:18:31.902236 18339 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:18:31.902855 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1890) took 1334 ms. Trace:
I20260709 13:18:31.903137 18339 rpcz_store.cc:276] 0709 13:18:30.568425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.901352 (+1332927us) service_pool.cc:224] Handling call
0709 13:18:31.901856 (+   504us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:31.902569 (+   713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.902804 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.903574 21599 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:31.836189 21569 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:31.904850 21569 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:31.862474 19025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.008s	sys 0.035s
W20260709 13:18:31.906085 19025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.008s	sys 0.035s
W20260709 13:18:31.906574 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 845467us
I20260709 13:18:31.907259 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:31.865353 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 614) took 1449 ms. Trace:
I20260709 13:18:31.907864 18410 rpcz_store.cc:276] 0709 13:18:30.416177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.521634 (+105457us) service_pool.cc:224] Handling call
0709 13:18:30.521936 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.522125 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:30.557678 (+ 35553us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.163593 (+605915us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b18002fac40. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f409bdf1a40 00007f409bdec4e4 00007f409bdec455 00007f409eed4060 00007f409eee6716 00007f409eef7287 00007f409eef7208
0709 13:18:31.863136 (+699543us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.865048 (+  1912us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.865095 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:31.865139 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.865201 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.865303 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11592,"prepare.queue_time_us":38305,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":608489,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":2960,"spinlock_wait_cycles":7207040,"thread_start_us":688252,"threads_started":1}
I20260709 13:18:31.868523 18344 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:31.910569 21625 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:31.910972 18344 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:31.911659 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1892) took 1342 ms. Trace:
I20260709 13:18:31.911998 18344 rpcz_store.cc:276] 0709 13:18:30.568985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.910570 (+1341585us) service_pool.cc:224] Handling call
0709 13:18:31.910823 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.911402 (+   579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.911593 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.869848 19053 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:31.913520 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 823) took 1363 ms. Trace:
I20260709 13:18:31.913833 19053 rpcz_store.cc:276] 0709 13:18:30.550144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.860088 (+1309944us) service_pool.cc:224] Handling call
0709 13:18:31.869675 (+  9587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.913301 (+ 43626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.913472 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.915182 19053 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:31.915700 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1013) took 1105 ms. Trace:
I20260709 13:18:31.915983 19053 rpcz_store.cc:276] 0709 13:18:30.810098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.914522 (+1104424us) service_pool.cc:224] Handling call
0709 13:18:31.914899 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.915512 (+   613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.915655 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.905840 21569 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.897519 18240 catalog_manager.cc:5697] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 4 to 7, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 7 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.923187 18240 catalog_manager.cc:5697] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 6, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 6 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:31.924351 21621 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:31.889686 18413 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:31.866271 21461 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:31.849817 21639 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.824568 21506 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:31.873512 18335 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:31.874269 18416 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:31.836628 21365 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:31.927368 19053 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:31.886605 18490 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:31.943347 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1014) took 1133 ms. Trace:
I20260709 13:18:31.943708 19053 rpcz_store.cc:276] 0709 13:18:30.810421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.916614 (+1106193us) service_pool.cc:224] Handling call
0709 13:18:31.927206 (+ 10592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.943120 (+ 15914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.943294 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.925101 18240 catalog_manager.cc:5697] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 3 to 5, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 5 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.928143 18343 raft_consensus.cc:2368] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 4. Current term is 5.
I20260709 13:18:31.928743 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 815) took 1444 ms. Trace:
I20260709 13:18:31.945456 19056 rpcz_store.cc:276] 0709 13:18:30.484694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.515794 (+ 31100us) service_pool.cc:224] Handling call
0709 13:18:30.539703 (+ 23909us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.540151 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.540189 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.993308 (+453119us) log.cc:844] Serialized 556 byte log entry
0709 13:18:31.837954 (+844646us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:31.838013 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.838128 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.928464 (+ 90336us) raft_consensus.cc:1685] finished
0709 13:18:31.928494 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.928670 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":844308,"threads_started":1,"wal-append.queue_time_us":928719}
I20260709 13:18:31.865146 18338 raft_consensus.cc:2955] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:31.942488 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1997) took 1376 ms. Trace:
I20260709 13:18:31.948887 18416 rpcz_store.cc:276] 0709 13:18:30.566155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.870948 (+1304793us) service_pool.cc:224] Handling call
0709 13:18:31.871148 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.942128 (+ 70980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.942414 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.895406 19062 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:31.952785 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1010) took 1144 ms. Trace:
I20260709 13:18:31.954434 18240 catalog_manager.cc:5697] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 5 to 6, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 6 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.958585 19056 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:18:31.958796 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 367206us
I20260709 13:18:31.960764 19062 rpcz_store.cc:276] 0709 13:18:30.808989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.895025 (+1086036us) service_pool.cc:224] Handling call
0709 13:18:31.895251 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.952461 (+ 57210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.952718 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.874812 21619 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.964915 18240 catalog_manager.cc:5697] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 4 to 5, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 5 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.970487 18240 catalog_manager.cc:5697] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 2 to 3, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.959676 18416 pending_rounds.cc:85] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 6
I20260709 13:18:31.972302 18416 pending_rounds.cc:107] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:18:31.972560 18416 raft_consensus.cc:2889] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.880052 21421 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:31.967099 18342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2101) took 1582 ms (client timeout 1629 ms). Trace:
W20260709 13:18:31.975869 18342 rpcz_store.cc:269] 0709 13:18:30.384765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.422563 (+ 37798us) service_pool.cc:224] Handling call
0709 13:18:31.966905 (+1544342us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b5400401d54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:31.967034 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128940288}
I20260709 13:18:31.976804 18457 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:31.973181 18240 catalog_manager.cc:5697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 5 to 6, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 6 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.978698 18240 catalog_manager.cc:5697] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 4 to 5, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 5 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.985809 18240 catalog_manager.cc:5697] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 6 to 7, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 7 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.995254 21365 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:31.996383 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 814) took 1517 ms. Trace:
W20260709 13:18:32.001106 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 93917.5us
I20260709 13:18:32.008711 19058 rpcz_store.cc:276] 0709 13:18:30.478460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.511355 (+ 32895us) service_pool.cc:224] Handling call
0709 13:18:30.511649 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.511882 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:30.910025 (+398143us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.840831 (+930806us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.995659 (+154828us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b18001dbb40. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f409bdf1a40 00007f409bdec4e4 00007f409bdec455 00007f409eed4060 00007f409eee6716 00007f409eef7287 00007f409eef7208
0709 13:18:31.995903 (+   244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.995975 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:31.996047 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.996143 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.996302 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147952,"prepare.queue_time_us":60055,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":14989,"raft.queue_time_us":159431,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":7160,"spinlock_wait_cycles":3950976,"thread_start_us":1303841,"threads_started":2,"wal-append.queue_time_us":962415}
I20260709 13:18:32.021250 19025 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:31.993702 21410 consensus_meta.cc:287] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.802s	user 0.010s	sys 0.000s
I20260709 13:18:31.985491 18457 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:32.023131 19025 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:32.024801 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:31.968657 21619 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.030122 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 1993) took 1608 ms. Trace:
I20260709 13:18:32.005846 21616 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:32.021158 21516 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.982182 21596 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:32.035841 18419 rpcz_store.cc:276] 0709 13:18:30.421645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.183165 (+761520us) service_pool.cc:224] Handling call
0709 13:18:31.183493 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.183825 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.183854 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.184300 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.860851 (+676551us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:31.860892 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.860970 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.029875 (+168905us) raft_consensus.cc:1685] finished
0709 13:18:32.029901 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.030059 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":775,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":51584,"thread_start_us":676171,"threads_started":1,"wal-append.queue_time_us":783481}
I20260709 13:18:32.057730 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:32.038396 18417 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:32.039168 21012 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:32.059173 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:32.037014 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:18:32.005492 21624 consensus_meta.cc:287] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.817s	user 0.007s	sys 0.002s
I20260709 13:18:32.039319 21454 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:32.001842 21524 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:32.010011 18240 catalog_manager.cc:5697] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 3 to 6, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 6 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:32.047966 21446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.077s	sys 0.105s
I20260709 13:18:32.066401 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:32.062719 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:32.055485 21536 consensus_meta.cc:287] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.885s	user 0.008s	sys 0.003s
I20260709 13:18:32.039397 21194 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:32.047689 21616 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:32.064121 18240 catalog_manager.cc:5697] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 1 to 5, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 5 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:32.059772 21012 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.062747 21454 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.069636 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:32.066282 21446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.078s	sys 0.105s
I20260709 13:18:32.065480 21524 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.119827 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:32.068863 19025 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:32.039058 21410 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:32.124692 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.119484 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:32.069798 21412 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:32.128679 18414 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2003) took 1562 ms (client timeout 1887 ms). Trace:
W20260709 13:18:32.258958 18414 rpcz_store.cc:269] 0709 13:18:30.566190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.119227 (+1553037us) service_pool.cc:224] Handling call
0709 13:18:32.128607 (+  9380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:32.259706 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:32.259985 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:32.260548 18414 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
W20260709 13:18:32.132902 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.261633 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.133687 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.257567 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:32.264159 18417 raft_consensus.cc:2368] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7.
I20260709 13:18:32.061271 21596 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.073999 21194 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:32.119470 21454 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.116366 21012 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.289373 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:32.124110 21524 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.119760 21658 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:32.065083 21624 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:32.100276 21536 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:32.295058 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 176286us
W20260709 13:18:32.296541 18384 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.007s	sys 0.010s
W20260709 13:18:32.296933 18384 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.007s	sys 0.010s
W20260709 13:18:32.297216 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 600923us
W20260709 13:18:32.298297 18337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.001s	sys 0.014s
W20260709 13:18:32.298815 18337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.001s	sys 0.015s
I20260709 13:18:32.299669 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2100) took 1915 ms. Trace:
I20260709 13:18:32.116726 21461 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.302578 18417 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:32.303648 18309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.000s	sys 0.009s
W20260709 13:18:32.304015 18309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.001s	sys 0.009s
W20260709 13:18:32.304378 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 743296us
I20260709 13:18:32.276885 21194 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:32.300137 18337 rpcz_store.cc:276] 0709 13:18:30.384526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.700345 (+1315819us) service_pool.cc:224] Handling call
0709 13:18:31.700756 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.299278 (+598522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.299305 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:32.299358 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:32.299394 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.299469 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.299605 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81107,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":7840,"thread_start_us":598051,"threads_started":1}
I20260709 13:18:32.123615 21616 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.171s
W20260709 13:18:32.374503 18486 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.010s	sys 0.040s
W20260709 13:18:32.379086 18486 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.010s	sys 0.040s
I20260709 13:18:32.386248 18337 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:32.389199 19055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.005s	sys 0.018s
W20260709 13:18:32.389573 19055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.005s	sys 0.018s
W20260709 13:18:32.390208 18458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.000s	sys 0.024s
W20260709 13:18:32.390602 18458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.000s	sys 0.024s
I20260709 13:18:32.390479 18419 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:18:32.394312 21698 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:18:32.399245 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 330420us
I20260709 13:18:32.378340 21614 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.403975 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:32.405992 18382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.015s	sys 0.008s
W20260709 13:18:32.418467 18382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.015s	sys 0.008s
W20260709 13:18:32.418826 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 612688us
W20260709 13:18:32.406265 18487 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.006s	sys 0.017s
W20260709 13:18:32.419656 18487 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.006s	sys 0.017s
I20260709 13:18:32.409031 19025 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:32.302598 21625 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:32.415136 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:32.428964 18417 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
W20260709 13:18:32.432155 21634 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.013s	sys 0.006s
W20260709 13:18:32.433444 21634 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.014s	sys 0.006s
W20260709 13:18:32.445072 19027 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.004s	sys 0.026s
W20260709 13:18:32.449514 18485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.011s	sys 0.051s
W20260709 13:18:32.450289 18485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.011s	sys 0.051s
W20260709 13:18:32.446350 19027 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.004s	sys 0.026s
W20260709 13:18:32.451373 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 655300us
I20260709 13:18:32.453863 19027 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:32.385243 21678 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:32.462318 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:32.464265 18384 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:32.467695 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:32.443358 21660 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 13:18:32.300261 21666 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 13:18:32.477414 18382 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:32.476559 18418 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.001s	sys 0.004s
W20260709 13:18:32.476378 18491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.000s	sys 0.004s
W20260709 13:18:32.482549 18418 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.001s	sys 0.005s
W20260709 13:18:32.482887 18491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.001s	sys 0.005s
I20260709 13:18:32.443711 21385 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:32.511216 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 47088us
I20260709 13:18:32.457690 21506 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:32.442874 21672 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:32.526031 21583 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:32.526651 21583 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.527077 21583 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:32.528410 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 51100.1us
I20260709 13:18:32.529233 18382 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:32.470990 21678 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.447072 21625 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:32.515697 21664 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.471s	user 0.000s	sys 0.001s
I20260709 13:18:32.447198 21599 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:18:32.478068 21697 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:32.445181 21614 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.514600 21385 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.532153 21672 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:32.588181 21697 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:32.588711 21624 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:32.588832 21697 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.589422 21697 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.545451 21365 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:32.539052 21678 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:32.529820 21569 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:32.569300 21506 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:32.591167 21672 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.605271 21674 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:32.608613 21478 consensus_meta.cc:287] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.765s	user 0.008s	sys 0.000s
I20260709 13:18:32.608875 21536 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:32.588173 21686 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:18:32.610284 21596 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:32.613720 21443 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.580639 21668 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:32.626668 21410 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:32.764829 18308 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.090s	user 0.008s	sys 0.008s
I20260709 13:18:32.889992 21658 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:32.890738 18308 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.009s	sys 0.009s
W20260709 13:18:32.891577 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 1.21725e+06us
W20260709 13:18:32.765954 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.894521 21599 consensus_queue.cc:1059] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:32.896643 21669 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:18:32.767122 18344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.001s	sys 0.005s
I20260709 13:18:32.767599 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1891) took 2198 ms. Trace:
I20260709 13:18:32.769451 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1889) took 2201 ms. Trace:
W20260709 13:18:32.898375 18344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.002s	sys 0.005s
I20260709 13:18:32.769858 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2106) took 2383 ms. Trace:
I20260709 13:18:32.898382 18339 rpcz_store.cc:276] 0709 13:18:30.568697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.903796 (+1335099us) service_pool.cc:224] Handling call
0709 13:18:31.904062 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.950560 (+ 46498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.950607 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.951200 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:18:32.398586 (+447386us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:32.398638 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.398735 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.766766 (+368031us) raft_consensus.cc:1685] finished
0709 13:18:32.766848 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.767329 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46099,"raft.queue_time_us":47128,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5328,"thread_start_us":415010,"threads_started":1,"wal-append.queue_time_us":709929}
I20260709 13:18:32.900069 18338 rpcz_store.cc:276] 0709 13:18:30.386031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.863401 (+1477370us) service_pool.cc:224] Handling call
0709 13:18:31.863613 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.865048 (+  1435us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:31.975406 (+110358us) log.cc:844] Serialized 14 byte log entry
0709 13:18:32.457205 (+481799us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:32.457343 (+   138us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:32.457465 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.769314 (+311849us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b54001d1354. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:32.769412 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.769669 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7383,"raft.queue_time_us":87653,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":2867584,"thread_start_us":473826,"threads_started":1,"wal-append.queue_time_us":618769}
I20260709 13:18:32.902949 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:32.898548 18341 rpcz_store.cc:276] 0709 13:18:30.568103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.878385 (+1310282us) service_pool.cc:224] Handling call
0709 13:18:31.878738 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.937990 (+ 59252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.938037 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.952033 (+ 13996us) log.cc:844] Serialized 26 byte log entry
0709 13:18:32.398957 (+446924us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:32.399002 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.399083 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.768816 (+369733us) raft_consensus.cc:1685] finished
0709 13:18:32.768871 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.769225 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58699,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":14678,"thread_start_us":376503,"threads_started":1,"wal-append.queue_time_us":655913}
I20260709 13:18:32.904251 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:32.904928 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:32.771963 18343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 1896) took 2200 ms (client timeout 1710 ms). Trace:
I20260709 13:18:32.906608 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:32.906105 21454 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:32.773319 18335 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2096) took 2832 ms (client timeout 2031 ms). Trace:
W20260709 13:18:32.907826 18335 rpcz_store.cc:269] 0709 13:18:29.940364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.940496 (+   132us) service_pool.cc:224] Handling call
0709 13:18:32.772752 (+2832256us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54004187d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:32.773055 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3458742016}
I20260709 13:18:32.908192 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:32.781278 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2107) took 2360 ms. Trace:
I20260709 13:18:32.774776 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2115) took 1042 ms. Trace:
I20260709 13:18:32.783704 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 621) took 1085 ms. Trace:
W20260709 13:18:32.784192 18411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2011) took 1631 ms (client timeout 1667 ms). Trace:
I20260709 13:18:32.909943 18337 rpcz_store.cc:276] 0709 13:18:31.732755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.373192 (+640437us) service_pool.cc:224] Handling call
0709 13:18:32.374101 (+   909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.387419 (+ 13318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.774121 (+386702us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54001653d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:32.774534 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26708352}
W20260709 13:18:32.910825 18411 rpcz_store.cc:269] 0709 13:18:31.152382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.169780 (+ 17398us) service_pool.cc:224] Handling call
0709 13:18:32.783693 (+1613913us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54001789d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:32.783908 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467683712}
I20260709 13:18:32.785738 18414 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:32.911171 18339 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
W20260709 13:18:32.779856 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.787146 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 367737us
I20260709 13:18:32.785990 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 1995) took 2256 ms. Trace:
I20260709 13:18:32.796550 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 620) took 1170 ms. Trace:
W20260709 13:18:32.788709 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.914264 18412 rpcz_store.cc:276] 0709 13:18:30.529043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.531456 (+1002413us) service_pool.cc:224] Handling call
0709 13:18:31.531963 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.698461 (+166498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.785362 (+1086901us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54003ebcd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:32.785788 (+   426us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380292352}
I20260709 13:18:32.914364 18413 rpcz_store.cc:276] 0709 13:18:31.626371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.926513 (+300142us) service_pool.cc:224] Handling call
0709 13:18:31.926881 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.968021 (+ 41140us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:32.465172 (+497151us) log.cc:844] Serialized 14 byte log entry
0709 13:18:32.784030 (+318858us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:32.784156 (+   126us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:32.784278 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.795986 (+ 11708us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b54001c43d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:32.796058 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.796293 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":62594,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":64239,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":276,"spinlock_wait_cycles":94090624,"thread_start_us":775377,"threads_started":2,"wal-append.queue_time_us":213669}
I20260709 13:18:32.917255 21704 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.917090 21666 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:32.812270 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2135) took 1160 ms. Trace:
I20260709 13:18:32.815726 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2131) took 1208 ms. Trace:
I20260709 13:18:32.824291 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:32.844663 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1006) took 2306 ms. Trace:
I20260709 13:18:32.845867 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:32.847831 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 393779us
I20260709 13:18:32.612159 20303 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:32.844704 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:32.855592 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:32.865801 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 816) took 2376 ms. Trace:
W20260709 13:18:32.843281 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.946354 21591 consensus_meta.cc:287] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.062s	user 0.011s	sys 0.014s
W20260709 13:18:32.946769 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.639252 21524 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.946885 21591 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.950067 18489 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.597899 21569 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.950937 21666 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:32.951113 21569 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.951867 21666 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:32.612231 21606 consensus_meta.cc:287] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.750s	user 0.008s	sys 0.000s
I20260709 13:18:32.954685 21606 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:32.710620 21613 consensus_meta.cc:287] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.764s	user 0.011s	sys 0.000s
I20260709 13:18:32.958779 21613 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:32.960556 18308 connection.cc:256] RPC call timeout handler was delayed by -1.125213376000147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 13:18:32.961098 18308 connection.cc:256] RPC call timeout handler was delayed by -1.1198133760001383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
I20260709 13:18:32.585414 21616 consensus_queue.cc:1059] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:18:32.961607 18337 raft_consensus.cc:1240] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:32.962373 18342 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:32.686695 21614 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:32.687904 21625 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:32.669739 21639 consensus_meta.cc:287] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.716s	user 0.007s	sys 0.000s
I20260709 13:18:32.964762 21634 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.965189 21639 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.965588 21634 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.918275 18491 rpcz_store.cc:276] 0709 13:18:31.651739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.790173 (+138434us) service_pool.cc:224] Handling call
0709 13:18:31.790451 (+   278us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:31.852125 (+ 61674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.852170 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:31.852857 (+   687us) log.cc:844] Serialized 52 byte log entry
0709 13:18:32.483479 (+630622us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:32.483530 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.483617 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.811515 (+327898us) raft_consensus.cc:1685] finished
0709 13:18:32.811561 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.811949 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105249,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6568,"thread_start_us":610486,"threads_started":1,"wal-append.queue_time_us":722349}
W20260709 13:18:32.711401 21644 consensus_meta.cc:287] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.804s	user 0.009s	sys 0.001s
I20260709 13:18:32.628185 21645 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:32.642809 21668 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:32.970240 21410 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:32.629979 21674 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.972200 21596 raft_consensus.cc:3055] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:32.727763 21678 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.594210 21365 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:32.974794 21365 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.976042 21678 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:32.651710 21689 log.cc:927] Time spent T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:18:32.715821 21697 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.978197 21410 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.879920 21225 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.980062 21225 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:32.980830 18491 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:32.880077 21598 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:32.919241 19055 rpcz_store.cc:276] 0709 13:18:30.538473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.781777 (+1243304us) service_pool.cc:224] Handling call
0709 13:18:31.782091 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.792519 (+ 10428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.792550 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.792991 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:18:32.389981 (+596990us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:32.390025 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.390105 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.843829 (+453724us) raft_consensus.cc:1685] finished
0709 13:18:32.843885 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.844350 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6737,"raft.queue_time_us":10028,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":3671,"thread_start_us":596671,"threads_started":1,"wal-append.queue_time_us":869146}
I20260709 13:18:32.627607 21506 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.884136 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:32.632778 21478 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.886834 21461 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:32.906214 18343 rpcz_store.cc:269] 0709 13:18:30.571330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.013904 (+442574us) service_pool.cc:224] Handling call
0709 13:18:32.771364 (+1757460us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b540003b1d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:32.771669 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2049501056}
I20260709 13:18:32.905902 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:32.908985 18340 rpcz_store.cc:276] 0709 13:18:30.420335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.869078 (+1448743us) service_pool.cc:224] Handling call
0709 13:18:31.871596 (+  2518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.871722 (+   126us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:32.340716 (+468994us) log.cc:844] Serialized 14 byte log entry
0709 13:18:32.780117 (+439401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:32.780241 (+   124us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:32.780493 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.780705 (+   212us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.781010 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":425274,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2238,"raft.queue_time_us":96027,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":221,"thread_start_us":805617,"threads_started":2,"wal-append.queue_time_us":370613}
W20260709 13:18:32.783205 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.813867 18492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 687) took 2298 ms (client timeout 2052 ms). Trace:
I20260709 13:18:32.918181 21704 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:32.820161 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:32.909749 18335 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:32.914024 18339 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:32.909713 21454 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:32.901577 21385 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:32.892740 21658 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.950470 18336 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:32.989287 21478 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:32.990248 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 1898) took 2402 ms. Trace:
I20260709 13:18:32.990861 21461 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:32.991406 18484 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:32.990301 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 106725us
I20260709 13:18:32.993412 21506 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:32.991421 21461 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.994534 21461 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:32.945746 19054 rpcz_store.cc:276] 0709 13:18:30.488830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.516896 (+ 28066us) service_pool.cc:224] Handling call
0709 13:18:30.585853 (+ 68957us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:30.731860 (+146007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.731908 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:30.732670 (+   762us) log.cc:844] Serialized 52 byte log entry
0709 13:18:31.898194 (+1165524us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:31.898500 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 13:18:32.000855 (+102355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.000938 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.843112 (+842174us) raft_consensus.cc:1685] finished
0709 13:18:32.843172 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.865097 (+ 21925us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b5400487950. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:32.865426 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134074,"prepare.queue_time_us":529,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":234209,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":62361,"spinlock_wait_cycles":129890560,"thread_start_us":1027526,"threads_started":1,"wal-append.queue_time_us":1160917}
W20260709 13:18:32.961531 18308 connection.cc:256] RPC call timeout handler was delayed by -1.0872098249999453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
I20260709 13:18:32.969543 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2130) took 1363 ms. Trace:
I20260709 13:18:32.720556 21672 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:32.969586 21644 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:32.972815 21596 raft_consensus.cc:740] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:32.919042 18493 rpcz_store.cc:276] 0709 13:18:31.607111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.607309 (+   198us) service_pool.cc:224] Handling call
0709 13:18:31.608798 (+  1489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.929807 (+321009us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:32.303279 (+373472us) log.cc:844] Serialized 14 byte log entry
0709 13:18:32.581586 (+278307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:32.581652 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:32.581700 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.815087 (+233387us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400240254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:32.815190 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.815482 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17651,"prepare.queue_time_us":365963,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":43537,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":48,"spinlock_wait_cycles":737647872,"thread_start_us":616757,"threads_started":2,"wal-append.queue_time_us":333003}
I20260709 13:18:32.968328 21639 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:32.910022 18416 rpcz_store.cc:276] 0709 13:18:31.698318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.958877 (+260559us) service_pool.cc:224] Handling call
0709 13:18:31.959405 (+   528us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:31.974115 (+ 14710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.974142 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:31.978089 (+  3947us) log.cc:844] Serialized 52 byte log entry
0709 13:18:32.458217 (+480128us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:32.458269 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.458357 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.782930 (+324573us) raft_consensus.cc:1685] finished
0709 13:18:32.782980 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.783407 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":971,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":8554,"thread_start_us":479838,"threads_started":1,"wal-append.queue_time_us":744433}
I20260709 13:18:32.990861 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2114) took 1288 ms. Trace:
I20260709 13:18:32.950270 19060 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:32.990693 18336 rpcz_store.cc:276] 0709 13:18:30.587410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.108379 (+520969us) service_pool.cc:224] Handling call
0709 13:18:32.989996 (+1881617us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b540007ec54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:32.990180 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4210535808}
I20260709 13:18:32.949730 21591 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:32.993611 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:32.994483 19061 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:33.017182 18338 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:33.022387 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2116) took 1244 ms. Trace:
I20260709 13:18:33.047709 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1024) took 1467 ms. Trace:
I20260709 13:18:33.047976 18335 rpcz_store.cc:276] 0709 13:18:31.777723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.909010 (+1131287us) service_pool.cc:224] Handling call
0709 13:18:32.909455 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.986943 (+ 77488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.022327 (+ 35384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.048524 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:32.949786 21524 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:32.957830 21606 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:33.023293 18486 rpcz_store.cc:276] 0709 13:18:31.606065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.610838 (+  4773us) service_pool.cc:224] Handling call
0709 13:18:31.611054 (+   216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.379630 (+768576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.379661 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:32.380139 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:18:32.879929 (+499790us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:32.880005 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.880124 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.969187 (+ 89063us) raft_consensus.cc:1685] finished
0709 13:18:32.969215 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.969366 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":289883,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":1204637,"threads_started":2,"wal-append.queue_time_us":553243}
W20260709 13:18:33.031392 18308 connection.cc:256] RPC call timeout handler was delayed by -1.0256091169999308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260709 13:18:33.030756 18489 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:33.029819 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:32.986516 18492 rpcz_store.cc:269] 0709 13:18:30.515384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.064589 (+549205us) service_pool.cc:224] Handling call
0709 13:18:32.813376 (+1748787us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400136d54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:32.813563 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386823040}
I20260709 13:18:33.047813 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:33.052081 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1023) took 1933 ms. Trace:
I20260709 13:18:33.053670 21644 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:33.042522 18342 rpcz_store.cc:276] 0709 13:18:31.702259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.035838 (+333579us) service_pool.cc:224] Handling call
0709 13:18:32.056953 (+ 21115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.962906 (+905953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.990510 (+ 27604us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b540007f654. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:32.990784 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081297280}
I20260709 13:18:33.054596 19053 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:33.047050 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:33.048329 19060 rpcz_store.cc:276] 0709 13:18:31.575590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.854817 (+1279227us) service_pool.cc:224] Handling call
0709 13:18:33.043035 (+188218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.058861 19061 rpcz_store.cc:276] 0709 13:18:31.118807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.595569 (+1476762us) service_pool.cc:224] Handling call
0709 13:18:33.051957 (+456388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.047200 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:33.077324 21619 consensus_meta.cc:287] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.993s	user 0.027s	sys 0.013s
W20260709 13:18:33.078797 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 85344.6us
I20260709 13:18:33.079622 18308 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:33.080305 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:33.082995 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:33.084244 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1899) took 2473 ms. Trace:
I20260709 13:18:33.067736 21613 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:33.084939 18485 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.011s	sys 0.003s
I20260709 13:18:33.091297 21674 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:33.093171 21672 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:33.095800 21669 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:33.096207 21669 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:33.088725 18487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.006s	sys 0.010s
I20260709 13:18:33.098045 21697 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:33.105981 20303 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:33.102654 18415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.009s	sys 0.005s
I20260709 13:18:33.106400 20303 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:33.089076 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 602208us
I20260709 13:18:33.107125 20303 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.074405 21598 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:33.105266 18485 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.011s	sys 0.003s
I20260709 13:18:33.114033 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:33.117409 21704 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:33.068820 21443 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:33.110113 18418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.008s	sys 0.006s
I20260709 13:18:33.121819 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:33.123046 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 105739us
I20260709 13:18:33.124325 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1018) took 2312 ms. Trace:
W20260709 13:18:33.110450 19059 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.010s	sys 0.004s
I20260709 13:18:33.088297 21591 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:33.121122 18487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.006s	sys 0.010s
I20260709 13:18:33.097302 21669 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.128610 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:33.131026 21666 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:33.134287 18419 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:33.127038 19053 rpcz_store.cc:276] 0709 13:18:30.811677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.944469 (+1132792us) service_pool.cc:224] Handling call
0709 13:18:31.944791 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.084203 (+1139412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.123994 (+ 39791us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400750154. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:33.124247 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2551305472}
W20260709 13:18:33.131590 21516 consensus_meta.cc:287] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.084s	user 0.006s	sys 0.012s
I20260709 13:18:33.131970 21598 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:33.135210 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 44614us
W20260709 13:18:33.135617 18415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.010s	sys 0.005s
W20260709 13:18:33.138232 19059 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.010s	sys 0.004s
I20260709 13:18:33.143926 18412 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:33.086328 21619 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.110180 21225 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.146301 21596 consensus_queue.cc:260] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:33.148640 18458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.020s	sys 0.027s
I20260709 13:18:33.137174 21410 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:33.154989 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:33.156432 21668 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:33.170508 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 822) took 2620 ms. Trace:
I20260709 13:18:33.156715 21598 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:33.159520 21194 consensus_meta.cc:287] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.768s	user 0.017s	sys 0.014s
I20260709 13:18:33.150333 21516 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:33.147131 21012 consensus_meta.cc:287] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.746s	user 0.013s	sys 0.012s
W20260709 13:18:33.168154 21421 consensus_meta.cc:287] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.160s	user 0.008s	sys 0.010s
I20260709 13:18:33.169195 19025 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:33.181465 18458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.021s	sys 0.027s
I20260709 13:18:33.172225 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2001) took 2613 ms. Trace:
I20260709 13:18:33.166173 21634 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:33.189558 18492 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:33.197302 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2132) took 1585 ms. Trace:
W20260709 13:18:33.190595 18384 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.007s	sys 0.017s
W20260709 13:18:33.168453 21583 consensus_meta.cc:287] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.641s	user 0.013s	sys 0.007s
I20260709 13:18:33.194911 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:33.198638 18486 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:33.171676 21454 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:33.203348 19026 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:18:33.201969 18384 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.008s	sys 0.017s
I20260709 13:18:33.193454 21619 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:33.208424 21443 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:33.179672 19059 rpcz_store.cc:276] 0709 13:18:30.549937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.853175 (+1303238us) service_pool.cc:224] Handling call
0709 13:18:31.866924 (+ 13749us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:31.999287 (+132363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.999318 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:32.000008 (+   690us) log.cc:844] Serialized 52 byte log entry
0709 13:18:32.398268 (+398260us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:32.472198 (+ 73930us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.170001 (+697803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.170162 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.170237 (+    75us) raft_consensus.cc:1685] finished
0709 13:18:33.170249 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.170455 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143829,"prepare.queue_time_us":73381,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":293217,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":12893,"thread_start_us":1057368,"threads_started":2,"wal-append.queue_time_us":461885}
W20260709 13:18:33.201742 18307 leader_election.cc:336] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.443s (SENT)
I20260709 13:18:33.197683 18487 rpcz_store.cc:276] 0709 13:18:31.611716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.776912 (+165196us) service_pool.cc:224] Handling call
0709 13:18:31.777514 (+   602us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:32.420153 (+642639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.420197 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:32.420895 (+   698us) log.cc:844] Serialized 52 byte log entry
0709 13:18:33.181905 (+761010us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:33.189401 (+  7496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.189494 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.189532 (+    38us) raft_consensus.cc:1685] finished
0709 13:18:33.189553 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.197249 (+  7696us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121787,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":42204,"thread_start_us":1355382,"threads_started":2,"wal-append.queue_time_us":534067}
W20260709 13:18:33.209457 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 58606.9us
W20260709 13:18:33.215216 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 63003.9us
W20260709 13:18:33.203333 21446 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.015s	sys 0.021s
W20260709 13:18:33.244973 21446 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.016s	sys 0.022s
I20260709 13:18:33.245380 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:33.194873 18418 rpcz_store.cc:276] 0709 13:18:30.558412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.098885 (+540473us) service_pool.cc:224] Handling call
0709 13:18:31.099153 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.099385 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:31.858370 (+758985us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.171727 (+1313357us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:33.171835 (+   108us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:33.171888 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.172011 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.172170 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46526,"prepare.queue_time_us":860998,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":46330,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":1921661,"threads_started":3,"wal-append.queue_time_us":858645}
I20260709 13:18:33.247180 21516 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:33.247833 21516 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:33.248945 21516 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.206926 21583 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.249881 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:33.250658 19059 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.250461 20303 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.252018 21583 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:33.252336 20303 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:33.254225 21365 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.254914 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:33.256743 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:33.257457 19053 raft_consensus.cc:2393] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:18:33.218912 21449 consensus_meta.cc:287] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.307s	user 0.010s	sys 0.005s
I20260709 13:18:33.218845 21524 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:33.204151 21421 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.258244 21449 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.259804 21421 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:33.260201 21449 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:33.220508 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 51439.3us
I20260709 13:18:33.258255 21524 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.209046 21669 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.262959 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:33.263789 19053 raft_consensus.cc:2393] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:18:33.223452 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 119583us
I20260709 13:18:33.227197 21596 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.216058 21410 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:18:33.231968 21721 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.286401 21721 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:33.084813 18344 rpcz_store.cc:276] 0709 13:18:30.602627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.912652 (+1310025us) service_pool.cc:224] Handling call
0709 13:18:31.912942 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.956791 (+ 43849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.956820 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.961273 (+  4453us) log.cc:844] Serialized 26 byte log entry
0709 13:18:32.609282 (+648009us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b480021e7d8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a3e05aa1 00007f40a3dfcb37 00007f40a3dfc9ca 00007f40a3ef426f 00007f40a3ef3f37 00007f40a3f0855c 00007f40a3f08508 00007f40a3f08488 00007f40a3f08443 00007f40a3f076ec 00007f40a2e31a96
0709 13:18:32.899297 (+290015us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:33.031332 (+132035us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.056137 (+ 24805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.070076 (+ 13939us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.070119 (+    43us) raft_consensus.cc:1685] finished
0709 13:18:33.074712 (+  4593us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.076024 (+  1312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43489,"raft.queue_time_us":57822,"raft.run_cpu_time_us":6336,"raft.run_wall_time_us":662989,"spinlock_wait_cycles":7182208,"thread_start_us":1002821,"threads_started":2,"wal-append.queue_time_us":672770}
W20260709 13:18:33.287834 19025 connection.cc:256] RPC call timeout handler was delayed by -1.1903894839999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260709 13:18:33.288681 21721 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:33.232496 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:33.289417 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.292099 18458 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:33.232815 21709 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:18:33.234798 18382 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:33.201638 21012 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.238189 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2127) took 2887 ms. Trace:
I20260709 13:18:33.242698 21225 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:33.243957 21461 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.256755 21583 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.260118 21569 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.261595 21524 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.231478 19027 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:33.327214 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 237203us
I20260709 13:18:33.269964 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:33.271083 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:33.272086 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:33.273418 19054 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:18:33.274343 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 83584.1us
I20260709 13:18:33.274395 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:33.202322 21194 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.330871 19055 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:33.275830 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:33.277140 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:33.279356 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:33.283982 18308 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:33.284915 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 615) took 1665 ms. Trace:
W20260709 13:18:33.217486 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 705324us
I20260709 13:18:33.284999 21365 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:33.306787 21666 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:33.307483 21708 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:33.309906 19059 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
W20260709 13:18:33.315328 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.317384 19057 raft_consensus.cc:2393] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:18:33.316607 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 81876.1us
I20260709 13:18:33.326249 21410 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:33.337998 19058 raft_consensus.cc:2393] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:33.303509 18485 rpcz_store.cc:276] 0709 13:18:30.350803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.490738 (+139935us) service_pool.cc:224] Handling call
0709 13:18:30.490966 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.154360 (+663394us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:31.602106 (+447746us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.144870 (+1542764us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:33.151036 (+  6166us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:33.153342 (+  2306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.237872 (+ 84530us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54003746d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:33.237933 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.238116 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":156146,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":81,"spinlock_wait_cycles":1525083904,"thread_start_us":1507118,"threads_started":2,"wal-append.queue_time_us":1098223}
I20260709 13:18:33.322943 21704 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:33.341616 19061 raft_consensus.cc:2393] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:33.302238 21668 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.347078 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:33.347301 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:33.347898 19055 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:33.348587 19056 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.349225 21668 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.348519 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:33.350396 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.332206 18415 rpcz_store.cc:276] 0709 13:18:31.619778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.899455 (+279677us) service_pool.cc:224] Handling call
0709 13:18:31.899707 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.899910 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:32.289414 (+389504us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.202571 (+913157us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.212844 (+ 10273us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.240442 (+ 27598us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b1800481600. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef522 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:18:33.266676 (+ 26234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:33.284492 (+ 17816us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:33.284549 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.284659 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.284859 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41480,"prepare.queue_time_us":210610,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":4008,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":29323520,"thread_start_us":1242345,"threads_started":2,"wal-append.queue_time_us":773629}
I20260709 13:18:33.350562 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:33.354867 18384 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:33.358179 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:33.360136 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:33.360761 19056 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
W20260709 13:18:33.353864 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 70043.1us
W20260709 13:18:33.379648 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 87636.6us
I20260709 13:18:33.360401 18382 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:33.337800 21598 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.317305 21721 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:18:33.385450 19060 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.350301 21225 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.350349 21410 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:33.356140 21668 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:33.360592 21461 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:33.359694 21012 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:33.398804 19054 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.400957 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:33.401229 19025 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:33.387518 21421 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:33.403680 18418 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.403950 19026 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:33.370227 21583 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:33.354876 21677 consensus_queue.cc:1059] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:18:33.358136 21634 consensus_queue.cc:1059] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:18:33.400298 21410 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.407402 21143 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:33.415730 21672 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:33.416217 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 61453.6us
I20260709 13:18:33.416402 18308 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:33.417114 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:33.419097 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:33.420528 21704 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.422981 21717 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:33.423422 21721 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:33.423913 21721 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:33.423573 21717 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.424366 21613 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:33.424862 21613 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:33.423159 21674 consensus_queue.cc:1059] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:33.407500 21449 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:33.359547 21708 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.460747 21708 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:33.462416 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:33.462690 21613 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.425501 21365 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:33.463951 21365 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:33.464385 21365 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.466567 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:33.467373 18489 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.469812 21677 raft_consensus.cc:3055] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:33.470279 21677 raft_consensus.cc:740] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:33.450726 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 61289us
I20260709 13:18:33.409112 21639 consensus_queue.cc:1059] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:18:33.435889 18308 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:33.453384 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 221988us
I20260709 13:18:33.424335 21721 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.463406 18486 raft_consensus.cc:2393] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:33.431557 19060 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:33.426093 21143 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:33.480798 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 63830.5us
I20260709 13:18:33.480640 21143 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.483786 21639 raft_consensus.cc:3055] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:33.435678 21449 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:33.464330 21613 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.483378 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:33.487540 21639 raft_consensus.cc:740] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:33.476689 21461 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:33.468292 21421 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.529538 18490 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.530354 18410 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:33.510813 21449 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:33.531785 19057 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1009) took 2941 ms (client timeout 3338 ms). Trace:
I20260709 13:18:33.515225 21709 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:33.538512 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:33.546960 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:33.539047 19057 rpcz_store.cc:269] 0709 13:18:30.579799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.845134 (+2265335us) service_pool.cc:224] Handling call
0709 13:18:33.521387 (+676253us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54006c0a54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:33.521559 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876232448}
W20260709 13:18:33.558112 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 44844.5us
I20260709 13:18:33.560333 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:33.560652 21710 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:33.561447 21710 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.530062 21461 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.572126 18384 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:33.563807 21710 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:33.585453 19054 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:33.540283 21672 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:33.557150 21709 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.541157 21569 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:33.616125 18489 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
W20260709 13:18:33.613312 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 195452us
I20260709 13:18:33.620092 21709 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:33.573606 21461 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.627131 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:33.627790 18412 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:33.663902 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:33.634914 21672 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:33.676905 18485 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:33.678176 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.614677 21708 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:18:33.648806 21668 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:33.638458 21012 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:18:33.754751 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 145300us
I20260709 13:18:33.755349 21624 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:33.756016 21624 raft_consensus.cc:697] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:33.756441 18309 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:33.757606 21669 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:33.758307 21669 raft_consensus.cc:697] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:33.679980 21639 consensus_queue.cc:260] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.994827 18412 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
W20260709 13:18:33.975802 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 330217us
I20260709 13:18:33.825634 18418 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
W20260709 13:18:33.967044 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:33.950039 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.788586 18458 leader_election.cc:400] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 4. Current term is 5.
I20260709 13:18:33.901005 18490 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:34.006675 18458 leader_election.cc:403] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.007090 18491 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:18:33.716890 21668 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:33.976567 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 437803us
I20260709 13:18:33.843024 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:34.013309 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 365946us
W20260709 13:18:33.760221 21741 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:18:33.771313 21742 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:33.766270 21194 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:33.750025 21457 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.781225 21697 raft_consensus.cc:3055] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:34.029877 21697 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:34.031126 21457 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:33.762396 21733 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:18:33.759279 21385 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:34.034638 21385 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:34.035838 21225 consensus_meta.cc:287] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.638s	user 0.006s	sys 0.003s
I20260709 13:18:34.035553 21385 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:34.036304 21225 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:34.036543 21385 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:34.040505 21143 consensus_meta.cc:287] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.003s
I20260709 13:18:34.040940 21143 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.042861 21143 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:34.043224 21410 consensus_meta.cc:287] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.003s
I20260709 13:18:34.043638 21410 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.046118 18410 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:34.047799 21613 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:34.048372 21613 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:34.049342 21613 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.054170 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.054854 18487 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:34.055891 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.056468 18491 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:18:34.017086 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 174104us
I20260709 13:18:34.021835 21596 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:18:34.022265 21735 log.cc:927] Time spent T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:18:34.023191 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.063097 18490 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.045665 21410 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:34.018908 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 354131us
I20260709 13:18:33.779227 21717 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:33.775894 21674 raft_consensus.cc:3055] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:33.795223 21412 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.780860 21421 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:34.014451 21668 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.073874 18490 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
W20260709 13:18:34.077875 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 58343.6us
I20260709 13:18:33.794921 21524 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:34.091912 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:34.099294 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.759357 21669 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:33.794179 21677 consensus_queue.cc:260] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:34.068070 21639 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:34.110410 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.774654 21672 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:33.757136 21624 consensus_queue.cc:237] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:34.094774 21365 consensus_meta.cc:287] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.000s
I20260709 13:18:34.071342 21674 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:34.126176 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.124779 18487 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:34.147599 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.144048 18491 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:34.149073 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.149808 18491 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.170125 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.174309 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.139647 21421 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.183934 21421 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.069657 21697 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.190433 21697 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:34.196251 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.197425 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.198025 18484 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.199622 21457 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:34.202992 21583 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:34.207345 21421 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:34.209226 21674 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:34.210448 21674 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:34.216269 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 50528.4us
I20260709 13:18:34.233582 18489 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:18:34.234321 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 54384.1us
I20260709 13:18:34.142340 21365 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:34.246763 18307 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.338s (SENT) [suppressed 38 similar messages]
I20260709 13:18:34.227303 21677 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.257558 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.275092 18487 raft_consensus.cc:2376] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7. Re-sending same reply.
I20260709 13:18:34.279778 18382 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:34.121904 21412 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.290514 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.300120 18493 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:34.250073 18484 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
W20260709 13:18:34.326344 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 264279us
I20260709 13:18:34.328992 18491 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
W20260709 13:18:34.339473 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 59799.3us
I20260709 13:18:34.335934 18309 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:34.346186 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:34.347496 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.348150 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.323714 21524 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:34.351702 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.349315 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:34.357185 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:34.358717 21194 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:34.359340 21194 raft_consensus.cc:697] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:34.360495 21194 consensus_queue.cc:237] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.362417 21443 consensus_queue.cc:1059] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:34.358382 21012 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:34.374008 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.374565 18487 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:34.375530 18489 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
W20260709 13:18:34.377111 18485 consensus_meta.cc:287] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.000s
I20260709 13:18:34.377424 18485 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:34.342711 21569 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:34.308596 21385 consensus_queue.cc:1059] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:18:34.386700 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:34.400897 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 299510us
W20260709 13:18:34.402967 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.408963 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.411130 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.415273 21613 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:34.415935 21613 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:34.417023 21613 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.427289 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.431118 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.407306 21596 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 4. Current term is 5.
W20260709 13:18:34.435461 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 45250.2us
W20260709 13:18:34.425658 21709 consensus_meta.cc:287] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.787s	user 0.006s	sys 0.005s
I20260709 13:18:34.407881 21569 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:34.443001 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 191704us
I20260709 13:18:34.443097 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:34.446043 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.448251 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:34.450242 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:34.450677 18490 raft_consensus.cc:2393] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:34.453290 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:34.439157 21410 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.438438 21365 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:34.467598 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.474234 18412 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.474769 21569 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.475258 21412 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:34.476217 21750 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.152s	user 0.001s	sys 0.004s
I20260709 13:18:34.476804 21669 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:34.477303 21669 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:34.478108 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.478258 21669 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:34.479276 18307 leader_election.cc:336] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.579s (SENT)
I20260709 13:18:34.482620 21225 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:34.483156 21225 raft_consensus.cc:697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:34.483448 21461 consensus_meta.cc:287] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.834s	user 0.011s	sys 0.000s
I20260709 13:18:34.483914 21461 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.487560 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.488839 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.489398 18493 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.490252 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.490561 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.491268 18485 raft_consensus.cc:2393] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:34.492084 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.493044 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.493525 18485 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.494428 21410 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:34.494915 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.496856 21410 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:34.497679 18410 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:18:34.500588 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 43517.7us
W20260709 13:18:34.502071 21721 consensus_meta.cc:287] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.971s	user 0.009s	sys 0.003s
I20260709 13:18:34.502471 21721 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:34.504392 21721 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:34.505066 21461 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:34.506460 21668 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.483969 21225 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.445736 21709 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.508267 18492 raft_consensus.cc:2410] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:34.569099 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.570156 18484 raft_consensus.cc:2393] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:18:34.541297 21449 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.982s	user 0.012s	sys 0.000s
I20260709 13:18:34.573207 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:34.575672 18307 leader_election.cc:336] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.678s (SENT)
I20260709 13:18:34.581868 18486 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:34.462109 18487 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:34.587239 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:34.589519 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 134160us
I20260709 13:18:34.539245 21457 raft_consensus.cc:3055] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:34.593173 18490 raft_consensus.cc:2393] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:18:34.594933 18307 leader_election.cc:336] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.686s (SENT)
I20260709 13:18:34.595410 18307 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:34.595826 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.597147 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.598331 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.596496 18412 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:34.590963 18382 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:34.576941 18493 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
W20260709 13:18:34.591351 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 136482us
I20260709 13:18:34.591015 18485 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:34.601634 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.602880 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:34.603466 18457 leader_election.cc:336] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.566s (SENT)
I20260709 13:18:34.506976 21461 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:34.590183 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:34.539829 21524 raft_consensus.cc:3055] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:34.601286 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.574432 21012 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:34.612807 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.614491 21365 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:34.614439 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.615113 21365 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:34.615737 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.616434 18488 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:34.615986 21365 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.617274 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.608464 21524 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:34.618106 21767 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:34.618862 21524 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.619812 21668 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:34.620078 21524 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:34.622352 18307 leader_election.cc:336] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.713s (SENT)
I20260709 13:18:34.622905 18307 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:34.623557 18484 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:34.623656 21767 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:34.626432 18308 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:34.627736 21767 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:34.628185 21767 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.628573 21767 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:34.630009 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.635914 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.594796 21457 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:34.599052 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.638546 18487 raft_consensus.cc:2368] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7.
I20260709 13:18:34.638700 18492 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:34.608965 21710 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:34.639170 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.590286 21449 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.668015 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.691730 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:34.669253 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 43519us
I20260709 13:18:34.700206 19060 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:34.700340 19057 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:34.702368 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.703401 18491 raft_consensus.cc:2393] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:34.694993 18493 raft_consensus.cc:2393] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:34.718561 18308 leader_election.cc:400] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7.
I20260709 13:18:34.719013 18308 leader_election.cc:403] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:34.721794 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.635675 21461 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:34.722319 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:34.727121 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 86609.8us
W20260709 13:18:34.728447 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.725376 18382 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:34.728463 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:34.724097 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 281059us
W20260709 13:18:34.728951 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 248216us
I20260709 13:18:34.731496 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.697484 21710 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:34.732700 19025 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:34.736771 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.737474 18491 raft_consensus.cc:2393] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:34.739444 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:34.739529 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.742147 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.744704 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.747426 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.747938 19060 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:34.742743 19053 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:34.749938 19026 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:34.750213 19025 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:34.697085 21583 consensus_queue.cc:1059] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:18:34.751866 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.729801 21761 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7.
I20260709 13:18:34.753783 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.754187 19058 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:34.755605 20851 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:34.756606 21516 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:34.758294 21769 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:34.758970 19054 raft_consensus.cc:1240] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:34.760728 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:34.761124 18342 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:34.761253 18344 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.763417 21449 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:34.735217 21591 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.765218 21591 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.767060 19025 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:34.767483 21591 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:34.767706 21449 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:34.767933 19025 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:34.768254 21449 raft_consensus.cc:697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:34.768779 21762 log.cc:927] Time spent T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:18:34.768867 19025 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:34.770072 21443 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:34.770277 21769 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:34.770804 21769 raft_consensus.cc:697] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:34.770925 21443 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:34.771443 21443 raft_consensus.cc:697] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:34.771816 21769 consensus_queue.cc:237] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.772245 21443 consensus_queue.cc:237] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.774084 21516 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:34.780354 21583 raft_consensus.cc:3055] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:34.780766 21583 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:34.782171 20851 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:34.783010 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.783111 20851 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.784097 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.784626 18488 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:34.785373 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.785882 18488 raft_consensus.cc:2376] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6. Re-sending same reply.
I20260709 13:18:34.786227 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:34.743635 21639 consensus_meta.cc:287] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.001s
I20260709 13:18:34.753090 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.790128 18344 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:34.769222 21449 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.745018 21194 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:34.794740 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.795377 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:34.795483 21461 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.808136 18412 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.805156 19057 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:34.794341 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:34.805636 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.806313 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.807507 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.734589 21710 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.815997 19056 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:34.820333 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.831103 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.831409 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.832113 19054 raft_consensus.cc:2410] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:34.832216 18491 raft_consensus.cc:2368] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7.
I20260709 13:18:34.781664 21583 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.736200 21457 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:34.855073 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:34.853825 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 109640us
I20260709 13:18:34.831132 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.840756 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:34.860951 18487 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:34.861258 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.833336 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:34.884969 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:34.894169 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.896421 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.815745 21613 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.903345 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:34.907938 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:34.908552 18344 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:34.819710 21709 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:34.910233 18338 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:34.900336 19062 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:34.910797 18488 raft_consensus.cc:2393] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:34.911852 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:34.912498 18335 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:34.912428 18308 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:34.914112 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:34.914534 18308 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:34.915009 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:34.915618 18336 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:18:34.915827 21759 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:34.916772 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:34.917630 18340 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:34.916833 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.918460 18343 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:34.824471 21639 consensus_queue.cc:1059] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:18:34.919821 21639 raft_consensus.cc:3055] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:34.920274 21639 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:34.921118 21639 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.922255 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:34.922523 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:34.922794 19053 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.923303 21721 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:34.919744 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.924463 19060 raft_consensus.cc:2393] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:34.924587 18308 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:34.925513 21721 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:34.854096 21773 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.927174 18337 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:34.928608 18458 connection.cc:256] RPC call timeout handler was delayed by -2.3706003180000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2464s for a response
W20260709 13:18:34.928970 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 160175us
I20260709 13:18:34.914744 18339 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:34.794835 21012 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.933785 18412 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:34.934904 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.938093 19026 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:34.938951 18308 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:34.909296 21757 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:34.942477 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.943226 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.944242 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:34.938815 21194 raft_consensus.cc:697] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:34.966560 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:34.969985 18339 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.937822 21516 raft_consensus.cc:697] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:34.983340 19058 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:34.945825 21697 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:34.982878 19025 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:34.990579 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:34.992259 19053 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:34.974211 21639 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:34.997337 18337 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:34.999111 21787 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.999665 21787 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.999897 21516 consensus_queue.cc:237] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:34.935678 21773 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.002295 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:35.002687 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:35.002965 18307 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:35.003289 19060 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:35.003355 21773 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:35.003644 21421 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:35.004220 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:35.004901 21759 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:35.005656 21721 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:35.002355 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:35.006126 21721 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:35.006754 21721 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.009114 21772 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:34.991045 21677 consensus_meta.cc:287] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.005s
I20260709 13:18:35.010351 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:35.014438 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 80316us
I20260709 13:18:34.964437 21668 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:18:35.017696 18415 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:35.018038 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:35.021175 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:35.018850 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:34.994730 21569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.010s	sys 0.026s
I20260709 13:18:34.937354 21613 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.028177 18490 pending_rounds.cc:85] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 3
I20260709 13:18:35.028333 21613 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:35.028595 18490 pending_rounds.cc:107] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:35.028944 18490 raft_consensus.cc:2889] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:35.029671 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:35.030311 18337 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:35.030982 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.024326 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:35.025982 21697 raft_consensus.cc:697] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:35.032853 21697 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.034267 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.026440 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.041234 18412 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:35.042147 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:35.043918 18339 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:35.010130 21591 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:35.050488 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.047896 18337 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:35.048578 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:35.049299 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:35.052089 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:35.052598 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:35.051442 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:35.054054 19056 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:35.057761 18338 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:35.058715 18341 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:35.057936 19058 raft_consensus.cc:2368] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6.
W20260709 13:18:35.034381 21777 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 13:18:35.034312 21758 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.513s	user 0.003s	sys 0.008s
W20260709 13:18:35.041450 21569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.010s	sys 0.026s
I20260709 13:18:35.010942 21787 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:35.062006 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:35.083858 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:35.060869 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.065634 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:35.062945 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.084410 19060 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:35.083441 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:35.066761 21591 raft_consensus.cc:697] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:35.037534 21461 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:35.087122 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.066915 18491 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:35.077111 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:35.077613 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:35.066546 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:35.050380 21759 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:35.092361 18418 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:35.087782 18342 raft_consensus.cc:2410] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:35.088708 19057 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:35.089356 19061 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:35.091219 18416 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:35.098412 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:35.098776 21613 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:35.099313 18340 raft_consensus.cc:2393] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:35.100327 18340 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:35.101199 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:35.102229 18338 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:35.102895 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:35.103907 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:34.969393 21757 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:35.107748 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:35.108371 21757 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:35.068446 21761 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:35.075318 21672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.014s	sys 0.003s
I20260709 13:18:35.101794 18340 raft_consensus.cc:2393] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:35.112890 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:35.118076 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:35.118286 18458 connection.cc:256] RPC call timeout handler was delayed by -1.6575566320000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3348s for a response
I20260709 13:18:35.118861 18344 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:35.121287 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:35.009756 21772 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.127851 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:35.127918 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:35.125309 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 74881.8us
I20260709 13:18:35.083422 21782 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.129626 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:35.117319 21672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.014s	sys 0.004s
W20260709 13:18:35.143414 21767 consensus_meta.cc:287] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 13:18:35.143985 21767 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.144593 21757 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:35.145380 18335 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:35.067078 19055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:18:35.136874 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:35.140684 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:35.146386 18343 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:18:35.156061 19060 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:35.150858 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.150441 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:35.151207 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.150352 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:35.146798 18414 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.154415 18339 raft_consensus.cc:2393] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 4: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:35.147095 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:35.152957 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.145889 18336 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:35.166870 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.167425 18341 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:18:35.168110 19062 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:35.170097 18344 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:35.125854 21461 raft_consensus.cc:697] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:35.198179 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.195103 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:35.059871 21194 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.196026 19059 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
W20260709 13:18:35.146720 21790 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:35.259115 18341 raft_consensus.cc:2393] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:18:35.235291 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.280184 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.202549 18412 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:35.290860 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:35.201665 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:35.298059 18344 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:35.298542 18336 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:35.299840 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:35.242969 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 164068us
I20260709 13:18:35.206712 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:35.243264 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 108214us
I20260709 13:18:35.280817 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:35.290611 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:35.303982 18417 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:35.265125 21774 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.467s	user 0.004s	sys 0.000s
W20260709 13:18:35.262516 21786 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:18:35.322325 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 169242us
I20260709 13:18:35.258777 21767 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:35.328943 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:35.217448 21421 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:35.308902 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 80373.4us
I20260709 13:18:35.311292 18336 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.314210 21710 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.315310 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:35.338771 18335 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:35.338955 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:35.331354 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.307734 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:35.340018 18344 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:35.217792 21672 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:35.329862 18337 raft_consensus.cc:2393] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:35.166594 21782 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.257813 21591 consensus_queue.cc:237] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:35.349488 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:35.354979 18337 raft_consensus.cc:2410] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:35.355505 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.352749 18414 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:35.337544 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:35.356997 18340 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:35.357404 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:35.172266 21613 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:35.358346 21613 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:35.262862 21721 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.360414 21666 raft_consensus.cc:2764] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:35.361940 21721 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:35.279245 21461 consensus_queue.cc:237] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:35.344990 18384 connection.cc:256] RPC call timeout handler was delayed by -1.6038314400000218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 13:18:35.362579 18384 connection.cc:256] RPC call timeout handler was delayed by -1.54083143999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 13:18:35.362900 18384 connection.cc:256] RPC call timeout handler was delayed by -1.4927952499999719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3017s for a response
W20260709 13:18:35.363198 18384 connection.cc:256] RPC call timeout handler was delayed by -1.4211314399999537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 13:18:35.363945 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:35.364616 18344 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.367759 18339 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.348508 18412 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:35.372743 18412 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:35.348009 18336 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:35.356680 18307 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.352861 21421 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:35.375562 18410 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:35.354010 18335 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:35.374298 18342 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:35.218698 21757 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:18:35.375063 18419 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:35.375838 18341 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:35.376946 18417 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:35.379037 18344 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:35.380178 18335 raft_consensus.cc:1240] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:18:35.383580 21410 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:35.384289 18307 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.387094 21710 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:35.366804 21596 consensus_queue.cc:1059] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 13:18:35.390312 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.390750 18340 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:35.391407 21672 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:35.390954 21613 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:35.393172 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.322475 21668 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:18:35.394238 21721 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:35.395418 18307 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:35.396341 21792 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:35.390755 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:35.408898 18458 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:35.405162 18412 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.410310 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:35.411962 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:35.413079 21697 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.417979 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:35.418241 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:35.419631 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:35.422077 21385 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:35.422758 21794 log.cc:927] Time spent T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.145s	user 0.002s	sys 0.000s
I20260709 13:18:35.422863 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.424505 21697 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.426080 21772 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:35.426744 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:35.427320 19057 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:35.428966 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:35.430384 18341 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:35.432325 21666 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:35.433043 21666 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:35.433382 21666 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:35.433739 21666 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.437012 19027 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:35.442323 18340 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:35.444908 18309 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:35.404495 21721 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:35.447616 18340 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:35.448019 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:35.454751 19062 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:35.451107 18412 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:35.457995 19054 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:18:35.460410 19060 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:35.463084 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:35.464586 19062 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:35.466344 19055 raft_consensus.cc:606] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.467141 18339 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
W20260709 13:18:35.466344 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 57498.1us
I20260709 13:18:35.471582 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:35.473834 18412 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:18:35.450217 21759 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:35.468712 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:35.450906 21721 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:35.454427 21569 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.421845 21412 consensus_queue.cc:1059] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:18:35.476984 19027 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:35.467376 21385 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:35.482450 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 59655.1us
I20260709 13:18:35.464651 21443 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:35.491475 19054 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.486060 21778 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:18:35.489445 21421 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:35.475253 21761 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:18:35.481421 21721 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.519860 18384 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.521731 18491 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:35.484232 21757 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.498184 19026 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:35.525944 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.498744 21772 consensus_queue.cc:1059] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:35.476014 21759 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.503942 19054 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
W20260709 13:18:35.504168 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 62544.5us
I20260709 13:18:35.505686 18458 leader_election.cc:400] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6.
I20260709 13:18:35.514142 19027 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:35.483193 21385 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.533407 18458 leader_election.cc:403] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:35.532738 21443 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:35.532891 21759 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.540845 21807 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6.
I20260709 13:18:35.548697 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.542032 21524 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.540313 21772 consensus_queue.cc:1243] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:18:35.561550 21805 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:18:35.561846 21770 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:35.537439 21365 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:35.537817 21385 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.565634 18308 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.556974 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:35.567723 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 43507.9us
I20260709 13:18:35.552562 21443 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.577661 18308 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:35.574579 18307 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.585655 18308 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.572326 21773 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:35.579721 21443 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.586951 21761 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:35.591979 21778 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:35.584283 21421 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:35.579203 21524 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:18:35.580796 21410 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:35.603106 18384 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.626331 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:35.632156 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 57638.5us
I20260709 13:18:35.633155 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:35.633212 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.634502 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:35.637377 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:35.640847 21808 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:35.645721 21808 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:35.646143 21808 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.640635 21757 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:35.647617 21757 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:35.648010 21757 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:35.642136 21807 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:35.612166 21770 raft_consensus.cc:3055] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:35.650444 21807 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:35.610569 21761 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:35.655326 18307 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:35.665351 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 109021us
I20260709 13:18:35.643514 21410 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:35.642000 21596 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:35.671096 18307 leader_election.cc:400] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7.
W20260709 13:18:35.672473 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 69453.7us
I20260709 13:18:35.673435 18384 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:35.627594 21759 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.654322 21770 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:35.677181 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.657740 21807 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:35.659267 21778 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:35.680905 18384 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:35.681617 21773 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:35.685168 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.686908 21672 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:35.687876 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:35.670539 21421 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:35.694633 18337 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:35.694547 21812 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:35.695531 21012 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:35.695914 21012 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:35.696691 21012 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.698486 21770 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.699501 21770 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:35.704591 21457 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.707989 21443 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.710224 21443 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:35.672081 21410 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.710906 21410 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:35.715854 19058 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:35.717985 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:35.718309 18335 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:35.718532 18412 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.718979 21669 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:35.720973 21759 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:35.721477 19059 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:35.675941 21596 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:35.723546 21596 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.697832 21012 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.724534 18341 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:35.725109 21385 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.672267 21666 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.728411 21666 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:35.728955 21666 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:35.731055 21782 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:35.731117 21385 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:35.741501 18412 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:35.693178 21721 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.754608 21668 raft_consensus.cc:3055] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:35.755436 21807 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:35.757035 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 114562us
W20260709 13:18:35.760023 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 79206.9us
W20260709 13:18:35.766072 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 96578.2us
W20260709 13:18:35.799989 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 214423us
I20260709 13:18:35.801055 18308 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.786193 21748 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:35.804625 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 45228.1us
I20260709 13:18:35.810350 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:35.761824 21668 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:35.811780 21668 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.813293 21668 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.807324 18412 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:35.762058 21812 raft_consensus.cc:697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:35.817529 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 99166.8us
I20260709 13:18:35.794634 21778 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:35.830773 18412 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:18:35.825313 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 57704us
I20260709 13:18:35.722750 21808 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:35.843511 21808 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:35.822773 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.845082 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.845376 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:35.846073 18412 raft_consensus.cc:2393] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:35.846269 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.826076 21748 raft_consensus.cc:697] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:35.846773 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.847334 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.847834 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.848901 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.849138 19027 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:35.871127 21757 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:35.825057 21613 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:18:35.824681 21461 consensus_queue.cc:1059] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:18:35.846372 18413 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:35.893924 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.849677 21808 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.895351 21808 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:35.897351 21583 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.837509 21812 consensus_queue.cc:237] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.912086 18412 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:35.851519 21668 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:35.913112 21668 raft_consensus.cc:697] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:35.913444 21815 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:35.913125 21194 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:35.847577 21748 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.920689 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.922176 21808 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:35.808718 21767 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:35.855293 19026 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:18:35.923666 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 68463.1us
I20260709 13:18:35.924665 21814 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:35.925227 21814 raft_consensus.cc:697] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:35.855348 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:35.856420 21721 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:35.858886 21807 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:35.862210 21820 raft_consensus.cc:3055] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:35.838470 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.873756 21757 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:35.850636 21782 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:35.917538 21668 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.919492 21012 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:35.915412 21194 raft_consensus.cc:697] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:35.914839 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 49878.2us
I20260709 13:18:35.930758 18415 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:35.942932 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:35.932020 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.943516 19053 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.929054 21677 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:18:35.945451 18418 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:35.946691 18418 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:35.948166 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:35.936877 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:35.938738 18492 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:35.942070 18487 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:35.931142 21808 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:35.921535 21596 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.950616 18413 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:35.931311 21820 raft_consensus.cc:740] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:35.963223 18418 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:18:35.953500 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 143251us
I20260709 13:18:35.926096 21814 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.974515 19059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:18:35.949802 21757 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.978036 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:36.009495 19053 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:36.029465 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:35.949982 21410 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:35.958555 21443 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:18:35.958243 21821 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:18:36.033213 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:36.034447 19059 raft_consensus.cc:606] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:36.039331 19059 raft_consensus.cc:614] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:36.039417 18344 raft_consensus.cc:1275] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:36.035087 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:36.040526 18489 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 4: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:36.041355 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:36.042650 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:35.968627 21457 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:18:35.952828 21012 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.043968 18384 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:36.046103 18338 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:36.047353 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:36.047720 18492 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:36.050312 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:36.051038 18492 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 9: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:18:36.029275 21818 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:36.051517 18418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34454
I20260709 13:18:36.052062 18418 raft_consensus.cc:606] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:18:36.051954 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:36.053037 18342 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:36.011665 21047 consensus_queue.cc:1059] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:18:36.054364 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:36.055001 18410 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:36.051843 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:36.054970 18488 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:35.970082 21808 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:36.057878 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 85864.1us
I20260709 13:18:36.059062 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:36.062078 18489 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:36.015182 21807 consensus_queue.cc:1059] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:18:36.064975 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 110889us
I20260709 13:18:36.068086 18489 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:36.065119 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.069685 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:36.067276 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:36.071614 18335 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:36.068634 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:36.075022 18493 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:36.040031 21757 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:36.107337 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 63439.7us
I20260709 13:18:36.110080 18307 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:36.110176 18489 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:36.111564 18384 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:36.064266 21721 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:36.052812 21412 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:18:36.116496 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:36.125401 21757 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:36.119093 18489 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:36.119138 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:36.126374 18492 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:36.053725 21827 consensus_queue.cc:1059] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:18:36.056382 21812 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:18:36.079097 21385 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:36.130275 21822 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:36.128358 21047 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:36.130719 21823 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:18:36.135941 21596 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:36.137532 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 66131.6us
I20260709 13:18:36.139653 18335 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:36.044201 21194 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:36.118947 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 44251.9us
I20260709 13:18:36.121583 21668 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:36.160969 18493 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:36.116621 21778 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:18:36.173020 18335 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:36.166448 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:36.167198 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:36.167749 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:36.167954 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:36.165788 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:36.175843 18338 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:36.178658 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:36.179204 18336 raft_consensus.cc:2376] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11. Re-sending same reply.
I20260709 13:18:36.179972 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:36.180464 18336 raft_consensus.cc:2376] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9. Re-sending same reply.
I20260709 13:18:36.181299 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:36.181864 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.182183 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:36.182720 18335 raft_consensus.cc:2393] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:36.158079 21822 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.184919 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:36.186298 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:36.178241 21757 raft_consensus.cc:3055] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:36.190035 18493 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:18:36.190502 18338 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:36.190673 18493 pending_rounds.cc:85] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 6
I20260709 13:18:36.191102 18493 pending_rounds.cc:107] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:18:36.191375 18493 raft_consensus.cc:2889] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.192032 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:36.193059 18338 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:36.185365 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:36.163546 21759 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:36.195598 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 76572.6us
I20260709 13:18:36.197742 18384 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:36.187052 18335 raft_consensus.cc:2376] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4. Re-sending same reply.
I20260709 13:18:36.187875 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:36.159466 21385 raft_consensus.cc:697] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:36.194927 18340 raft_consensus.cc:2393] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:36.197824 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:36.200629 18493 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:36.201728 18493 pending_rounds.cc:85] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 3
I20260709 13:18:36.201988 18493 pending_rounds.cc:107] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:18:36.202222 18493 raft_consensus.cc:2889] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.203572 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:36.208602 18336 raft_consensus.cc:1240] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:36.195683 21596 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:36.211848 18335 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:36.210314 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:36.212990 18384 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:36.221508 21596 raft_consensus.cc:697] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:18:36.222170 21831 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:18:36.222638 21808 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:36.222715 21596 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:36.197106 21827 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:18:36.223788 21836 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:18:36.190160 21757 raft_consensus.cc:740] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:36.225361 21757 consensus_queue.cc:260] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.226074 21748 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:36.226667 21748 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:36.227029 21832 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:18:36.212031 21047 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.230000 21816 raft_consensus.cc:2764] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:18:36.230379 21410 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:36.231323 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:36.231735 18336 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:36.232191 21835 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:36.233412 18340 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:36.226933 21757 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:36.237838 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.190328 21822 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.175783 21668 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:36.244875 18335 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:18:36.248318 18457 leader_election.cc:336] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.667s (SENT)
W20260709 13:18:36.248389 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 104820us
I20260709 13:18:36.250765 18411 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:36.229907 21824 raft_consensus.cc:3055] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:36.256179 21845 consensus_queue.cc:1059] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:36.254182 18457 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:36.256556 21824 raft_consensus.cc:740] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:36.257865 21824 consensus_queue.cc:260] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:36.259205 21824 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:36.261248 21844 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:36.226162 21843 consensus_queue.cc:1059] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:18:36.252707 21772 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:18:36.262678 21843 raft_consensus.cc:3055] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:36.262809 18457 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:36.263072 21843 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:18:36.244004 21826 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:18:36.263947 21843 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:36.227044 21748 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.269826 18457 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:36.199599 21759 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.249528 21410 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:36.268594 21814 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:18:36.293340 21814 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:36.296736 21385 consensus_queue.cc:237] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:36.299458 18457 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:36.300354 21828 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:36.300056 21820 consensus_queue.cc:260] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:36.301574 21820 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:36.301875 18457 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:36.302166 21752 raft_consensus.cc:2764] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:18:36.281792 21012 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:36.317715 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 70450.3us
I20260709 13:18:36.306022 21839 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:18:36.306799 21815 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.307945 21759 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:36.309492 18485 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:36.300647 21827 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.268241 21844 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:36.310269 21843 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:36.248639 21807 consensus_queue.cc:1059] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:18:36.311739 18308 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:36.312053 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2138) took 1168 ms. Trace:
I20260709 13:18:36.339294 18339 rpcz_store.cc:276] 0709 13:18:35.143298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.166233 (+ 22935us) service_pool.cc:224] Handling call
0709 13:18:36.311897 (+1145664us) spinlock_profiling.cc:243] Waited 65.8 ms on lock 0x7b540007eed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:36.311998 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151415680}
I20260709 13:18:36.340607 18308 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:36.313925 18344 raft_consensus.cc:2410] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:36.311836 21668 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:36.304188 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:36.322439 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:36.342926 18343 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:36.343850 18490 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:36.345412 18490 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:36.318696 19025 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:36.321592 18384 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:36.317224 21835 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:36.286931 21583 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:18:36.354382 21697 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:36.324421 21828 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:36.356976 21833 log.cc:927] Time spent T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
I20260709 13:18:36.324239 21410 raft_consensus.cc:697] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:36.370671 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 49153.1us
W20260709 13:18:36.375936 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 57306.2us
W20260709 13:18:36.372377 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 70561.1us
I20260709 13:18:36.317906 21812 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:18:36.378427 18457 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:36.340988 21808 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:36.370622 21596 raft_consensus.cc:3055] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:36.390807 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:36.331915 21815 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.381225 21839 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:36.388043 21824 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:36.414067 21839 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:18:36.416687 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 148671us
I20260709 13:18:36.400859 21596 raft_consensus.cc:740] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:18:36.426153 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 85653.6us
I20260709 13:18:36.426872 21839 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:36.389853 21841 consensus_queue.cc:1059] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.189s
I20260709 13:18:36.423292 21824 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:36.471956 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 94570.8us
I20260709 13:18:36.427023 21194 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:18:36.474522 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:36.471764 21824 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:36.454845 21857 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:36.483140 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 55939.4us
I20260709 13:18:36.456564 21842 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.471452 21669 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:36.485711 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.487686 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:36.488252 19060 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.488397 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:36.488756 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:36.489207 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:36.488435 19055 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:36.505678 19060 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:36.506796 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:36.507820 19060 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:36.442348 21847 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 13:18:36.519068 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:36.519745 19060 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:36.513394 19057 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:36.524235 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:36.527218 19058 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:18:36.527526 19062 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:18:36.527711 19058 pending_rounds.cc:85] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 9
I20260709 13:18:36.528939 19058 pending_rounds.cc:107] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:18:36.529259 19058 raft_consensus.cc:2889] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.454144 21410 consensus_queue.cc:237] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:36.525375 21852 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:18:36.541661 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:36.541977 21851 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:18:36.542936 18343 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:36.544406 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:36.546698 21849 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:18:36.552723 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.553625 21853 log.cc:927] Time spent T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:18:36.505465 21842 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.555272 21845 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:36.522528 21856 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.494259 21596 consensus_queue.cc:260] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.547613 21857 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:36.550419 21862 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:36.550923 21861 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:18:36.525358 21841 raft_consensus.cc:3055] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:36.558812 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:36.561205 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:36.592207 19062 raft_consensus.cc:2393] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 3: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:36.572749 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:36.577019 19060 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:36.580475 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:36.581202 21047 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:36.590322 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 186989us
I20260709 13:18:36.568737 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:36.593364 18485 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:36.593627 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:36.595957 19057 raft_consensus.cc:2368] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9.
I20260709 13:18:36.570006 21669 raft_consensus.cc:697] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:36.599845 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:36.600803 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:36.601598 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:36.604281 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:36.605538 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 131083us
I20260709 13:18:36.606696 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:36.606964 18308 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:36.609023 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:36.611986 19053 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:36.612934 19053 raft_consensus.cc:1240] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:18:36.613897 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.614297 19060 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:36.591813 21841 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:36.618502 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:36.599668 21815 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:36.598645 21862 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:36.675411 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:36.588541 21856 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:36.676110 18413 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:36.677040 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:36.608946 21596 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:36.677824 21856 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:36.679407 21842 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:36.679497 21867 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:36.590471 21828 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:18:36.680645 21855 log.cc:927] Time spent T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:18:36.671201 21822 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.683704 21822 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:36.685155 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:36.619894 19057 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:36.673244 19058 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8. Ops: [6.7-7.8]
I20260709 13:18:36.675124 21841 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.677866 19062 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:36.688083 18416 raft_consensus.cc:2368] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10.
I20260709 13:18:36.685427 18340 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:18:36.675034 21862 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.672163 19053 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:36.689519 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:36.696918 18493 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:36.702349 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:36.706574 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:36.707710 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:36.708302 18489 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.711105 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:36.711458 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:36.712162 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:36.713184 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:36.600407 21047 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:36.714402 18338 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:18:36.714733 18338 pending_rounds.cc:85] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 5
I20260709 13:18:36.714932 18338 pending_rounds.cc:107] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:18:36.715153 18338 raft_consensus.cc:2889] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.715781 21047 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:36.717466 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2030) took 1578 ms. Trace:
I20260709 13:18:36.717935 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:36.720458 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:36.722929 21669 consensus_queue.cc:237] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:36.724004 18411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 2019) took 1684 ms (client timeout 1507 ms). Trace:
I20260709 13:18:36.724527 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:36.724409 18411 rpcz_store.cc:269] 0709 13:18:35.039845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.044889 (+  5044us) service_pool.cc:224] Handling call
0709 13:18:36.723851 (+1678962us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002a6554. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:36.723942 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2568088320}
I20260709 13:18:36.727993 18413 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:36.727996 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:36.717842 18419 rpcz_store.cc:276] 0709 13:18:35.139344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.332688 (+193344us) service_pool.cc:224] Handling call
0709 13:18:35.371679 (+ 38991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.376984 (+  5305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.717274 (+1340290us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b54001784d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:36.717408 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88942464}
W20260709 13:18:36.731971 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.732100 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:36.732723 18343 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:36.730425 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:36.747105 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:36.754319 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 142868us
I20260709 13:18:36.758953 19053 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:36.763561 19027 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:36.790124 21792 raft_consensus.cc:3055] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:36.790632 21792 raft_consensus.cc:740] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:36.791431 21792 consensus_queue.cc:260] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.792678 21792 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:36.753871 21816 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:36.807530 21880 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:18:36.759068 21808 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:36.812546 21850 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.800338 21869 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.829465 21854 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:36.826682 21850 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:36.821447 21820 consensus_meta.cc:287] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.504s	user 0.012s	sys 0.000s
I20260709 13:18:36.834172 21869 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.851230 21824 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:36.822197 21816 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:36.853329 21824 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:36.854081 21816 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.859920 21839 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.846220 21854 raft_consensus.cc:697] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:36.876680 21854 consensus_queue.cc:237] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:36.880712 21869 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:36.882234 21850 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:36.888805 21839 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:36.966142 21846 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.492s	user 0.004s	sys 0.000s
I20260709 13:18:36.967842 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:36.968632 18415 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:36.969409 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:36.970108 18415 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:36.977408 18415 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:36.979408 18415 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:37.027510 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:37.028357 18419 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:37.111575 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:53696 (request call id 1) took 1137 ms. Trace:
I20260709 13:18:37.112116 19059 rpcz_store.cc:276] 0709 13:18:35.974264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.974390 (+   126us) service_pool.cc:224] Handling call
0709 13:18:37.111324 (+1136934us) spinlock_profiling.cc:243] Waited 59.3 ms on lock 0x7b54000bf754. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eed6853 00007f40a3ea460a 00007f409d42a7d4 00007f409d42a762 00007f409d42a691 00007f409d42a60c 00007f409d4298c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:37.111475 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136363264}
I20260709 13:18:37.122284 18489 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:37.135520 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:37.136219 18417 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:37.138465 21896 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.139012 21896 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.141180 21896 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:36.784866 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:37.159336 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 677) took 1730 ms. Trace:
I20260709 13:18:37.159799 18341 rpcz_store.cc:276] 0709 13:18:35.429293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.435691 (+  6398us) service_pool.cc:224] Handling call
0709 13:18:35.724248 (+288557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.724881 (+   633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.159119 (+1434238us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540007ec50. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:37.159271 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661360000}
W20260709 13:18:37.165228 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:37.191376 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.193570 18489 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:37.199126 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:37.202447 18491 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:18:37.208999 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 461261us
I20260709 13:18:37.209830 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:37.210453 18308 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.001s	sys 0.006s
W20260709 13:18:37.210769 18308 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.001s	sys 0.006s
I20260709 13:18:37.210654 21825 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:37.211011 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:37.211194 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 515522us
I20260709 13:18:37.211776 21825 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:37.212165 18458 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:37.212918 21825 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.213297 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:37.214375 21824 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:37.215698 18458 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:37.216400 21824 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:37.217459 21814 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:37.218902 21881 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:18:37.219220 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 455701us
I20260709 13:18:37.219925 21869 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:37.220350 21869 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:37.221174 21869 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.224475 19027 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:37.227052 18417 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:37.229697 18458 leader_election.cc:400] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9.
I20260709 13:18:37.230041 18458 leader_election.cc:403] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:18:37.231424 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 694) took 1051 ms. Trace:
I20260709 13:18:37.231667 21824 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9.
I20260709 13:18:37.231909 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:37.232466 18417 raft_consensus.cc:2376] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6. Re-sending same reply.
I20260709 13:18:37.233413 18458 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:37.235504 21824 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:37.236213 21847 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:37.236826 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:37.240710 21824 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:37.240777 21012 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:37.242519 18458 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:37.243095 21850 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:37.236851 21461 raft_consensus.cc:3055] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:37.244127 21461 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:37.245528 21807 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:37.245491 21847 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:37.247334 21847 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:37.247447 21807 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:37.248358 21824 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:37.248714 21824 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:37.251080 21457 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:37.249455 21824 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.251461 21457 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:37.252453 21457 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:36.765614 21748 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.254724 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:37.245126 21461 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.231839 18340 rpcz_store.cc:276] 0709 13:18:36.180307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.234420 (+ 54113us) service_pool.cc:224] Handling call
0709 13:18:36.234721 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.688764 (+454043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.231163 (+542399us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b5400058cd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:37.231364 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035997568}
I20260709 13:18:37.253793 21457 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.258459 18491 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:37.257741 21807 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:37.259555 21807 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.259905 21807 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:37.262662 18491 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:37.264508 18491 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:37.274689 21850 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.275207 21850 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.275867 21748 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:37.271848 21881 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:18:37.277024 21820 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:37.278122 21820 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:37.280637 21820 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:37.281196 21748 consensus_queue.cc:1059] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:37.282035 21461 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:37.282243 21748 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:37.282608 21748 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:37.278581 21850 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:37.283433 21748 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.284597 21748 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.286204 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:37.286931 18487 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.291124 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:37.292387 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:37.292544 21862 consensus_queue.cc:1059] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:37.293202 21862 consensus_queue.cc:1243] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:37.293387 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:37.293660 21862 raft_consensus.cc:3055] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:37.294016 21862 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:37.295986 21825 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:37.297288 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:37.297905 18489 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:37.297686 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34454 (request call id 88) took 1256 ms. Trace:
I20260709 13:18:37.298439 18418 rpcz_store.cc:276] 0709 13:18:36.041328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.043988 (+  2660us) service_pool.cc:224] Handling call
0709 13:18:37.297387 (+1253399us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b540008bea0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee59520 00007f409eed6652 00007f40a3ea460a 00007f409d42a7d4 00007f409d42a762 00007f409d42a691 00007f409d42a60c 00007f409d4298c2 00007f409d21748c 00007f409d2168c6
0709 13:18:37.297588 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17458944}
I20260709 13:18:37.299077 18491 raft_consensus.cc:2410] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:18:37.301226 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.302548 21709 consensus_queue.cc:1059] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:37.304519 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 730) took 1077 ms. Trace:
I20260709 13:18:37.304893 18485 rpcz_store.cc:276] 0709 13:18:36.227356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.333754 (+106398us) service_pool.cc:224] Handling call
0709 13:18:36.367329 (+ 33575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.593823 (+226494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.304313 (+710490us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400137754. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:37.304464 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512296320}
I20260709 13:18:37.306565 21817 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:37.309599 18487 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:37.311147 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2024) took 1475 ms. Trace:
I20260709 13:18:37.311255 18487 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:18:37.311769 18487 pending_rounds.cc:85] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 5
I20260709 13:18:37.312417 18487 pending_rounds.cc:107] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:18:37.311606 18412 rpcz_store.cc:276] 0709 13:18:35.836014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.848690 (+ 12676us) service_pool.cc:224] Handling call
0709 13:18:37.310958 (+1462268us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b540011bcd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:37.311074 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143810304}
I20260709 13:18:37.313306 18382 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:37.313149 19025 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:37.294801 21862 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:37.318163 21848 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:37.318823 21848 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.319191 21848 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.319610 21862 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:37.320711 21669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.033s	sys 0.031s
I20260709 13:18:37.322104 21817 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:37.323179 18308 leader_election.cc:400] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10.
I20260709 13:18:37.335770 18308 leader_election.cc:403] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:37.313470 18487 raft_consensus.cc:2889] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:37.319837 21856 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:37.323949 21867 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:37.325619 21807 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.326349 21778 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.324436 18340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:18:37.347147 18340 raft_consensus.cc:606] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:18:37.347601 18340 raft_consensus.cc:614] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:37.327389 19060 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:37.339244 21856 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.340425 21864 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.340936 21860 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.341512 21583 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:37.343667 18487 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:37.343974 18308 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:37.345010 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2001) took 1300 ms. Trace:
I20260709 13:18:37.314502 21825 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:18:37.329577 21669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.035s	sys 0.031s
I20260709 13:18:37.380931 21860 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.383637 21669 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10.
I20260709 13:18:37.384323 21669 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.384359 21897 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:37.384842 21669 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:37.385206 21860 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:37.369268 21778 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.386955 21669 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:37.383649 21820 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:18:37.388430 21778 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:37.388665 21856 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:37.387406 21449 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:37.389635 21449 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:37.390551 18340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:55720
I20260709 13:18:37.387454 21825 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.391397 18340 raft_consensus.cc:606] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:18:37.391870 18340 raft_consensus.cc:614] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:37.392752 21825 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:37.385756 21860 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:37.393280 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.336938 21613 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:37.347009 21817 raft_consensus.cc:697] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:37.395134 21817 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.395716 19060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:18:37.346752 21867 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.377657 18488 rpcz_store.cc:276] 0709 13:18:36.044322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.057417 (+ 13095us) service_pool.cc:224] Handling call
0709 13:18:36.066282 (+  8865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.359361 (+293079us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b480021ccd8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a3e05aa1 00007f40a3dfcb37 00007f40a3dfc9ca 00007f40a3ef426f 00007f40a3ef3f37 00007f40a3f0855c 00007f40a3f08508 00007f40a3f08488 00007f40a3f08443 00007f40a3f076ec 00007f40a2e31a96
0709 13:18:37.335749 (+976388us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b1800386aa0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409ea844bc 00007f409bdd248b 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdec455 00007f409eed4060 00007f409eed4bfb 00007f409eedf64b
0709 13:18:37.335913 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.335952 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:37.344634 (+  8682us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:37.344699 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.344802 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.344944 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25236,"raft.queue_time_us":71651,"raft.run_cpu_time_us":2477,"raft.run_wall_time_us":217680,"spinlock_wait_cycles":29821568,"thread_start_us":46929,"threads_started":1}
I20260709 13:18:37.400110 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:37.396256 19060 raft_consensus.cc:606] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:37.413039 21820 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.414233 18488 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:37.417676 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:37.393802 21848 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:37.417402 21820 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.377247 21864 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:37.390472 21449 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.417676 18488 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:37.423159 21848 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:37.407810 21613 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.427002 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2016) took 1632 ms. Trace:
I20260709 13:18:37.427464 18410 rpcz_store.cc:276] 0709 13:18:35.794383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.795047 (+   664us) service_pool.cc:224] Handling call
0709 13:18:35.816083 (+ 21036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.060670 (+244587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.426733 (+1366063us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54000a82d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:37.426935 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":548782976}
W20260709 13:18:37.434561 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.450767 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:37.451200 21867 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:37.451359 18489 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.457774 18489 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:37.458958 18382 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:37.424322 21814 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:18:37.478312 18488 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:37.449194 21847 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.491335 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.472242 21848 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:37.488641 21752 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.501490 21848 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:37.510604 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:37.511751 19060 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:37.512090 21752 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.526799 21848 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:37.527138 21752 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:37.492280 21847 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.510761 21807 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:37.554431 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:37.555104 18485 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:37.556550 19060 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:37.560747 21613 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:37.566454 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.567569 21847 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:37.568949 21907 log.cc:927] Time spent T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:37.575857 18382 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:37.589332 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 245454us
I20260709 13:18:37.590525 18308 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:37.586143 21792 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:37.597426 18308 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:37.602447 18308 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:37.598022 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.597545 21792 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.606447 21792 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.594157 21721 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:37.612694 18335 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:37.614091 21856 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.614573 18342 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:37.616732 21856 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.610926 21639 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:18:37.597834 21864 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:37.608660 21591 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:37.607266 21613 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:37.623607 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:37.624529 18412 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:37.631491 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:37.610073 21867 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:18:37.609689 21914 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 13:18:37.631567 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:37.649576 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.639398 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:37.696986 18342 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:37.785907 18491 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:37.795753 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 43825.1us
I20260709 13:18:37.775151 18307 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:37.794597 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:37.664373 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2038) took 1160 ms. Trace:
W20260709 13:18:37.864748 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 70232.8us
I20260709 13:18:37.738770 18487 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:18:37.868177 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 93110.2us
I20260709 13:18:37.875993 18307 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:37.717706 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.770512 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:37.862991 18415 rpcz_store.cc:276] 0709 13:18:36.504085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.980042 (+475957us) service_pool.cc:224] Handling call
0709 13:18:37.311763 (+331721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.312048 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.312073 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:37.312107 (+    34us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:37.312150 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.312204 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.664207 (+352003us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b540011bcd0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:37.664317 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":387,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":1888,"spinlock_wait_cycles":762220416}
W20260709 13:18:37.736007 21923 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:18:37.716841 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:37.838632 18273 debug-util.cc:398] Leaking SignalData structure 0x7b0800135140 after lost signal to thread 17231
W20260709 13:18:37.888407 18273 debug-util.cc:398] Leaking SignalData structure 0x7b080016f160 after lost signal to thread 18276
I20260709 13:18:37.737670 21807 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.890726 21807 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:37.891680 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:37.892267 18341 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:37.892558 18273 debug-util.cc:398] Leaking SignalData structure 0x7b0800194140 after lost signal to thread 18290
W20260709 13:18:37.893216 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.662406 21412 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:37.622327 21856 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:37.840776 21841 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.876626 21669 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:37.876601 21012 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.890218 18411 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:37.837638 21639 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.750986 21860 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:37.883183 21778 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:37.885070 21449 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:37.904887 21778 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.750795 21721 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.839298 21836 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.696919 21825 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.898555 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 128157us
I20260709 13:18:37.796172 21613 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:37.821976 21882 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:37.624874 21817 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.271s
I20260709 13:18:37.632833 21847 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.263s
I20260709 13:18:37.795971 21915 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.633157 21225 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.270s
I20260709 13:18:37.919947 21778 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.922413 18341 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:37.905951 21856 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:37.903064 21669 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:37.894312 21845 consensus_queue.cc:1059] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:18:37.918217 21925 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:37.938040 21836 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.911244 21012 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.918004 21860 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:37.945145 21807 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:37.945124 21613 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:37.946178 21882 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:37.948355 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.945547 21824 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:37.932703 21721 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.941906 21792 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.902742 21412 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.950785 21867 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.910481 21639 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.964628 21669 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:37.951133 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:37.986105 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 91330.3us
I20260709 13:18:37.968381 21925 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:37.935396 21825 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:37.968765 21856 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:38.014194 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 137068us
I20260709 13:18:38.016407 18341 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:38.017254 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:38.007279 21927 log.cc:927] Time spent T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:18:38.017982 18341 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:37.981751 21591 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:37.962145 21915 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:38.024343 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.025283 18341 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:38.028741 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.033059 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.014671 21925 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.034180 18341 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 8: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:18:38.031425 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.022467 21914 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.046716 18341 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:38.048597 18341 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:38.011336 21867 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:38.069271 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 135337us
I20260709 13:18:38.073851 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:38.071776 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:38.027833 21591 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:38.050192 21808 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:38.080089 18491 raft_consensus.cc:2393] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:38.110193 18486 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:38.110584 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:38.111111 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:38.111188 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:38.112627 18486 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:38.116976 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:38.117772 18490 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
W20260709 13:18:38.142174 21931 log.cc:927] Time spent T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:18:38.121315 21808 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:38.144850 18273 debug-util.cc:398] Leaking SignalData structure 0x7b0800143460 after lost signal to thread 18368
W20260709 13:18:38.145193 18273 debug-util.cc:398] Leaking SignalData structure 0x7b08000f1060 after lost signal to thread 18369
W20260709 13:18:38.149991 18384 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.536s	user 0.015s	sys 0.024s
W20260709 13:18:38.150348 18384 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.536s	user 0.015s	sys 0.024s
W20260709 13:18:38.150606 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 1.54428e+06us
I20260709 13:18:38.053305 21914 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:38.169092 21933 log.cc:927] Time spent T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:18:38.196375 18273 debug-util.cc:398] Leaking SignalData structure 0x7b08003fd840 after lost signal to thread 18443
W20260709 13:18:38.199741 18273 debug-util.cc:398] Leaking SignalData structure 0x7b08003fd8a0 after lost signal to thread 18444
I20260709 13:18:38.196640 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:38.200716 18490 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.077744 21934 consensus_queue.cc:1059] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
W20260709 13:18:38.201442 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 50103us
I20260709 13:18:38.169656 21721 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:38.212883 19026 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.596s	user 0.004s	sys 0.006s
W20260709 13:18:38.214941 19026 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.598s	user 0.004s	sys 0.006s
I20260709 13:18:38.075161 21856 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:38.221254 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.200771 21412 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.193043 21860 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:38.194751 21524 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:38.213248 21613 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:38.213411 21882 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.216966 21792 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.239993 18337 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:38.243373 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 170569us
W20260709 13:18:38.234022 21928 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:18:38.228210 21825 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.249782 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 738) took 1056 ms. Trace:
I20260709 13:18:38.231758 21012 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:38.250526 18493 rpcz_store.cc:276] 0709 13:18:37.193171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.321162 (+127991us) service_pool.cc:224] Handling call
0709 13:18:37.321488 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.321797 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.321826 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:37.335345 (+ 13519us) log.cc:844] Serialized 26 byte log entry
0709 13:18:37.843059 (+507714us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b1800207940. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:18:38.005736 (+162677us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:38.005795 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.005887 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.244627 (+238740us) raft_consensus.cc:1685] finished
0709 13:18:38.244662 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.249714 (+  5052us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":855,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":11662,"spinlock_wait_cycles":16674048,"thread_start_us":162444,"threads_started":1,"wal-append.queue_time_us":711731}
I20260709 13:18:38.255031 18490 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:38.255949 18411 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:38.256670 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:38.258671 21946 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.260675 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:38.270749 21946 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.262125 18412 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:38.271788 21836 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:38.279498 21677 raft_consensus.cc:3055] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:38.280019 21677 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:38.282083 21915 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:38.284781 21924 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.414s	user 0.003s	sys 0.000s
I20260709 13:18:38.288398 21820 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.248267 21639 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.294843 21591 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:38.236225 21524 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.298687 21759 raft_consensus.cc:3055] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:38.299310 21759 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:38.300520 21759 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.262836 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:38.302850 21932 log.cc:927] Time spent T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:18:38.265661 21914 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:38.268584 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:38.269330 21845 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.271257 21867 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.266120 21869 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:38.297626 21524 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:38.305521 19058 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:38.305627 18485 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:38.312906 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:38.314270 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 1998) took 2268 ms. Trace:
I20260709 13:18:38.317044 18492 rpcz_store.cc:276] 0709 13:18:36.037848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.051642 (+ 13794us) service_pool.cc:224] Handling call
0709 13:18:38.305171 (+2253529us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b54000dcfd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:38.306591 (+  1420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160964480}
W20260709 13:18:38.320173 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 75873.5us
I20260709 13:18:38.321133 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2206) took 2372 ms. Trace:
I20260709 13:18:38.321517 18484 rpcz_store.cc:276] 0709 13:18:35.948486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.949581 (+  1095us) service_pool.cc:224] Handling call
0709 13:18:35.965958 (+ 16377us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:36.007250 (+ 41292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.007277 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:37.947082 (+1939805us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b2c001042f8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:18:37.947930 (+   848us) log.cc:844] Serialized 78 byte log entry
0709 13:18:38.044793 (+ 96863us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:38.044848 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.044948 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.313732 (+268784us) raft_consensus.cc:1685] finished
0709 13:18:38.313761 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.321059 (+  7298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7571,"raft.queue_time_us":41884,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"spinlock_wait_cycles":4574464,"thread_start_us":66708,"threads_started":1,"wal-append.queue_time_us":199654}
I20260709 13:18:38.328820 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:38.314954 21759 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.334993 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:38.339495 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.281028 21677 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:38.322302 21769 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.334609 18382 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:38.336869 21867 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.331482 18384 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:38.328439 21820 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:38.328126 21709 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.303798 21669 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.336896 21954 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.353039 21792 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:38.356894 21792 raft_consensus.cc:697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:38.356729 21954 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:38.353403 21807 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:38.359375 21954 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:38.359266 21792 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.360126 21954 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:38.360760 21954 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.327939 21946 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.362859 21677 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.363279 21896 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:38.363195 21807 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:38.364679 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:38.346101 21808 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.373193 18457 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:38.374555 18490 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:38.375345 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:38.376032 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:38.376128 18457 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:38.377323 18489 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:38.365861 21954 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.347651 21867 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.368875 21896 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:38.380053 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.368305 21820 raft_consensus.cc:697] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:38.320861 21845 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.382459 18457 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:38.383755 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:38.382763 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.386085 21778 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:38.375556 21807 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:38.417055 21807 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:38.386787 18273 debug-util.cc:398] Leaking SignalData structure 0x7b0800287460 after lost signal to thread 18517
I20260709 13:18:38.418385 18336 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:38.354113 21769 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.384552 21825 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:38.379869 21808 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:38.388250 21867 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.388696 21820 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.383505 21863 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:38.389307 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:38.395002 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.396061 21869 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:38.406373 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.404989 18341 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:38.407231 18489 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:38.415005 21778 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:38.418463 18273 debug-util.cc:398] Leaking SignalData structure 0x7b080010ec80 after lost signal to thread 18518
I20260709 13:18:38.368673 21709 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.428035 18418 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:18:38.427881 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:38.443318 18418 pending_rounds.cc:85] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 9
W20260709 13:18:38.442975 18273 debug-util.cc:398] Leaking SignalData structure 0x7b08001a97a0 after lost signal to thread 19086
I20260709 13:18:38.443598 18418 pending_rounds.cc:107] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:18:38.443866 18418 raft_consensus.cc:2889] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:38.444235 18273 debug-util.cc:398] Leaking SignalData structure 0x7b080034a760 after lost signal to thread 21771
I20260709 13:18:38.442363 18493 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:38.445640 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.420848 21940 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.449457 19060 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:38.450320 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.451099 18341 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:38.456805 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:38.460184 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.460642 18341 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:38.468231 18489 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:38.426651 21825 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:38.427052 21957 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.477764 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.475340 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:38.476313 18341 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:38.479396 19056 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:18:38.475126 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.480337 18341 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:18:38.470594 18457 leader_election.cc:336] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.517s (SENT)
I20260709 13:18:38.482105 18457 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:38.466037 21834 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:38.475641 21772 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.486790 21808 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:38.456131 21869 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:38.490195 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 69808.4us
I20260709 13:18:38.459800 21461 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.490103 21897 raft_consensus.cc:993] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:18:38.478241 21825 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.493414 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.495927 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.447538 21863 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.465565 21939 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:18:38.516724 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:38.499809 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 77904.3us
I20260709 13:18:38.492632 21845 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.501269 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:38.501686 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.517760 19061 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:18:38.481446 21925 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.524292 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.530066 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.531205 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.531435 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.531739 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.531859 19060 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 4.
I20260709 13:18:38.534030 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.534668 19059 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:38.536010 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.536515 19059 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:38.499643 21461 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.532869 21812 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:18:38.539065 21461 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:38.495213 21772 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.547224 21772 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:38.525745 21925 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.548132 18337 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:38.527347 21709 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.552426 18337 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:38.529143 21897 raft_consensus.cc:1081] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:18:38.528266 21669 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.554203 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.555518 19059 raft_consensus.cc:1240] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:18:38.561538 19054 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:38.557442 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:38.558797 19058 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 872) took 1861 ms (client timeout 2217 ms). Trace:
I20260709 13:18:38.559293 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:38.562534 19058 rpcz_store.cc:269] 0709 13:18:36.687520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.688803 (+  1283us) service_pool.cc:224] Handling call
0709 13:18:38.548722 (+1859919us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540055a5d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:38.548870 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3645415168}
I20260709 13:18:38.532873 21835 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:38.494287 21834 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.565203 18382 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:38.566893 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:38.566248 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.567822 19062 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:38.568670 19056 raft_consensus.cc:2410] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:18:38.567823 21709 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.573724 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 53714.4us
I20260709 13:18:38.574373 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.558514 21807 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:38.575237 19026 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:38.580996 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 151676us
W20260709 13:18:38.585467 18413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 2040) took 1887 ms (client timeout 1613 ms). Trace:
I20260709 13:18:38.586416 18384 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:38.585829 18413 rpcz_store.cc:269] 0709 13:18:36.698318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.706244 (+  7926us) service_pool.cc:224] Handling call
0709 13:18:38.585281 (+1879037us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b540032fd54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:38.585403 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47751936}
I20260709 13:18:38.576375 21792 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:38.572425 21709 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:38.537117 21896 consensus_queue.cc:1059] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:18:38.567929 21940 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:18:38.586380 21461 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:38.572880 21835 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:38.592343 21961 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 13:18:38.590937 21942 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:18:38.605029 19026 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:38.593299 21845 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:38.593407 21792 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.611047 21461 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:38.611452 21461 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:38.611814 21461 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:38.619808 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 705) took 1003 ms. Trace:
I20260709 13:18:38.620149 19026 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:38.620431 18340 rpcz_store.cc:276] 0709 13:18:37.616730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.623805 (+  7075us) service_pool.cc:224] Handling call
0709 13:18:38.618860 (+995055us) spinlock_profiling.cc:243] Waited 893 us on lock 0x7b5800002a98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:18:38.619129 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.619354 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.619391 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.619451 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:38.619502 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.619584 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.619730 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052992}
I20260709 13:18:38.621987 21461 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.599282 18493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:18:38.630748 18493 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:38.592185 21965 consensus_queue.cc:1059] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:18:38.631250 18493 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.628850 19026 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:38.623884 21792 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.638885 21516 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.627914 21772 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:38.639849 21709 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:38.639846 21516 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:38.641973 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:38.628170 21869 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:38.647352 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 49463.4us
I20260709 13:18:38.631176 21845 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:38.648612 21834 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:38.648993 21845 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.653033 21835 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:38.653599 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:38.655480 21461 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:38.653841 18493 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.647265 21516 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.662706 18493 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.664374 21752 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:38.665436 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 681) took 2479 ms. Trace:
I20260709 13:18:38.665092 21752 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.665808 18338 rpcz_store.cc:276] 0709 13:18:36.167181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.197220 (+ 30039us) service_pool.cc:224] Handling call
0709 13:18:36.714103 (+516883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.715748 (+  1645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.646308 (+1930560us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54000582d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:38.646439 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1188039552}
I20260709 13:18:38.670272 21752 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:38.670629 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.672127 21863 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.674489 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:38.675282 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:38.676424 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:38.677425 18489 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:38.679664 21783 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:18:38.686242 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 84607.3us
I20260709 13:18:38.637029 21968 raft_consensus.cc:3055] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:38.691408 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:38.693195 18335 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:38.695561 18488 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:38.703182 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 704) took 1086 ms. Trace:
I20260709 13:18:38.697736 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:38.697611 21834 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:38.699608 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:38.700292 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:38.703548 18335 rpcz_store.cc:276] 0709 13:18:37.616416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.616522 (+   106us) service_pool.cc:224] Handling call
0709 13:18:38.653452 (+1036930us) spinlock_profiling.cc:243] Waited 87.9 ms on lock 0x7b5800002a98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:18:38.703129 (+ 49677us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202171648}
I20260709 13:18:38.657461 21825 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:38.704329 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:38.707150 18415 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:38.624617 21966 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:18:38.714361 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:38.716871 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:38.717402 18416 raft_consensus.cc:2410] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:38.717433 18493 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:38.715262 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:38.718370 18419 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:38.636369 21896 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 13:18:38.721429 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.727039 18336 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:38.727595 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.728159 18337 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:38.728950 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.735745 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.736486 18341 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:38.728878 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:38.739763 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 50367.1us
I20260709 13:18:38.702630 21968 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:38.704507 21957 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:38.746168 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:38.746451 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:38.754621 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.757826 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:38.759266 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:38.750571 21516 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:38.725203 21856 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.766983 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.702575 21569 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:18:38.771018 18487 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:38.740821 21591 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.772903 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:38.746326 21955 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.721063 21867 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 13:18:38.773730 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 91581.8us
I20260709 13:18:38.756606 18309 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:38.797042 18457 leader_election.cc:336] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 2.103s (SENT)
I20260709 13:18:38.797475 18457 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:38.776119 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2232) took 1273 ms. Trace:
I20260709 13:18:38.798472 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 702) took 1182 ms. Trace:
I20260709 13:18:38.798007 18485 rpcz_store.cc:276] 0709 13:18:37.502917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.588330 (+ 85413us) service_pool.cc:224] Handling call
0709 13:18:38.305342 (+717012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.316167 (+ 10825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.775869 (+459702us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54000dcfd0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:38.776044 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1648162688}
I20260709 13:18:38.799233 18342 rpcz_store.cc:276] 0709 13:18:37.615855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.615976 (+   121us) service_pool.cc:224] Handling call
0709 13:18:37.616218 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.829334 (+213116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.776826 (+947492us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b54000e10d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:38.798393 (+ 21567us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120424704}
I20260709 13:18:38.800781 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.803467 18309 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:38.805605 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:38.801554 18342 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:38.808036 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.808784 18342 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:38.809845 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.811198 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.811898 18342 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:38.812906 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.768689 21194 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.826414 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:38.827083 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 43653.3us
I20260709 13:18:38.828549 18411 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:38.828715 18307 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:38.826711 18309 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:38.829561 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.831161 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.833602 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:38.835558 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:38.841480 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:38.774520 21808 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:38.842597 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 88521.2us
I20260709 13:18:38.854074 19058 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:38.854388 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.855214 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.837788 18307 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:38.844446 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:38.857025 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:38.855118 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.864784 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.822218 21860 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:38.802392 21957 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:38.846326 18342 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:38.825991 21820 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:38.834434 21639 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:38.832026 21807 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:38.876040 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:38.859524 21613 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:38.889611 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:38.827366 21449 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:18:38.889979 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:38.773679 21856 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.797869 21591 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:38.774063 21971 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:18:38.851890 21778 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.895383 19058 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:38.889329 21757 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.845494 21956 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:38.888253 21759 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:38.806532 21955 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:38.858382 21914 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:38.851207 21896 consensus_queue.cc:1059] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:18:38.880913 21940 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:38.840080 21194 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.832201 21836 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:18:38.882987 21639 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:38.911864 18342 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:38.911926 18340 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:38.893828 21613 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.945701 21639 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:38.945844 21613 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.910840 21757 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.948158 21757 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.875471 21869 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:18:38.950459 21972 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.240s	user 0.002s	sys 0.003s
I20260709 13:18:38.887694 21820 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.919054 21969 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.951634 21969 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:38.952039 21969 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.927210 21856 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.928085 18344 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:38.952908 21820 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.881744 21957 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:38.899053 21965 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.902168 21971 consensus_queue.cc:1243] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:38.892755 21848 consensus_queue.cc:1059] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:18:38.958649 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 215261us
I20260709 13:18:39.000159 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.001070 18486 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:38.911985 21956 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.002766 18492 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:39.003913 21956 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.905352 21583 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:18:38.988689 21955 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:38.988433 21792 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:38.989387 21807 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:38.995620 21957 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:38.997987 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.011296 18485 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:39.006858 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:38.997437 21613 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:39.020802 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 163843us
I20260709 13:18:39.020823 18411 raft_consensus.cc:2368] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8.
I20260709 13:18:39.023116 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:39.024473 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:39.025903 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.026971 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:39.026458 18307 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:39.032436 18307 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:39.030511 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.031224 19060 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:18:39.034516 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:39.029981 18486 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:39.030108 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:39.015992 21807 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.039431 21914 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:39.047866 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 150527us
I20260709 13:18:39.029562 21955 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:18:39.029742 21980 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:39.043007 21449 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:39.046082 21848 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.081966 21812 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:18:39.059376 21613 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:39.069932 21914 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.051198 21759 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:39.048751 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:39.114435 21591 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:39.118403 21982 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:18:39.122745 21787 raft_consensus.cc:3055] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:39.047801 21981 consensus_queue.cc:1059] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:18:39.052493 21836 consensus_queue.cc:1059] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:18:39.139871 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:39.207970 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 68190.8us
I20260709 13:18:39.209208 18384 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:39.140702 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 91999.1us
W20260709 13:18:39.146862 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 101649us
I20260709 13:18:39.099174 21914 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.138717 21778 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:39.090559 21848 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:39.148063 21980 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:39.248556 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.249342 18486 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:39.150085 21787 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:39.207793 21194 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:39.245805 21412 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:39.268468 21792 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:39.269548 21787 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.270918 21787 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.274299 21759 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.274951 21759 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.240749 21569 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:39.278105 21569 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.278477 21569 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:39.279035 21759 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:39.251988 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:39.258564 21769 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:39.259814 21955 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:39.265152 21990 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:39.267007 21969 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.280681 21968 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.283123 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:39.291680 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.284025 21862 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:39.254626 21986 log.cc:927] Time spent T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:18:39.292563 18484 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:39.292172 18335 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.145216 21954 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
W20260709 13:18:39.302407 18458 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 2.217s (SENT) [suppressed 36 similar messages]
I20260709 13:18:39.303562 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:39.314935 21925 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:39.315786 21925 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.303157 19025 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:39.268491 21412 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.317859 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.319502 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:39.319746 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.320322 18342 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:39.319828 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.321051 18484 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:39.321661 18335 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:39.324985 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:39.326712 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:39.329947 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.326639 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.295352 21769 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:39.316180 21925 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:39.333492 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:39.358774 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.334868 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:39.330860 18485 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:39.361744 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.348968 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.352283 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:39.350574 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:39.315961 21969 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:39.286339 21955 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.326259 21412 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.332213 21968 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.292940 21990 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.368857 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.369656 18489 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:39.370668 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:39.371646 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.356115 21769 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.372476 21769 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:39.372268 21969 consensus_queue.cc:1059] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:39.373034 18382 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:39.352819 21808 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:39.299716 21862 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:39.332405 21194 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:39.374511 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.367597 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:39.377220 18485 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:39.361320 21778 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:39.380256 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:39.381029 19058 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:39.364969 21807 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:39.384776 18309 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:39.386482 18338 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:39.388922 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:39.389694 19057 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:39.373823 21940 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:39.394989 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:39.378027 21808 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.380085 21194 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.362892 21639 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.405586 18338 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:39.408667 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 666) took 1095 ms. Trace:
I20260709 13:18:39.419299 18418 rpcz_store.cc:276] 0709 13:18:38.312937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.313095 (+   158us) service_pool.cc:224] Handling call
0709 13:18:38.313432 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.444324 (+130892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.408422 (+964098us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400177fd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:39.408615 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256649472}
I20260709 13:18:39.420833 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.424906 18492 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:39.425123 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.426615 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.393558 21591 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:39.428622 18418 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:39.436617 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.395363 21807 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:39.395032 21940 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:39.439603 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.416492 21194 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.444787 18418 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:39.407270 21808 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.406364 21957 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:39.446631 18490 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:39.446822 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.448441 18413 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:39.448451 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.449131 18418 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:39.449958 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.450897 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.451826 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.453193 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.453712 18418 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:39.514292 19058 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:39.435916 21591 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.514281 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:39.447539 21991 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:18:39.439832 21807 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.447355 21940 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.529004 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.529948 21783 consensus_queue.cc:1059] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:39.544384 21639 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:39.546705 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:39.558612 21759 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:39.559145 21759 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.561657 21759 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:39.564023 22000 log.cc:927] Time spent T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:18:39.568748 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.570286 19058 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:18:39.570358 18415 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:39.521579 21980 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 13:18:39.573877 21998 log.cc:927] Time spent T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:18:39.576375 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:39.578308 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 203053us
I20260709 13:18:39.592443 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:39.518611 21848 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:39.522749 21591 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:39.594125 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 211900us
I20260709 13:18:39.595871 18309 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:39.549338 21569 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.615226 18415 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:39.552603 21807 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.623952 18458 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:39.635308 19026 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:39.590719 21957 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.648949 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:39.650027 21992 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:39.650884 19026 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:39.651486 21992 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:39.652443 21992 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.651481 21981 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:39.653373 21981 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:39.653880 21981 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:39.652634 21787 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:39.643180 21994 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:18:39.657855 19026 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:39.669831 21992 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.670884 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:39.674543 21992 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:39.675648 18307 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:39.675807 21992 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:39.681732 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:39.690339 18415 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:18:39.642999 21759 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:39.706103 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:39.682898 22008 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.683022 21980 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:18:39.708367 22001 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:39.752463 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2145) took 1541 ms. Trace:
I20260709 13:18:39.753017 18339 rpcz_store.cc:276] 0709 13:18:38.210783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.222345 (+ 11562us) service_pool.cc:224] Handling call
0709 13:18:38.228030 (+  5685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.371234 (+143204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.371257 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.378431 (+  7174us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.426363 (+ 47932us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:38.448191 (+ 21828us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.448483 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.448556 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.698489 (+1249933us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b1800456fa0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:18:39.752084 (+ 53595us) raft_consensus.cc:1685] finished
0709 13:18:39.752210 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.752388 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3736,"prepare.queue_time_us":29214,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2672,"raft.queue_time_us":8990,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":18983,"spinlock_wait_cycles":5398272,"thread_start_us":175398,"threads_started":2,"wal-append.queue_time_us":74931}
I20260709 13:18:39.697754 21992 consensus_queue.cc:1059] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:18:39.758596 21992 raft_consensus.cc:3055] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:39.759039 21992 raft_consensus.cc:740] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:39.760010 21992 consensus_queue.cc:260] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.761508 21992 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.761986 22008 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.764720 22008 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:39.767342 21569 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:39.771955 22000 log.cc:927] Time spent T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:18:39.774092 21997 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:18:39.776916 21990 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:39.778208 22005 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.778750 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2046) took 1020 ms. Trace:
I20260709 13:18:39.778846 22005 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.779419 18411 rpcz_store.cc:276] 0709 13:18:38.758155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.841160 (+ 83005us) service_pool.cc:224] Handling call
0709 13:18:39.778492 (+937332us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54003638d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:39.778675 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410380160}
I20260709 13:18:39.780930 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:39.781594 18411 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.783581 18414 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:39.785060 18414 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:39.791370 19057 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:39.642988 21194 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.699348 21994 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:39.703629 21820 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:39.800843 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 205062us
I20260709 13:18:39.714679 21639 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:39.708803 22006 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:39.765413 21412 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:39.700533 21955 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:39.817345 18309 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:39.818306 22004 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.706295 21759 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:39.804337 21994 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.830564 22006 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:39.819046 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:39.827525 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:39.831485 21820 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.822762 18411 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:39.850162 21994 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:39.878604 22013 log.cc:927] Time spent T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:39.882606 22011 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:39.883939 21194 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:39.846441 21955 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:39.929731 18486 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:18:39.906270 21914 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.659s	user 0.011s	sys 0.000s
W20260709 13:18:39.930476 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 254933us
I20260709 13:18:39.905063 18411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34454
W20260709 13:18:39.933514 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 116239us
I20260709 13:18:39.894454 22006 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:39.906047 22008 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:39.846804 22004 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:39.930895 21951 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.076s	user 0.002s	sys 0.005s
W20260709 13:18:39.935869 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 137652us
W20260709 13:18:39.932741 21769 consensus_meta.cc:287] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.006s
I20260709 13:18:39.932754 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:39.883989 21759 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.939817 21639 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:39.953985 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:39.959903 21412 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:39.933379 22005 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:39.960541 21807 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:39.962780 22009 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:18:39.963586 18488 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:39.963828 22004 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:39.935832 21914 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.964404 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:39.964241 21981 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.965236 18338 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:18:39.968236 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:39.939684 21980 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:39.969175 18485 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.970203 21980 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.954130 21955 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:39.974871 21955 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.975273 21955 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.941550 22008 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:39.977448 22008 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:39.977972 22008 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:39.978962 21820 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:39.978889 22008 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.982188 18343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 709) took 2364 ms. Trace:
I20260709 13:18:39.968065 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:39.984594 18485 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:39.986234 21808 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.986619 18382 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:39.987160 21981 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:39.987984 18485 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:39.988898 21808 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:39.989683 22012 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:18:39.990741 18485 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:39.990199 21385 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:39.991216 21807 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:39.991487 21385 raft_consensus.cc:697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:39.928360 22011 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:39.992381 21412 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:18:39.966462 21639 raft_consensus.cc:697] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:39.994113 21759 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:40.015727 21225 raft_consensus.cc:3055] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:40.016233 21225 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:40.016441 21639 consensus_queue.cc:237] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.017417 22011 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.003450 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1070) took 1555 ms. Trace:
W20260709 13:18:39.994647 21925 consensus_meta.cc:287] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
I20260709 13:18:39.955968 21012 raft_consensus.cc:3055] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:40.004784 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.003005 21863 raft_consensus.cc:3055] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:40.019066 21863 raft_consensus.cc:740] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:40.005060 21709 raft_consensus.cc:3055] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:40.019623 21709 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:40.019789 21863 consensus_queue.cc:260] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.020411 21709 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.020709 21940 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.021773 21709 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:40.022059 21925 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.023202 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2053) took 1330 ms. Trace:
I20260709 13:18:40.020898 21863 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.018579 21012 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:40.025316 18417 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:40.023583 18412 rpcz_store.cc:276] 0709 13:18:38.692356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.692620 (+   264us) service_pool.cc:224] Handling call
0709 13:18:38.693042 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:38.715943 (+ 22901us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:38.740859 (+ 24916us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.093512 (+352653us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b180041e060. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c23a 00007f409eee6a2a
0709 13:18:39.363403 (+269891us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:39.364518 (+  1115us) log.cc:844] Serialized 52 byte log entry
0709 13:18:39.364666 (+   148us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:39.364957 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.021283 (+656326us) spinlock_profiling.cc:243] Waited 883 us on lock 0x7b180041e060. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f409bdf1a40 00007f409bdec4e4 00007f409bdec455 00007f40a28d43c7 00007f409eee69a7 00007f409eef60bf 00007f409eef6038
0709 13:18:40.021473 (+   190us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.021670 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.021735 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.021777 (+    42us) raft_consensus.cc:1685] finished
0709 13:18:40.021789 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.022359 (+   570us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b180041e060. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:18:40.023130 (+   771us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":655232,"prepare.queue_time_us":689288,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":101,"raft.queue_time_us":25953,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3555,"spinlock_wait_cycles":17424000,"thread_start_us":269643,"threads_started":1,"wal-append.queue_time_us":665993}
I20260709 13:18:39.993057 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2049) took 2113 ms. Trace:
I20260709 13:18:40.027928 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:40.028352 18484 raft_consensus.cc:2393] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:39.993471 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:39.982582 18343 rpcz_store.cc:276] 0709 13:18:37.617788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.632002 (+ 14214us) service_pool.cc:224] Handling call
0709 13:18:38.746713 (+1114711us) spinlock_profiling.cc:243] Waited 91.1 ms on lock 0x7b5800002a98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:18:38.746882 (+   169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.747185 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.747227 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.754086 (+  6859us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.625991 (+871905us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b1800265ae0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:18:39.918578 (+292587us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:39.918633 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.918738 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.981972 (+ 63234us) raft_consensus.cc:1685] finished
0709 13:18:39.981991 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.982133 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":462,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4232,"spinlock_wait_cycles":223641600,"thread_start_us":292283,"threads_started":1,"wal-append.queue_time_us":1189986}
W20260709 13:18:39.997274 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.018286 19055 rpcz_store.cc:276] 0709 13:18:38.448048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.448202 (+   154us) service_pool.cc:224] Handling call
0709 13:18:38.448615 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.515531 (+ 66916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.515582 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.515644 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:38.515696 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.003229 (+1487533us) spinlock_profiling.cc:243] Waited 66.6 ms on lock 0x7b54004f4054. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:40.003273 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.003395 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153278336}
I20260709 13:18:39.992447 18489 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:18:40.033056 18344 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:40.017576 21225 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.033799 21225 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.034451 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:40.033108 21012 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.035908 21012 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.037178 21964 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:39.951992 21769 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.056268 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:40.028463 18410 rpcz_store.cc:276] 0709 13:18:37.879381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.879546 (+   165us) service_pool.cc:224] Handling call
0709 13:18:37.893165 (+ 13619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.038093 (+144928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.038142 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.055531 (+ 17389us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.366349 (+310818us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:38.380767 (+ 14418us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.381541 (+   774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.381608 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.954272 (+572664us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b18003c01c0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef522 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:18:39.831889 (+877617us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b18003c01c0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:18:39.992815 (+160926us) raft_consensus.cc:1685] finished
0709 13:18:39.992838 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.992970 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11996,"prepare.queue_time_us":14286,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":2374,"raft.queue_time_us":114563,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":27163,"spinlock_wait_cycles":34191488,"thread_start_us":358783,"threads_started":2,"wal-append.queue_time_us":301815}
I20260709 13:18:40.057518 21769 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:40.058176 19059 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:40.059144 21940 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.060024 19061 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:40.060444 21856 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:40.061131 21856 consensus_queue.cc:1243] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:40.061365 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:40.061563 21856 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:40.061889 21856 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:40.062166 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:39.994091 21385 consensus_queue.cc:237] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:40.050552 21825 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:40.053804 21897 raft_consensus.cc:3055] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:40.054082 22024 raft_consensus.cc:2764] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:18:40.055228 21914 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:40.007450 21968 consensus_meta.cc:287] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.004s
I20260709 13:18:40.000849 21957 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.055660 21677 consensus_queue.cc:1059] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:40.064687 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.075752 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:40.078297 18492 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:40.078564 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:40.079164 18490 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:40.080435 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:40.081065 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 113066us
I20260709 13:18:40.081422 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 726) took 1352 ms. Trace:
I20260709 13:18:39.985473 22005 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:39.998749 21591 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.089672 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.081751 18341 rpcz_store.cc:276] 0709 13:18:38.729242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.874738 (+145496us) service_pool.cc:224] Handling call
0709 13:18:38.881408 (+  6670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.891618 (+ 10210us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:39.020712 (+129094us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.091443 (+ 70731us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.091501 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:39.091548 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.066780 (+975232us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b1800381160. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdbd2a6 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419
0709 13:18:40.081226 (+ 14446us) spinlock_profiling.cc:243] Waited 9.95 ms on lock 0x7b54000e97d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:40.081274 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.081374 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6075,"prepare.queue_time_us":28086,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":1068,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3161,"spinlock_wait_cycles":31255808,"thread_start_us":181764,"threads_started":2,"wal-append.queue_time_us":118435}
I20260709 13:18:40.082993 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:40.166018 18485 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:40.083441 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.084590 18308 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:40.083388 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.079375 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:40.111186 18416 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:40.094560 21930 consensus_queue.cc:1059] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:18:40.072366 21881 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:18:40.122452 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 61160.8us
I20260709 13:18:40.171509 18414 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:40.167819 18489 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.172791 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.106552 18490 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
W20260709 13:18:40.174817 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.126109 18491 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:40.126524 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 764) took 1451 ms. Trace:
I20260709 13:18:40.175441 18487 rpcz_store.cc:276] 0709 13:18:38.674961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.675056 (+    95us) service_pool.cc:224] Handling call
0709 13:18:40.124931 (+1449875us) spinlock_profiling.cc:243] Waited 94.9 ms on lock 0x7b54001b6f54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:40.126457 (+  1526us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218304768}
I20260709 13:18:40.063621 21897 raft_consensus.cc:740] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:40.124155 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 717) took 1397 ms. Trace:
I20260709 13:18:40.131209 18339 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:40.133558 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:40.176883 18340 rpcz_store.cc:276] 0709 13:18:38.726598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.740980 (+ 14382us) service_pool.cc:224] Handling call
0709 13:18:38.741337 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.944927 (+203590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.123866 (+1178939us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400416ed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:40.124083 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391710464}
I20260709 13:18:40.134980 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:40.136427 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:40.136469 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:40.161391 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 81971.4us
I20260709 13:18:40.136902 22023 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:40.182438 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:40.062695 21856 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.066780 21925 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.188372 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:40.189316 19062 raft_consensus.cc:2368] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7.
I20260709 13:18:40.178905 21930 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:40.190253 21930 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:40.108805 22005 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.191128 21930 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.192416 21930 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:40.193338 22005 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.170698 21882 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.186784 21955 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:40.201009 21955 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:40.202136 22023 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:40.202956 18489 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:40.204967 22023 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:40.207762 22006 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.166810 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:40.209112 18343 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:40.209457 21965 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:40.167851 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 83354.3us
I20260709 13:18:40.210495 21968 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:40.210795 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:40.211018 21968 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.211910 18308 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:40.212927 21968 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.213119 21792 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:40.212970 18308 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:40.168053 18411 raft_consensus.cc:606] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:18:40.100327 22024 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:40.170512 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:40.170636 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:40.219084 19061 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:40.169437 18415 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:40.220223 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.171115 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:40.173401 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:40.079766 22011 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:40.174089 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.175027 18414 raft_consensus.cc:2393] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:40.065937 21677 consensus_queue.cc:1243] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:40.177855 19059 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:40.181159 19058 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:40.230370 18419 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:40.208319 21861 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:40.214082 18411 raft_consensus.cc:614] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:40.214533 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:40.214581 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:40.217226 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.232389 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:40.088186 18493 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:18:40.213622 21792 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:40.178453 21881 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:40.183940 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.218214 21955 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:40.221716 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 48389.2us
I20260709 13:18:40.248626 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:40.233973 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.233938 18308 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:40.186288 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 676) took 1088 ms. Trace:
I20260709 13:18:40.235201 18418 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:40.218410 21856 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:40.239532 19058 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:40.241935 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:40.219915 22023 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:40.255447 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:40.255834 18308 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:40.221237 21930 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:40.227656 21964 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:40.250458 18413 rpcz_store.cc:276] 0709 13:18:39.097954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.625031 (+527077us) service_pool.cc:224] Handling call
0709 13:18:39.627772 (+  2741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.628046 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:40.033879 (+405833us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.185784 (+151905us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.185828 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:40.185890 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.186072 (+   182us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.186221 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":396381,"prepare.queue_time_us":407205,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":23443,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":151563,"threads_started":1}
I20260709 13:18:40.258220 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:40.257220 19025 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:40.261471 18415 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.262952 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:40.235245 21759 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.263625 19062 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:40.267551 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.268250 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:40.268882 19059 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:40.246533 21861 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:40.256022 21677 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:40.253849 21591 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.229807 22011 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.255620 22023 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:40.263036 21814 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:40.235245 21748 consensus_queue.cc:1059] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:18:40.303649 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:40.356117 19059 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:40.263691 21955 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:40.264883 21769 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:40.218796 21914 consensus_queue.cc:1175] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" responder_term: 10 status { last_received { term: 8 index: 9 } last_committed_idx: 9 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:40.229615 22024 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:40.306629 21814 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.307024 22023 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.326844 22006 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.330094 22011 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.334961 21881 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:40.335366 21863 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:40.335568 21943 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:40.336766 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:40.386324 18344 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.337343 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:40.337934 19062 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:18:40.386996 18343 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.338029 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:40.301107 21677 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:40.338447 21954 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:18:40.339483 18416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2054) took 1575 ms (client timeout 1712 ms). Trace:
I20260709 13:18:40.291882 22016 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:40.342581 21994 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.361027 21869 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.345216 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 89449.5us
I20260709 13:18:40.346694 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:40.348726 19027 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:40.349862 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:40.352377 18415 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:40.352941 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:40.353647 18489 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:40.353941 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:40.404207 18341 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:40.404598 19061 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:18:40.332901 21862 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:40.303913 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:40.359364 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:40.344477 21792 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:40.347693 22003 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.361554 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:40.433382 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 71903.4us
I20260709 13:18:40.434589 18458 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:40.435599 18489 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:18:40.435988 18489 pending_rounds.cc:85] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 7
I20260709 13:18:40.436210 18489 pending_rounds.cc:107] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:18:40.436424 18489 raft_consensus.cc:2889] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:40.365546 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:40.333635 21861 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.378686 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 728) took 1093 ms. Trace:
I20260709 13:18:40.439695 18338 rpcz_store.cc:276] 0709 13:18:39.285030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.419767 (+134737us) service_pool.cc:224] Handling call
0709 13:18:39.421994 (+  2227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.967879 (+545885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.378445 (+410566us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54001662d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:40.378623 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248773504}
I20260709 13:18:40.440424 18340 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:40.379335 22024 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:40.380388 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:40.441258 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:40.382570 19026 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:40.382750 21881 consensus_queue.cc:1059] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:40.351428 21752 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:18:40.383824 21863 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.384269 22008 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.361393 21814 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:40.396152 18416 rpcz_store.cc:269] 0709 13:18:38.764192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.770175 (+  5983us) service_pool.cc:224] Handling call
0709 13:18:40.339277 (+1569102us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400362ed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:40.339410 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2899389696}
I20260709 13:18:40.279721 21930 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:40.405833 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 57217us
I20260709 13:18:40.367054 22005 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:18:40.460521 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.460779 19027 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:40.407281 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:40.461385 18416 raft_consensus.cc:2368] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8.
W20260709 13:18:40.461850 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 54691us
I20260709 13:18:40.462579 18308 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:40.364856 21769 raft_consensus.cc:697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:40.404145 18490 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:40.437433 18487 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.469358 18490 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:40.437404 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:40.470320 18489 raft_consensus.cc:2393] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 6: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:40.474228 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2260) took 1479 ms. Trace:
I20260709 13:18:40.474743 18488 rpcz_store.cc:276] 0709 13:18:38.995191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.998488 (+  3297us) service_pool.cc:224] Handling call
0709 13:18:39.931455 (+932967us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b5800143198. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7eee 0000000000375939 00007f40a3e2b1e0 00007f40a3ef40c4 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:18:39.931618 (+   163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.964002 (+ 32384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.466488 (+502486us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b5400257954. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:40.474155 (+  7667us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90965760}
W20260709 13:18:40.438011 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.438114 18307 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:40.438668 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:40.397171 21677 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.380722 18238 catalog_manager.cc:5697] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:40.442119 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:40.380721 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:40.442292 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 59800.3us
I20260709 13:18:40.439720 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:40.482532 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34454 (request call id 89) took 1219 ms. Trace:
I20260709 13:18:40.443125 19057 raft_consensus.cc:2368] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
I20260709 13:18:40.482903 18411 rpcz_store.cc:276] 0709 13:18:39.242803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.902180 (+659377us) service_pool.cc:224] Handling call
0709 13:18:40.461695 (+559515us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400362ed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eed6853 00007f40a3ea460a 00007f409d42a7d4 00007f409d42a762 00007f409d42a691 00007f409d42a60c 00007f409d4298c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:40.461789 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541307648}
I20260709 13:18:40.395712 21943 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.445441 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.409168 22025 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:40.397610 21639 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:40.440927 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:40.495395 18338 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:40.452665 22017 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:40.393196 21449 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:40.448889 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:40.449594 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 167106us
I20260709 13:18:40.450526 18384 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:40.432492 21785 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:40.500505 21785 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.501027 21785 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.458396 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 674) took 1394 ms. Trace:
I20260709 13:18:40.502102 18417 rpcz_store.cc:276] 0709 13:18:39.063581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.593409 (+529828us) service_pool.cc:224] Handling call
0709 13:18:39.622900 (+ 29491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.028257 (+405357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.458081 (+429824us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54001c3ed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:40.458322 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925028608}
I20260709 13:18:40.503773 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:40.439467 21869 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.484020 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.448900 22022 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:40.481010 21955 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:40.519577 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:40.488963 22035 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.485173 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.490564 18418 raft_consensus.cc:2393] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:40.491230 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:40.452869 21835 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:40.481796 21981 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:18:40.508216 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 57808.1us
I20260709 13:18:40.499441 22017 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:40.496539 22034 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:40.522562 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.510736 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:40.523797 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.520505 22022 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:40.494449 21881 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:40.440518 22003 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.488539 18344 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:40.525127 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.485173 19027 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:40.532464 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:40.533111 18416 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.534088 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2268) took 1536 ms. Trace:
I20260709 13:18:40.536851 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:40.486668 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.521557 21965 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:40.519328 18487 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:40.505834 21968 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:18:40.522660 21955 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:40.498656 21990 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:18:40.666170 21012 consensus_meta.cc:287] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.002s
I20260709 13:18:40.505594 21969 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:18:40.505895 21639 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.528618 18457 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:40.669754 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 141241us
I20260709 13:18:40.671504 18457 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:40.505663 22025 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:40.653395 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 142770us
I20260709 13:18:40.655499 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:40.656399 18335 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:40.657512 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.658905 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:40.583355 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.659550 18491 rpcz_store.cc:276] 0709 13:18:39.006422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.006768 (+   346us) service_pool.cc:224] Handling call
0709 13:18:40.125711 (+1118943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.175295 (+ 49584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.533881 (+358586us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001b6f50. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:40.534030 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2548609920}
I20260709 13:18:40.509671 21449 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.544651 22017 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:40.536617 21981 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:40.650724 21862 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.672796 19056 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:40.671979 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.687565 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:40.689074 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.551476 22022 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.804380 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:40.806658 18419 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:40.529134 21783 consensus_queue.cc:1059] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
W20260709 13:18:40.790932 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 114466us
W20260709 13:18:40.791074 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 305951us
I20260709 13:18:40.810333 18335 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:40.791416 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.812470 18414 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:40.652760 21835 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:40.670056 21955 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:40.815923 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 272481us
I20260709 13:18:40.537456 22035 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.821622 18416 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:40.828439 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:40.829900 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.674623 21194 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:40.831996 18418 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 3.
I20260709 13:18:40.688469 21925 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:40.787175 21709 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.792074 21896 raft_consensus.cc:3055] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:18:40.812511 22033 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.448s	user 0.003s	sys 0.007s
W20260709 13:18:40.850755 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 179295us
I20260709 13:18:40.548508 21769 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.798775 21461 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:40.791978 22006 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:18:40.842619 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:40.825083 21639 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.846678 21225 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.851722 18457 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:40.851822 21994 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:40.901623 22016 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:40.902176 22016 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.902807 18412 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:40.904242 22016 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.904749 21835 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:40.905455 21856 consensus_meta.cc:287] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.647s	user 0.007s	sys 0.000s
I20260709 13:18:40.850814 21709 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:40.906225 21863 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.906719 18384 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:40.907660 21709 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:40.907938 18384 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:40.908185 21709 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.908850 21709 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:40.909286 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:40.866837 21981 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.910044 21759 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:40.910290 21869 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:40.910540 21759 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.912119 22025 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.912559 21759 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.852604 22011 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.915144 21748 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:40.915684 21748 raft_consensus.cc:697] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:40.881422 18457 leader_election.cc:400] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8.
W20260709 13:18:40.882525 22044 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:40.886070 21925 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.886847 18340 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: [4.5-8.7]
I20260709 13:18:40.916596 21748 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.918181 21449 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:40.919400 21943 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.839001 21881 consensus_queue.cc:1059] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:18:40.919878 21449 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:40.920460 21881 raft_consensus.cc:3055] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:40.920910 21881 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:40.920620 21449 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.829762 21862 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.895144 18309 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:40.895859 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 457795us
I20260709 13:18:40.899380 21882 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:40.899565 22043 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
W20260709 13:18:40.899960 22037 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 13:18:40.847409 21896 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:40.916369 18457 leader_election.cc:403] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:40.953003 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 71783.3us
I20260709 13:18:40.953665 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:40.919759 18290 auto_rebalancer.cc:893] Removing replace marker failed: Replica 20e06cff39b649c48d342b7431135303 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:40.956507 21639 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:40.956656 18290 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:18:40.891189 22035 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:40.957046 18290 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:18:40.889487 22022 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:40.931005 18343 consensus_meta.cc:287] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.001s
W20260709 13:18:40.923756 22023 consensus_meta.cc:287] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.000s
I20260709 13:18:40.931427 21863 consensus_queue.cc:1059] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:18:40.922043 21225 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.930667 21881 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:40.969398 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:40.936904 22003 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:40.940999 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.932384 18335 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:18:40.958587 18343 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:40.980114 18337 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:40.980355 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:40.964033 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.974884 18416 raft_consensus.cc:2376] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7. Re-sending same reply.
I20260709 13:18:40.958149 21882 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:40.976820 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 163251us
I20260709 13:18:40.964735 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.984956 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:40.981575 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.985998 18416 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:40.983214 18490 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:40.980973 18340 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
W20260709 13:18:40.976260 18457 leader_election.cc:336] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.501s (SENT)
I20260709 13:18:40.986038 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:40.985239 18419 raft_consensus.cc:2376] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8. Re-sending same reply.
I20260709 13:18:40.985687 18414 raft_consensus.cc:2376] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6. Re-sending same reply.
I20260709 13:18:40.995880 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:41.009310 18489 raft_consensus.cc:2393] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:40.952780 21930 consensus_queue.cc:1059] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:18:41.011729 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:40.981264 21814 consensus_meta.cc:287] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.001s
I20260709 13:18:40.958331 21516 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:18:40.987573 22034 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:41.019002 21194 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:41.005029 22003 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.978585 22049 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8.
I20260709 13:18:40.974037 22023 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:40.957053 21639 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:41.044957 19060 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:41.039341 19059 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:18:41.039628 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 729) took 1013 ms. Trace:
I20260709 13:18:41.014978 21882 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:41.017565 21881 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.048060 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:41.050689 19054 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:41.056778 19054 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:40.956693 21896 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.059755 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:41.020035 21863 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:18:41.062023 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:41.066104 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:41.066404 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:41.070803 19059 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:41.043273 22034 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:41.072692 19059 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:18:41.036836 21869 consensus_queue.cc:1059] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:18:41.033448 21836 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:18:41.033298 21814 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.035830 21012 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:18:41.074333 19059 pending_rounds.cc:85] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 5
I20260709 13:18:41.083184 19059 pending_rounds.cc:107] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:18:41.084112 19059 raft_consensus.cc:2889] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.083230 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:41.064844 21449 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:41.079512 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:41.094326 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:41.044710 22003 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:41.074707 21896 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:41.074010 21862 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:40.982306 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:41.107590 18458 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:41.101544 18238 catalog_manager.cc:5697] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 3 to 4, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 4 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.108722 22049 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.108870 19055 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:41.111439 18458 leader_election.cc:400] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7.
I20260709 13:18:41.128504 18458 leader_election.cc:403] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:41.128316 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:41.129168 19058 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.129565 18458 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:41.130452 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:41.048992 18342 rpcz_store.cc:276] 0709 13:18:40.026235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.026361 (+   126us) service_pool.cc:224] Handling call
0709 13:18:40.026666 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.075070 (+ 48404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.075114 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.075689 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.311824 (+236135us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b18003b3c20. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:18:40.451789 (+139965us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:40.486294 (+ 34505us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.888989 (+402695us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b18003b3c20. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f409bdf1a40 00007f409bdec4e4 00007f409bdec455 00007f409eed4060 00007f409eee6716 00007f409eef7287 00007f409eef7208
0709 13:18:41.039240 (+150251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.039337 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.039394 (+    57us) raft_consensus.cc:1685] finished
0709 13:18:41.039413 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.039561 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92254,"prepare.queue_time_us":28982,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":453841,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":6756,"spinlock_wait_cycles":67387392,"thread_start_us":289783,"threads_started":2,"wal-append.queue_time_us":435031}
I20260709 13:18:41.133292 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:41.136387 19058 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:41.137444 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:41.137562 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:41.138165 19059 raft_consensus.cc:2393] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 5: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:41.139595 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:41.142129 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:41.142373 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:41.143026 19059 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:41.143950 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:41.112303 21925 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.139953 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:41.157186 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:41.159914 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:41.160471 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:41.158171 19054 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:41.138689 22006 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:41.103793 21955 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.121433 22022 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:41.164170 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:41.156725 21785 consensus_meta.cc:287] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.655s	user 0.006s	sys 0.004s
I20260709 13:18:41.081784 21194 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.172106 19054 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:41.144362 21752 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:41.156926 21968 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:41.136952 22011 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7.
I20260709 13:18:41.128584 21971 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:18:41.177953 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:41.183013 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:41.170506 22049 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:41.164716 22006 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.188275 21968 raft_consensus.cc:697] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:41.200464 21968 consensus_queue.cc:237] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.145236 21792 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:18:41.177515 21785 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.195797 21971 consensus_queue.cc:1243] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:41.203341 21639 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:41.172219 21225 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:41.204438 21785 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:41.205577 21897 consensus_queue.cc:260] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:41.206508 22038 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.393s	user 0.000s	sys 0.003s
I20260709 13:18:41.207139 21897 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.203640 19061 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:18:41.209100 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.209429 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2062) took 1144 ms. Trace:
I20260709 13:18:41.212060 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:41.173002 21939 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:41.183907 21677 consensus_meta.cc:287] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.691s	user 0.005s	sys 0.005s
I20260709 13:18:41.212782 18484 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:41.209893 18410 rpcz_store.cc:276] 0709 13:18:40.065277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.080314 (+ 15037us) service_pool.cc:224] Handling call
0709 13:18:40.120680 (+ 40366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.120957 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.120993 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.335196 (+214203us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b2c001026c8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:18:40.335714 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.479993 (+144279us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:40.480043 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.480119 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.176305 (+696186us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:41.209221 (+ 32916us) raft_consensus.cc:1685] finished
0709 13:18:41.209242 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.209377 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19221120,"thread_start_us":143851,"threads_started":1,"wal-append.queue_time_us":200532}
I20260709 13:18:41.166280 21863 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:18:41.212251 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 81862us
I20260709 13:18:41.226935 18458 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:41.141055 21882 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:41.213660 22056 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:18:41.213053 22006 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.189100 22049 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:41.231612 18458 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:41.236699 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:41.119688 22034 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.226037 22023 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:41.242705 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.246541 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.234979 22022 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:41.250176 22022 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.250671 22022 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.254043 21814 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:41.256206 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:41.256861 18484 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.258327 22067 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:41.258752 22067 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.259073 22067 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.225782 21677 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.261402 21677 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:41.238389 22049 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.262094 18417 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:41.264850 19053 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
W20260709 13:18:41.269446 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.271425 18484 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:41.272877 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:41.229298 22011 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:18:41.278100 22070 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:41.278542 22070 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.278882 22070 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:41.282413 22006 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.285902 22023 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.286422 22023 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.286767 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:41.287302 18410 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.287345 22006 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:41.288461 22023 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:41.292414 22070 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.293864 18410 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:41.271703 21955 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:41.276122 21881 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:41.248559 22017 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.310534 18457 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:41.315794 18335 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:41.313566 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:41.317385 18411 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:41.318468 19059 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:18:41.319895 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:41.320693 18335 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:41.324218 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:41.325012 18341 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:41.326570 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:41.327419 19060 raft_consensus.cc:2393] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 10: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:41.330386 18457 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:41.331671 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:41.332532 18335 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:41.333616 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:41.328891 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:41.314612 22061 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:18:41.336566 19059 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:41.339426 18492 raft_consensus.cc:1240] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:41.338606 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:41.309458 22003 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:41.342579 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:41.343251 22070 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:41.343027 21812 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:41.340548 21971 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:41.345521 18384 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:41.346634 21955 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.350281 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:41.328490 21881 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:41.357185 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:41.339536 21925 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:41.365396 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:41.355809 22003 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:41.356357 22070 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.340409 21677 consensus_queue.cc:1059] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:18:41.360610 21792 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:41.362118 21968 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:41.377838 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:41.388195 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.390152 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 114416us
I20260709 13:18:41.391048 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:41.394003 18458 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:41.417462 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:41.362171 21955 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.383073 21792 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.382831 21964 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:41.420293 21861 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.427603 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:41.448590 18410 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:41.430542 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:41.451077 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:41.384047 21968 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:41.459379 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:41.419993 22003 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:41.458774 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:41.423597 22070 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:41.420110 21925 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:41.463939 18487 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:41.464504 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:41.462957 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:41.478485 18488 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:41.447851 21792 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.471443 18382 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:41.447005 22011 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.479112 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 101345us
I20260709 13:18:41.439393 21990 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.469834 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:41.441057 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:41.462302 18336 raft_consensus.cc:2955] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:41.474838 18491 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:18:41.448202 21964 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:41.459903 22051 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:41.465221 21968 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:41.545805 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 104829us
I20260709 13:18:41.546839 18458 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:41.558748 18458 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:41.485718 22070 raft_consensus.cc:697] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:41.442273 21881 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.562665 18458 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:41.499852 21964 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.564045 18410 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:18:41.465510 21861 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.478585 21812 consensus_queue.cc:1059] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:18:41.548887 22017 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:41.498005 22011 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.585440 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:41.480767 22022 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.560817 22073 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.565732 22003 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:41.562422 21925 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:41.590221 18339 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:41.357257 21971 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.600468 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:41.584137 22015 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:41.600728 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.545746 22051 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:41.593393 22077 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:18:41.601622 18485 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:41.608132 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:41.608968 18339 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.595397 21812 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.596577 22073 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.594861 22003 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:41.619843 18339 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
W20260709 13:18:41.635272 22084 log.cc:927] Time spent T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:41.643958 22011 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:41.645416 22022 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:41.646317 21861 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:41.647035 21971 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:41.647218 18339 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:18:41.651458 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 749971us
I20260709 13:18:41.605334 21990 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:18:41.653548 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 167128us
I20260709 13:18:41.652199 18308 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:41.655717 18308 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:41.621577 22003 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:41.686798 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 91329us
I20260709 13:18:41.607622 22015 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.705169 18339 raft_consensus.cc:1240] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:41.705592 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:41.706403 18487 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:41.686352 21385 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:18:41.707947 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:41.708778 18486 raft_consensus.cc:2410] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:18:41.708810 22050 log.cc:927] Time spent T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.900s	user 0.000s	sys 0.002s
I20260709 13:18:41.710443 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:41.710767 21897 consensus_meta.cc:287] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.004s
I20260709 13:18:41.620862 22070 consensus_queue.cc:237] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:41.711130 18486 raft_consensus.cc:2393] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:41.711483 18413 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:18:41.712749 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:41.713557 18413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2059) took 1456 ms (client timeout 1501 ms). Trace:
I20260709 13:18:41.713780 18415 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:18:41.717978 18415 pending_rounds.cc:85] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 6
I20260709 13:18:41.718401 18415 pending_rounds.cc:107] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:18:41.718696 18415 raft_consensus.cc:2889] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.713999 22046 consensus_queue.cc:1059] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:41.714800 18486 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:41.716018 22049 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:41.716327 22081 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:18:41.658969 21955 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:41.717175 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:41.815878 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 80922.2us
W20260709 13:18:41.717869 18413 rpcz_store.cc:269] 0709 13:18:40.257309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.257997 (+   688us) service_pool.cc:224] Handling call
0709 13:18:41.713373 (+1455376us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54002a6054. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:41.713507 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3340206464}
I20260709 13:18:41.817375 18493 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:41.718827 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:41.719291 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:41.719924 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:41.721345 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:41.723066 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:41.725615 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:41.686607 22023 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:41.705224 22074 log.cc:927] Time spent T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:18:41.659817 21882 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.818462 18487 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
W20260709 13:18:41.833899 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 114679us
I20260709 13:18:41.863971 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:41.834352 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:41.865876 18486 raft_consensus.cc:2393] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:41.833566 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:41.849856 18343 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:18:41.850920 18339 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:18:41.871614 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:41.872583 18339 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:41.833011 18335 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:41.875608 18491 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:41.734339 21385 consensus_queue.cc:1243] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:41.895814 18339 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:18:41.914088 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 75611.4us
I20260709 13:18:41.816695 21861 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.921991 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:41.865571 22022 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:41.931449 18339 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:41.922034 18340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.023s	sys 0.020s
W20260709 13:18:41.934700 18340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.023s	sys 0.021s
I20260709 13:18:41.941139 18343 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:18:41.866254 21955 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:41.953079 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:41.956661 18487 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:18:41.916941 22011 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:41.969851 18339 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:18:41.972796 18486 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:18:41.950034 22082 log.cc:927] Time spent T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:18:41.988662 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:41.990780 18491 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:41.929490 21783 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:42.001049 18457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.015s	sys 0.064s
I20260709 13:18:42.005021 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 1961) took 1043 ms. Trace:
W20260709 13:18:42.006381 18457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.015s	sys 0.065s
I20260709 13:18:41.959244 22017 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:42.007218 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 676846us
I20260709 13:18:42.005446 18336 rpcz_store.cc:276] 0709 13:18:40.961935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.962086 (+   151us) service_pool.cc:224] Handling call
0709 13:18:40.962629 (+   543us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:40.975540 (+ 12911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.975569 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:41.004787 (+ 29218us) log.cc:844] Serialized 608 byte log entry
0709 13:18:41.388315 (+383528us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b18004b2860. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:18:41.440603 (+ 52288us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:41.573230 (+132627us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.715610 (+142380us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:41.928957 (+213347us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.929836 (+   879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.929906 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.004802 (+ 74896us) raft_consensus.cc:1685] finished
0709 13:18:42.004823 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.004964 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9988,"raft.queue_time_us":8839,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":22363,"spinlock_wait_cycles":23044736,"thread_start_us":383578,"threads_started":2,"wal-append.queue_time_us":480619}
I20260709 13:18:41.968477 21639 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:42.005337 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 175618us
I20260709 13:18:42.011782 18457 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:41.970453 22011 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:42.030068 18385 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.004s	sys 0.021s
W20260709 13:18:42.030558 18385 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.004s	sys 0.021s
I20260709 13:18:41.948426 21861 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.038509 18457 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:42.036408 18413 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:18:42.010321 22017 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.046125 18457 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:41.970019 21955 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.033000 22011 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.017822 22073 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.032550 21812 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.054260 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:42.046483 22022 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:42.009536 21783 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.046002 22051 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:42.049852 22017 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.108301 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:42.032310 21639 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:42.112715 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 66189us
W20260709 13:18:42.109380 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 156236us
I20260709 13:18:42.057684 22073 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.117017 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:42.114768 18458 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:42.119347 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:42.115842 19026 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:42.121904 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:42.123023 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 86047.1us
I20260709 13:18:42.126027 19026 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:42.127249 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:42.112442 22022 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:42.135550 19026 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:42.118396 22073 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.109194 22093 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:42.067806 21812 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:42.133054 22067 consensus_meta.cc:287] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.874s	user 0.011s	sys 0.000s
I20260709 13:18:42.145699 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:42.128958 22098 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:42.132264 22104 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:42.135159 22015 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.155726 18413 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:42.127431 21954 consensus_queue.cc:1059] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:18:42.143110 22049 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.145206 22051 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.132020 21709 consensus_queue.cc:1059] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:18:42.137195 22097 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:42.170260 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 55588.4us
I20260709 13:18:42.170576 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:42.171490 19057 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1097) took 2347 ms (client timeout 2020 ms). Trace:
W20260709 13:18:42.173986 19057 rpcz_store.cc:269] 0709 13:18:39.819847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.827168 (+  7321us) service_pool.cc:224] Handling call
0709 13:18:42.167438 (+2340270us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54005ff5d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:42.167565 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231698304}
I20260709 13:18:42.179627 21461 raft_consensus.cc:3055] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:42.180083 21461 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:42.181072 21461 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.164855 22093 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:42.168027 22100 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:42.192803 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 54386.2us
I20260709 13:18:42.197576 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:42.184234 22022 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:42.200425 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:42.200637 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2287) took 1819 ms. Trace:
I20260709 13:18:42.200965 21812 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.192278 22093 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.201536 22100 raft_consensus.cc:697] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:42.202462 21861 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:42.206334 21896 consensus_meta.cc:287] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.085s	user 0.008s	sys 0.005s
I20260709 13:18:42.226606 22093 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.207129 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:42.227470 18484 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:42.227685 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:42.228397 18412 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:18:42.209095 22073 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:42.209694 22051 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:42.214476 21955 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.176856 22104 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:42.240298 19057 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:42.198747 19026 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:42.152958 22067 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.218565 18490 rpcz_store.cc:276] 0709 13:18:40.381172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.470299 (+ 89127us) service_pool.cc:224] Handling call
0709 13:18:40.470523 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.986869 (+516346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.197946 (+1211077us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54000dd4d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:42.200555 (+  2609us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178570496}
I20260709 13:18:42.225648 22100 consensus_queue.cc:237] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:42.209241 21792 consensus_meta.cc:287] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.000s
I20260709 13:18:42.225543 21639 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.236665 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:42.237412 18485 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:42.241462 19054 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:42.199277 21461 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:42.245285 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 46618us
I20260709 13:18:42.251674 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:42.248514 19057 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:42.253438 22051 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:42.254155 22051 raft_consensus.cc:697] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:42.255407 22051 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.258490 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 888) took 1221 ms. Trace:
I20260709 13:18:42.258903 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2175) took 1853 ms. Trace:
I20260709 13:18:42.259407 18337 rpcz_store.cc:276] 0709 13:18:40.406051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.406218 (+   167us) service_pool.cc:224] Handling call
0709 13:18:40.979893 (+573675us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.980508 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.258712 (+1278204us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b540028cdd0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:42.258841 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318595456}
I20260709 13:18:42.258960 19055 rpcz_store.cc:276] 0709 13:18:41.036577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.039673 (+  3096us) service_pool.cc:224] Handling call
0709 13:18:41.039935 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.128259 (+ 88324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.258271 (+1130012us) spinlock_profiling.cc:243] Waited 66 ms on lock 0x7b5400643a54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:42.258435 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151894784}
I20260709 13:18:42.260703 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:42.258497 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2069) took 1935 ms. Trace:
I20260709 13:18:42.221170 22011 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.262135 18415 rpcz_store.cc:276] 0709 13:18:40.323430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.805155 (+481725us) service_pool.cc:224] Handling call
0709 13:18:41.713487 (+908332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.719523 (+  6036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.258303 (+538780us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54002a6050. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:42.258438 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088075136}
I20260709 13:18:42.264022 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:42.266047 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:42.261047 21943 raft_consensus.cc:3055] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:42.266745 21943 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:42.267621 21943 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.268436 18490 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:42.268828 21943 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:42.271126 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:42.272893 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:42.274539 18490 raft_consensus.cc:2410] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:18:42.275453 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:42.276464 18490 raft_consensus.cc:2410] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:18:42.277273 22003 consensus_meta.cc:287] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.000s
I20260709 13:18:42.277341 22112 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:42.278004 22003 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.278614 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:42.279620 19057 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:42.280292 22003 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.281682 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:42.282313 22104 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.282893 22017 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.262423 21783 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:42.244978 21896 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.277732 18490 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:42.288020 18485 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:42.275660 21964 consensus_meta.cc:287] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.000s
W20260709 13:18:42.277307 22094 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:18:42.291456 21896 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.305500 22085 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:42.306833 22011 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.308835 22067 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.309516 22073 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:42.277274 22089 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:42.310382 18484 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:42.291461 22110 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:42.313058 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:42.338653 18415 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:42.341346 22110 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.313663 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:42.318193 19056 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 884) took 2185 ms (client timeout 1932 ms). Trace:
W20260709 13:18:42.342530 19056 rpcz_store.cc:269] 0709 13:18:40.132539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.132681 (+   142us) service_pool.cc:224] Handling call
0709 13:18:42.317672 (+2184991us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54006c0a54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:42.317823 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030609152}
I20260709 13:18:42.247716 21792 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:42.341670 21896 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.285235 22083 raft_consensus.cc:3055] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:42.319648 21964 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.350777 18418 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:42.351775 21964 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.352509 21792 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:42.330272 22097 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:18:42.354849 22017 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.355015 22052 raft_consensus.cc:3055] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:42.355523 22052 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:42.355769 18416 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:42.356619 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:42.356446 22052 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.357344 18487 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:42.349479 22110 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.350046 22083 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:42.360260 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:42.346566 18415 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:42.361711 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:42.363217 18416 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.357841 22052 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.368849 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:42.368979 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:42.358973 21968 consensus_meta.cc:287] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.801s	user 0.005s	sys 0.005s
I20260709 13:18:42.371428 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:42.372189 19057 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:42.373559 18493 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:42.386650 22085 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.390277 22085 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.369630 22083 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.393844 22083 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.422387 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:42.427629 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:42.429829 19054 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:42.374261 21968 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.436513 21968 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:42.442880 19057 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:18:42.464954 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:42.865163 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 670257us
W20260709 13:18:42.871908 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.442312 22116 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:18:42.463276 18416 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:42.619781 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:42.661518 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:42.960281 19058 raft_consensus.cc:2376] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7. Re-sending same reply.
I20260709 13:18:42.960474 19059 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.961263 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:42.810562 19053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 896) took 1745 ms (client timeout 2231 ms). Trace:
I20260709 13:18:42.873413 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 745) took 1140 ms. Trace:
W20260709 13:18:42.963325 19053 rpcz_store.cc:269] 0709 13:18:41.065613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.065837 (+   224us) service_pool.cc:224] Handling call
0709 13:18:42.810341 (+1744504us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54006a2f54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:42.810482 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443643776}
W20260709 13:18:42.901160 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 71123.9us
I20260709 13:18:42.556690 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2302) took 1107 ms. Trace:
W20260709 13:18:42.928754 22083 consensus_meta.cc:287] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.000s
W20260709 13:18:42.826521 18457 leader_election.cc:336] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.855s (SENT)
I20260709 13:18:42.971462 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:42.971657 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 145185us
I20260709 13:18:42.966948 18307 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:42.653362 22079 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 1.090s	user 0.003s	sys 0.000s
I20260709 13:18:42.941080 21981 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.654562 21748 raft_consensus.cc:3055] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:42.901628 22023 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:42.502720 22123 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:42.957055 18418 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 694) took 1525 ms (client timeout 1590 ms). Trace:
I20260709 13:18:42.898783 22046 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:42.512645 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:42.983306 18418 rpcz_store.cc:269] 0709 13:18:41.431376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.431494 (+   118us) service_pool.cc:224] Handling call
0709 13:18:42.956882 (+1525388us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54000a78d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:42.956995 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2033543424}
I20260709 13:18:42.463199 22017 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:42.673743 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:42.986256 19056 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:42.902691 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.811879 18412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2075) took 1848 ms (client timeout 1855 ms). Trace:
I20260709 13:18:42.963442 18341 rpcz_store.cc:276] 0709 13:18:41.732938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.854235 (+121297us) service_pool.cc:224] Handling call
0709 13:18:41.854790 (+   555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.879006 (+ 24216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.879052 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.879582 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.126121 (+246539us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:42.144628 (+ 18507us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.860557 (+715929us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b18004ac680. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f409bdf1a40 00007f409bdec4e4 00007f409bdec455 00007f409eed4060 00007f409eee6716 00007f409eef7287 00007f409eef7208
0709 13:18:42.860857 (+   300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.860966 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.861027 (+    61us) raft_consensus.cc:1685] finished
0709 13:18:42.873225 (+ 12198us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.873358 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8107,"prepare.queue_time_us":20646,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":718865,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":45164,"spinlock_wait_cycles":6610816,"thread_start_us":132482,"threads_started":1,"wal-append.queue_time_us":212398}
I20260709 13:18:42.902825 22054 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:42.988649 21939 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:42.990800 22054 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.991137 21939 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:42.991742 22070 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:42.992305 22070 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:42.993585 22054 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:42.967401 18382 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:42.999732 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:42.999995 18382 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:43.000861 18341 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:42.968672 22101 consensus_queue.cc:1059] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:42.968204 18238 catalog_manager.cc:5697] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 3 to 5, term changed from 6 to 7, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to <none>, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1), VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2), VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3), VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:42.969599 22015 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:42.972078 19057 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.661955 21914 raft_consensus.cc:3055] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:42.900589 22024 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:42.618397 22075 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 1.117s	user 0.000s	sys 0.011s
W20260709 13:18:42.974969 18487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.016s	sys 0.027s
I20260709 13:18:42.975318 18338 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.975427 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.019867 18337 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
W20260709 13:18:43.021097 18487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.017s	sys 0.027s
I20260709 13:18:42.980670 19058 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
W20260709 13:18:42.591581 22069 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.266s	user 0.007s	sys 0.002s
I20260709 13:18:42.820139 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2078) took 1918 ms. Trace:
I20260709 13:18:42.868803 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 746) took 1036 ms. Trace:
I20260709 13:18:42.825147 19054 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:43.029778 18337 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:42.954228 21965 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:42.965642 18489 rpcz_store.cc:276] 0709 13:18:41.449258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.450058 (+   800us) service_pool.cc:224] Handling call
0709 13:18:41.478241 (+ 28183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.481977 (+  3736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.482021 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.482079 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:41.482123 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.556371 (+1074248us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b54002201d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:42.556433 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.556616 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8016128}
I20260709 13:18:42.970853 21969 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.617025 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 799) took 1432 ms. Trace:
I20260709 13:18:43.044148 18492 rpcz_store.cc:276] 0709 13:18:41.184443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.184658 (+   215us) service_pool.cc:224] Handling call
0709 13:18:41.184958 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.339904 (+154946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.616703 (+1276799us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54003fc354. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:42.616943 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354814336}
I20260709 13:18:42.556427 21835 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:42.987993 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.018025 21968 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:42.989569 18412 rpcz_store.cc:269] 0709 13:18:40.963578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.963719 (+   141us) service_pool.cc:224] Handling call
0709 13:18:42.811667 (+1847948us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400109854. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:42.811805 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2864424704}
I20260709 13:18:42.973021 21897 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.981886 21639 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:42.994307 21939 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:42.593538 22006 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.994558 22100 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:42.994693 22017 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:42.985728 22046 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:42.997382 22104 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:42.973012 22034 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:43.008360 18238 catalog_manager.cc:5697] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:43.010658 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:42.981060 21748 raft_consensus.cc:740] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:43.013275 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:42.986276 22123 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.013732 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 908) took 1681 ms. Trace:
I20260709 13:18:42.901438 21225 consensus_queue.cc:1059] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:18:43.029628 18417 rpcz_store.cc:276] 0709 13:18:40.901278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.901971 (+   693us) service_pool.cc:224] Handling call
0709 13:18:40.902248 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.262621 (+360373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.819939 (+1557318us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54002a6554. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:42.820083 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":827078400}
I20260709 13:18:43.056041 21968 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.034379 19059 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:43.018296 22054 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.013865 21385 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:18:43.047536 21792 consensus_queue.cc:1059] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:43.011570 22085 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:43.140480 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 309566us
I20260709 13:18:42.986617 22023 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.011556 21412 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:42.868130 21955 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:18:43.054050 22051 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:43.054567 21869 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.059584 21881 consensus_queue.cc:1059] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:18:43.018005 21964 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:43.054591 18240 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42284 (request call id 334) took 13543 ms (client timeout 15000 ms). Trace:
W20260709 13:18:43.056766 19055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.007s	sys 0.020s
I20260709 13:18:43.055675 21835 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.058809 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2188) took 1747 ms. Trace:
W20260709 13:18:43.067575 18490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.001s	sys 0.044s
I20260709 13:18:43.070726 18338 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:43.074400 18341 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:43.156098 18490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.001s	sys 0.044s
I20260709 13:18:43.051617 21965 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.030030 18335 rpcz_store.cc:276] 0709 13:18:41.832810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.902741 (+ 69931us) service_pool.cc:224] Handling call
0709 13:18:41.903191 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.903594 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.903632 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.904170 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.078097 (+173927us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:42.252636 (+174539us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.868476 (+615840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.868557 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.868601 (+    44us) raft_consensus.cc:1685] finished
0709 13:18:42.868611 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.868746 (+   135us) inbound_call.cc:177] Queueing success response
0709 13:18:42.938754 (+ 70008us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b480021e7d8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a3e05aa1 00007f40a3dfcb37 00007f40a3dfc9ca 00007f40a3ef426f 00007f40a3ef3f37 00007f40a3f0855c 00007f40a3f08508 00007f40a3f08488 00007f40a3f08443 00007f40a3f076ec 00007f40a2e31a96
Metrics: {"mutex_wait_us":614940,"prepare.queue_time_us":48818,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":631631,"raft.run_cpu_time_us":2835,"raft.run_wall_time_us":46045,"spinlock_wait_cycles":7512448,"thread_start_us":311497,"threads_started":2,"wal-append.queue_time_us":307102}
I20260709 13:18:43.055382 21969 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.078574 19061 rpcz_store.cc:276] 0709 13:18:41.331853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.374024 (+ 42171us) service_pool.cc:224] Handling call
0709 13:18:41.380307 (+  6283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.380664 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.380693 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.383051 (+  2358us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.254668 (+871617us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b18001eee60. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409ea844bc 00007f409bdd248b 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1
0709 13:18:42.254802 (+   134us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:42.254826 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.254911 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.652426 (+397515us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:43.013497 (+361071us) raft_consensus.cc:1685] finished
0709 13:18:43.013519 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.013658 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23694,"raft.queue_time_us":547,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":5239,"spinlock_wait_cycles":39514112,"thread_start_us":44644,"threads_started":1,"wal-append.queue_time_us":97371}
I20260709 13:18:43.046025 22101 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:18:43.059773 21639 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.028313 22024 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.077456 21990 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.150933 18309 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:43.014678 21914 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:43.155577 19055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.007s	sys 0.020s
I20260709 13:18:43.055152 19027 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:43.173471 18309 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:43.176046 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 120966us
I20260709 13:18:43.177481 19027 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:43.136863 21968 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.156028 18342 rpcz_store.cc:276] 0709 13:18:41.311089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.311218 (+   129us) service_pool.cc:224] Handling call
0709 13:18:41.311532 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.311833 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.311861 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.321804 (+  9943us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.385044 (+ 63240us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:41.420374 (+ 35330us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.420673 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.420747 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.617468 (+1196721us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:42.804605 (+187137us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b1800299aa0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:18:43.058619 (+254014us) raft_consensus.cc:1685] finished
0709 13:18:43.058639 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.058756 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23124,"prepare.queue_time_us":36546,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":502,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":17972,"spinlock_wait_cycles":140667520,"thread_start_us":27086,"threads_started":1,"wal-append.queue_time_us":100456}
I20260709 13:18:43.018513 22080 consensus_queue.cc:1059] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:18:43.158895 18344 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:43.140875 22015 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.078156 22104 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.130589 22034 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.168609 18341 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:43.070991 22006 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.075956 22100 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.206575 22100 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.150786 21412 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:43.066989 21897 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.185178 19054 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:43.182323 21814 consensus_queue.cc:1059] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:18:43.182260 21850 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:18:43.200703 21965 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.160315 21964 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.201146 22023 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:43.219591 22023 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:43.219964 22023 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:43.220065 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:43.220541 21964 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:43.220942 22023 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.222510 22023 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:43.193411 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:43.172267 22098 raft_consensus.cc:3055] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:43.159780 21869 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.209787 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:43.229797 19060 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:43.171135 19057 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:18:43.180382 21639 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:43.181778 21225 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:43.230749 21225 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.231175 21225 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.231997 21969 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.147586 22054 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.233752 22017 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.234520 22054 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:43.172017 21955 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.234369 21914 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.235558 21914 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:43.235219 21955 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.237344 21955 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.172554 22070 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.210458 21412 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:43.212271 19061 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:18:43.212107 21835 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.174985 22083 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:43.180980 21881 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:43.203789 22015 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.208639 22123 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.215304 21897 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.224269 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:43.152508 22051 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.180604 21385 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:43.208678 22006 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.228029 22024 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:43.225265 22121 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:18:43.180929 21990 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.179082 21748 consensus_queue.cc:260] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.282109 21969 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:43.335879 21969 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.336961 22015 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.337788 21969 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.283294 21968 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.339311 22051 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:43.287500 21225 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.288268 22104 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.288938 22101 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:43.351902 19053 raft_consensus.cc:2368] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:18:43.289151 22083 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:43.290910 19062 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:43.224352 21850 consensus_queue.cc:1243] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:18:43.214790 22052 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.851s	user 0.007s	sys 0.003s
I20260709 13:18:43.353957 22083 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.207510 22046 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.226258 22098 raft_consensus.cc:740] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:43.355130 22083 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:43.355319 21785 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.237843 21955 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:43.319721 19054 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:18:43.357056 19054 pending_rounds.cc:85] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 7
I20260709 13:18:43.357501 19054 pending_rounds.cc:107] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:18:43.357818 19054 raft_consensus.cc:2889] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.290319 22034 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.324430 19058 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:43.317271 21385 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:43.286695 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:43.360985 19059 raft_consensus.cc:2393] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 10: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:43.355283 21990 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:43.339731 21968 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.363056 21225 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.367072 21385 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.363754 21194 raft_consensus.cc:3055] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:43.355775 21748 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.355556 22098 consensus_queue.cc:260] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:43.366257 19062 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 905) took 2039 ms (client timeout 1908 ms). Trace:
I20260709 13:18:43.357167 21785 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:43.370827 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.372645 19053 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:43.369553 19062 rpcz_store.cc:269] 0709 13:18:41.326817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.327766 (+   949us) service_pool.cc:224] Handling call
0709 13:18:43.366093 (+2038327us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54005465d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:43.366197 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4443743104}
I20260709 13:18:43.372972 19053 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:43.375499 19056 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:43.376926 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 922) took 1005 ms. Trace:
I20260709 13:18:43.373703 19053 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.384785 19053 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:43.378897 22098 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.368846 21194 raft_consensus.cc:740] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:43.385013 22104 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:43.399897 21412 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.396566 22104 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.413895 21955 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:43.423497 22104 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.128839 18238 catalog_manager.cc:5697] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 3, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 3 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:43.487257 18308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.038s	sys 0.031s
W20260709 13:18:43.487955 18308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.038s	sys 0.031s
W20260709 13:18:43.488478 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 617476us
I20260709 13:18:43.489887 18238 catalog_manager.cc:5697] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:43.506137 18238 catalog_manager.cc:5697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 3 to 5, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 5 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:43.155025 18240 rpcz_store.cc:269] 0709 13:18:29.510905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.581735 (+ 70830us) service_pool.cc:224] Handling call
0709 13:18:43.054357 (+13472622us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:33.184731 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:33.234140 (+ 49409us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:33.234201 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:18:33.234233 (+    32us) tablet.cc:662] Decoding operations
0709 13:18:33.236190 (+  1957us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:33.236265 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:33.236310 (+    45us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:18:33.321305 (+ 84995us) tablet.cc:701] Row locks acquired
0709 13:18:33.321354 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:18:33.321536 (+   182us) write_op.cc:270] Start()
0709 13:18:33.321680 (+   144us) write_op.cc:276] Timestamp: P: 1783603113321474 usec, L: 0
0709 13:18:33.321702 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:33.358989 (+ 37287us) log.cc:844] Serialized 9406 byte log entry
0709 13:18:34.421113 (+1062124us) op_driver.cc:464] REPLICATION: finished
0709 13:18:34.633782 (+212669us) write_op.cc:301] APPLY: starting
0709 13:18:34.633884 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:34.634376 (+   492us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:34.634500 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:34.844742 (+210242us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:34.845197 (+   455us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 13:18:34.845241 (+    44us) write_op.cc:312] APPLY: finished
0709 13:18:34.845696 (+   455us) log.cc:844] Serialized 158 byte log entry
0709 13:18:34.845870 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:34.886219 (+ 40349us) write_op.cc:454] Released schema lock
0709 13:18:34.915883 (+ 29664us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:34.916304 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:34.916337 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41651,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":212354,"apply.run_cpu_time_us":6670,"apply.run_wall_time_us":282494,"num_ops":23,"prepare.queue_time_us":370756,"prepare.run_cpu_time_us":17978,"prepare.run_wall_time_us":270534,"raft.queue_time_us":398813,"raft.run_cpu_time_us":14268,"raft.run_wall_time_us":156799,"replication_time_us":1099237,"thread_start_us":767870,"threads_started":4,"wal-append.queue_time_us":439707,"wal-append.run_cpu_time_us":86152,"wal-append.run_wall_time_us":2051953}]]}
I20260709 13:18:43.509508 18238 catalog_manager.cc:5697] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:18:43.525154 18382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.032s	sys 0.019s
I20260709 13:18:43.512437 18238 catalog_manager.cc:5697] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 4 to 7, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:18:43.525876 18382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.032s	sys 0.019s
W20260709 13:18:43.526401 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 510798us
I20260709 13:18:43.527307 18238 catalog_manager.cc:5697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:43.530890 18238 catalog_manager.cc:5697] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 4 to 5, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 5 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:43.534832 18383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.017s	sys 0.074s
W20260709 13:18:43.535389 18383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.017s	sys 0.074s
W20260709 13:18:43.537981 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.534832 18384 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.006s	sys 0.007s
W20260709 13:18:43.538873 18456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.002s	sys 0.012s
W20260709 13:18:43.539002 18384 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.008s
W20260709 13:18:43.539223 18456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.002s	sys 0.012s
W20260709 13:18:43.539544 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 551824us
W20260709 13:18:43.541119 18457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.003s	sys 0.011s
W20260709 13:18:43.541541 18457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.003s	sys 0.011s
I20260709 13:18:43.541421 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 816) took 1180 ms. Trace:
W20260709 13:18:43.546933 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 441008us
I20260709 13:18:43.385895 19056 rpcz_store.cc:276] 0709 13:18:42.372083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.673363 (+301280us) service_pool.cc:224] Handling call
0709 13:18:43.376874 (+703511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:43.400646 21194 consensus_queue.cc:260] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.565783 22132 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.566094 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.567340 22132 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.568229 22034 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:43.569294 22034 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.572345 22129 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:43.572831 22034 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.574127 21955 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:43.564554 22104 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.542327 18490 rpcz_store.cc:276] 0709 13:18:42.360233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.362210 (+  1977us) service_pool.cc:224] Handling call
0709 13:18:42.373807 (+ 11597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.385343 (+ 11536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.385398 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.388346 (+  2948us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.156724 (+768378us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:43.156778 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.156865 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.540654 (+383789us) raft_consensus.cc:1685] finished
0709 13:18:43.540739 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.541094 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11129,"raft.queue_time_us":12616,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":45427,"thread_start_us":718367,"threads_started":1,"wal-append.queue_time_us":974876}
I20260709 13:18:43.575026 21955 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.575708 22104 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.577215 22101 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.578168 22101 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.579202 22104 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.580402 21769 raft_consensus.cc:3055] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:43.582337 21769 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:43.583954 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 410396us
I20260709 13:18:43.584455 21769 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.577708 21955 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:43.585563 18309 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:43.586977 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.594224 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.595886 18341 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:18:43.595394 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.598134 21412 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.600363 21194 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.603597 21939 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:43.604054 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.604637 21939 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.606292 22130 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.607232 22130 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.608628 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.611092 22132 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:43.604655 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.612391 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.535355 18238 catalog_manager.cc:5697] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 5 to 6, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 6 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:43.613489 18417 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:43.615214 18338 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:18:43.618148 18489 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:43.619993 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:43.621176 18486 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:43.622625 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:43.623672 18493 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:43.624702 21385 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.626263 22046 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:43.627472 18344 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:43.627978 21785 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.629889 21869 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.635317 18487 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:43.573596 22129 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.637756 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:43.638871 18342 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:43.639324 21971 raft_consensus.cc:3055] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:43.639892 21971 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:43.644945 22124 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.487s	user 0.005s	sys 0.002s
I20260709 13:18:43.647677 22130 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.650269 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.651386 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.652098 18410 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:43.654420 18411 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:43.655946 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.657048 18411 raft_consensus.cc:2393] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:43.659287 21971 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.660342 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.660705 21971 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:43.661387 18416 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:43.662688 22129 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.652011 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:43.645328 22101 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.690881 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.691932 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:43.694608 18384 leader_election.cc:400] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:18:43.694983 18384 leader_election.cc:403] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:43.695783 22110 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:43.696491 22110 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.697541 22131 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:43.698328 22131 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.699676 21769 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:43.701400 22131 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.702059 21968 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.702968 21968 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.706749 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.707612 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:43.708220 18337 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.709494 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.710278 18417 raft_consensus.cc:2368] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8.
I20260709 13:18:43.710294 18335 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:43.710981 18340 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:43.711565 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.712134 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.714388 18336 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:43.692183 18238 catalog_manager.cc:5697] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:43.716351 18339 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:43.717837 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.717262 18238 catalog_manager.cc:5697] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:43.718001 21792 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:18:43.718735 18343 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:43.719756 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.720641 18341 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:43.726130 18238 catalog_manager.cc:5697] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 5 to 6, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 6 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.729498 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.733624 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.732542 18341 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:18:43.733043 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.730050 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.740337 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:43.742568 18412 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 13:18:43.742311 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 47969.7us
I20260709 13:18:43.747879 18342 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:43.751574 18411 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:18:43.750927 21792 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.753186 18335 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:43.753350 21792 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.705838 21968 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.753208 18238 catalog_manager.cc:5697] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 1 to 6, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 6 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:18:43.758268 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:43.751950 18411 pending_rounds.cc:85] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 7
I20260709 13:18:43.762738 18413 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:43.764969 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:43.765440 21792 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.764945 21769 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:43.766815 18418 raft_consensus.cc:1240] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:43.766983 21769 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.757510 22130 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.767429 18238 catalog_manager.cc:5697] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 6 to 3, term changed from 5 to 6, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from VOTER to NON_VOTER, now has a pending config: VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1), VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2), VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3), VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 6 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:43.769102 21769 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.772552 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.760056 18411 pending_rounds.cc:107] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:18:43.763396 18343 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:43.773357 18411 raft_consensus.cc:2889] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:43.777942 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 192641us
I20260709 13:18:43.781031 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:43.783062 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:43.783946 21792 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:43.784353 21792 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.784718 21792 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:43.787020 21639 consensus_meta.cc:287] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.005s
I20260709 13:18:43.787519 21639 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.790068 21639 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.792246 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:43.793190 18339 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:43.794371 22104 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:43.795071 22104 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.797319 22104 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.799839 18336 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 13:18:43.807483 18337 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:43.805830 18410 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:18:43.810158 18412 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:43.809613 18410 pending_rounds.cc:85] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 8
I20260709 13:18:43.813086 18410 pending_rounds.cc:107] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:18:43.813338 18410 raft_consensus.cc:2889] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:43.811273 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 68009.3us
I20260709 13:18:43.814680 18340 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.816493 18415 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:43.821244 18238 catalog_manager.cc:5697] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 7 to 8, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 8 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:43.824473 22101 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:43.825138 22101 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:43.826309 22023 consensus_meta.cc:287] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.010s
I20260709 13:18:43.828917 22123 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.832033 22123 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.829802 22006 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.835162 22006 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.837463 22006 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.834380 22123 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.827414 22101 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:43.830916 22110 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.839314 22110 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.839973 22110 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.842365 22110 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.845340 22110 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:43.846582 18341 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:43.844604 18457 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:43.853638 22123 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:43.812347 22104 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:43.855983 22123 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.862171 22123 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.868914 18309 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:43.866750 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.867480 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.871850 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.872507 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.873733 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.871050 18413 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:43.874498 18410 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:43.872041 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.877207 18417 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:43.878239 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.880379 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.883769 19058 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:43.887879 22006 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:43.892078 19053 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:18:43.892204 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.892462 22006 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.893041 18414 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:43.894901 22006 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.895135 22130 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:18:43.899230 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:43.901082 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:43.886629 18238 catalog_manager.cc:5697] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 3 to 6, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 6 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:18:43.906801 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.892445 19053 pending_rounds.cc:85] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 6
I20260709 13:18:43.907508 19053 pending_rounds.cc:107] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:18:43.907727 19053 raft_consensus.cc:2889] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.888695 21939 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.889837 22123 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:43.908854 22006 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:43.915325 18412 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:43.916496 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.915457 18238 catalog_manager.cc:5697] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 6 to 7, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 7 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.920363 18418 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:43.920482 22133 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:43.921123 22131 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:43.921252 22133 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.921814 22131 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:43.923032 22131 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.910151 21194 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.908943 22132 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:43.892532 22104 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:43.926759 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 108455us
W20260709 13:18:43.929159 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 84768.7us
I20260709 13:18:43.904579 22110 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.923872 22133 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:43.936120 21194 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.938066 18418 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:43.938309 21194 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.932060 22132 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:43.942155 22132 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.951653 22104 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:43.955435 18457 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:43.938067 19027 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:43.957037 22134 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:43.957609 22134 raft_consensus.cc:697] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:18:43.959906 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 58887.5us
I20260709 13:18:43.959905 18344 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:43.965197 19027 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:43.965480 22098 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:43.966455 21869 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:43.966935 19027 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:43.968835 21785 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:43.969138 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:43.969273 21785 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.969944 21385 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:43.969306 22134 consensus_queue.cc:237] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:43.970309 21385 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.970729 21385 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.966301 22098 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:43.974686 18458 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:43.975184 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.975692 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.976187 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:43.976270 18412 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:43.976861 18486 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:43.977253 22104 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:43.977448 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.977676 22104 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.978103 22104 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.980245 19025 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:43.983152 18484 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:43.946125 22132 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:18:43.983834 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:43.983845 21639 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:43.985373 22147 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:18:43.986456 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:43.987576 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:43.969758 21785 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.988444 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:43.989138 18491 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:43.985414 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:43.985778 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:43.994274 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:43.994920 18492 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:43.998087 21225 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:43.999967 22110 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:44.000079 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.000774 18486 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:43.983052 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:44.004750 18458 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:44.006949 22129 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:44.010540 21792 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.011880 18411 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:44.012737 21792 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:44.001840 18308 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:44.018035 18340 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:44.018174 22132 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:44.018814 22132 raft_consensus.cc:697] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:44.019170 18308 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:44.020852 21882 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:44.021271 21882 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:44.021245 22141 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:44.022032 21882 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:44.022496 22141 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:44.023689 21194 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:44.024076 21194 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:44.024401 21194 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.025734 21869 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.019869 22132 consensus_queue.cc:237] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.026269 21869 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.028512 22123 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:44.029031 22123 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:44.029218 22101 consensus_queue.cc:1059] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:44.030257 22141 raft_consensus.cc:3055] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:44.030705 22141 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:44.030144 22123 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.031448 21869 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.031608 22141 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.039785 22141 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.044142 18309 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:44.046103 21639 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:44.046859 21639 consensus_queue.cc:1243] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:18:44.048121 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 43504.6us
W20260709 13:18:44.049484 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.021656 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:44.054358 18309 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:44.048434 21639 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:44.074559 18493 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:44.077179 21792 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:44.072541 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.080343 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.067473 21225 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.087834 18416 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:44.082974 21968 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.105353 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:44.090327 21639 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.083335 22006 raft_consensus.cc:697] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:44.110831 18492 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:44.112154 22142 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:18:44.112298 22137 consensus_queue.cc:1059] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:18:44.112713 22138 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:44.113420 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.114140 18485 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:44.115341 19026 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:44.115097 21225 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.120317 21194 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.121376 21748 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.121938 21748 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.122560 18488 raft_consensus.cc:1240] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:44.123355 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 101804us
I20260709 13:18:44.126726 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:44.132869 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.133720 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.136533 21748 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:44.103729 22034 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:44.092975 21882 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.148986 21194 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.152467 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.153232 19025 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:44.156785 22130 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:44.157330 22130 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:44.158255 22130 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.134517 22131 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:44.116953 21968 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:44.156826 22153 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:44.128257 22104 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:44.176456 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 130664us
I20260709 13:18:44.117283 21639 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.180928 18308 leader_election.cc:400] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8.
I20260709 13:18:44.185204 18308 leader_election.cc:403] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:18:44.183722 21968 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:44.185979 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 70697.7us
I20260709 13:18:44.189955 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:44.190662 18485 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.192489 21785 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.206887 18309 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:44.210013 18490 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:44.185853 21385 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.212956 21869 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:44.213498 21869 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.214704 21385 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:44.214905 21785 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.180014 22134 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:18:44.203673 22034 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8.
I20260709 13:18:44.213830 21869 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.226481 22006 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:44.237416 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 126754us
I20260709 13:18:44.227483 21965 raft_consensus.cc:3055] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:44.194100 22137 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:18:44.161351 22152 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:18:44.240684 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 92674.5us
I20260709 13:18:44.235293 22138 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:44.251451 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:44.254657 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 103719us
I20260709 13:18:44.240892 21965 raft_consensus.cc:740] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:44.212347 22098 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:18:44.250576 21814 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.268218 18308 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:44.267619 18382 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:44.268821 18384 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:44.234050 21785 consensus_queue.cc:1059] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:18:44.278288 21965 consensus_queue.cc:260] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.280789 21882 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:44.296548 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 43634.7us
I20260709 13:18:44.290223 22098 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:44.304574 21971 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:44.301368 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.305243 21971 raft_consensus.cc:697] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:44.307546 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 55170.7us
I20260709 13:18:44.313169 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.313817 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:44.314117 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 58565.1us
I20260709 13:18:44.314803 21965 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.316097 18308 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:44.316463 19053 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:44.318995 21639 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:44.319554 21639 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:44.320222 22101 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:44.320714 22101 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.280242 22034 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:44.306035 21748 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:44.325115 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:44.329082 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:44.330315 18308 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:44.332018 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 90953.6us
I20260709 13:18:44.307850 21225 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.334462 21971 consensus_queue.cc:237] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:44.337558 22164 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:44.327790 21748 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.338886 21748 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.339682 21869 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.346087 21882 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.346737 21882 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:44.348874 21882 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.351378 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.352221 18489 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 9: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:44.353691 21814 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:44.323951 22101 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:44.370563 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 48191.3us
I20260709 13:18:44.370573 18485 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:44.373831 22172 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:44.377014 19026 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:18:44.381042 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 58742.9us
I20260709 13:18:44.354419 21814 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.353683 22138 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:44.385013 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.385903 18337 raft_consensus.cc:2393] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:44.341848 21869 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.396421 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.397102 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.393529 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.394423 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.382547 18382 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:44.396181 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.386080 22131 raft_consensus.cc:697] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:44.404167 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.404309 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.408001 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:44.404871 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 178831us
I20260709 13:18:44.405167 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.383056 22104 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:44.411211 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:44.397428 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.407828 18415 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:44.386776 21882 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:44.414076 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.412163 18336 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:44.413569 18343 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:44.415598 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:44.416160 18337 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.416219 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.416738 18418 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:44.417714 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.418167 18382 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:44.418303 18489 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:44.420238 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.420828 18340 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:44.420882 18308 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:44.422338 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:44.422919 18490 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.408845 21971 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:44.424659 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:44.427103 18344 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:44.411669 22098 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:44.428356 21792 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:44.396020 21814 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.438416 21792 raft_consensus.cc:697] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:44.439373 21792 consensus_queue.cc:237] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.439893 21814 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.440445 21814 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:44.440939 21814 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.426265 21869 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:44.442385 21869 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.442778 21869 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:44.444223 22098 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.444831 22098 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.426383 22138 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:44.446413 18337 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:44.446893 22138 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.447515 22138 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.447691 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.414578 21882 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:44.450883 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.451664 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.453768 22098 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.455680 22166 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.456240 22166 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.454409 18336 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:44.458642 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.461858 18337 raft_consensus.cc:2393] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:44.459254 18343 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:44.427901 21971 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:44.467404 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.467582 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.469390 18340 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:44.452746 21882 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.468255 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.472150 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.470147 18414 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:18:44.468691 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:44.470388 21194 consensus_queue.cc:1059] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:44.472482 18416 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:44.477844 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:44.478609 18410 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:44.487278 22173 log.cc:927] Time spent T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 13:18:44.471400 21971 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.530422 18490 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:44.500460 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.502121 22034 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:44.502959 21225 raft_consensus.cc:3055] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:44.535912 21225 raft_consensus.cc:740] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:44.536840 21225 consensus_queue.cc:260] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.536859 22034 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:44.503794 21882 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:44.504650 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 87817.9us
I20260709 13:18:44.542466 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:44.543164 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.507604 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.543407 22104 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:44.510246 22166 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:44.510386 18489 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:44.544039 22104 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:44.544620 22104 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.519666 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.520413 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.521068 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:44.546573 18341 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:44.547117 18335 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:44.522477 21814 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.512844 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.563531 21225 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.563699 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:44.567852 22034 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.568490 21882 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.574972 21814 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.575460 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.575615 21814 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.576818 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:44.577394 18416 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.578909 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:44.579851 22160 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.580633 18458 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:44.580734 22160 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.582751 22133 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:44.581818 22160 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:44.583623 22160 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:44.584079 22160 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.585199 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:44.586944 22174 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 13:18:44.588980 22130 consensus_queue.cc:1059] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:44.592244 18416 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:44.593168 18410 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:44.597007 18335 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:18:44.599624 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:44.600908 18308 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:44.601969 18340 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:18:44.603780 21814 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.604025 22034 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:44.603932 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:44.608335 21968 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:44.607187 22152 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:44.589068 21748 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:44.618361 19025 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:44.628288 19025 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:44.610963 22034 raft_consensus.cc:697] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:44.641845 21194 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:44.642125 18411 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:44.642529 21194 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:44.620441 21968 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:44.566390 22131 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.651916 19025 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:44.653568 21194 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.657888 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.661814 18458 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:44.649595 22172 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:44.626535 22101 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.667678 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.667099 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.671528 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:44.671248 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 46056.6us
I20260709 13:18:44.672431 18487 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:44.635546 22132 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:18:44.671168 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 255429us
I20260709 13:18:44.638695 22169 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:18:44.660017 22166 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:44.675549 19027 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:44.652908 22098 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:18:44.684312 21968 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.685705 21968 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.687713 18342 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:18:44.688346 22101 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:44.689659 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:44.690477 18410 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:44.692332 22034 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:44.696791 21882 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:44.697778 21882 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:44.698153 21882 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:44.699115 21882 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:44.671777 22172 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:44.702011 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.676640 21971 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:44.702335 22172 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:44.717273 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.718114 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.718235 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.719568 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.723949 18411 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:18:44.735221 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 59724.7us
I20260709 13:18:44.737993 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:44.740007 21814 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:44.740658 21814 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.741153 21814 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:44.745019 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.718261 22142 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.676343 22006 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:44.735548 21882 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.751771 18411 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:44.752641 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:44.756435 18485 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.757717 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.753242 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.755384 19027 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:44.743777 22166 raft_consensus.cc:697] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:44.751806 21965 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.737607 21869 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:44.768002 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 90584.8us
I20260709 13:18:44.752516 21748 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.752230 22006 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:44.778852 18412 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:44.759445 22123 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:44.780578 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:44.798363 18485 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
W20260709 13:18:44.799806 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 51767.7us
I20260709 13:18:44.800472 18490 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.800709 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:44.801466 21194 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:44.801684 18382 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:44.776523 21965 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.802229 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:44.802855 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:44.803527 19053 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:44.803669 21194 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.804085 21194 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:44.768986 21971 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:44.805671 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.810997 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:44.805253 22184 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:44.813237 22184 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.813603 22184 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.814615 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:44.815287 19053 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:44.815500 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:44.816387 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:44.816916 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:44.817539 19061 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:44.811489 19056 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:44.817772 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.818320 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:44.805279 21639 consensus_queue.cc:1059] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:18:44.817551 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:44.819437 19054 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:44.817791 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:44.821159 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:44.821643 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 45636.4us
I20260709 13:18:44.763629 22142 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.807564 22130 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:44.825971 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.826813 18416 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:44.830344 18458 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:44.783849 22006 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.831827 22166 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.832743 19060 pending_rounds.cc:85] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 6
I20260709 13:18:44.833077 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:44.857199 19060 pending_rounds.cc:107] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:18:44.833307 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:44.833470 22130 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:44.834333 22178 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:18:44.834702 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:44.834794 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:44.839020 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.814631 21965 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:44.841733 18309 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:44.842514 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.842926 18485 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:44.843359 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.861094 18410 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:44.844836 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.862293 18416 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:44.850287 22098 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:44.850672 19027 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:44.857470 19060 raft_consensus.cc:2889] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:44.858809 19054 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:44.866755 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:44.898337 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.856920 22174 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:44.864209 22123 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:44.904153 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 62513.6us
I20260709 13:18:44.908783 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.908933 21194 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.911083 18458 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:44.915514 22134 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:44.916036 22134 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:44.909480 18485 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:44.918304 18490 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:44.893676 22132 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:44.851460 22138 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:44.919070 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.925420 18382 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:44.926755 21194 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.926503 18382 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:44.924419 18309 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:44.926829 18414 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:44.916535 22134 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.927994 21939 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:44.909925 22167 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:44.894924 21965 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:18:44.906764 22123 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:44.936302 18343 raft_consensus.cc:2393] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:44.934437 21194 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.937479 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.940287 21194 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:44.944465 21748 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:44.945060 21748 raft_consensus.cc:697] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:44.945996 21748 consensus_queue.cc:237] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:44.948315 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.954015 18309 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:44.922224 22132 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:44.931452 22142 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:44.931540 21939 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.923838 21639 raft_consensus.cc:3055] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:44.959081 21194 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:44.962733 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.955598 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.926349 22200 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:44.971541 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.969666 18491 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:44.968612 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.953289 22123 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.995684 18492 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:44.998996 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:44.998421 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 44497.1us
I20260709 13:18:44.997165 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:44.968884 21939 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.000861 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.969071 21639 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:45.006060 21869 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:45.006712 21639 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:45.008008 21639 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:45.008224 22195 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.008870 22195 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.010080 22198 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:45.010556 22198 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:45.010926 22198 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:45.011132 22195 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:45.011695 22195 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:45.012316 22195 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:45.018401 18486 raft_consensus.cc:2410] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:18:44.965003 22132 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:45.029299 18414 raft_consensus.cc:2393] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:44.921361 22130 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:44.928820 22174 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:45.014122 22188 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:18:45.038431 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:44.994890 22200 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:45.053390 22134 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:45.054132 22200 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:45.054911 22192 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:18:45.055729 22134 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:45.039273 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:45.000051 18309 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:45.063527 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 63564.1us
I20260709 13:18:45.064431 18309 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:44.955394 22167 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:45.062232 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:45.012844 22195 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:45.050060 22194 log.cc:927] Time spent T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:18:45.045888 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 195246us
I20260709 13:18:45.076396 18487 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:45.088407 19027 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:45.088676 22185 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:18:45.089339 22174 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:45.089401 19027 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:45.090085 22174 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:45.090312 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:45.091874 22205 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:45.092315 22205 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:45.092658 22205 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.093854 22199 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:45.094219 22186 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:45.094338 22199 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.094763 22199 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.096311 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:45.098173 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:45.099349 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:45.048346 21968 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.101198 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:45.101390 19027 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:45.075605 22034 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:45.104410 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 243046us
I20260709 13:18:45.107749 18309 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:45.109112 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:45.109640 18488 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.112015 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:45.115494 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:45.116236 18411 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:45.116356 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:45.117534 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:45.040061 22160 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:45.122254 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.125423 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:45.130159 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:45.133070 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:45.133747 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:45.107607 22186 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:45.074394 22184 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.106180 22034 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:45.137749 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.141980 19053 raft_consensus.cc:2393] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:45.142654 18419 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:45.143676 21194 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.143953 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.120071 22098 consensus_queue.cc:1243] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:45.144160 21194 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.154038 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.170177 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:45.115105 21869 consensus_queue.cc:1059] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:18:45.106316 21968 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:45.197146 18416 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:45.201948 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.204931 21194 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:45.206053 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 52977.4us
I20260709 13:18:45.206701 19026 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:45.206833 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 99181.8us
I20260709 13:18:45.207770 18309 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:45.209425 21194 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.210243 18336 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:18:45.210150 21194 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.208915 19026 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:45.145545 22034 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.214329 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.214929 18339 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
W20260709 13:18:45.212450 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.216958 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:45.217761 18344 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:45.215301 18339 pending_rounds.cc:85] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 8
I20260709 13:18:45.220120 18339 pending_rounds.cc:107] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:18:45.220369 18339 raft_consensus.cc:2889] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:45.222046 18416 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:18:45.223384 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.211333 22186 raft_consensus.cc:697] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:45.211483 22152 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.232659 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:45.237164 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:45.200579 18414 raft_consensus.cc:2955] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:45.214682 22167 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:45.251545 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.250357 22202 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:45.264266 19055 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
W20260709 13:18:45.277051 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.283697 18488 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
W20260709 13:18:45.301055 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 67031us
I20260709 13:18:45.302892 21194 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:45.300987 21882 consensus_meta.cc:287] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 13:18:45.295797 22202 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:45.303869 22101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.006s	sys 0.011s
I20260709 13:18:45.236733 22152 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:45.333957 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:45.282845 22210 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:45.330193 19055 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:45.332049 22221 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:45.332808 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:45.310859 21639 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:45.325306 21814 consensus_meta.cc:287] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.004s
I20260709 13:18:45.376852 21968 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:45.377170 18340 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:45.368831 18344 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:18:45.303758 21769 consensus_queue.cc:1059] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:18:45.334000 22101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.006s	sys 0.011s
I20260709 13:18:45.368566 18419 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:45.380290 21939 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.382018 18418 raft_consensus.cc:2393] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:45.388643 18308 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:45.390048 22210 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:45.329862 22202 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:45.390440 22210 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:45.390928 22210 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:45.372346 18410 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:45.316089 22201 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:45.368462 22104 consensus_meta.cc:287] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.810s	user 0.013s	sys 0.000s
I20260709 13:18:45.322511 21869 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:45.394094 21869 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.394467 21869 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.304519 22131 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:18:45.399523 19056 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:18:45.398311 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:45.401072 18338 raft_consensus.cc:2410] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:18:45.401078 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 245647us
I20260709 13:18:45.395051 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:45.395265 18457 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.579s (SENT) [suppressed 14 similar messages]
I20260709 13:18:45.430029 21412 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.430594 21412 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.433310 21412 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:45.427268 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:45.393641 22104 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.444764 19055 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:45.329598 22123 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:45.402437 22195 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:45.403788 22142 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.394654 22101 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:18:45.458417 18484 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:45.427526 22160 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:45.475615 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 45210.8us
I20260709 13:18:45.400806 21814 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.396924 22200 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:45.496558 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 46648.7us
I20260709 13:18:45.500666 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:45.454162 22190 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:45.506843 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:45.508692 18384 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:45.510041 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:45.512333 22215 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:45.512929 22215 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:45.513898 22215 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.515715 22175 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.516297 22175 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.517434 21748 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:45.517884 21748 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.518240 21748 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:45.368974 22186 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:45.520525 22172 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.818s	user 0.009s	sys 0.000s
I20260709 13:18:45.520985 22172 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.522531 19058 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:45.525194 22223 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.526161 18342 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:45.476966 21939 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:45.527803 22206 log.cc:927] Time spent T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:18:45.528192 18492 raft_consensus.cc:1240] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:45.528689 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:45.529299 18342 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:45.532171 22174 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:45.532574 22174 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:45.465281 22104 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:45.535617 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:45.510020 18338 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:18:45.476289 22134 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.540458 18490 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:18:45.508373 22203 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:18:45.545145 18487 raft_consensus.cc:1240] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:45.545727 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 150474us
W20260709 13:18:45.550577 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 50390.1us
I20260709 13:18:45.551348 18307 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:45.604314 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:45.609942 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 58657.3us
I20260709 13:18:45.540359 21939 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:45.507877 22190 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:45.470108 22142 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:45.619872 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 410820us
I20260709 13:18:45.619980 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:45.628571 18338 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.629037 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:45.533524 22174 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.451537 22221 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.618912 21939 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:45.552132 21412 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:45.634637 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:45.635921 18309 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:45.632537 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 415897us
I20260709 13:18:45.637012 18309 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:45.637266 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:45.638927 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:45.641376 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.525856 22223 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.643373 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.647075 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:45.625182 22190 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:45.654798 21412 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:45.554741 22205 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.649883 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:45.662717 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 116313us
I20260709 13:18:45.633447 21939 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:45.660318 18307 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:45.670153 18384 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:45.642856 22195 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:45.647620 22104 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:45.679201 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:45.686316 18490 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:45.687776 18457 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:45.619596 22134 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.683621 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:45.690907 18411 consensus_meta.cc:287] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.000s
I20260709 13:18:45.691390 18411 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:45.649044 22160 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:45.661525 22133 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:45.692390 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.658975 22174 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:45.695503 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:45.697126 19058 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:45.698450 19056 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:45.703702 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.705588 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:45.709537 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:45.710237 18418 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:45.715155 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:45.716185 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:45.716301 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:45.716750 22211 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:45.717375 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.717943 19058 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:45.716183 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:45.716328 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.722698 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:45.723763 18413 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:45.724830 18411 raft_consensus.cc:2393] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:45.725811 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:45.728013 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.707067 22204 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:18:45.731037 19055 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:45.702589 22101 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:45.729491 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:45.748714 18417 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:45.754128 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:45.762116 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 58497.4us
I20260709 13:18:45.762518 19058 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:45.762874 18457 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:45.714769 22152 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:45.697579 22169 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:18:45.727586 22195 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:45.728483 22160 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:45.766191 21412 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.766712 19058 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:45.773975 22217 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:45.762344 22193 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:45.778018 22214 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:45.729748 22211 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:45.783237 22223 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:45.784438 21748 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:45.786648 22225 log.cc:927] Time spent T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:18:45.837124 22104 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:45.791603 22230 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:18:45.752110 22175 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:45.729421 21792 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:45.798148 21814 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:45.800547 22202 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.802290 22205 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:45.803778 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:45.804078 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:45.916019 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.805296 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:45.808192 22134 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:45.810900 18308 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:45.811510 22231 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:45.920739 19057 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:45.812069 22218 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.812163 22198 consensus_meta.cc:287] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.801s	user 0.007s	sys 0.003s
W20260709 13:18:45.815790 22196 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.762s	user 0.000s	sys 0.003s
I20260709 13:18:45.816375 21785 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:45.823287 18338 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:18:45.825496 18336 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
W20260709 13:18:45.831905 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 69110.9us
I20260709 13:18:45.930914 18457 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:45.931906 22233 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:18:45.932257 18457 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:45.840466 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.934880 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:45.936023 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:45.936951 22134 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:45.937680 22134 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:45.938334 22134 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:45.929462 22198 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.942385 22198 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:45.942693 21748 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:45.942387 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 725) took 1105 ms. Trace:
I20260709 13:18:45.944584 22218 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:45.945967 22227 log.cc:927] Time spent T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:18:45.829543 22006 consensus_meta.cc:287] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.936s	user 0.003s	sys 0.008s
I20260709 13:18:45.947135 22006 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:45.897292 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.947640 22218 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:45.929731 21785 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:45.841555 22132 consensus_meta.cc:287] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.002s
I20260709 13:18:45.948879 18341 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:45.949070 21785 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.950168 21785 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:45.948917 22132 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.918320 22160 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:45.951081 22160 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:45.951248 22006 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:45.951488 22160 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:45.951927 18488 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:45.915611 22222 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:45.923509 22210 consensus_meta.cc:287] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.002s
I20260709 13:18:45.903249 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:45.791630 22142 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:45.790611 22229 log.cc:927] Time spent T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:18:45.841269 22123 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:45.842401 22217 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:18:45.910351 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 179824us
W20260709 13:18:45.917846 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 107037us
I20260709 13:18:45.918215 19060 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:45.838104 22152 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:18:45.839447 21869 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:45.905798 21971 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:45.904237 22234 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.165s
I20260709 13:18:45.944744 18415 rpcz_store.cc:276] 0709 13:18:44.836868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.836988 (+   120us) service_pool.cc:224] Handling call
0709 13:18:44.837306 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.837878 (+   572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.837903 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.838404 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.921293 (+ 82889us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:44.921329 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.921435 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.815119 (+893684us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:45.942044 (+126925us) raft_consensus.cc:1685] finished
0709 13:18:45.942069 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.942307 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1774,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":92,"spinlock_wait_cycles":45217152,"thread_start_us":82546,"threads_started":1,"wal-append.queue_time_us":129038}
I20260709 13:18:45.946564 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:46.017375 19053 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
W20260709 13:18:45.901275 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 175218us
I20260709 13:18:45.956903 19054 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:45.933744 18457 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:45.894765 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.960299 22132 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:45.992585 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.922587 22193 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:46.011229 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 318226us
I20260709 13:18:45.953293 22231 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:46.020076 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 86394.9us
I20260709 13:18:46.021934 18458 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:46.025377 18457 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:46.000499 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:45.994017 22199 consensus_meta.cc:287] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.881s	user 0.009s	sys 0.004s
I20260709 13:18:46.028196 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:46.031208 19054 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:45.941329 22190 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.037881 18336 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:46.040419 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:46.040227 18457 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:45.901079 22211 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.026955 19027 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:46.042524 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:46.042526 19027 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:46.043514 18415 raft_consensus.cc:2410] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 13:18:46.044184 18227 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b345033a56994fff90990b7d03324074 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 20e06cff39b649c48d342b7431135303 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:18:46.046321 22034 consensus_meta.cc:287] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.818s	user 0.003s	sys 0.007s
I20260709 13:18:46.046813 22034 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.048887 22034 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:46.025902 22123 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:46.050171 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:46.052795 22202 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:46.053107 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:46.053450 22246 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:18:46.050177 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:46.055459 18382 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:46.056026 21869 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:46.030424 22142 consensus_queue.cc:1059] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:18:46.058486 19026 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:46.059327 22190 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:46.060454 19056 raft_consensus.cc:2410] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:18:46.060703 22130 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:46.061144 22130 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.061506 22130 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.062752 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:46.040213 22199 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.063055 19056 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:45.976137 22210 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:46.064711 22199 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:46.064981 19056 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:46.065510 22210 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:46.013715 22218 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.018390 22221 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:46.066148 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:46.066433 22218 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:46.066939 18343 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:46.067699 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:46.068208 18343 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:46.068392 22218 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:46.068979 18338 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:46.069425 22223 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:46.069531 22132 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:46.069928 22223 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.070122 22132 raft_consensus.cc:697] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:46.070326 22223 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:46.070981 18457 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:46.071044 22132 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.073876 19058 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:46.050096 22245 consensus_queue.cc:1059] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:18:46.053702 18344 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:46.079015 19027 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:46.033032 22214 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:46.095727 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:46.096989 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:46.097559 22231 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:46.088454 21965 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.099538 21965 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.102057 22174 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:46.063098 22142 raft_consensus.cc:3055] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:46.040416 22193 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:46.090204 19027 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:46.082867 21769 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:46.026644 22217 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.092549 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:46.107259 19056 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:46.097579 18336 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:46.070343 22241 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:46.082875 22123 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:46.080425 22152 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:46.083473 21748 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.117825 18415 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:46.124349 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:46.101615 21965 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:46.127235 18419 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:46.092909 22190 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:46.092630 22210 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:46.114156 21769 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.105289 22142 raft_consensus.cc:740] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:46.179641 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:46.180326 22142 consensus_queue.cc:260] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:46.181154 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:46.179659 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:46.181576 22142 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.093510 22169 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:18:46.148581 22138 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:46.150357 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:46.205740 18343 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:46.153710 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:46.158452 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:46.161149 18338 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:18:46.161554 18339 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
W20260709 13:18:46.162593 18412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2100) took 1361 ms (client timeout 1704 ms). Trace:
I20260709 13:18:46.164554 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:46.209184 19058 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.164703 19053 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:18:46.166165 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:46.166742 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:46.127444 22202 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:18:46.174868 22184 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:46.176564 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:46.177508 22193 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:46.179811 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:46.217504 18490 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:46.139418 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:46.218454 19056 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:46.117009 22186 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:46.089367 22234 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:18:46.181988 18488 raft_consensus.cc:2393] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:46.187637 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:46.183822 22241 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:46.182849 18492 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:46.182487 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:46.224888 18413 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:46.225212 18491 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:46.106213 22214 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:46.137522 21748 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:46.166045 22209 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.848s	user 0.000s	sys 0.003s
I20260709 13:18:46.201421 18344 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:46.186340 21769 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:46.210536 18336 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.200086 21792 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:46.214637 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:46.183352 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:46.226220 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:46.177520 22174 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:18:46.227741 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 154669us
I20260709 13:18:46.242724 18457 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:46.229085 19026 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:46.229393 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:46.227465 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 154310us
W20260709 13:18:46.209007 18412 rpcz_store.cc:269] 0709 13:18:44.806557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.809190 (+  2633us) service_pool.cc:224] Handling call
0709 13:18:46.162338 (+1353148us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54000a91d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:46.162513 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1933733120}
I20260709 13:18:46.238813 18338 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 13:18:46.239800 18418 raft_consensus.cc:2410] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:18:46.205602 22210 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.239770 18487 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:46.238587 18417 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:46.244751 18413 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.230680 22190 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:46.260304 19056 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:46.265444 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:46.230932 22186 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:46.276418 18336 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:46.277544 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:46.281162 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:46.267612 21939 consensus_meta.cc:287] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.000s
I20260709 13:18:46.283934 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:46.247198 22202 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:46.293813 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:46.294991 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:46.295089 21748 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:46.255960 22123 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:18:46.296257 21769 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.298215 19059 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:18:46.299381 19027 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:46.301124 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:46.301271 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 844) took 1641 ms. Trace:
I20260709 13:18:46.301643 18484 rpcz_store.cc:276] 0709 13:18:44.660299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.660484 (+   185us) service_pool.cc:224] Handling call
0709 13:18:44.671635 (+ 11151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.466644 (+795009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.301056 (+834412us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b5400259754. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:46.301205 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808993024}
I20260709 13:18:46.302277 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:46.303750 18342 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:18:46.304090 18342 pending_rounds.cc:85] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 4
I20260709 13:18:46.304294 18342 pending_rounds.cc:107] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:18:46.304509 18342 raft_consensus.cc:2889] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.304597 18309 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:46.305271 21814 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:46.305779 21814 raft_consensus.cc:697] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:46.306279 18335 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:46.306728 21882 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:46.306897 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 2002) took 1103 ms. Trace:
I20260709 13:18:46.306631 21814 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.307322 18335 rpcz_store.cc:276] 0709 13:18:45.202982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.203097 (+   115us) service_pool.cc:224] Handling call
0709 13:18:45.203373 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.306123 (+1102750us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5400404fa0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee53dc0 00007f409eede1c0 00007f409eedf231 00007f409eedbd8f 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c
0709 13:18:46.306657 (+   534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.306825 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29018496}
I20260709 13:18:46.310842 22211 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:46.311348 18411 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:46.313009 18411 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:18:46.313412 22252 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:18:46.316295 22212 log.cc:927] Time spent T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.920s	user 0.003s	sys 0.000s
I20260709 13:18:46.317338 21412 raft_consensus.cc:3055] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:46.317778 21412 raft_consensus.cc:740] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:46.318071 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1130) took 1501 ms. Trace:
I20260709 13:18:46.318506 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:46.318622 21412 consensus_queue.cc:260] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:46.319926 18412 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:18:46.321182 18412 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:46.327358 18458 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:46.329092 18415 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:46.332597 18417 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:46.227936 22241 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.334169 18413 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:46.335258 18412 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:18:46.323916 18309 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:46.339435 19058 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:46.258278 22250 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:46.318440 19062 rpcz_store.cc:276] 0709 13:18:44.816658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.827901 (+ 11243us) service_pool.cc:224] Handling call
0709 13:18:44.831834 (+  3933us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:44.861507 (+ 29673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.861536 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:44.897855 (+ 36319us) log.cc:844] Serialized 52 byte log entry
0709 13:18:45.210747 (+312892us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:45.219839 (+  9092us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.425448 (+205609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.425556 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.315691 (+890135us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:46.317757 (+  2066us) raft_consensus.cc:1685] finished
0709 13:18:46.317859 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.317998 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71884,"prepare.queue_time_us":8926,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":38,"raft.queue_time_us":135884,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":20201,"spinlock_wait_cycles":13463808,"thread_start_us":497753,"threads_started":2,"wal-append.queue_time_us":408097}
I20260709 13:18:46.345498 18488 raft_consensus.cc:3055] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:46.346035 18488 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:46.349087 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:46.349337 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:46.350744 18491 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:46.349287 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:46.351979 18488 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:46.266268 22223 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.370381 18488 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.339228 21882 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:46.373543 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:46.379611 18491 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:46.380774 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:46.381292 18488 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:46.381989 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:46.383383 22251 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:18:46.386389 22210 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:46.386889 22131 consensus_queue.cc:1059] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:46.356923 22234 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:46.389999 22258 consensus_queue.cc:1059] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:18:46.390908 22258 raft_consensus.cc:3055] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:46.391232 22258 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:46.391335 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:46.392055 22258 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.393231 22258 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.394369 22186 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.288259 21939 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:46.395337 22133 consensus_meta.cc:287] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.001s
I20260709 13:18:46.395732 22133 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:46.396466 18410 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:46.396924 21939 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:46.397296 18487 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:46.397418 22241 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:46.371568 22152 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 13:18:46.402661 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 142942us
I20260709 13:18:46.340225 22123 consensus_queue.cc:1059] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:18:46.408432 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:46.409878 18491 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:46.409766 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:46.408258 22250 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:18:46.401667 22241 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:46.426409 22123 raft_consensus.cc:3055] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:46.428295 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:46.428714 21882 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.438081 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:46.429124 18343 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:46.429492 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:46.347678 22130 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:46.431581 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:46.434185 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:46.435182 19062 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:46.440229 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:46.417692 18384 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:46.437181 18342 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:46.436453 19025 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:46.443653 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:46.447846 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:46.449033 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:46.449676 18488 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:46.454169 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:46.454447 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:46.407012 21939 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:18:46.451610 18413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:18:46.457528 22264 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:46.414662 21869 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:46.458048 22264 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.458549 22264 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.420507 21965 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:46.466950 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:46.467708 18492 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 5: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:46.468485 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:46.469046 18492 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:46.445168 22241 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.469707 22195 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:46.470284 18342 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:46.471282 22241 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:46.420709 22257 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:18:46.476666 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:46.476784 22104 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.477419 22238 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:46.477355 22104 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.478077 22238 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:46.479048 22238 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.479835 22104 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:46.438719 22222 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:46.443374 22221 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:46.482121 22222 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.482723 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:46.483554 18491 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:46.484691 22214 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:46.485890 22237 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:46.451414 22175 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:46.490372 22175 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.490751 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:46.490803 22175 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.416507 22133 raft_consensus.cc:3055] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:46.455801 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:46.494509 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.494925 18336 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:46.466952 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:46.407295 22184 consensus_queue.cc:1059] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:18:46.457125 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:46.459316 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:46.500164 19062 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:46.457108 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:46.457954 18413 raft_consensus.cc:606] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:46.460901 18414 raft_consensus.cc:2368] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8.
I20260709 13:18:46.413475 21968 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:18:46.436823 22123 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:46.500895 18457 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:46.502470 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:46.510529 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:46.504084 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.508563 19060 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:18:46.510670 19062 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:18:46.500723 18493 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:46.500490 18382 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:46.515166 18457 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:46.514688 18336 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:46.513283 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:46.525653 19054 raft_consensus.cc:2410] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:46.528944 18307 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:46.531517 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:46.493790 21785 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:46.532609 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:46.534010 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:46.538465 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:46.499912 22133 raft_consensus.cc:740] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:46.446278 21882 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:46.548888 18307 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:46.555776 18416 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:46.557204 18342 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:18:46.521178 22104 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:46.565282 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.533572 22172 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:46.652262 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 137173us
I20260709 13:18:46.536404 22234 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.535318 22195 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:46.634363 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.558535 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:46.535002 21785 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:46.512924 22142 consensus_queue.cc:1059] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:18:46.513487 22257 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:18:46.542062 22210 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:46.704272 22175 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.491066 22264 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.544929 22131 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:46.544797 21965 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:46.756937 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 198485us
W20260709 13:18:46.692901 22260 log.cc:927] Time spent T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.272s	user 0.001s	sys 0.001s
W20260709 13:18:46.693845 22212 log.cc:927] Time spent T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:18:46.560410 22221 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.564553 22152 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:46.793197 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 272350us
I20260709 13:18:46.845381 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:46.651119 22231 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:46.840543 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 113735us
I20260709 13:18:46.846695 18457 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:46.848151 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:46.761346 22198 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:46.844282 22160 consensus_meta.cc:287] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.892s	user 0.006s	sys 0.006s
I20260709 13:18:46.792639 22210 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.794268 22131 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.848112 22231 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.562914 22217 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.890398 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:46.951678 18335 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
W20260709 13:18:46.918675 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.794312 22132 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:46.889895 22214 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:46.842972 21965 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.917873 22210 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:46.924353 21882 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:46.923431 22130 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:46.924660 22200 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:46.909449 22142 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:46.938370 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 93069.8us
I20260709 13:18:46.940896 22175 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:46.926151 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:46.992815 19062 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:46.945044 22264 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:46.923776 22253 log.cc:927] Time spent T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:18:46.950241 21785 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:46.952713 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.848362 21939 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.961730 22231 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:46.926438 22263 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.406s	user 0.000s	sys 0.000s
W20260709 13:18:46.925186 22262 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.369s	user 0.001s	sys 0.000s
I20260709 13:18:46.998458 18384 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:46.802857 22123 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:47.000216 22203 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:47.024390 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:46.850484 22241 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.144s
I20260709 13:18:46.919946 22131 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.850274 22152 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:46.986424 21965 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:47.025442 18340 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:47.025897 21785 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:46.961269 22160 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.044134 18309 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:47.049880 18417 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:47.013091 22198 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:47.047132 18410 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:18:47.031663 19062 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:46.993695 22214 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:47.025108 22264 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:47.051034 22255 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:46.994059 22132 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.055331 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:47.057415 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 210820us
I20260709 13:18:47.058440 18309 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:47.059676 18309 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:47.061801 18410 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 9: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:47.062606 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:47.047045 22244 raft_consensus.cc:3055] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:47.019713 21939 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.067907 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:47.068222 18486 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:47.068411 18490 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:47.055087 22142 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:47.052601 22123 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:47.072935 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:47.052162 22006 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:47.079434 18485 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:47.065882 22200 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:47.099148 18485 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:47.064648 21882 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:47.090221 22264 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:47.092067 21412 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.069766 22034 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.111263 22264 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.113775 22264 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.105854 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:47.071244 22244 raft_consensus.cc:740] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:47.060607 22198 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.079667 22142 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:47.064452 22258 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:18:47.110714 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:47.084836 22245 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:47.146791 18458 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:47.148805 18458 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:47.149585 22255 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:47.150262 22217 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.150955 22160 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.151619 22160 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:47.152334 22160 raft_consensus.cc:3055] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:47.152693 22160 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:47.128320 22244 consensus_queue.cc:260] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:47.154498 22244 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:47.128377 18226 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b345033a56994fff90990b7d03324074 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) due to error UNKNOWN_ERROR; will retry: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }.
  Pending config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.156426 22255 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:47.156653 18226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 90104.4us
I20260709 13:18:47.158344 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:47.159435 22255 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:47.159561 22175 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:47.161002 22241 consensus_queue.cc:1059] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:47.134285 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:47.162998 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:47.135354 22198 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.138015 22214 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:47.141124 22132 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.143014 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 2123) took 1061 ms. Trace:
I20260709 13:18:47.159881 22255 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.123289 22264 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:47.109154 22006 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:47.163231 18491 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 9: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:47.135823 21939 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.133417 22034 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:47.178166 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:47.179183 18492 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:47.165020 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:47.165441 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:47.164474 19026 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:47.168771 18490 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:47.126703 22142 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:47.174125 18414 rpcz_store.cc:276] 0709 13:18:46.081981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.082159 (+   178us) service_pool.cc:224] Handling call
0709 13:18:47.142822 (+1060663us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540011d5d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:47.142954 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837947136}
I20260709 13:18:47.158890 22152 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.127022 21882 raft_consensus.cc:697] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:47.184033 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 115537us
I20260709 13:18:47.168883 22199 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:47.190404 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:47.191545 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:47.191429 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:47.175222 22255 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:47.221570 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 137159us
I20260709 13:18:47.153566 22160 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.221580 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:47.235523 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:47.238806 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:47.239050 18486 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:47.239670 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:47.242861 18384 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:47.235522 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:47.243727 18490 raft_consensus.cc:2410] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:47.244383 18492 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:47.245801 21939 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:47.245550 21882 consensus_queue.cc:237] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.246516 22264 consensus_queue.cc:1059] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:47.193936 22184 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:47.254377 22184 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.256827 22184 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:47.259349 22221 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:47.250785 22214 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.261154 22214 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.244529 22202 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:47.263291 22202 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:47.263422 22214 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.251379 22172 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:47.264317 22172 raft_consensus.cc:697] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:47.255918 22199 consensus_queue.cc:1059] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:18:47.265304 22172 consensus_queue.cc:237] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.265990 22006 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:47.266708 22274 raft_consensus.cc:3055] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:47.267122 22274 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:47.255355 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:47.269634 18492 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:47.270982 22231 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.173514 22283 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:18:47.269784 21939 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:47.286469 21939 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.286864 21939 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.288057 22214 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.288586 22214 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.316429 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:47.253191 22222 consensus_meta.cc:287] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.771s	user 0.013s	sys 0.006s
I20260709 13:18:47.334726 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 944) took 1880 ms. Trace:
I20260709 13:18:47.316119 22210 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:47.294126 22160 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.335204 19055 rpcz_store.cc:276] 0709 13:18:45.454283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.476222 (+ 21939us) service_pool.cc:224] Handling call
0709 13:18:45.476530 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.736332 (+259802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.334484 (+1598152us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54006c0a54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:47.334664 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584884096}
I20260709 13:18:47.268102 22274 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.339584 18492 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:47.338196 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:47.337563 22264 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:47.316430 22231 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.354344 18338 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:47.343523 22214 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.264345 22202 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.371325 18410 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:47.372303 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:47.373057 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:47.374326 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:47.341607 22257 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:18:47.377131 18414 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:47.342257 22130 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:18:47.341205 22222 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.378491 18485 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:18:47.392839 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 159000us
I20260709 13:18:47.394042 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:47.394665 18336 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:47.394858 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.397360 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:47.366221 22238 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:47.396270 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.399439 19056 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:47.419344 22222 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:47.421171 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:47.421948 18340 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:47.422533 18335 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:47.416498 22104 consensus_queue.cc:1059] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:18:47.444358 21965 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.448454 18336 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:47.452345 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:47.455157 21639 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:47.466143 21639 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.468267 21639 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.427810 22152 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:18:47.415027 22186 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:18:47.428385 22134 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:18:47.475198 22172 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:47.478981 22131 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:47.481032 22184 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.521342 21639 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:47.521968 21639 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:47.489972 22292 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:18:47.529129 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.538168 22210 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:47.539664 21965 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.546828 22131 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:47.547747 22223 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:47.489037 22213 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.140s
I20260709 13:18:47.515551 22172 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.561931 22255 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.567229 22172 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:47.556929 22214 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.568542 22255 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.576797 22133 consensus_queue.cc:260] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.578406 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.579226 19061 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:18:47.579645 19061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 947) took 1438 ms (client timeout 1653 ms). Trace:
W20260709 13:18:47.580118 19061 rpcz_store.cc:269] 0709 13:18:46.141622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.578122 (+1436500us) service_pool.cc:224] Handling call
0709 13:18:47.579582 (+  1460us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:47.587026 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.589015 22274 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:47.590380 21639 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.592651 22184 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:47.593290 21939 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.594584 18410 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:18:47.599231 22215 raft_consensus.cc:3055] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:47.599632 22215 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:47.600510 22215 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.601118 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2085) took 1074 ms. Trace:
W20260709 13:18:47.604203 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.605234 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 853) took 1280 ms. Trace:
I20260709 13:18:47.601651 22215 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.619779 21971 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.620383 21971 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:47.623525 21971 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:47.604722 21792 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:47.624374 21792 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:47.625144 21792 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:47.616358 18489 rpcz_store.cc:276] 0709 13:18:46.325255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.325388 (+   133us) service_pool.cc:224] Handling call
0709 13:18:46.325644 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.356675 (+ 31031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.356705 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:46.356746 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:46.356775 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.604982 (+1248207us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b54002922d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:47.605034 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.605177 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70963456}
I20260709 13:18:47.629427 21792 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.631053 22133 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:47.631642 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.603076 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2124) took 1345 ms. Trace:
I20260709 13:18:47.634259 18416 rpcz_store.cc:276] 0709 13:18:46.257838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.294782 (+ 36944us) service_pool.cc:224] Handling call
0709 13:18:47.602888 (+1308106us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54001c52d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:47.603011 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466903296}
I20260709 13:18:47.637005 18342 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:47.639750 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:47.640307 18343 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:47.643358 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:47.644011 22264 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:47.644550 22264 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:47.645718 22264 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.647469 22264 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.649163 18343 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:47.653642 22169 raft_consensus.cc:3055] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:47.654124 22169 raft_consensus.cc:740] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:47.654408 18335 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:47.655004 18340 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:47.655397 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:47.656109 18336 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:47.656425 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:47.657104 18340 raft_consensus.cc:2393] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 6: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:47.659109 18341 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:18:47.660009 21225 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.660470 21225 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.663309 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2260) took 1121 ms. Trace:
W20260709 13:18:47.663441 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.667212 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:47.668063 18490 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:47.668978 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:47.669173 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:47.669551 18490 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:47.669904 18489 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:47.670753 18486 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:47.663759 18338 rpcz_store.cc:276] 0709 13:18:46.541550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.542286 (+   736us) service_pool.cc:224] Handling call
0709 13:18:46.542546 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.360281 (+817735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.663043 (+302762us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54000e15d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:47.663248 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859440896}
I20260709 13:18:47.786561 22174 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.673154 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:47.716683 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 932) took 2006 ms. Trace:
I20260709 13:18:47.711459 21225 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:47.766405 18307 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:47.720338 19025 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:47.831179 22034 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:47.772967 22258 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.831933 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 111683us
I20260709 13:18:47.832350 22258 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.830312 19053 rpcz_store.cc:276] 0709 13:18:45.710673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.054829 (+344156us) service_pool.cc:224] Handling call
0709 13:18:46.164440 (+109611us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.210028 (+ 45588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.716450 (+1506422us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54006446d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:47.716615 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251379968}
I20260709 13:18:47.693507 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:47.834256 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 67981.8us
I20260709 13:18:47.834486 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.720866 22169 consensus_queue.cc:260] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.769845 18340 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:47.838245 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.709641 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.841653 19062 raft_consensus.cc:2410] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:18:47.731011 19061 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:47.842511 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.760744 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:47.843483 18484 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:47.842645 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:47.741164 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.845930 19053 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:47.846809 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:47.847005 22104 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:47.735761 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.762818 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:47.848857 19054 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:18:47.756768 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:47.601508 18493 rpcz_store.cc:276] 0709 13:18:46.526823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.528046 (+  1223us) service_pool.cc:224] Handling call
0709 13:18:46.543441 (+ 15395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.792284 (+248843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.792313 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:46.792351 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:46.792388 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.600883 (+808495us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54002927d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:47.600931 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.601060 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571831040}
W20260709 13:18:47.749771 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.827811 22123 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.850039 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 93385.6us
I20260709 13:18:47.771068 22132 raft_consensus.cc:3055] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:18:47.703683 22142 consensus_meta.cc:287] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.510s	user 0.000s	sys 0.010s
I20260709 13:18:47.858629 21225 consensus_queue.cc:1059] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:47.859795 21225 raft_consensus.cc:3055] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:47.860261 21225 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:47.860446 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:47.861609 19058 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:18:47.862676 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.862951 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.864575 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.867528 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:47.868323 18410 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.721866 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2257) took 1182 ms. Trace:
I20260709 13:18:47.745347 22218 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.828933 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:47.568836 22214 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.712007 21769 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:47.762110 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:47.699254 22211 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.823299 22174 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.830940 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:47.834738 19056 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:47.720579 22167 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.770381 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.922150 21225 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:47.923581 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.924538 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.700836 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37140 (request call id 21) took 1267 ms. Trace:
I20260709 13:18:47.717036 22241 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:47.927141 18309 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:47.709112 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 857) took 1353 ms. Trace:
I20260709 13:18:47.930717 19056 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:47.711802 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.699255 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.721820 18485 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:47.730876 22245 raft_consensus.cc:3055] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:47.773466 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:47.820631 18308 leader_election.cc:400] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8.
I20260709 13:18:47.933219 18308 leader_election.cc:403] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:18:47.835080 18307 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:47.844477 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:47.709558 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:47.846426 22169 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:47.848095 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.718516 22274 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:47.634153 21939 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.951182 18410 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:47.735339 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.827778 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:47.872445 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.869987 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:47.847687 22104 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:47.957253 18489 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:47.873080 19025 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:47.861852 22234 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:47.897095 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.969929 19053 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:47.873787 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:47.925505 18413 rpcz_store.cc:276] 0709 13:18:46.439768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.446913 (+  7145us) service_pool.cc:224] Handling call
0709 13:18:47.700442 (+1253529us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b540008d2a0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee59520 00007f409eed6652 00007f40a3ea460a 00007f409d42a7d4 00007f409d42a762 00007f409d42a691 00007f409d42a60c 00007f409d4298c2 00007f409d21748c 00007f409d2168c6
0709 13:18:47.700722 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26825472}
I20260709 13:18:47.926004 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:47.874073 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:47.928485 21225 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.971442 18417 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:47.928606 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:47.928965 21769 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.940246 22218 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.975696 21769 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.941219 22174 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:47.978232 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:47.978873 18412 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:47.872519 22290 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:18:47.979671 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:47.980736 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:47.981410 18412 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:47.981540 22283 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:48.034274 18489 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:47.984853 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:47.936313 19060 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:47.834734 22258 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:47.930809 18487 rpcz_store.cc:276] 0709 13:18:46.355309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.355430 (+   121us) service_pool.cc:224] Handling call
0709 13:18:46.380208 (+ 24778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.397684 (+ 17476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.708891 (+1311207us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b5400122d54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:47.709053 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38861696}
I20260709 13:18:47.936071 22152 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:47.929765 22134 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:18:47.936465 22167 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.950244 21639 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:47.950809 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 115783us
I20260709 13:18:47.983592 19058 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:48.045321 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:47.984793 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:47.862120 22175 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:47.873147 22123 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:47.904049 21412 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:47.861522 22199 consensus_queue.cc:1059] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:18:47.954084 22255 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.940465 19057 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:47.955749 19027 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:47.852432 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:47.941354 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:47.941838 19056 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:47.941934 19059 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:48.143108 18491 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
W20260709 13:18:47.939240 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 118840us
W20260709 13:18:48.145572 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 189912us
W20260709 13:18:47.969168 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 96146.8us
W20260709 13:18:48.148933 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.920959 18490 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:47.873124 22142 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:47.973577 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 99865.1us
I20260709 13:18:47.982264 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:48.151847 19053 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.858533 22132 raft_consensus.cc:740] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:47.728849 21869 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 13:18:48.034760 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:48.035924 18412 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:47.870285 18344 rpcz_store.cc:276] 0709 13:18:46.539620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.539906 (+   286us) service_pool.cc:224] Handling call
0709 13:18:46.563995 (+ 24089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.717831 (+153836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.717880 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:46.718573 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.054208 (+335635us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:47.055977 (+  1769us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.083717 (+ 27740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.721356 (+637639us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540007f154. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:47.721423 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.721489 (+    66us) raft_consensus.cc:1685] finished
0709 13:18:47.721616 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.721792 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52412,"prepare.queue_time_us":1476,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":54645,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":40541,"spinlock_wait_cycles":295242112,"thread_start_us":209518,"threads_started":1,"wal-append.queue_time_us":380915}
I20260709 13:18:47.932705 18341 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:47.999773 18382 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:48.154713 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 155060us
I20260709 13:18:48.038569 19060 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:47.872817 22244 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 13:18:48.046440 22152 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:48.050099 18384 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.024s	sys 0.056s
I20260709 13:18:48.050545 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:48.158025 21639 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:48.158064 18384 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.024s	sys 0.056s
I20260709 13:18:48.158751 21639 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.160883 22152 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:48.161890 21939 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:48.162353 21939 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.162747 21939 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:48.162436 22133 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:48.163689 22283 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:48.164152 22283 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:48.163843 22290 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:48.164945 22283 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.981422 22172 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:48.166191 22172 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:48.166330 22283 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:48.166644 22172 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:48.167253 22167 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:47.952381 18242 catalog_manager.cc:5697] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 7 to 8, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 8 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.170697 22223 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:48.171224 22223 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.171651 22223 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:48.172541 18242 catalog_manager.cc:5697] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 5 to 8, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 8 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:48.097854 22104 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:48.174651 22132 consensus_queue.cc:260] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.176321 22132 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:48.178148 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.179370 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:48.180099 22257 consensus_queue.cc:1059] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:48.180192 22142 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:48.126888 22034 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:48.094755 22202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.013s	sys 0.021s
W20260709 13:18:48.136951 18238 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42292 (request call id 342) took 13922 ms (client timeout 15000 ms). Trace:
I20260709 13:18:48.065728 22138 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:48.097793 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.193113 18384 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:47.941429 22241 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.202419 21965 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:48.204737 22241 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:48.206400 22265 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:48.066159 21412 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:47.943195 22211 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:47.977887 22218 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:48.223946 22218 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:48.224323 22218 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:48.224689 22218 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:48.190727 18238 rpcz_store.cc:269] 0709 13:18:34.186855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.187145 (+   290us) service_pool.cc:224] Handling call
0709 13:18:48.108951 (+13921806us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:44.313081 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:44.313740 (+   659us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:44.313798 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:18:44.313816 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:44.315571 (+  1755us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:44.315666 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:44.315706 (+    40us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:18:44.317566 (+  1860us) tablet.cc:701] Row locks acquired
0709 13:18:44.317619 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:18:44.317802 (+   183us) write_op.cc:270] Start()
0709 13:18:44.366705 (+ 48903us) write_op.cc:276] Timestamp: P: 1783603124317734 usec, L: 0
0709 13:18:44.366744 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:18:44.375996 (+  9252us) log.cc:844] Serialized 8175 byte log entry
0709 13:18:44.691345 (+315349us) op_driver.cc:464] REPLICATION: finished
0709 13:18:44.848745 (+157400us) write_op.cc:301] APPLY: starting
0709 13:18:44.848848 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:44.849254 (+   406us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:44.849397 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:45.004675 (+155278us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:45.005070 (+   395us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:18:45.005119 (+    49us) write_op.cc:312] APPLY: finished
0709 13:18:45.005552 (+   433us) log.cc:844] Serialized 139 byte log entry
0709 13:18:45.005763 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:45.014552 (+  8789us) write_op.cc:454] Released schema lock
0709 13:18:45.047074 (+ 32522us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:45.119557 (+ 72483us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:45.123455 (+  3898us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3578675,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":134824,"apply.run_cpu_time_us":6233,"apply.run_wall_time_us":254179,"num_ops":20,"prepare.queue_time_us":189971,"prepare.run_cpu_time_us":6886,"prepare.run_wall_time_us":94294,"raft.queue_time_us":132095,"raft.run_cpu_time_us":6998,"raft.run_wall_time_us":105088,"replication_time_us":304579,"thread_start_us":311620,"threads_started":4,"wal-append.queue_time_us":1204,"wal-append.run_cpu_time_us":19633,"wal-append.run_wall_time_us":1715259}]]}
I20260709 13:18:48.108424 18486 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:18:48.226059 18486 pending_rounds.cc:85] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 8
I20260709 13:18:48.226327 18486 pending_rounds.cc:107] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:18:48.226540 18486 raft_consensus.cc:2889] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:48.228071 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.977857 21769 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:48.181582 22257 raft_consensus.cc:3055] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:48.053105 19055 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:48.165654 22193 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8.
I20260709 13:18:48.182269 18418 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:48.183651 18458 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:48.105497 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:48.208058 21412 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:48.234460 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 50936.7us
I20260709 13:18:48.187320 18490 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
W20260709 13:18:48.241140 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.191679 21225 raft_consensus.cc:3055] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:48.200672 18384 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:48.199163 22138 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:48.190687 22202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.013s	sys 0.021s
I20260709 13:18:48.154947 19027 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:48.251847 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 96981.2us
W20260709 13:18:48.250833 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 50297.3us
I20260709 13:18:48.253175 19027 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:48.074661 18417 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:48.188825 21639 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:48.253666 22138 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:48.241758 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.262768 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:48.263447 18337 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:47.960750 22210 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:47.938258 22245 raft_consensus.cc:740] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:48.200143 22123 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:48.245388 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:48.247777 22152 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:48.248437 18484 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:48.275264 18344 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:18:48.249532 21225 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:48.271070 18382 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:48.276223 21225 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.277640 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:48.278486 18337 raft_consensus.cc:2368] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:18:47.970382 22274 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.230552 22257 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:48.234763 18488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.025s	sys 0.007s
I20260709 13:18:48.260891 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:48.268996 21939 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:48.272038 18417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:18:48.283609 18417 raft_consensus.cc:606] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:48.278312 18458 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:48.279678 18488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.025s	sys 0.007s
I20260709 13:18:48.279999 18485 raft_consensus.cc:2393] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:48.254006 22137 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:48.281972 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 2089) took 1102 ms. Trace:
I20260709 13:18:48.257577 22199 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:48.256524 22213 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:18:48.291500 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.287685 18491 rpcz_store.cc:276] 0709 13:18:47.173497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.183635 (+ 10138us) service_pool.cc:224] Handling call
0709 13:18:48.272899 (+1089264us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54000dcfd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:48.272987 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1829778688}
I20260709 13:18:48.293148 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:48.274899 22210 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.198601 22255 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:48.256469 21769 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:18:48.287977 18458 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:48.256342 21869 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:48.290514 22123 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:48.299496 18493 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:48.233093 19053 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:48.259899 22265 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:18:48.283267 22175 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:18:48.306067 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:48.307188 18491 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:18:48.338496 18491 pending_rounds.cc:85] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 4
I20260709 13:18:48.338821 18491 pending_rounds.cc:107] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:18:48.285822 21225 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:48.339102 18491 raft_consensus.cc:2889] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:48.329083 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:48.295742 22130 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:48.329305 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:48.341673 19060 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:48.296989 22210 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:48.342964 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:48.299430 22137 raft_consensus.cc:697] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:48.343461 18417 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:18:48.299190 22213 raft_consensus.cc:697] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:48.344339 18489 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:48.335103 18492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.014s	sys 0.012s
I20260709 13:18:48.346029 18417 pending_rounds.cc:85] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 10
I20260709 13:18:48.346642 18417 pending_rounds.cc:107] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:18:48.346997 18417 raft_consensus.cc:2889] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:48.346021 18492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.014s	sys 0.012s
I20260709 13:18:48.350179 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:48.351598 19053 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:18:48.352674 18412 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:48.352682 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:48.357511 19056 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:18:48.357777 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:48.308044 22283 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:48.348547 21971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.007s	sys 0.018s
I20260709 13:18:48.368355 21225 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.344898 22241 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:48.390004 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:48.392014 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:48.403723 21225 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.344743 22234 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:48.391126 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:48.359026 22214 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:48.398753 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:48.349229 22130 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:48.304834 21869 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.412364 21225 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:48.426806 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:48.432778 19058 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:48.349186 22134 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:18:48.310494 22257 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.464058 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:48.401587 21971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.007s	sys 0.019s
I20260709 13:18:48.465607 22234 consensus_queue.cc:1059] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:18:48.503592 22234 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:48.503927 22234 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:48.504787 22234 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.472054 19060 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:18:48.501626 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:48.506265 19062 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:18:48.461798 19056 raft_consensus.cc:2393] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:48.476541 18309 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:48.478003 22283 consensus_queue.cc:1059] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:48.482034 22213 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.482545 21412 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.483225 22274 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:48.484091 21939 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:48.485661 22304 raft_consensus.cc:993] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:18:48.486229 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:48.514137 18492 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:48.438851 22211 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:48.490253 22137 consensus_queue.cc:237] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:48.491492 22255 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:48.492405 22130 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.407820 22104 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:18:48.481503 22138 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.482573 22223 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.495285 21792 raft_consensus.cc:993] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:18:48.304736 22245 consensus_queue.cc:260] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.497282 22218 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:48.497957 22264 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:18:48.498541 22306 log.cc:927] Time spent T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:18:48.450968 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:48.440644 22241 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:48.502801 19053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:18:48.774212 19053 raft_consensus.cc:606] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:48.412542 22142 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:48.390097 22199 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:48.365156 22172 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.483242 18418 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
W20260709 13:18:48.519861 18414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.012s	sys 0.034s
I20260709 13:18:48.510792 22134 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:48.791628 18414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.013s	sys 0.034s
I20260709 13:18:48.791807 22134 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:48.793046 22172 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:48.793962 22134 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:48.510665 22152 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:48.761752 22264 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:48.794796 22152 raft_consensus.cc:697] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:48.795801 22152 consensus_queue.cc:237] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.796391 22264 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:48.797526 22264 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:48.513470 22214 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:48.526248 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 420386us
W20260709 13:18:48.589671 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.520956 22234 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.542593 22244 raft_consensus.cc:1081] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
W20260709 13:18:48.726095 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 426078us
W20260709 13:18:48.731828 18419 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.016s	sys 0.045s
W20260709 13:18:48.752592 18307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.000s	sys 0.020s
I20260709 13:18:48.760152 22283 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.767388 22274 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:48.725574 18487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.000s	sys 0.011s
I20260709 13:18:48.754170 18308 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:48.519721 22265 raft_consensus.cc:1081] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
W20260709 13:18:48.811411 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 57351.8us
I20260709 13:18:48.812984 18308 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:48.815902 18410 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: [6.7-8.8]
W20260709 13:18:48.810465 18487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.000s	sys 0.012s
W20260709 13:18:48.759433 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.821005 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.821398 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.595136 18335 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.001s	sys 0.062s
W20260709 13:18:48.823046 18335 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.005s	sys 0.066s
I20260709 13:18:48.824033 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:48.824671 18488 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:48.759594 19055 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:48.761111 18492 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:48.763614 21225 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.826350 21225 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.767381 18341 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:48.772677 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 321796us
I20260709 13:18:48.827929 19026 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:18:48.756500 22132 consensus_meta.cc:287] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.580s	user 0.017s	sys 0.002s
I20260709 13:18:48.789197 22218 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:48.753539 22211 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:48.801652 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.804088 18419 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.017s	sys 0.045s
W20260709 13:18:48.804275 18307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.000s	sys 0.020s
W20260709 13:18:48.846076 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 795562us
W20260709 13:18:48.753604 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.805119 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:48.803364 22214 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:48.754868 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.835268 19026 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:48.852979 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:48.840823 18415 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:48.841866 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:48.867698 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:48.868525 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 55621us
I20260709 13:18:48.803637 22311 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:48.920203 18488 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:48.888293 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:48.913414 18384 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:48.924479 18413 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
W20260709 13:18:48.891055 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.863735 21792 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.936690 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:48.839943 22134 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:48.844938 22175 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:48.939211 18415 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:48.864204 22167 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:48.851071 22214 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.944974 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 757) took 1071 ms. Trace:
I20260709 13:18:48.865093 22241 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.815807 22186 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:18:48.804083 22199 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.980525 18415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:18:48.816879 22283 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:48.936828 22310 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:18:48.817140 22274 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:48.921057 22321 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.890717 22218 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:48.891945 22193 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:48.952603 18418 rpcz_store.cc:276] 0709 13:18:47.873682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.873806 (+   124us) service_pool.cc:224] Handling call
0709 13:18:48.944773 (+1070967us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54003ecbd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:48.944909 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480035200}
I20260709 13:18:48.965161 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:48.884972 22104 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:48.981194 18415 raft_consensus.cc:606] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:49.063200 18415 raft_consensus.cc:614] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:48.932080 22138 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:48.941865 22175 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.931536 22255 consensus_queue.cc:1059] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:18:48.946651 22265 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:48.890642 21769 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:18:48.884809 22215 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
W20260709 13:18:49.040762 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 152686us
I20260709 13:18:48.864794 22211 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:48.945596 21412 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.081310 22175 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:49.024994 18488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:18:49.111045 18488 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:49.111595 18488 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:49.088073 22265 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:48.947592 21792 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:49.094753 18307 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:48.951471 22134 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:49.113524 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 259941us
I20260709 13:18:49.118635 22238 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.109144 22328 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:18:49.120541 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:49.122195 18413 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:48.980369 22241 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.092808 21869 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:49.067143 22193 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.082789 22104 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:49.148958 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 301642us
I20260709 13:18:49.165963 19062 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:49.123225 18382 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:49.202688 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 79554.4us
I20260709 13:18:49.223203 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:49.148618 22210 consensus_meta.cc:287] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.791s	user 0.005s	sys 0.006s
I20260709 13:18:49.067353 22321 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.233947 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 2019) took 1472 ms. Trace:
I20260709 13:18:49.111107 22218 consensus_queue.cc:1059] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 13:18:49.144251 21412 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:49.143519 22265 raft_consensus.cc:697] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:49.234362 18339 rpcz_store.cc:276] 0709 13:18:47.761700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.763609 (+  1909us) service_pool.cc:224] Handling call
0709 13:18:47.764020 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.764440 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.764469 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.816006 (+ 51537us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b2c000014c8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:18:47.816454 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.271056 (+454602us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:48.271096 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.271161 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.215019 (+943858us) raft_consensus.cc:1685] finished
0709 13:18:49.215045 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.233860 (+ 18815us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"spinlock_wait_cycles":114596608,"thread_start_us":454223,"threads_started":1,"wal-append.queue_time_us":709549}
I20260709 13:18:49.238550 18488 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:49.244191 22321 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.246706 18418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:18:49.160782 22193 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:49.231537 22335 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:49.231257 22202 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:18:49.253332 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 288251us
I20260709 13:18:49.260396 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:49.266105 18488 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:49.144074 22238 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:49.252753 22315 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
W20260709 13:18:49.268505 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 137212us
I20260709 13:18:49.270150 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 2024) took 1506 ms. Trace:
I20260709 13:18:49.301842 18335 rpcz_store.cc:276] 0709 13:18:47.763475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.764801 (+  1326us) service_pool.cc:224] Handling call
0709 13:18:47.765177 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.765417 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:48.823423 (+1058006us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.269765 (+446342us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.269813 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:49.269852 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.269990 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.270091 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1125050,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":275357,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":1849,"thread_start_us":1503488,"threads_started":3,"wal-append.queue_time_us":324410}
W20260709 13:18:49.310236 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 166542us
W20260709 13:18:49.267102 22325 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:18:49.278762 22318 log.cc:927] Time spent T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
W20260709 13:18:49.361537 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.238471 22210 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.258749 22335 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:18:49.371318 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 167479us
I20260709 13:18:49.266332 22311 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:49.378721 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:49.378968 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:49.382690 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 457085us
I20260709 13:18:49.281420 22334 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:49.281849 22328 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:49.388025 18344 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:18:49.390341 18489 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:18:49.389707 18492 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
W20260709 13:18:49.389107 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.367545 22337 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:49.249156 21412 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.408084 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:49.410512 18491 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:49.408267 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:49.416009 18485 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:49.408921 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:49.423586 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 163236us
I20260709 13:18:49.272045 22202 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.425170 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:49.383704 22336 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.383095 22123 raft_consensus.cc:3055] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:18:49.434530 18309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.016s	sys 0.012s
I20260709 13:18:49.390383 22241 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:49.440469 18309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.017s	sys 0.013s
I20260709 13:18:49.387763 22210 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.401892 22342 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:49.446319 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 593995us
I20260709 13:18:49.384159 22332 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 13:18:49.422434 22319 log.cc:927] Time spent T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.366s	user 0.001s	sys 0.000s
I20260709 13:18:49.422852 22344 raft_consensus.cc:3055] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:49.426424 22199 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:49.441318 22283 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.461354 18491 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:49.440214 22274 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:49.440303 22123 raft_consensus.cc:740] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:49.445397 22341 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.468902 18412 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:49.474205 18418 raft_consensus.cc:606] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:49.476718 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 95374.4us
I20260709 13:18:49.479032 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:49.479638 19062 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
W20260709 13:18:49.479182 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.459592 22344 raft_consensus.cc:740] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:49.468000 22316 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
I20260709 13:18:49.482336 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:49.463873 21792 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:49.460374 22211 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:49.484737 22307 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:49.485065 22320 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:49.485940 22330 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.261s	user 0.000s	sys 0.000s
W20260709 13:18:49.486824 22331 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:18:49.487622 22329 log.cc:927] Time spent T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.274s	user 0.000s	sys 0.000s
I20260709 13:18:49.487787 22352 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:49.487903 22241 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:49.405367 22265 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.490466 22130 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:49.478535 22341 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.389994 22311 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.388787 22335 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:49.538569 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.539928 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 114820us
I20260709 13:18:49.540997 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 759) took 1658 ms. Trace:
I20260709 13:18:49.541334 18419 rpcz_store.cc:276] 0709 13:18:47.882976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.883109 (+   133us) service_pool.cc:224] Handling call
0709 13:18:47.929805 (+ 46696us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.930182 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.930211 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.930640 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.846207 (+915567us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:48.846258 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.846347 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.540815 (+694468us) raft_consensus.cc:1685] finished
0709 13:18:49.540834 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.540947 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63033,"raft.queue_time_us":143,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":31672,"thread_start_us":800654,"threads_started":1,"wal-append.queue_time_us":984504}
I20260709 13:18:49.545584 18384 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:49.505517 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 49449.3us
I20260709 13:18:49.467950 22349 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:18:49.489799 22314 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.251s	user 0.000s	sys 0.000s
I20260709 13:18:49.545405 22354 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.445508 22336 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.516582 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 959) took 1678 ms. Trace:
W20260709 13:18:49.519631 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.481802 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 170809us
I20260709 13:18:49.512794 22320 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:49.540369 22210 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.481797 22134 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:49.548033 22335 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:49.539821 22211 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:49.508970 22344 consensus_queue.cc:260] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.539182 22337 raft_consensus.cc:697] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:49.619439 18342 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:18:49.596853 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.532390 22241 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.576104 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:49.596537 19054 rpcz_store.cc:276] 0709 13:18:47.838288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.879885 (+ 41597us) service_pool.cc:224] Handling call
0709 13:18:47.880312 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.096640 (+216328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.096682 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.097222 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.538964 (+441742us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:48.539007 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.775694 (+236687us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54004551d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:48.775833 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.504099 (+728266us) raft_consensus.cc:1685] finished
0709 13:18:49.504122 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.516518 (+ 12396us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10138,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5053,"spinlock_wait_cycles":496387840,"thread_start_us":401115,"threads_started":1,"wal-append.queue_time_us":803555}
I20260709 13:18:49.594663 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:49.574400 22349 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.610510 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 955) took 1771 ms. Trace:
I20260709 13:18:49.610158 22210 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:49.549993 22345 consensus_queue.cc:1175] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "20e06cff39b649c48d342b7431135303" responder_term: 11 status { last_received { term: 9 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: [10.11-10.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:49.612071 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:49.609774 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:49.572640 22356 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:49.618462 22211 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:49.641826 22202 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:49.648808 21225 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:49.608078 22342 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:49.618458 22350 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:49.653856 18491 raft_consensus.cc:1240] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:49.686959 18337 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:49.574231 22334 raft_consensus.cc:697] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:49.611475 22332 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.663213 22358 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.690295 22361 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:49.538970 22130 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:49.689607 22337 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.691323 22349 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.723299 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:49.696851 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:49.724655 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:49.824618 18492 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:18:49.721997 18342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37920
I20260709 13:18:49.551678 22238 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.825696 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:49.707044 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:49.547657 22352 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:18:49.731773 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:49.722325 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 758) took 1840 ms. Trace:
I20260709 13:18:49.692629 22341 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.781350 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:49.848426 18485 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:49.802359 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:49.601994 22354 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.803223 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:49.695398 22175 consensus_meta.cc:287] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.557s	user 0.005s	sys 0.005s
I20260709 13:18:49.782852 22244 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:49.803558 22361 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.780897 22342 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:49.703889 22359 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:18:49.805979 22332 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.808715 22241 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.722664 22320 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:49.708166 22264 consensus_meta.cc:287] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.910s	user 0.012s	sys 0.000s
I20260709 13:18:49.906060 22202 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.906664 22202 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.908092 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2272) took 1611 ms. Trace:
I20260709 13:18:49.908453 18344 rpcz_store.cc:276] 0709 13:18:48.296806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.296912 (+   106us) service_pool.cc:224] Handling call
0709 13:18:48.308432 (+ 11520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.403200 (+1094768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.907862 (+504662us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000ea1d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:49.908034 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2482230656}
I20260709 13:18:49.909492 22202 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:49.910060 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.910280 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:49.911067 19053 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:18:49.911841 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:49.912216 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:49.912756 19059 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:18:49.913038 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:49.913590 19062 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:49.911711 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2386) took 1950 ms. Trace:
I20260709 13:18:49.702157 22336 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.657509 19061 rpcz_store.cc:276] 0709 13:18:47.839340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.937597 (+ 98257us) service_pool.cc:224] Handling call
0709 13:18:47.982191 (+ 44594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.295468 (+313277us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:48.716194 (+420726us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.821869 (+105675us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.822213 (+   344us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:48.822284 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.610300 (+788016us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540059ea54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:49.610345 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.610450 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1204,"prepare.queue_time_us":693561,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":10299,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":11740,"spinlock_wait_cycles":719863168,"thread_start_us":470774,"threads_started":2,"wal-append.queue_time_us":352743}
I20260709 13:18:49.812292 18337 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
W20260709 13:18:49.702785 22351 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
W20260709 13:18:49.696270 22214 consensus_meta.cc:287] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.000s
I20260709 13:18:49.820600 18457 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:49.823355 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 431379us
W20260709 13:18:49.698719 22234 consensus_meta.cc:287] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.891s	user 0.002s	sys 0.009s
W20260709 13:18:49.825651 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.827678 22137 consensus_queue.cc:1059] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:49.842656 18343 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:49.730948 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:49.691531 21412 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.777881 18484 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:18:49.922602 18484 pending_rounds.cc:85] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 5
W20260709 13:18:49.922546 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 191659us
I20260709 13:18:49.923098 18484 pending_rounds.cc:107] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:18:49.923420 18484 raft_consensus.cc:2889] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:49.919386 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 98886.7us
I20260709 13:18:49.926466 18457 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:49.844707 18416 rpcz_store.cc:276] 0709 13:18:47.881692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.922018 (+ 40326us) service_pool.cc:224] Handling call
0709 13:18:47.922406 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.922781 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.922811 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.923299 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.409289 (+485990us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:48.409326 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.409392 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.715304 (+1305912us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b2400181358. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bc759c4 00007f409bc73acb 00007f409be2edc9 00007f409be2ea55 00007f409be2dfb0 00007f409eaa4488 00007f409eaa4be8 00007f409ea7c398 00007f409ea7776a 00007f409ea76bb6
0709 13:18:49.722027 (+  6723us) raft_consensus.cc:1685] finished
0709 13:18:49.722048 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.722267 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3453,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":12072192,"thread_start_us":428860,"threads_started":1,"wal-append.queue_time_us":1191322}
I20260709 13:18:49.843775 18340 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:18:49.846817 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:49.930202 18484 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:49.802709 22358 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.712809 22142 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:49.818742 22356 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:49.783505 22134 consensus_queue.cc:1059] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:18:49.863524 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:49.938834 18491 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:49.843166 22353 consensus_queue.cc:1059] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
W20260709 13:18:49.865826 22355 log.cc:927] Time spent T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:18:49.868511 22332 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.871628 22342 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:49.883327 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.883431 22130 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:49.884644 18489 raft_consensus.cc:2410] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:18:49.885747 22354 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.887451 22211 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:49.888415 22193 consensus_meta.cc:287] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.003s
I20260709 13:18:49.816088 22350 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.893273 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55634 (request call id 91) took 1655 ms. Trace:
I20260709 13:18:49.974817 18384 leader_election.cc:400] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:18:49.975178 18384 leader_election.cc:403] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:49.894881 22257 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:49.897221 22341 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:49.922293 22214 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.901968 22361 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.905068 22210 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.911643 22357 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:49.668947 22344 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.862378 18382 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:49.914204 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:49.711207 22365 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.915020 18487 rpcz_store.cc:276] 0709 13:18:47.961692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.130641 (+168949us) service_pool.cc:224] Handling call
0709 13:18:48.130938 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.131174 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:48.131555 (+   381us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.911234 (+1779679us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b180042a720. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409ea844bc 00007f409bdd248b 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c23a
0709 13:18:49.911408 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.911450 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:49.911489 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.911562 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.911661 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":168,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"spinlock_wait_cycles":114697088,"thread_start_us":697328,"threads_started":1,"wal-append.queue_time_us":684067}
I20260709 13:18:49.919341 18308 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:49.920755 21225 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.009549 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 209053us
I20260709 13:18:49.932940 18342 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:18:49.939424 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.952026 18492 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:49.856514 22175 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.954684 18493 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:18:49.860414 22244 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.922123 22349 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:49.938472 22346 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.891602 22334 consensus_queue.cc:237] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:49.934262 22336 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:49.947227 22142 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:49.934000 22360 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:49.938339 21965 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.975008 18490 rpcz_store.cc:276] 0709 13:18:48.237501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.301404 (+ 63903us) service_pool.cc:224] Handling call
0709 13:18:49.892878 (+1591474us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b5400354dd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee2735 00007f409eeda9fa 00007f40a3ea24c9 00007f409d41ec54 00007f409d41ebe2 00007f409d41eb11 00007f409d41ea8c 00007f409d41dd42 00007f409d21748c 00007f409d2168c6
0709 13:18:49.893154 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250918144}
I20260709 13:18:49.899814 22241 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.984884 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2140) took 1179 ms. Trace:
I20260709 13:18:49.965049 22362 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:50.028322 22175 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:50.028192 22362 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:50.028913 22175 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:50.029390 22175 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.030400 22362 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:49.989815 22199 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:50.031032 22199 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.031585 22175 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:50.032071 22175 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.032454 22175 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.033262 22199 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:49.988309 22341 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.034483 22175 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:50.035382 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.035614 22341 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:49.990553 22371 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:50.035966 19060 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:18:49.990585 18416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:18:49.992769 22358 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.996567 22123 consensus_queue.cc:260] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.037161 18416 raft_consensus.cc:606] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:50.037638 22123 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.017711 22356 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.039268 22104 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:50.040294 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2269) took 1779 ms. Trace:
I20260709 13:18:50.040645 18341 rpcz_store.cc:276] 0709 13:18:48.261253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.261372 (+   119us) service_pool.cc:224] Handling call
0709 13:18:48.270290 (+  8918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.833763 (+563473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.040083 (+1206320us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b540018bad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:50.040238 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142732032}
I20260709 13:18:50.025486 21412 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:50.042032 21412 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.042390 21412 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:50.043479 22152 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.012s	sys 0.004s
I20260709 13:18:50.002235 22350 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:49.969933 22343 consensus_queue.cc:1059] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:18:49.983522 22193 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.009279 21225 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:49.931792 18457 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:50.010130 18342 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:50.012068 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 92843.7us
W20260709 13:18:50.011134 22304 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.008s	sys 0.016s
I20260709 13:18:50.015187 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.010655 22357 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:50.062173 18226 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b345033a56994fff90990b7d03324074 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d6cd7c600ec4ab2b5cac479f05d4c0f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:50.062531 18343 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:50.016523 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.017938 22137 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:18:50.063629 18337 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:50.020401 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:50.021346 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 159052us
I20260709 13:18:50.065361 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.023504 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.020833 22336 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.010107 22130 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.026472 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.070240 19054 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:50.025360 18411 rpcz_store.cc:276] 0709 13:18:48.804969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.805082 (+   113us) service_pool.cc:224] Handling call
0709 13:18:48.805436 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.809461 (+  4025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.809490 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.817708 (+  8218us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.415645 (+597937us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:49.415685 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.415751 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.984579 (+568828us) raft_consensus.cc:1685] finished
0709 13:18:49.984606 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.984807 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23657,"raft.queue_time_us":12909,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":8958,"thread_start_us":478783,"threads_started":1,"wal-append.queue_time_us":616541}
I20260709 13:18:50.071167 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 768) took 1716 ms. Trace:
I20260709 13:18:50.071568 18412 rpcz_store.cc:276] 0709 13:18:48.354656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.354785 (+   129us) service_pool.cc:224] Handling call
0709 13:18:48.355017 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.474086 (+1119069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.070881 (+596795us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000a82d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:50.071087 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2561311616}
I20260709 13:18:50.075579 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.075778 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.076192 18490 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:50.027129 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:50.027534 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.077162 18338 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.077374 18344 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:50.030016 21965 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:49.988950 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.046229 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:50.043845 22152 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.012s	sys 0.004s
I20260709 13:18:50.012912 22264 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:50.016438 22361 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.058926 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 127239us
I20260709 13:18:50.122514 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.122593 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.122874 18457 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:50.059262 18308 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:50.069033 22328 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.004s	sys 0.004s
I20260709 13:18:50.019243 22211 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.028196 22375 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:50.069083 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:50.078503 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.079929 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.137228 18418 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.137537 18341 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:18:50.092178 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.106063 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.128091 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:50.142159 19053 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:50.079876 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.142693 18492 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:50.143033 19062 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:50.018169 22342 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:18:50.118640 18490 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:18:50.118543 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 72421us
I20260709 13:18:50.081179 22336 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:50.151089 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.121258 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.016016 22210 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:50.029572 22241 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:50.126982 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 67798.3us
I20260709 13:18:50.127393 21225 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:50.130098 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.123070 18309 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:50.131919 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.129315 22360 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:50.133755 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.135608 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.135936 18338 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:50.138695 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.022188 22346 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:50.069941 22175 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:18:50.144519 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 168241us
I20260709 13:18:50.068849 22104 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:50.134572 22328 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.004s	sys 0.004s
I20260709 13:18:50.014916 22365 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:50.146154 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.127082 22264 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.147817 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.197862 22244 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.198282 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:50.198817 18412 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.198938 22264 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.202752 21965 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.149389 19055 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:50.171511 22377 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:18:50.162858 22360 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.206290 22360 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:50.145455 22211 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.209569 18342 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:50.211104 22241 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.211254 22211 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.143621 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:50.212267 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.192121 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.117643 22332 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:50.133749 18486 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:50.133304 22354 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:50.222126 22354 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.222529 22354 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:50.223321 22333 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.981s	user 0.004s	sys 0.000s
I20260709 13:18:50.224750 18412 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:18:50.225181 22352 raft_consensus.cc:3055] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:50.160658 18308 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:50.225642 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.134294 22361 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.137109 22134 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.133368 22350 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:50.161130 18418 raft_consensus.cc:2410] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:50.245638 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.161588 18336 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:18:50.162382 18309 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:50.171037 22104 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.139849 22335 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.164474 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.258806 18410 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:50.164427 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.225626 22352 raft_consensus.cc:740] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:50.169335 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.150231 22353 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.153008 22234 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.062201 22304 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.009s	sys 0.016s
I20260709 13:18:50.176299 22365 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.176743 22142 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.177716 22349 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.180999 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.187443 22193 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.192598 22214 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.192955 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.284132 18484 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:50.258394 22104 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:50.195478 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.196745 22283 raft_consensus.cc:3055] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:50.125051 22130 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.151815 18413 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:50.221558 22346 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:50.226418 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 65858.8us
I20260709 13:18:50.226478 18412 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:50.285585 22283 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:50.137703 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.292058 22364 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:50.232010 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:50.166246 22210 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:50.293040 22210 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:50.293084 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 61162us
I20260709 13:18:50.293598 22210 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:50.233207 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:50.294811 22152 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:50.295555 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 62471.9us
I20260709 13:18:50.296362 18307 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:50.193959 22378 log.cc:927] Time spent T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:18:50.297930 22130 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.171604 22175 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:50.298627 22384 consensus_queue.cc:1059] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:18:50.299701 22175 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.301056 22175 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.150315 22132 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.302199 22132 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.288005 21792 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.303391 21792 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.304603 22132 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.304889 18419 raft_consensus.cc:2410] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:50.170943 22328 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:50.260499 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.306301 18418 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:50.306429 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.264654 22335 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.307111 18413 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:50.307510 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.308162 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:50.308669 22335 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.308921 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.309353 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:50.259795 18338 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:50.310722 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 760) took 2386 ms. Trace:
I20260709 13:18:50.311832 22365 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:50.312862 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:50.260033 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 97714.4us
W20260709 13:18:50.260761 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 43900.1us
I20260709 13:18:50.274837 18410 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:50.275576 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:50.235050 22218 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:50.245632 22211 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.193948 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.290934 22283 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.274852 22377 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:50.223327 21412 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:50.370975 22223 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:50.371511 21412 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:50.371640 22223 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.265640 18415 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:18:50.309798 18418 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:50.372169 22223 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.372869 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.374366 22283 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.374634 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.375846 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.376421 18490 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:50.376811 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.377236 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:50.377514 18492 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:50.335983 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.379132 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:50.379804 18412 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:50.382331 18487 raft_consensus.cc:2393] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:50.381901 22357 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.372790 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.387864 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:50.390452 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2098) took 1012 ms. Trace:
I20260709 13:18:50.336580 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:50.339145 22343 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.339879 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:50.342597 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.258206 22134 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.232628 22332 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.292618 22364 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.344969 22384 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:18:50.346131 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 70632.2us
W20260709 13:18:50.411144 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 74644.5us
I20260709 13:18:50.411904 18458 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:50.312343 22365 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.346789 22383 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.348999 22245 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:50.339852 22152 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:50.349821 18339 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:50.351130 22361 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.334635 22328 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.353199 22142 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.283509 22349 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.334915 22214 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:50.280046 22234 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:50.337527 22193 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.311117 18414 rpcz_store.cc:276] 0709 13:18:47.924429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.924582 (+   153us) service_pool.cc:224] Handling call
0709 13:18:47.924907 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.936289 (+ 11382us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:47.954679 (+ 18390us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.792139 (+837460us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.234754 (+1442615us) spinlock_profiling.cc:243] Waited 9.82 ms on lock 0x7b2c001026c8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:18:50.245938 (+ 11184us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.246119 (+   181us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:50.246154 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.246220 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.310390 (+ 64170us) raft_consensus.cc:1685] finished
0709 13:18:50.310510 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.310646 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18240,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":6325,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"spinlock_wait_cycles":22630528,"thread_start_us":837064,"threads_started":1,"wal-append.queue_time_us":849713}
I20260709 13:18:50.360283 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.363983 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.364878 18382 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:50.450865 18410 raft_consensus.cc:2368] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9.
I20260709 13:18:50.451980 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.369443 22377 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.337428 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.373775 18418 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
W20260709 13:18:50.453399 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 88602.1us
I20260709 13:18:50.454099 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.454703 18418 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:50.392204 18492 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:50.456348 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.278600 22353 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.390892 18486 rpcz_store.cc:276] 0709 13:18:49.377968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.378135 (+   167us) service_pool.cc:224] Handling call
0709 13:18:49.402979 (+ 24844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.226138 (+823159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.390237 (+164099us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54003543d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:50.390393 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680228224}
W20260709 13:18:50.398691 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.454764 18382 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:50.398716 18338 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:50.483443 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.399572 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.484781 18344 raft_consensus.cc:2410] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:18:50.401480 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 61687.5us
I20260709 13:18:50.403929 18343 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:50.400334 22199 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:50.405025 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.487010 18336 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:18:50.488106 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.405943 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.407115 22134 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.398519 18309 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:50.489758 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 91306us
I20260709 13:18:50.422679 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:50.409049 22332 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.431838 18384 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:50.522194 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 90473.9us
I20260709 13:18:50.445905 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:50.523505 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.524341 22339 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:50.440732 22321 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:50.367825 22211 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.421767 22343 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.409533 22384 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:50.460089 22223 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:50.421655 22365 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.553452 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:50.460399 22352 consensus_queue.cc:260] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:50.461793 22342 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:50.462158 22349 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.463860 22234 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:50.464967 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.464793 22193 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.437228 22383 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.468168 18342 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:50.468922 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.561151 18336 raft_consensus.cc:2410] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:18:50.470086 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.470682 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.563356 18492 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:50.472352 22393 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:50.474329 22377 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:50.478366 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.479279 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.392117 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:50.485900 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:50.493659 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.564833 18343 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.493810 18412 raft_consensus.cc:2368] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9.
I20260709 13:18:50.551999 21965 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:50.486100 18307 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:50.552012 22255 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:50.514536 19027 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.747s (SENT) [suppressed 12 similar messages]
W20260709 13:18:50.576877 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 62372us
W20260709 13:18:50.577507 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.437037 22357 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:50.555539 22321 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:50.516979 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.587425 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.588151 19057 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:50.587949 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.520953 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.589469 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.590044 18414 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:50.590830 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.591882 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.492897 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:50.592744 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 99965.3us
W20260709 13:18:50.544487 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 99174.4us
I20260709 13:18:50.594265 18309 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:50.595419 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.595836 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.596233 18457 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:50.596513 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:50.601478 22399 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:18:50.542042 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.545800 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.625670 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.597635 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.627031 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.528162 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:50.537820 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.627918 19053 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:50.628324 19055 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:50.549543 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.628998 18486 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:50.551065 21225 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:50.526990 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.630149 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.630658 18489 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:50.631016 19060 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:50.509845 22346 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:50.557778 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.486634 22199 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.552685 19026 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:18:50.644147 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 91526.2us
I20260709 13:18:50.559302 18340 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:50.646008 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:50.561620 18484 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:50.529083 22214 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:50.569108 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 177078us
I20260709 13:18:50.486208 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.650214 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.651086 18484 raft_consensus.cc:2410] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:50.651002 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.651678 18488 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 5.
I20260709 13:18:50.653237 18382 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:50.583904 22332 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:50.572693 18343 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
W20260709 13:18:50.574550 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 88538.5us
I20260709 13:18:50.669763 18307 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:50.670501 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:50.671430 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.671663 18340 raft_consensus.cc:2410] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:50.430294 22265 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.554265 22362 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.581694 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.528028 21939 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:18:50.516287 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:50.676502 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.582212 22104 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:50.586906 22255 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:50.602751 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.715495 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:50.603798 22348 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:50.604107 22193 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.604590 22137 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.606499 22343 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:50.607378 22354 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:50.608785 22384 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.611196 22383 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:50.610934 22336 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.817788 22211 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.817606 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:50.613006 22344 consensus_meta.cc:287] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.000s
I20260709 13:18:50.618527 22357 raft_consensus.cc:697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:50.842046 22357 consensus_queue.cc:237] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:50.838178 22382 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:18:50.843888 22382 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:50.844359 22382 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:50.559062 22342 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:50.596545 19061 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:50.430162 22356 consensus_queue.cc:1059] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:18:50.554106 18335 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.526047 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:50.633533 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.635038 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.635511 21225 consensus_queue.cc:1243] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:50.636061 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:50.637678 18490 raft_consensus.cc:2410] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:50.639796 18384 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:50.640890 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.870020 19055 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:50.627432 19059 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:50.573863 22223 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:50.670696 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.873667 18488 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:50.575204 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.874396 19055 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:50.679513 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:50.875293 18484 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.650517 22199 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:50.634488 22346 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:50.659024 22138 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:50.657872 22234 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:50.652221 22214 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.658764 22175 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:50.664618 21971 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:50.602427 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.625957 22360 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.711823 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.668919 22274 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:50.519702 18458 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:50.724103 19062 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
W20260709 13:18:50.772482 22402 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:18:50.773452 22398 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:50.773897 22354 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:50.774652 18493 raft_consensus.cc:2368] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9.
I20260709 13:18:50.779383 22104 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:50.728508 22137 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:50.781615 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:50.782927 22400 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:50.783886 22364 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.709481 22362 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.795260 22353 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.797453 21965 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:50.715019 22218 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:50.802850 18491 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:50.728502 18486 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:50.731873 18338 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:50.763885 18343 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:18:50.937770 18335 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:50.622313 22321 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:50.844404 22283 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.623631 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.815086 21792 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.852131 22384 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:50.817876 22255 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:50.859958 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 214040us
W20260709 13:18:50.823287 22210 consensus_meta.cc:287] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 13:18:50.840796 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.866828 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.869042 18414 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
W20260709 13:18:50.872148 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 232454us
W20260709 13:18:50.882622 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 234528us
I20260709 13:18:50.882615 18382 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:50.957100 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 74603.1us
W20260709 13:18:50.958748 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.840772 22336 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:50.886595 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:50.959791 18415 raft_consensus.cc:3055] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:50.960233 18415 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:50.720616 22265 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:50.896406 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.905570 19061 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:50.870067 22342 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:50.906832 19056 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
W20260709 13:18:50.909253 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 389641us
I20260709 13:18:50.911756 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.985287 18340 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:18:50.985600 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:50.961146 18415 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:50.986793 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:50.886658 22346 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:50.940912 21965 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:50.925631 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.991396 18336 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:18:50.992254 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.992758 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.992964 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:50.927049 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.933488 18417 raft_consensus.cc:2410] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:18:50.904685 22214 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.872094 22383 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:18:50.938727 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.938771 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:50.998040 18308 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:50.939774 22138 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.940038 22362 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:51.006798 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:50.908885 21971 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:50.915634 22393 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.016945 18419 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:51.017349 18308 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:50.948205 19026 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:50.918008 22175 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:50.880415 21412 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:50.994211 18489 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:18:51.021998 18489 pending_rounds.cc:85] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 10
I20260709 13:18:51.022341 18489 pending_rounds.cc:107] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:18:51.022675 18489 raft_consensus.cc:2889] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:50.994841 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:50.993281 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.023308 18308 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:50.996485 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:51.024142 18414 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:18:50.998436 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:51.024791 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:51.001840 19027 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:51.003350 22364 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:51.028263 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.030375 19062 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:51.031486 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:50.993359 18486 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
W20260709 13:18:51.005477 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.033011 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.005877 18338 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:51.008249 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:51.033003 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.043085 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.043949 18343 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:51.044409 18336 raft_consensus.cc:2410] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:50.875643 22365 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.046856 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:51.006542 22138 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.007411 22255 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:51.047298 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:50.947913 22283 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.020352 21225 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:51.051075 21225 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:51.051467 21225 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.723138 22332 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.054263 22353 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:51.054970 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:50.988093 22274 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.055533 18488 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:51.055697 22274 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:51.056728 18488 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:51.018932 22104 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:51.057974 22152 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:51.033812 22211 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:51.062943 18484 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:51.063570 22175 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.030423 22218 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:51.076125 22265 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:51.027606 18418 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:51.078068 18341 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:18:51.079031 22365 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:51.080502 22339 raft_consensus.cc:993] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:18:51.050343 22361 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:51.086356 22361 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:51.086740 22361 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.029439 22364 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.090335 22364 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.094615 18488 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:51.033977 22358 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:51.050559 22382 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.008484 19025 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:51.045590 18308 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:51.106822 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 98410.2us
W20260709 13:18:51.107084 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 61548.5us
I20260709 13:18:51.108223 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:51.108893 18308 leader_election.cc:400] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9.
I20260709 13:18:51.109210 18308 leader_election.cc:403] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:51.109288 19025 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:50.997699 22336 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:51.110337 18416 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:51.026163 22377 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.049384 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:51.049575 19055 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:18:51.014256 22238 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.052352 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:51.052971 18343 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:51.049108 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:51.053535 22134 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:51.054150 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:51.054769 22332 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:51.028275 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:51.019724 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 71637.1us
I20260709 13:18:50.987692 22210 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.143324 22134 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:51.143924 18339 raft_consensus.cc:2368] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12.
I20260709 13:18:51.143942 22134 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.140417 19061 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:51.018815 21971 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.139816 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:51.141265 18489 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.152387 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:51.152604 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:51.028643 22354 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.111807 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.142706 19026 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:51.144831 22210 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:51.022063 22393 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:51.112468 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:51.147745 19053 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:51.033950 22343 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:51.196412 18492 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:51.018739 22223 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 13:18:51.050364 22255 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.200028 18342 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:51.204725 18344 raft_consensus.cc:2368] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7.
I20260709 13:18:51.013952 22406 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 13:18:51.141059 22336 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.148097 22407 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:51.139353 22349 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.214185 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.246665 18335 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:51.207008 18343 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:51.148869 22396 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.251125 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:51.252285 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:51.253836 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:51.254504 18335 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:51.162379 22365 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9.
I20260709 13:18:51.195752 22337 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:18:51.195279 22393 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.263036 22377 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:51.263746 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:51.265468 18490 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.200165 22354 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.268275 22377 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:51.268947 22377 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:51.196740 22238 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.271430 22377 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:51.245270 22343 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:51.274377 22343 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.274809 22343 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:51.275008 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.276154 18339 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:51.273511 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:51.209482 22255 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.264375 22396 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:51.279304 22396 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.279958 22223 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.286672 22223 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.287145 22223 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.287693 22283 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:51.288631 22382 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.281541 22407 raft_consensus.cc:697] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:51.283856 22344 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:51.289819 22344 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:51.195014 22218 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.291163 22218 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:51.291574 22218 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.292346 22344 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:51.285738 22332 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:51.293113 22350 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:51.302397 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:51.305450 18382 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:51.294262 22407 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.308606 22257 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:18:51.322104 22362 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:18:51.323114 22304 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:51.333294 18484 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:51.334329 22142 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:51.329763 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:51.346020 18488 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:51.213346 22336 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.247135 22339 raft_consensus.cc:1081] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:18:51.207634 22210 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:51.306401 22238 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:51.351919 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 317877us
I20260709 13:18:51.354539 22283 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.355283 22283 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.360249 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:51.374022 18490 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:51.375607 18335 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:18:51.378230 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:51.381778 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:51.382254 21225 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.387286 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.392369 18344 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:18:51.351583 22210 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.396054 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:51.396427 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:51.395798 22238 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:51.304781 22349 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:51.407166 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.359100 22304 raft_consensus.cc:697] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:51.376153 22137 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:51.409142 22334 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:51.412515 22238 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:51.417109 22346 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:51.417409 22304 consensus_queue.cc:237] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:51.417603 22238 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.419297 22346 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:51.390475 22357 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:51.420071 22357 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:51.421273 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:51.421008 22357 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.382661 22360 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:51.417644 21965 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.424401 21965 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:51.427166 22218 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.430932 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2106) took 1240 ms. Trace:
I20260709 13:18:51.431321 18491 rpcz_store.cc:276] 0709 13:18:50.190641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.194442 (+  3801us) service_pool.cc:224] Handling call
0709 13:18:50.194761 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.937107 (+742346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.430690 (+493583us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b5400135454. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:51.430873 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1227762048}
I20260709 13:18:51.386317 22245 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:51.440322 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 2104) took 1250 ms. Trace:
I20260709 13:18:51.440709 18493 rpcz_store.cc:276] 0709 13:18:50.190022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.195210 (+  5188us) service_pool.cc:224] Handling call
0709 13:18:51.437482 (+1242272us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400121e54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:51.440262 (+  2780us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126591744}
I20260709 13:18:51.421868 18484 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
W20260709 13:18:51.438947 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.438978 21225 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:51.443872 18417 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 765) took 3089 ms (client timeout 2229 ms). Trace:
I20260709 13:18:51.442178 21939 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:51.450323 22283 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:51.445113 18417 rpcz_store.cc:269] 0709 13:18:48.349797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.349956 (+   159us) service_pool.cc:224] Handling call
0709 13:18:51.439463 (+3089507us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b54000a7dd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:51.439562 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5938612992}
I20260709 13:18:51.405371 22210 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:51.462699 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 350272us
I20260709 13:18:51.464018 18308 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:51.470716 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:51.471386 18417 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:51.475055 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:51.475955 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.476167 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:51.477270 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:51.476408 18308 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:51.483134 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:51.484885 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 342236us
I20260709 13:18:51.486321 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2290) took 1023 ms. Trace:
I20260709 13:18:51.486220 21225 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:51.488655 19026 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:18:51.498019 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.503393 18344 raft_consensus.cc:2368] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7.
I20260709 13:18:51.521425 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:51.523658 18416 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:18:51.524369 18308 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:51.451372 22354 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:51.486860 18342 rpcz_store.cc:276] 0709 13:18:50.463112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.602193 (+139081us) service_pool.cc:224] Handling call
0709 13:18:51.486153 (+883960us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54002d0ad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:51.486257 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675147648}
I20260709 13:18:51.534032 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.540535 21225 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.534403 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.541023 21225 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.541522 18344 raft_consensus.cc:2410] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:18:51.505848 19026 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:51.453729 22104 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:51.468336 22193 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:51.504487 22332 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.452059 22342 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:51.566516 18384 leader_election.cc:400] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12.
I20260709 13:18:51.567028 18384 leader_election.cc:403] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:51.578008 21965 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:51.544343 22344 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:51.559089 22199 consensus_meta.cc:287] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.000s
I20260709 13:18:51.598840 18342 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:51.600404 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.601143 18342 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:51.454982 21939 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:51.586589 22274 consensus_meta.cc:287] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.000s
I20260709 13:18:51.654043 22274 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.655898 22245 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:51.557893 22193 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.657310 22193 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:51.608687 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.660293 18342 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:51.570652 22332 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.662271 22332 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.617022 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.334893 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:51.618656 22418 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:51.610857 18410 raft_consensus.cc:2393] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:51.618430 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:51.676790 18491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:18:51.677482 18491 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:51.677938 18491 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.678695 22342 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:51.679587 22348 consensus_meta.cc:287] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.954s	user 0.010s	sys 0.001s
I20260709 13:18:51.680176 22348 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:51.611630 22421 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:51.680985 18341 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:51.622995 22419 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:51.627487 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:51.682829 18344 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:51.628227 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 972) took 1049 ms. Trace:
I20260709 13:18:51.684430 19056 rpcz_store.cc:276] 0709 13:18:50.578885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.581501 (+  2616us) service_pool.cc:224] Handling call
0709 13:18:51.628061 (+1046560us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54005582d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:51.628173 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537411456}
W20260709 13:18:51.628754 22416 log.cc:927] Time spent T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:18:51.629730 18411 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:51.686692 22311 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.630195 22349 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:51.687443 22311 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.638136 22339 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:51.638777 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:51.688906 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 50228.3us
I20260709 13:18:51.615907 22387 raft_consensus.cc:3055] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:51.689477 22387 raft_consensus.cc:740] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:51.643551 19060 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:51.690299 19060 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:51.690891 22387 consensus_queue.cc:260] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:51.691188 19060 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.692342 22387 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.692735 19060 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.642403 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 2037) took 1514 ms. Trace:
I20260709 13:18:51.640548 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 2410) took 1091 ms. Trace:
I20260709 13:18:51.651127 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:51.694854 18484 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
W20260709 13:18:51.622056 22414 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:18:51.694096 18337 rpcz_store.cc:276] 0709 13:18:50.127997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.128134 (+   137us) service_pool.cc:224] Handling call
0709 13:18:50.128411 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.844000 (+715589us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:50.844031 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:50.844081 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:50.844112 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.642121 (+798009us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400417dd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:51.642180 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.642338 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1336,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":1644942080}
I20260709 13:18:51.697795 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.698508 18337 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:51.699468 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:51.687713 22420 consensus_queue.cc:1059] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:51.637696 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:51.720964 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 83383.8us
I20260709 13:18:51.721150 18382 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:51.689558 22349 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.647110 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:51.694448 18492 rpcz_store.cc:276] 0709 13:18:50.549692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.574995 (+ 25303us) service_pool.cc:224] Handling call
0709 13:18:51.640354 (+1065359us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54003534d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:51.640479 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739165568}
I20260709 13:18:51.653074 22352 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.661593 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:51.728909 18342 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:51.721889 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:51.729990 18384 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:51.702709 18415 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.735055 18416 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:18:51.735229 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:51.736397 18308 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:51.737807 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:51.742357 18342 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:51.745231 18382 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:51.703554 18336 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.006s	sys 0.017s
W20260709 13:18:51.746403 18336 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.006s	sys 0.017s
I20260709 13:18:51.750042 19060 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:18:51.751513 19060 pending_rounds.cc:85] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 8
I20260709 13:18:51.560444 21225 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:51.701386 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:51.753125 18491 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:51.707842 18489 consensus_meta.cc:287] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.000s
I20260709 13:18:51.755388 18489 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:51.759354 18491 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:51.761194 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:51.756028 21225 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:51.757189 22348 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:51.728204 22349 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.767127 22349 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.727949 22344 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:51.768184 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.772323 18337 raft_consensus.cc:1240] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:51.770933 19025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.008s	sys 0.032s
I20260709 13:18:51.511885 22407 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:18:51.773051 19025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.008s	sys 0.032s
W20260709 13:18:51.786475 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 677211us
W20260709 13:18:51.781324 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 46191.1us
I20260709 13:18:51.728912 22339 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:51.733099 22342 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:51.743762 21792 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:51.797868 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:51.769798 21225 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:51.603528 22138 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.793052 19060 pending_rounds.cc:107] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:18:51.806130 19060 raft_consensus.cc:2889] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:51.806617 19025 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:51.807152 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 980) took 1226 ms. Trace:
I20260709 13:18:51.796523 18344 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:18:51.753667 22410 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.607550 22199 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:51.805382 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.793385 18415 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:51.808063 18342 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:18:51.807718 19025 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:51.810477 19060 rpcz_store.cc:276] 0709 13:18:50.580939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.631954 (+ 51015us) service_pool.cc:224] Handling call
0709 13:18:50.632328 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.643437 (+1011109us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400484a20. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee53dc0 00007f409eede1c0 00007f409eedf231 00007f409eedbd8f 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c
0709 13:18:51.806855 (+163418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.807097 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545054976}
I20260709 13:18:51.803632 21792 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.828677 21792 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:51.831907 22413 log.cc:927] Time spent T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.557s	user 0.004s	sys 0.000s
W20260709 13:18:51.833304 21412 consensus_meta.cc:287] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.806s	user 0.006s	sys 0.002s
I20260709 13:18:51.833721 21412 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:51.836560 18417 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:51.827314 18308 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:51.842204 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.824667 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:51.838730 18307 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:51.746901 22362 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12.
I20260709 13:18:51.717795 22104 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:51.786396 22407 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:51.770448 22348 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:51.791441 22265 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:51.849516 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:51.791656 22245 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.798934 22342 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.851189 18338 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:18:51.806213 22396 consensus_meta.cc:287] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.001s
I20260709 13:18:51.758651 22244 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 13:18:51.844337 22202 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:18:51.849618 22214 consensus_meta.cc:287] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.832s	user 0.005s	sys 0.005s
W20260709 13:18:51.857908 18226 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b345033a56994fff90990b7d03324074 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d6cd7c600ec4ab2b5cac479f05d4c0f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:51.823541 22410 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.862926 19058 raft_consensus.cc:2393] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 13: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:51.866345 18384 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:51.868551 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 321823us
I20260709 13:18:51.792977 22344 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:51.861032 22407 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:51.858099 22420 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:51.886157 18384 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:51.863463 22218 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:51.917759 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:51.874038 22342 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:51.863281 22265 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:51.866017 22142 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:51.871431 22245 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.879151 22365 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:52.034260 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 132010us
I20260709 13:18:52.047466 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:51.886924 22410 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.048192 18416 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:52.051326 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:51.981751 21412 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:52.033680 22142 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.060343 18415 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:18:51.988440 22383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.017s	sys 0.012s
W20260709 13:18:52.035221 22361 consensus_meta.cc:287] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.948s	user 0.011s	sys 0.000s
I20260709 13:18:52.061780 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:51.976133 22364 consensus_meta.cc:287] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.885s	user 0.011s	sys 0.000s
I20260709 13:18:51.912578 22422 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:52.042579 22255 consensus_meta.cc:287] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.000s
W20260709 13:18:52.039845 22384 consensus_meta.cc:287] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.057s	user 0.006s	sys 0.004s
I20260709 13:18:51.929342 22417 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:52.033370 22265 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:52.146441 22429 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:18:52.043977 22223 consensus_meta.cc:287] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.756s	user 0.006s	sys 0.006s
I20260709 13:18:52.037644 22337 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:52.076490 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 268823us
W20260709 13:18:52.078209 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 441592us
I20260709 13:18:52.150223 22223 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.151253 19027 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:51.883615 22214 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.152256 22223 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:52.152523 22199 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:52.153373 22343 consensus_meta.cc:287] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.878s	user 0.005s	sys 0.014s
I20260709 13:18:52.036312 22311 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:51.894521 22358 consensus_queue.cc:1059] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.171s
I20260709 13:18:52.060655 22104 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:52.043551 22218 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.154484 22218 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:52.156433 22218 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:52.156590 22336 consensus_meta.cc:287] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.808s	user 0.005s	sys 0.002s
I20260709 13:18:52.061287 22428 raft_consensus.cc:3055] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:52.157027 22428 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:52.157891 22428 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.158641 22244 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.159088 22244 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:52.160996 22244 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:52.161665 22393 consensus_meta.cc:287] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.894s	user 0.008s	sys 0.000s
I20260709 13:18:52.070801 22142 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:52.132431 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 1.51396e+06us
I20260709 13:18:51.876542 22396 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.132942 18411 raft_consensus.cc:1217] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Deduplicated request from leader. Original: 6.7->[8.8-9.9]   Dedup: 8.8->[9.9-9.9]
I20260709 13:18:52.035871 22328 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:52.153297 22214 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:52.044224 22245 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.130913 18341 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:18:52.158315 22343 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:52.164943 22382 consensus_meta.cc:287] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.876s	user 0.005s	sys 0.002s
I20260709 13:18:52.118448 22361 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:52.166251 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 296907us
I20260709 13:18:52.264884 18307 leader_election.cc:400] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9.
W20260709 13:18:52.073959 22383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.017s	sys 0.012s
I20260709 13:18:52.168864 18309 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:52.135310 21971 consensus_meta.cc:287] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.939s	user 0.008s	sys 0.004s
I20260709 13:18:52.152367 18340 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:52.167243 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2292) took 1703 ms. Trace:
I20260709 13:18:52.119091 22364 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:52.212834 18457 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:52.278096 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 65351.1us
I20260709 13:18:52.279058 18457 leader_election.cc:400] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9.
I20260709 13:18:52.279394 18457 leader_election.cc:403] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:18:52.280463 18457 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:52.213801 18411 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 13:18:52.282131 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:52.215544 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 64351.2us
I20260709 13:18:52.283615 19027 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:52.271299 18336 rpcz_store.cc:276] 0709 13:18:50.463657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.094581 (+630924us) service_pool.cc:224] Handling call
0709 13:18:51.097823 (+  3242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.099477 (+  1654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.099615 (+   138us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:51.104358 (+  4743us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.747810 (+643452us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:51.747866 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.747957 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.166938 (+418981us) raft_consensus.cc:1685] finished
0709 13:18:52.166957 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.167087 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":556001,"threads_started":1,"wal-append.queue_time_us":808410}
W20260709 13:18:52.170157 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.271392 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 102598us
W20260709 13:18:52.169773 22134 consensus_meta.cc:287] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.953s	user 0.002s	sys 0.006s
W20260709 13:18:52.212153 19028 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.012s	sys 0.021s
W20260709 13:18:52.295396 19028 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.012s	sys 0.021s
I20260709 13:18:52.159111 22428 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:52.136615 22422 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:52.276408 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2289) took 1813 ms. Trace:
I20260709 13:18:52.307747 18343 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.308931 19059 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:52.287704 18410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2151) took 1864 ms (client timeout 2004 ms). Trace:
I20260709 13:18:52.288122 18414 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:52.287762 18309 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:52.214358 21965 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.265883 18307 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:52.296437 18457 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:52.184732 22337 raft_consensus.cc:697] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:52.298864 19060 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:52.299371 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 991) took 1257 ms. Trace:
W20260709 13:18:52.299749 18340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 2044) took 1559 ms (client timeout 1832 ms). Trace:
I20260709 13:18:52.301191 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:52.318485 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:52.318873 19062 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:18:52.313522 18309 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:52.261194 22433 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:52.314308 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 48527.6us
W20260709 13:18:52.310312 18410 rpcz_store.cc:269] 0709 13:18:50.423611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.485892 (+ 62281us) service_pool.cc:224] Handling call
0709 13:18:52.287453 (+1801561us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b540025c6d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:52.287633 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2202508544}
I20260709 13:18:52.307478 18338 rpcz_store.cc:276] 0709 13:18:50.462825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.051135 (+588310us) service_pool.cc:224] Handling call
0709 13:18:51.051455 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.872460 (+821005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.276127 (+403667us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b540007f654. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:52.276339 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1838668672}
I20260709 13:18:52.302111 18231 maintenance_manager.cc:419] P ea3145ed28eb426e9222df0873a0b8d5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033397
I20260709 13:18:52.138115 22255 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.264031 22199 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:52.273501 22328 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:52.317649 19058 rpcz_store.cc:276] 0709 13:18:51.027903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.028028 (+   125us) service_pool.cc:224] Handling call
0709 13:18:52.285580 (+1257552us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b5400750154. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:52.285704 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1648411008}
I20260709 13:18:52.323330 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:52.318120 18340 rpcz_store.cc:269] 0709 13:18:50.726651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.992657 (+266006us) service_pool.cc:224] Handling call
0709 13:18:52.285954 (+1293297us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400235ad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:52.286074 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664179584}
I20260709 13:18:52.337858 18309 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:52.336294 18412 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:52.339488 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:52.325765 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:52.295956 22421 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:52.253616 22336 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.273113 22365 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:52.297552 22152 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:52.294458 22104 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9.
I20260709 13:18:52.302122 22234 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.345211 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:52.316741 22214 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:52.299656 22244 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:52.317282 21965 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:52.349421 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 65897.9us
W20260709 13:18:52.350020 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.349973 21225 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:52.350342 19055 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:52.346911 22420 raft_consensus.cc:697] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:52.347031 22442 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:52.358381 22383 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.368867 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:52.339258 22358 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:52.290628 21971 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.371295 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:52.338382 22433 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.135672 22348 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.296749 22138 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:52.224452 22393 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.307019 22134 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.386111 19053 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:52.407068 19062 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:52.408259 18343 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:52.410343 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:52.466025 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:52.466809 18417 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:52.467914 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:52.469256 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:52.306555 22357 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:52.382467 22430 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
W20260709 13:18:52.419642 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 81863.8us
I20260709 13:18:52.420305 18336 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:18:52.420679 18410 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.418810 19027 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:52.481896 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 63147.6us
I20260709 13:18:52.482412 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:52.482658 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:52.482923 19027 leader_election.cc:400] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7.
I20260709 13:18:52.483160 18344 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.484122 19027 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:52.429118 18487 raft_consensus.cc:2368] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9.
I20260709 13:18:52.409555 22234 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:52.429899 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 133569us
I20260709 13:18:52.493506 18457 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:52.383127 22396 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:52.411615 22442 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.410822 22199 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.406661 22214 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.415040 22244 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.458550 18419 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:52.459208 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 118067us
I20260709 13:18:52.408404 22344 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:52.428627 22152 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:52.472898 22435 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 13:18:52.473347 22427 log.cc:927] Time spent T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
W20260709 13:18:52.473790 22423 log.cc:927] Time spent T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.479s	user 0.001s	sys 0.000s
I20260709 13:18:52.487736 19027 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:52.533241 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 45593.6us
I20260709 13:18:52.492102 19057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 981) took 1911 ms. Trace:
I20260709 13:18:52.493537 21225 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:52.494558 18344 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:52.496026 18340 pending_rounds.cc:85] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 6
I20260709 13:18:52.535542 18340 pending_rounds.cc:107] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:52.535929 18340 raft_consensus.cc:2889] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:52.497610 18338 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:52.498204 18486 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:52.499454 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 157655us
I20260709 13:18:52.418202 22337 consensus_queue.cc:237] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:52.430127 22433 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.406518 22421 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:52.516768 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 108353us
I20260709 13:18:52.517220 18309 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:52.428544 22382 consensus_queue.cc:1059] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:18:52.471230 22223 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:52.523012 18410 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:52.421110 22383 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.498708 22311 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:52.535342 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:52.630829 18344 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 4.
I20260709 13:18:52.539669 18338 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:18:52.540057 18308 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:52.632201 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 92211.5us
I20260709 13:18:52.503093 18457 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:52.540283 22441 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 13:18:52.541124 22438 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:18:52.542508 22444 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:52.542894 21792 consensus_meta.cc:287] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.001s
I20260709 13:18:52.543015 22356 consensus_queue.cc:1059] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:52.546132 22450 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.540094 22422 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:52.519399 22214 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.505844 22442 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.519301 22357 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:52.553447 18490 raft_consensus.cc:1275] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:52.653846 22364 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:52.557734 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:52.558332 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 62660.4us
I20260709 13:18:52.559661 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:52.562469 21225 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.582123 18415 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:52.576743 22421 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:52.695116 22311 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.610476 22343 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:52.610352 22334 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:52.524507 22420 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.613315 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:18:52.739882 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 128461us
I20260709 13:18:52.606770 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:52.586086 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.618201 22336 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:52.618551 22443 log.cc:927] Time spent T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 13:18:52.618748 21939 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:52.548614 22449 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:18:52.558075 22361 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:52.529815 22321 raft_consensus.cc:3055] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:52.766803 22321 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:52.767983 22321 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:52.768796 22142 consensus_meta.cc:287] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.000s
I20260709 13:18:52.769357 22321 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.580235 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:52.770040 22437 consensus_queue.cc:1059] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.212s
I20260709 13:18:52.585755 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:52.771114 22422 raft_consensus.cc:3055] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:52.771176 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:52.771348 19061 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:52.526840 22152 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.587302 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:52.519887 22358 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:18:52.772205 22152 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.772612 19053 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:52.773013 22358 raft_consensus.cc:3055] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:52.625269 18491 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:52.773463 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:52.534600 19057 rpcz_store.cc:276] 0709 13:18:50.581146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.633309 (+ 52163us) service_pool.cc:224] Handling call
0709 13:18:50.633573 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.895661 (+262088us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:51.025159 (+129498us) log.cc:844] Serialized 14 byte log entry
0709 13:18:51.383376 (+358217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:51.383425 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:51.383471 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.491807 (+1108336us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54004551d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:52.491868 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.492021 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8710,"prepare.queue_time_us":27705,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":616,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":17845,"spinlock_wait_cycles":602241408,"thread_start_us":411984,"threads_started":2,"wal-append.queue_time_us":380499}
W20260709 13:18:52.626690 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 109575us
W20260709 13:18:52.581845 22452 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:18:52.646108 22223 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:52.646618 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 143602us
I20260709 13:18:52.647470 22382 raft_consensus.cc:3055] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:52.648051 22463 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:52.649348 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:52.624364 22448 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
W20260709 13:18:52.702620 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 69076.5us
I20260709 13:18:52.630373 22211 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:52.703260 19058 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:52.774574 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:52.876402 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2436) took 1229 ms. Trace:
W20260709 13:18:52.879473 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.879505 18484 rpcz_store.cc:276] 0709 13:18:51.647085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.696002 (+ 48917us) service_pool.cc:224] Handling call
0709 13:18:51.696436 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.696895 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.696937 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:51.697536 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:18:52.134023 (+436487us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:52.134079 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.134160 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.876199 (+742039us) raft_consensus.cc:1685] finished
0709 13:18:52.876217 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.876342 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3889,"raft.queue_time_us":4026,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":11981,"thread_start_us":434884,"threads_started":1,"wal-append.queue_time_us":646231}
I20260709 13:18:52.881835 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:52.882419 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:52.630870 22365 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:52.653017 22265 consensus_meta.cc:287] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.003s
I20260709 13:18:52.633498 22244 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:52.554224 19062 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:52.851114 18417 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:52.890779 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:52.603907 22352 consensus_meta.cc:287] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.864s	user 0.009s	sys 0.000s
I20260709 13:18:52.657433 22444 raft_consensus.cc:697] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:52.913165 22342 consensus_meta.cc:287] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.874s	user 0.010s	sys 0.000s
I20260709 13:18:52.956040 22468 consensus_queue.cc:1059] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:18:52.956393 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:52.956599 22461 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 13:18:52.957068 19061 raft_consensus.cc:2368] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12.
W20260709 13:18:52.957592 22332 consensus_meta.cc:287] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.295s	user 0.005s	sys 0.005s
I20260709 13:18:52.822829 22358 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:52.958076 22332 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.734144 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:52.726197 21225 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.960505 19056 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:52.738106 22431 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.291s	user 0.001s	sys 0.001s
I20260709 13:18:52.742781 18488 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:52.714010 22238 raft_consensus.cc:3055] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:52.657981 21792 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.753038 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:52.979710 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:52.980104 18490 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:18:52.712342 22450 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.770298 22274 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:52.771693 22245 consensus_meta.cc:287] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.003s
I20260709 13:18:52.771651 22422 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:52.522174 22328 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.769270 22142 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:52.884279 18489 raft_consensus.cc:2368] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9.
W20260709 13:18:52.884656 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.995715 18489 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:52.879522 22348 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.148s
I20260709 13:18:52.823282 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:52.999150 18491 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.976027 22238 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:52.860509 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.775192 18309 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:52.901141 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:52.889832 18457 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:52.909461 19062 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:52.771944 18485 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:52.909847 18484 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.908368 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:52.869640 22387 consensus_meta.cc:287] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.177s	user 0.009s	sys 0.002s
W20260709 13:18:52.751505 22410 consensus_meta.cc:287] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
I20260709 13:18:52.879479 19057 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
W20260709 13:18:52.826562 22210 consensus_meta.cc:287] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.355s	user 0.012s	sys 0.000s
W20260709 13:18:52.870213 22349 consensus_meta.cc:287] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 1.103s	user 0.011s	sys 0.001s
W20260709 13:18:52.871604 22193 consensus_meta.cc:287] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.214s	user 0.008s	sys 0.004s
I20260709 13:18:52.958086 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:53.035373 19061 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
W20260709 13:18:53.017853 22465 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:18:52.870797 22199 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:52.969118 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.041642 21792 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:52.883670 22382 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:52.845533 22454 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:53.047601 22454 raft_consensus.cc:697] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:53.048476 22454 consensus_queue.cc:237] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:52.744503 22311 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.050668 22223 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:53.051522 22311 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:53.039882 22383 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:53.055302 22382 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.056056 18491 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:53.055948 22238 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.056589 22382 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:53.057142 22238 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:53.059805 22152 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:52.990430 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 249911us
I20260709 13:18:52.915364 22437 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:53.062168 22437 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:53.062958 22437 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.063419 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:52.750075 22357 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.234s
I20260709 13:18:52.914013 22361 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:52.754128 22364 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.234s
I20260709 13:18:52.845870 21939 consensus_queue.cc:1059] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 13:18:52.975510 22463 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.997215 18488 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:18:52.884897 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 110776us
I20260709 13:18:52.997452 21225 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:52.998373 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:52.900542 22214 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.004091 19056 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
W20260709 13:18:53.014469 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 239359us
I20260709 13:18:52.902376 22211 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.018678 18338 raft_consensus.cc:2393] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:52.956101 22342 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:53.019562 18382 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:52.913373 22265 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:53.021045 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 131296us
I20260709 13:18:53.109571 18457 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:53.017788 22365 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:52.993439 22134 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.028298 19062 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:53.029470 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2127) took 1683 ms. Trace:
I20260709 13:18:53.061901 22152 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:52.962076 18413 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:53.038589 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:53.112738 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 93229.4us
I20260709 13:18:53.113343 19053 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:18:53.113503 18382 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:53.026597 22407 consensus_meta.cc:287] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.050s	user 0.011s	sys 0.002s
I20260709 13:18:53.044620 22349 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.068086 18484 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:53.063916 22437 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:53.064508 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:53.069290 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:52.994433 22245 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.050699 22450 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.108224 18338 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:18:53.035295 22210 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.044516 22193 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.035449 22410 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.112083 18493 rpcz_store.cc:276] 0709 13:18:51.345595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.441619 (+ 96024us) service_pool.cc:224] Handling call
0709 13:18:51.441934 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.445704 (+  3770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.445732 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:51.459080 (+ 13348us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.875363 (+416283us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:51.876336 (+   973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.876404 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:53.029294 (+1152890us) raft_consensus.cc:1685] finished
0709 13:18:53.029311 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.029416 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3397,"raft.queue_time_us":3861,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":9392,"thread_start_us":415933,"threads_started":1,"wal-append.queue_time_us":677384}
I20260709 13:18:53.127874 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2158) took 2338 ms. Trace:
W20260709 13:18:53.130777 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 66340.8us
I20260709 13:18:53.147547 18411 raft_consensus.cc:2410] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:53.151528 18457 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:53.147809 18414 rpcz_store.cc:276] 0709 13:18:50.789383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.032109 (+242726us) service_pool.cc:224] Handling call
0709 13:18:52.287904 (+1255795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.311135 (+ 23231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.127627 (+816492us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540025c6d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:53.127801 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2887415680}
W20260709 13:18:53.148445 22459 log.cc:927] Time spent T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:18:53.162875 18339 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:53.116192 22346 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.118988 22339 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:53.081633 22361 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:53.126735 22356 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:53.167181 18335 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:53.149978 22134 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:53.173177 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 47508.6us
I20260709 13:18:53.146754 22472 raft_consensus.cc:2764] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:18:53.160743 22365 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.071097 22422 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.191092 18382 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:53.204879 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 53410.7us
I20260709 13:18:53.170169 22339 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:53.128340 22407 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.052851 22444 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.225032 22481 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:53.189352 22134 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:53.206255 22472 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.207305 22450 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:53.253644 18308 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:53.235073 22193 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.235905 22142 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.170935 22346 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:53.238611 19059 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:53.110948 22463 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:53.221329 22175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.968s	user 0.009s	sys 0.012s
I20260709 13:18:53.189064 22470 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:53.251838 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 798) took 1118 ms. Trace:
W20260709 13:18:53.254215 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 106096us
I20260709 13:18:53.299978 18411 rpcz_store.cc:276] 0709 13:18:52.133632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.281818 (+148186us) service_pool.cc:224] Handling call
0709 13:18:53.251533 (+969715us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b5400234e54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:53.251755 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987793792}
I20260709 13:18:53.259258 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:53.301208 18414 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:53.262264 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:53.190254 22357 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:18:53.263552 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:53.218969 22339 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:53.218194 22449 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:53.256384 22411 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.985s	user 0.017s	sys 0.000s
I20260709 13:18:53.323318 18489 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:18:53.277701 22175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.072s	user 0.009s	sys 0.013s
I20260709 13:18:53.254312 22407 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:53.255270 22134 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.283773 22342 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:53.284605 22433 consensus_meta.cc:287] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.704s	user 0.005s	sys 0.002s
I20260709 13:18:53.284824 22265 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.285825 22214 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:53.287266 22442 consensus_meta.cc:287] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.001s
I20260709 13:18:53.287822 22361 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:53.352640 22361 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:53.289191 22332 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.354197 22486 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:53.354775 22486 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.355978 22332 raft_consensus.cc:3055] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:53.356396 22332 raft_consensus.cc:740] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:53.357102 22486 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.256063 22422 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:53.289446 22210 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.290536 22484 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:53.291760 22474 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:18:53.270125 22456 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:53.296563 22434 log.cc:927] Time spent T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 1.145s	user 0.000s	sys 0.003s
I20260709 13:18:53.302373 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:53.304136 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:53.306857 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:53.208745 22365 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.312667 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:53.337664 22450 raft_consensus.cc:697] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:53.405725 19062 raft_consensus.cc:2393] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:53.318277 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:53.406316 19053 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:53.406464 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 99863.9us
I20260709 13:18:53.337823 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:53.338662 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:53.407037 18344 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:53.317943 22234 consensus_meta.cc:287] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.805s	user 0.006s	sys 0.006s
W20260709 13:18:53.349647 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.349838 22442 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:53.350553 22350 raft_consensus.cc:3055] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:53.316314 22357 consensus_queue.cc:1243] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:53.317641 22193 raft_consensus.cc:2764] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:18:53.430747 18343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 2046) took 2279 ms. Trace:
I20260709 13:18:53.431236 18343 rpcz_store.cc:276] 0709 13:18:51.151293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.250799 (+ 99506us) service_pool.cc:224] Handling call
0709 13:18:53.430473 (+2179674us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001d0e54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:53.430624 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428384512}
I20260709 13:18:53.335664 22449 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.434352 22349 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.435034 22349 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:53.435395 22349 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.435732 22349 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:53.436061 22470 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:53.436559 22470 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.438714 22450 consensus_queue.cc:237] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:53.366779 18414 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
W20260709 13:18:53.369586 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 54251.2us
I20260709 13:18:53.357187 22332 consensus_queue.cc:260] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:53.303126 22202 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:18:53.313485 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:53.319789 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.454676 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.282593 21225 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.455470 21225 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.407688 18336 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:53.357751 22486 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:53.263314 22472 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.407403 18458 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:18:53.466518 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 59203.8us
I20260709 13:18:53.408624 18338 raft_consensus.cc:2393] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:53.409648 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:53.468359 18340 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:53.409111 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:53.468601 19056 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:53.417378 22365 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.410899 22350 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:53.454262 22321 consensus_meta.cc:287] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.001s
I20260709 13:18:53.449050 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:53.430217 22480 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:18:53.359349 22433 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.499346 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:53.459017 22348 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:53.367167 22484 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.423251 19053 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:53.501395 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:53.411034 22234 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.503854 18343 raft_consensus.cc:1240] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:53.516827 18340 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:18:53.505990 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:53.464702 22463 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.508214 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:53.510362 21225 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:53.467360 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:53.470697 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:53.523398 18490 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:53.519294 18489 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:53.527248 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:53.531685 19055 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:18:53.533041 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 65782.9us
W20260709 13:18:53.534543 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 230999us
I20260709 13:18:53.535629 18307 leader_election.cc:400] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9.
I20260709 13:18:53.504956 22488 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:53.538344 18338 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:53.538196 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:53.540666 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:53.541198 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:53.509212 22321 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.545539 22470 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:53.550899 22487 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:18:53.519032 22447 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.544368 18343 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:53.539431 22193 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:18:53.471357 22486 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:53.547923 18338 raft_consensus.cc:1275] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:18:53.552511 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.538306 22463 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:53.569628 22321 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.585772 22393 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.518601 22348 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.541262 22494 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.551507 22210 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:53.600153 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 992) took 1022 ms. Trace:
I20260709 13:18:53.619028 19058 rpcz_store.cc:276] 0709 13:18:52.577544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.577669 (+   125us) service_pool.cc:224] Handling call
0709 13:18:52.577963 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.878833 (+300870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.593495 (+714662us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b5400580a54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:53.600087 (+  6592us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182395648}
I20260709 13:18:53.536870 22350 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:53.602831 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 992) took 1007 ms. Trace:
I20260709 13:18:53.620457 19061 rpcz_store.cc:276] 0709 13:18:52.595415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.036073 (+440658us) service_pool.cc:224] Handling call
0709 13:18:53.044172 (+  8099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.044503 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.044529 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.045345 (+   816us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.215910 (+170565us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:53.215973 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.216068 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:53.602616 (+386548us) raft_consensus.cc:1685] finished
0709 13:18:53.602638 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.602774 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2533,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":751360,"thread_start_us":141099,"threads_started":1,"wal-append.queue_time_us":156020}
W20260709 13:18:53.603979 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.606132 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:53.623854 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:53.624686 18414 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:18:53.607007 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1185) took 1312 ms. Trace:
I20260709 13:18:53.626112 19060 rpcz_store.cc:276] 0709 13:18:52.294491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.294610 (+   119us) service_pool.cc:224] Handling call
0709 13:18:52.294899 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.317388 (+ 22489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.586361 (+1268973us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b5400494154. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:53.606952 (+ 20591us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8549760}
I20260709 13:18:53.627540 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:53.628213 18415 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:53.607268 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:53.542860 22488 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:53.636193 18336 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:18:53.615557 18487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 2115) took 2557 ms (client timeout 2213 ms). Trace:
W20260709 13:18:53.638011 18487 rpcz_store.cc:269] 0709 13:18:51.048765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.048896 (+   131us) service_pool.cc:224] Handling call
0709 13:18:53.593892 (+2544996us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400258d54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:53.605982 (+ 12090us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2936765184}
I20260709 13:18:53.639644 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:53.630283 18418 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:18:53.630786 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.625753 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:53.645176 18487 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:53.642380 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:53.633777 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 77185.8us
I20260709 13:18:53.646631 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:53.617178 22491 log.cc:927] Time spent T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:18:53.652760 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:53.632025 19026 connection.cc:256] RPC call timeout handler was delayed by -1.0632421499999509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:18:53.649760 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:53.613893 22410 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.617961 22481 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:53.656903 19026 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:53.655949 21225 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:53.660727 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:53.667133 21225 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.580088 22447 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.666806 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:53.671658 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:53.634747 22238 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:53.643601 22488 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:53.674641 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:53.654198 22499 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.686296 19026 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:53.680022 18487 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:53.650635 22350 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:53.658784 22463 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:53.663040 22210 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:53.648013 22444 consensus_queue.cc:1175] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 9 index: 6 } }
I20260709 13:18:53.672642 22470 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:53.627869 22494 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:53.697654 18411 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:18:53.675654 22440 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:53.707433 22486 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:53.664019 22382 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:18:53.691262 22238 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.701588 21225 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:53.679481 22489 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:53.703950 22210 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:53.714450 22489 raft_consensus.cc:697] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:53.715322 22494 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:53.695042 22421 consensus_meta.cc:287] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.965s	user 0.011s	sys 0.000s
I20260709 13:18:53.715318 22489 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.701117 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:53.716523 22421 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.717664 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:53.718369 22463 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.704866 22406 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:53.719308 19057 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:18:53.719405 22406 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:53.703488 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:53.704890 22490 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:18:53.705715 22134 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.706194 22472 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.706857 22433 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:53.692739 22442 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:53.716367 22210 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:53.718667 22421 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:53.718739 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:53.698381 22499 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:53.720230 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:18:53.705399 22495 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:18:53.721138 21225 consensus_queue.cc:1059] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:53.704888 22484 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.721297 19025 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:53.696200 22493 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:53.738497 22493 raft_consensus.cc:697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:53.739598 22493 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.703020 22470 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.722129 22238 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.717347 22349 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.725752 18493 raft_consensus.cc:1240] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:53.743436 22321 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.736676 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:53.742250 22470 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:53.723417 22406 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.813598 22255 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.763854 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:53.744900 18490 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:53.839188 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2426) took 2512 ms. Trace:
I20260709 13:18:53.838236 22346 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:53.809661 22433 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:53.839627 18486 rpcz_store.cc:276] 0709 13:18:51.327256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.328930 (+  1674us) service_pool.cc:224] Handling call
0709 13:18:51.329244 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.537676 (+1208432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.838912 (+1301236us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400437954. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:53.839098 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2668224896}
I20260709 13:18:53.743782 22349 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.810315 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:53.818329 22334 raft_consensus.cc:3055] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:53.764200 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:53.764562 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:53.829777 22477 log.cc:927] Time spent T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.619s	user 0.002s	sys 0.000s
I20260709 13:18:53.813270 21971 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.724084 22234 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.758630 22134 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.837081 22499 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:53.818186 22447 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.763166 22339 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:53.819917 22451 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 1.339s	user 0.002s	sys 0.003s
W20260709 13:18:53.762916 22437 consensus_meta.cc:287] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.620s	user 0.005s	sys 0.006s
I20260709 13:18:53.863503 22348 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.895524 22488 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:53.934461 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:53.937223 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:53.938781 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:53.938830 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2309) took 2220 ms. Trace:
I20260709 13:18:53.940095 18338 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:53.939370 18337 rpcz_store.cc:276] 0709 13:18:51.718463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.774528 (+ 56065us) service_pool.cc:224] Handling call
0709 13:18:51.775145 (+   617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.792372 (+ 17227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.792401 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:51.799837 (+  7436us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.299332 (+1499495us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b1800358360. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:18:53.455904 (+156572us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:53.456082 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.456152 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:53.938133 (+481981us) raft_consensus.cc:1685] finished
0709 13:18:53.938190 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.938587 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15161,"raft.queue_time_us":23102,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":19201,"spinlock_wait_cycles":13234944,"thread_start_us":155847,"threads_started":1,"wal-append.queue_time_us":1742527}
I20260709 13:18:53.941615 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:53.942549 18338 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:53.943547 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:53.944873 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:53.947513 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:53.948454 18337 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:53.959008 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.959867 18343 pending_rounds.cc:85] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 9
I20260709 13:18:53.960258 18343 pending_rounds.cc:107] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:18:53.960688 18343 raft_consensus.cc:2889] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:53.842892 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:53.842715 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 121490us
I20260709 13:18:53.995256 22488 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:53.996088 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:53.870092 19058 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:53.830860 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1190) took 1514 ms. Trace:
I20260709 13:18:53.999750 19059 rpcz_store.cc:276] 0709 13:18:52.316664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.317387 (+   723us) service_pool.cc:224] Handling call
0709 13:18:52.317650 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.270930 (+953280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.830508 (+559578us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54006f77d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:53.830776 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2117475584}
I20260709 13:18:54.001029 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2438) took 2353 ms. Trace:
I20260709 13:18:53.945873 18338 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:53.975593 18485 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 9: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:54.001649 18492 rpcz_store.cc:276] 0709 13:18:51.647646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.738969 (+ 91323us) service_pool.cc:224] Handling call
0709 13:18:51.739316 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.744098 (+  4782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.744140 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:51.744716 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:18:52.290798 (+546082us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:52.290849 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.290930 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:53.819093 (+1528163us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:54.000314 (+181221us) raft_consensus.cc:1685] finished
0709 13:18:54.000377 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.000758 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4331,"raft.queue_time_us":19423,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":19381,"spinlock_wait_cycles":19001600,"thread_start_us":455559,"threads_started":1,"wal-append.queue_time_us":605014}
I20260709 13:18:54.003804 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:54.004639 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:54.005062 18485 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:53.977067 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 290715us
I20260709 13:18:54.008329 19026 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:53.869284 22245 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.010653 22433 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:54.011793 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 318030us
I20260709 13:18:53.745060 21225 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:53.869421 22334 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:54.021451 18410 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:54.040236 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 852) took 1131 ms. Trace:
I20260709 13:18:54.047600 18344 rpcz_store.cc:276] 0709 13:18:52.908259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.908849 (+   590us) service_pool.cc:224] Handling call
0709 13:18:52.909191 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.408003 (+498812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.039661 (+631658us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b540007f3d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:54.040001 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1093367680}
W20260709 13:18:54.014498 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.050913 22421 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.051851 22421 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.046365 22334 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:54.037125 22510 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:54.037895 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 829) took 3479 ms. Trace:
I20260709 13:18:54.054792 19057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 994) took 1475 ms. Trace:
W20260709 13:18:54.038926 18341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 2051) took 2817 ms (client timeout 1547 ms). Trace:
I20260709 13:18:54.055145 22334 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:54.055452 18341 rpcz_store.cc:269] 0709 13:18:51.220940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.302120 (+ 81180us) service_pool.cc:224] Handling call
0709 13:18:54.038460 (+2736340us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54002d14d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:54.038675 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":868949888}
I20260709 13:18:54.046761 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.057525 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.059167 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.059231 21965 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.060348 21965 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.060904 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:54.059163 22344 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:54.062685 22344 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.063129 22377 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:54.064000 22377 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:54.020910 22339 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.067165 18337 raft_consensus.cc:2410] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:18:54.067894 18491 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:54.057562 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:54.055361 19057 rpcz_store.cc:276] 0709 13:18:52.579077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.029184 (+450107us) service_pool.cc:224] Handling call
0709 13:18:53.029484 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.719695 (+690211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.054257 (+334562us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54005ff5d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:54.054586 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585877248}
I20260709 13:18:54.054876 18339 rpcz_store.cc:276] 0709 13:18:50.558612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.304102 (+745490us) service_pool.cc:224] Handling call
0709 13:18:51.342350 (+ 38248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.163300 (+1820950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.037240 (+873940us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b5400165dd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:54.037679 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4186350976}
I20260709 13:18:54.070202 18493 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:18:54.070466 22344 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.061305 21965 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:54.074858 22337 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.077091 22447 consensus_queue.cc:1059] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:54.077265 22337 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:54.078188 22346 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:54.078994 22346 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.080876 22449 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.080964 22337 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:54.081394 22346 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:54.084026 22464 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.087s	user 0.003s	sys 0.007s
W20260709 13:18:54.085755 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:54.089939 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.091674 18492 raft_consensus.cc:2368] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:18:54.090416 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:18:54.095888 18412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 2166) took 2621 ms (client timeout 2512 ms). Trace:
W20260709 13:18:54.096467 18412 rpcz_store.cc:269] 0709 13:18:51.474274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.475902 (+  1628us) service_pool.cc:224] Handling call
0709 13:18:54.095308 (+2619406us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b540011c1d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:54.095594 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1927332224}
W20260709 13:18:54.098302 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 102699us
I20260709 13:18:54.098510 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 792) took 2049 ms. Trace:
I20260709 13:18:54.099210 19025 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:54.100339 22175 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:54.100585 18413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 2150) took 3761 ms (client timeout 2032 ms). Trace:
W20260709 13:18:54.101002 18413 rpcz_store.cc:269] 0709 13:18:50.338615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.340249 (+  1634us) service_pool.cc:224] Handling call
0709 13:18:54.100194 (+3759945us) spinlock_profiling.cc:243] Waited 2.51 s on lock 0x7b54003638d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:54.100398 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5776343808}
I20260709 13:18:54.103097 22152 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:54.075872 22422 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:54.103871 22152 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:54.104434 18484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 2455) took 1472 ms (client timeout 1849 ms). Trace:
W20260709 13:18:54.104841 18484 rpcz_store.cc:269] 0709 13:18:52.632213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.881609 (+249396us) service_pool.cc:224] Handling call
0709 13:18:54.104063 (+1222454us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b54000b72d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:54.104266 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41539328}
I20260709 13:18:54.106194 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:54.106973 18484 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:54.107355 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:54.108129 18491 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:54.111994 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:54.114032 21225 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:54.114584 18488 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:18:54.120100 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 44493.5us
I20260709 13:18:54.121410 18382 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:54.098964 18419 rpcz_store.cc:276] 0709 13:18:52.049424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.051111 (+  1687us) service_pool.cc:224] Handling call
0709 13:18:52.060977 (+  9866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.524005 (+463028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.098019 (+1574014us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54003ed0d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:54.098328 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901459712}
I20260709 13:18:54.122992 22421 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:54.123405 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:54.126399 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 112874us
W20260709 13:18:54.126890 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 54693us
I20260709 13:18:54.127475 18458 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:54.129645 22498 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:54.118023 18486 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:54.132517 22447 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:54.133337 22447 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:54.134266 22498 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:54.135486 22498 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:54.135546 22358 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.136999 22358 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:54.138536 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.136132 22447 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:54.127849 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:54.113745 21965 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:54.128770 21225 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.144274 18493 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:18:54.146016 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:54.153863 18488 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:54.155287 18488 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:54.157760 18485 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:54.168084 18337 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
W20260709 13:18:54.175077 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 47443.9us
I20260709 13:18:54.177551 21225 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.181977 21965 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:54.182773 21965 raft_consensus.cc:697] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:54.184285 21965 consensus_queue.cc:237] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.185047 19060 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
W20260709 13:18:54.188016 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 1.10833e+06us
I20260709 13:18:54.189563 18384 leader_election.cc:400] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12.
I20260709 13:18:54.165735 22152 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.213828 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:54.214815 18413 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:54.190063 22447 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:54.190649 22377 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:54.193066 18486 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:54.203441 22433 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:54.206262 18382 leader_election.cc:400] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
W20260709 13:18:54.208177 19054 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1180) took 3682 ms (client timeout 2421 ms). Trace:
I20260709 13:18:54.228564 18382 leader_election.cc:403] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:54.208789 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 850) took 1307 ms. Trace:
I20260709 13:18:54.190896 22421 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:54.210350 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:54.211333 22346 raft_consensus.cc:3055] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:54.220445 18491 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:18:54.215978 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:54.232465 18484 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:54.193678 22211 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:54.228641 19054 rpcz_store.cc:269] 0709 13:18:50.525561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.525677 (+   116us) service_pool.cc:224] Handling call
0709 13:18:54.207744 (+3682067us) spinlock_profiling.cc:243] Waited 3.2 s on lock 0x7b5400489254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:54.207925 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7353620736}
I20260709 13:18:54.236016 18493 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:54.238682 22332 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:54.243235 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 113119us
I20260709 13:18:54.244176 18412 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:54.245513 22138 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.246182 22138 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:54.255309 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:54.234375 22421 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:54.264111 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 102459us
W20260709 13:18:54.262588 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 46200.2us
W20260709 13:18:54.267678 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.233952 22346 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:54.276684 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 112003us
I20260709 13:18:54.229053 18342 rpcz_store.cc:276] 0709 13:18:52.900986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.916737 (+ 15751us) service_pool.cc:224] Handling call
0709 13:18:52.917180 (+   443us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:52.925793 (+  8613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.925837 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:52.974554 (+ 48717us) log.cc:844] Serialized 52 byte log entry
0709 13:18:53.117841 (+143287us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:53.214329 (+ 96488us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.215114 (+   785us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.215300 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.215373 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:53.812614 (+597241us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b18002d4fc0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:18:54.155482 (+342868us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b18002d4fc0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdbd2a6 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1
0709 13:18:54.157454 (+  1972us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b18002d4fc0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:18:54.208421 (+ 50967us) raft_consensus.cc:1685] finished
0709 13:18:54.208440 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.208630 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7958,"prepare.queue_time_us":421188,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":72,"raft.queue_time_us":37687,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":14120,"spinlock_wait_cycles":88429568,"thread_start_us":182321,"threads_started":2,"wal-append.queue_time_us":219852}
I20260709 13:18:54.268321 22421 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:54.286991 19027 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:54.263350 22138 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:54.234930 22470 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:54.291107 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 101717us
I20260709 13:18:54.299847 18382 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:54.307197 18487 raft_consensus.cc:2393] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:18:54.312289 18335 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2300) took 2746 ms (client timeout 2051 ms). Trace:
W20260709 13:18:54.312865 18335 rpcz_store.cc:269] 0709 13:18:51.565889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.604497 (+ 38608us) service_pool.cc:224] Handling call
0709 13:18:54.311762 (+2707265us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54000e10d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:54.312066 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3455353088}
I20260709 13:18:54.315659 18410 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:54.283675 22447 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:54.274777 22433 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.328449 21225 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:18:54.331048 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 51783.6us
I20260709 13:18:54.332360 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:54.332535 18413 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:54.333662 18412 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:54.338748 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.339720 18416 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:54.342922 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 797) took 2259 ms. Trace:
I20260709 13:18:54.343312 18416 rpcz_store.cc:276] 0709 13:18:52.083911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.131641 (+ 47730us) service_pool.cc:224] Handling call
0709 13:18:52.131950 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.340154 (+2208204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.342604 (+  2450us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54001784d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:54.342846 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5076545280}
W20260709 13:18:54.353483 22516 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.326s	user 0.003s	sys 0.000s
I20260709 13:18:54.354844 22387 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:54.355578 22387 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:18:54.357177 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.356894 22387 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:54.361714 22515 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.328s	user 0.002s	sys 0.001s
I20260709 13:18:54.362982 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.330159 22346 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:54.367041 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 83377.2us
I20260709 13:18:54.367120 22264 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.326434 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:54.396027 22264 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:54.396844 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 95929.3us
I20260709 13:18:54.398319 22264 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:54.399798 22328 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:54.400605 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:54.400389 22328 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.401440 19060 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:54.401235 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:54.402119 19054 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.402168 22334 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:54.402962 22334 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.404359 22510 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:54.405041 22334 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.405422 22437 raft_consensus.cc:3055] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:54.405575 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:54.406023 22437 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:54.406862 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 89111.7us
I20260709 13:18:54.408057 22244 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:54.408337 22445 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:54.408499 22244 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:54.408912 22244 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:54.409020 22445 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.407317 22437 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.417768 18343 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:54.383201 22406 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:54.425170 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:54.429455 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 142556us
I20260709 13:18:54.431731 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:54.432384 19059 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:54.432757 22433 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:54.434176 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:54.434759 18410 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:54.428998 22264 consensus_queue.cc:1059] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:18:54.443914 22328 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.446758 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:54.447856 21225 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:18:54.453028 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.461897 18340 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:18:54.461786 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 168171us
I20260709 13:18:54.423262 22406 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:54.445907 22346 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:54.472826 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.476994 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:54.474239 22437 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:54.474133 22406 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:54.493284 18382 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:54.473860 22328 consensus_queue.cc:1059] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:18:54.502245 19054 raft_consensus.cc:2410] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:18:54.502799 19057 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:18:54.504396 18226 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b345033a56994fff90990b7d03324074 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d6cd7c600ec4ab2b5cac479f05d4c0f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:54.505672 22470 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.506645 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:54.508452 21225 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:18:54.501396 22517 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:18:54.520439 18343 raft_consensus.cc:2376] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15. Re-sending same reply.
I20260709 13:18:54.528975 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.529596 22104 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:54.529855 18490 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:18:54.530279 22104 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.531214 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:54.532034 18487 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:54.532848 22422 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:54.533070 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.533623 22422 consensus_queue.cc:1243] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:54.533986 18484 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:54.533861 22245 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:54.535234 18493 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:54.535548 22245 consensus_queue.cc:1059] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:54.533138 21792 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:54.536486 22245 raft_consensus.cc:3055] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:54.537267 21792 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:54.537320 22218 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.537658 22245 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:54.538054 22361 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:18:54.538455 21792 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.539247 22245 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.539855 21792 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:54.529747 18491 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:54.540683 22245 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:54.534230 22422 raft_consensus.cc:3055] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:54.501502 22264 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:54.549641 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:54.549777 22264 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:54.551988 19058 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.552614 22264 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.503161 22152 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:54.566684 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.567817 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:54.570801 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:54.532864 22104 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.575160 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.574193 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:54.575754 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:54.579020 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 70903.8us
I20260709 13:18:54.579509 18484 raft_consensus.cc:2368] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10.
I20260709 13:18:54.544041 22422 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:54.572759 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:54.581568 18342 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:54.550321 22218 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.593355 22218 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.596802 19059 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:18:54.599913 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.539247 18239 catalog_manager.cc:5697] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 4 to 8, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 8 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:54.589129 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:54.603528 19025 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:54.605857 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.609295 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:54.611740 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.616006 19059 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:54.614653 18485 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:54.619853 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.624818 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.585098 22152 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:54.625505 18492 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:54.611060 22433 consensus_queue.cc:1059] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:18:54.634294 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.636240 18484 raft_consensus.cc:2393] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:54.637928 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:54.638281 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:54.639178 19055 raft_consensus.cc:2393] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:54.639963 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:54.640547 19055 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:54.641471 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:54.642213 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:54.642787 18242 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42278 (request call id 370) took 21691 ms (client timeout 15000 ms). Trace:
I20260709 13:18:54.642915 19062 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:54.642975 18412 raft_consensus.cc:2368] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10.
I20260709 13:18:54.641178 22244 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.643021 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:54.643816 19055 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:54.647990 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:54.650018 19057 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:54.650532 19058 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:54.652737 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:54.647187 19027 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:54.653234 22422 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.669143 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:54.643669 22510 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:54.671607 19054 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:18:54.678704 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.674877 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:54.655953 22244 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.649318 21965 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.715077 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:54.644971 22445 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:54.715688 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 121282us
I20260709 13:18:54.715977 19059 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:54.723628 18412 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:54.716496 18239 catalog_manager.cc:5697] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 5 to 9, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 9 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:54.681658 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:54.726575 19053 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:54.728453 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.670944 22377 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.729117 18491 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:18:54.739563 18382 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:54.716071 22422 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.738072 21965 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.743147 22377 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.746182 22421 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:54.747251 22520 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:18:54.750063 22348 consensus_queue.cc:1059] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:18:54.750808 18309 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:54.751487 22332 consensus_meta.cc:287] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
W20260709 13:18:54.754290 22501 log.cc:927] Time spent T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 13:18:54.755402 22523 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:18:54.773882 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.756763 19025 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:54.757685 22218 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:54.778815 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:54.738935 21225 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:18:54.768374 19061 raft_consensus.cc:2410] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:18:54.766683 18239 catalog_manager.cc:5697] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 4 to 9, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 9 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:54.761955 22334 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:54.643242 18242 rpcz_store.cc:269] 0709 13:18:32.951938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.952273 (+   335us) service_pool.cc:224] Handling call
0709 13:18:54.642510 (+21690237us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:48.953801 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:49.234841 (+281040us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:49.237464 (+  2623us) write_op.cc:435] Acquired schema lock
0709 13:18:49.240241 (+  2777us) tablet.cc:662] Decoding operations
0709 13:18:49.518978 (+278737us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:49.528017 (+  9039us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:49.531954 (+  3937us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:49.552123 (+ 20169us) tablet.cc:701] Row locks acquired
0709 13:18:49.573013 (+ 20890us) write_op.cc:260] PREPARE: finished
0709 13:18:49.600253 (+ 27240us) write_op.cc:270] Start()
0709 13:18:49.612283 (+ 12030us) write_op.cc:276] Timestamp: P: 1783603129596049 usec, L: 0
0709 13:18:49.619342 (+  7059us) op_driver.cc:348] REPLICATION: starting
0709 13:18:49.857497 (+238155us) log.cc:844] Serialized 913 byte log entry
0709 13:18:50.478541 (+621044us) op_driver.cc:464] REPLICATION: finished
0709 13:18:50.796047 (+317506us) write_op.cc:301] APPLY: starting
0709 13:18:50.796197 (+   150us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:50.796370 (+   173us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:50.796505 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:50.796975 (+   470us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:50.797244 (+   269us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:18:50.797315 (+    71us) write_op.cc:312] APPLY: finished
0709 13:18:50.797617 (+   302us) log.cc:844] Serialized 29 byte log entry
0709 13:18:50.797842 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:50.797979 (+   137us) write_op.cc:454] Released schema lock
0709 13:18:50.798024 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:50.798494 (+   470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:50.798528 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":94925,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":248737,"apply.run_cpu_time_us":2462,"apply.run_wall_time_us":69609,"num_ops":2,"prepare.queue_time_us":435879,"prepare.run_cpu_time_us":27524,"prepare.run_wall_time_us":1082564,"raft.queue_time_us":179369,"raft.run_cpu_time_us":43280,"raft.run_wall_time_us":191831,"replication_time_us":859034,"thread_start_us":742367,"threads_started":4,"wal-append.queue_time_us":161930,"wal-append.run_cpu_time_us":42563,"wal-append.run_wall_time_us":1774557}]]}
I20260709 13:18:54.787395 18488 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:54.788097 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:54.759995 22510 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:18:54.800072 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:54.788697 22346 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.837986 22346 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:54.838541 22152 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:54.839946 22346 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:54.810843 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:54.840942 18410 raft_consensus.cc:2410] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:18:54.814293 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:54.842095 18413 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:54.819662 22365 raft_consensus.cc:3055] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:54.842844 22365 raft_consensus.cc:740] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:54.843899 22365 consensus_queue.cc:260] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.844940 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:54.831877 18308 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:54.823199 21965 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.786895 22334 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.846982 22334 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:54.847498 21225 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:54.847901 21225 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.848227 21225 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:54.848840 18308 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:54.835321 22377 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:54.836350 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:54.837232 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 80630.3us
I20260709 13:18:54.845113 22365 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:54.833261 22487 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 13:18:54.857250 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 201491us
W20260709 13:18:54.854435 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 47843.1us
W20260709 13:18:54.859155 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.805775 22358 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:54.865624 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 114873us
I20260709 13:18:54.873297 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:54.876422 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 229323us
I20260709 13:18:54.890661 22406 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.892235 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:54.861246 22377 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:54.898145 18491 raft_consensus.cc:1275] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:54.854457 22138 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:18:54.910760 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.915346 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:54.873835 22332 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:54.859777 22218 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:18:54.894512 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:54.925009 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.928244 18488 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:54.924973 21225 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:54.930866 18487 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:54.903403 22377 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.997354 18416 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
W20260709 13:18:54.997638 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 74094.1us
I20260709 13:18:54.919371 22387 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:54.995138 22447 consensus_meta.cc:287] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.004s
W20260709 13:18:55.013676 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.017635 21225 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:54.993492 22377 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:55.020643 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 126204us
I20260709 13:18:55.026759 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:55.030982 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.001793 22358 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:18:55.034933 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:55.035714 18336 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:18:55.036000 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.004264 22332 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.016034 22437 raft_consensus.cc:3055] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:55.030121 22387 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.047461 18239 catalog_manager.cc:5697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 5 to 6, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 6 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:55.027838 22447 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
W20260709 13:18:55.049852 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 76956.9us
W20260709 13:18:55.054323 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 150585us
I20260709 13:18:55.030972 22421 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:55.054641 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:55.079536 21225 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:55.080231 18340 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:55.080658 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:55.081832 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:55.085219 18342 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.046342 22437 raft_consensus.cc:740] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:55.085668 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:18:55.087436 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 157766us
W20260709 13:18:55.088033 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 205411us
I20260709 13:18:55.056849 22433 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.089906 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.053103 22536 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:55.092872 22454 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:55.093562 22530 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:18:55.097359 22421 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.090726 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:55.109092 18239 catalog_manager.cc:5697] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 8 to 10, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 10 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.116396 18340 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:55.118516 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 78618.8us
I20260709 13:18:55.090895 22104 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:55.113458 22498 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.124173 22498 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:55.126214 19025 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:55.126884 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.127489 19025 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:55.137056 22526 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.363s	user 0.011s	sys 0.022s
I20260709 13:18:55.139256 18239 catalog_manager.cc:5697] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 8 to 9, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 9 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.142035 22535 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.142606 22535 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.121117 22421 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.145258 22421 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:55.145360 22535 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:55.150982 22498 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:55.151036 22387 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:55.151800 22529 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
W20260709 13:18:55.155675 22532 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.325s	user 0.003s	sys 0.000s
I20260709 13:18:55.157794 18382 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:55.159230 22387 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:55.159624 22387 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.159965 22387 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.162125 22537 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:18:55.166090 22533 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.342s	user 0.003s	sys 0.000s
I20260709 13:18:55.145813 22421 consensus_queue.cc:1059] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:18:55.170128 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 93904.9us
I20260709 13:18:55.171048 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:55.172214 22421 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.172816 22510 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:55.174213 21965 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.174849 21965 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.162163 22547 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:55.180225 22547 raft_consensus.cc:3055] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:55.180593 22547 raft_consensus.cc:740] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:18:55.181149 22528 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.410s	user 0.002s	sys 0.000s
W20260709 13:18:55.178287 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 55931.1us
I20260709 13:18:55.183008 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.183677 18335 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:18:55.178551 22406 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:55.183722 18343 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:55.181559 22547 consensus_queue.cc:260] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.185369 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.186013 22547 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.186266 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.187186 22175 raft_consensus.cc:3055] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:55.187531 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.187969 22348 raft_consensus.cc:3055] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:55.188354 22348 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:55.188454 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.189126 18341 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:18:55.177906 21965 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:55.191807 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.085769 22332 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:55.194399 22527 log.cc:927] Time spent T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.390s	user 0.001s	sys 0.001s
I20260709 13:18:55.194571 22332 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:55.194973 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.195757 18335 raft_consensus.cc:2393] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:55.194576 18343 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
W20260709 13:18:55.197276 22540 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:55.118223 22433 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:55.199507 22548 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:55.110294 22264 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.200220 22264 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:55.200773 22433 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:55.151933 22437 consensus_queue.cc:260] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.202241 22264 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:55.205554 22437 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:55.190155 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.206262 18339 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:55.190871 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.207710 22544 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:55.190927 18382 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:55.208828 22361 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:55.209389 18309 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:55.209864 22537 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:55.187562 22175 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:55.210551 22537 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.210680 18309 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:55.211045 22537 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.212003 22218 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:55.212539 22218 raft_consensus.cc:697] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:55.212962 18309 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:55.213708 22544 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:55.213526 22218 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.214082 22264 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:55.214939 22546 consensus_queue.cc:1059] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:55.215823 22138 raft_consensus.cc:3055] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:55.215662 22348 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.216238 22138 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:55.216921 22348 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:55.218283 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:55.219039 18489 raft_consensus.cc:2410] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:55.141260 18239 catalog_manager.cc:5697] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.214387 22544 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:55.230018 18342 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:18:55.221773 18336 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:55.214119 18309 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:55.237455 18340 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:55.239113 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:55.236523 18239 catalog_manager.cc:5697] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.247709 18486 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:18:55.248036 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 153408us
I20260709 13:18:55.248756 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:55.217347 22138 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.249539 18489 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:18:55.257561 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:55.258277 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:55.258998 18417 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:55.259099 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:55.259362 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:55.265651 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.266428 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:55.267275 18413 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:18:55.267707 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.272244 18416 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:18:55.165673 22334 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:55.283579 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 69530us
I20260709 13:18:55.283767 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:55.229431 22544 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:55.298954 22544 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:55.285669 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 50742.6us
I20260709 13:18:55.302387 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:55.303210 18239 catalog_manager.cc:5697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.304827 18239 catalog_manager.cc:5697] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 3 to 5, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 5 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.287072 22454 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:55.287864 22536 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:55.295055 18382 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:55.306619 22454 raft_consensus.cc:2764] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:55.306820 19056 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:18:55.307178 19056 pending_rounds.cc:85] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 7
I20260709 13:18:55.307386 19056 pending_rounds.cc:107] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:18:55.307603 19056 raft_consensus.cc:2889] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:55.308048 22546 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:55.308550 22264 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:55.308969 22264 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.309134 22546 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:55.277631 22358 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:55.296664 22138 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:55.211058 22175 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.306169 22328 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:55.295831 22245 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:55.312323 22358 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.314563 22358 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:55.309697 22546 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:55.317334 22546 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.318993 22546 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.308064 18307 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:55.314272 21965 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:55.306640 22536 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:55.323913 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:55.324405 22361 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:55.324231 22536 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.325176 22361 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:55.328336 18342 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:55.329607 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.309322 22264 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.330632 18339 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:55.246919 22332 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:55.334267 22332 raft_consensus.cc:697] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:55.334658 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:55.335168 22332 consensus_queue.cc:237] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.335933 22245 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:55.336334 22245 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.336661 22245 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:55.336848 18384 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:55.340372 18337 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
W20260709 13:18:55.342538 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 58273.6us
I20260709 13:18:55.343748 18307 leader_election.cc:400] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10.
I20260709 13:18:55.344156 18307 leader_election.cc:403] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:55.348870 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.289413 22387 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:55.350931 18307 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:55.357009 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:55.357969 18384 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:55.358207 22361 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:55.359679 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 510945us
I20260709 13:18:55.360608 18308 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:55.345815 21965 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:18:55.362185 22361 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:55.363169 22334 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:55.363816 22535 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.364293 22535 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.364915 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:55.365626 18489 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.366362 22535 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:55.366981 22447 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:55.357971 18307 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:55.370321 22348 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:55.370947 22348 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.371424 22348 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:55.371584 18309 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:55.372605 18309 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:55.370378 22387 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:55.375161 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.380149 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.380919 18337 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:18:55.377323 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.373886 18309 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:55.345660 22358 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10.
I20260709 13:18:55.381202 18239 catalog_manager.cc:5697] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 3 to 6, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 6 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.376492 18308 leader_election.cc:400] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10.
I20260709 13:18:55.383594 18339 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:55.352046 22175 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.352350 22421 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:55.385588 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:55.390319 18486 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.391534 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:55.392050 18308 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:55.380235 22365 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:55.380635 22361 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:55.347232 22377 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:55.382429 22339 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:55.382573 22328 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:55.353618 22537 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.379452 22152 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:18:55.400913 22365 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.396256 18384 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:55.459043 18344 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:55.407013 22387 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:55.404969 22339 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:18:55.466747 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 70598.1us
I20260709 13:18:55.405213 22328 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:55.460119 22365 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.469405 18489 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
W20260709 13:18:55.477509 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 350070us
I20260709 13:18:55.474450 18239 catalog_manager.cc:5697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.495095 18411 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:55.471302 22334 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:55.475171 22328 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:55.500308 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:55.475796 22339 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.476763 22361 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:55.477164 22387 raft_consensus.cc:697] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:55.502100 21965 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.512543 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:55.514587 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.518625 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:55.529289 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 137422us
I20260709 13:18:55.530043 18308 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:55.530222 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 122283us
I20260709 13:18:55.517318 22245 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.536306 18486 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:18:55.497874 22550 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:55.503837 22552 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:55.543619 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:55.547605 18308 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:55.528437 22551 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.556123 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:55.556339 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:55.556740 19055 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.550472 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.557543 19053 raft_consensus.cc:2410] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:55.524557 22361 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.565467 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:55.567224 19059 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:18:55.569126 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.574355 19061 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:55.528698 22334 raft_consensus.cc:697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:55.576718 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:55.577440 19025 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:55.581400 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:55.582130 19054 raft_consensus.cc:2368] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:18:55.582365 18413 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:18:55.575803 18457 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.528s (SENT) [suppressed 24 similar messages]
W20260709 13:18:55.589329 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 215504us
I20260709 13:18:55.573158 22361 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.595182 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.600762 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:55.599074 22536 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.554219 21965 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:55.612528 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 73277.1us
I20260709 13:18:55.614161 19056 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 6.
I20260709 13:18:55.616240 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.616619 22387 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.617561 22537 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:55.619041 22245 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:55.620112 22536 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:55.615326 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:55.620947 19025 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:55.621438 22152 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:55.621721 22377 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:55.621846 22152 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:55.622319 22152 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.622575 22563 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:55.595636 22550 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:55.589521 22551 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.623939 22545 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:55.629938 21965 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:55.595104 22552 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.631524 18416 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:55.631956 22552 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:55.632949 22553 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:55.623318 22563 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:55.639230 19055 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:55.643136 19059 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:55.645581 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 162051us
I20260709 13:18:55.650624 18458 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:55.651685 18382 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:55.652859 18382 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:55.652726 22447 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:55.656527 22562 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:55.644361 22563 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.662046 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:55.673766 18413 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
W20260709 13:18:55.662474 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.662957 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:55.667639 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.668219 22332 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:55.669078 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.669610 22138 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.670267 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:55.625705 22551 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:55.670594 19059 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:18:55.682776 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:55.683658 18490 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:55.684432 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 63558.7us
I20260709 13:18:55.588774 22498 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:18:55.652410 18416 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
W20260709 13:18:55.672207 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 124672us
I20260709 13:18:55.672402 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.691511 19055 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:55.687757 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.676578 22104 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:55.697489 22104 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:55.677774 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:55.687474 19058 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:55.674996 19053 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.697940 22104 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:55.708169 22339 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:55.693246 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:55.710518 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:55.711099 18411 raft_consensus.cc:2393] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:55.711763 18413 raft_consensus.cc:2410] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:18:55.694789 18336 raft_consensus.cc:2410] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:18:55.692392 22138 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.671000 22377 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.693720 18308 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:55.703449 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.706849 19054 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:55.671512 22552 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:55.710867 18486 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:18:55.702492 19062 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:18:55.706266 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:55.702070 22447 raft_consensus.cc:697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:55.723069 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.723479 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:55.716565 22332 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:55.723695 22447 consensus_queue.cc:237] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:55.724200 22332 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:55.724586 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.725241 19055 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:55.726251 22332 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:55.726629 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:55.726915 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.727950 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:55.727725 22334 consensus_queue.cc:237] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.630007 22264 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:55.698496 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:55.730013 18309 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:55.730500 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:55.732422 19053 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:55.703703 22562 raft_consensus.cc:697] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:55.737486 19061 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:18:55.738464 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.747400 19057 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
W20260709 13:18:55.748217 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 54611.3us
I20260709 13:18:55.750560 18308 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:55.752310 19061 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:18:55.753335 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.754247 19054 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:55.759755 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:55.702119 22564 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.675587 22348 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:55.705960 22563 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:55.776392 18336 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:55.773181 18458 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:55.777969 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:55.781013 19053 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:55.781431 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.782786 18336 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:18:55.783519 19059 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:55.790952 18491 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:55.791841 19055 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:55.783285 18336 pending_rounds.cc:85] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 8
I20260709 13:18:55.793607 18336 pending_rounds.cc:107] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:18:55.793900 18336 raft_consensus.cc:2889] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:55.795506 22563 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.798447 19061 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:55.796898 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:55.802235 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:55.803028 18488 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:55.803157 19054 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:55.764245 22551 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.804474 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:55.765836 22332 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:55.808192 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:55.814600 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:55.746874 22377 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.787142 22470 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:55.818863 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:55.782471 22570 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:55.790645 22567 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:55.796195 22563 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:55.834867 18336 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:55.823041 19057 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:18:55.823504 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 73036.4us
I20260709 13:18:55.786787 22339 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:55.885648 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.804049 22546 raft_consensus.cc:2764] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:18:55.829481 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:55.817945 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:55.809221 22433 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.825356 22358 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:55.824857 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:55.891537 19061 raft_consensus.cc:2410] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:18:55.873775 19054 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:55.924947 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:55.839170 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:55.901262 18416 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:18:55.780997 22564 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.836162 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:55.901396 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:55.940054 18417 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:55.834365 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:55.903318 18492 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 5.
I20260709 13:18:55.826692 22470 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:55.827281 22152 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:55.832096 22570 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.941013 18491 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:18:55.942472 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:55.943902 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:55.946971 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:55.956228 18416 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:55.957751 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 170363us
I20260709 13:18:55.958909 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:55.951413 19025 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:55.884419 22377 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:55.889544 22138 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:55.952759 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:55.961288 19057 raft_consensus.cc:2410] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:18:55.961869 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:55.962803 22534 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:55.963505 22534 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:55.963856 22534 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.964206 22534 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.883040 22348 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:55.966691 18484 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:55.969609 18416 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:55.980082 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.981149 19025 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:55.984972 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:55.985829 18416 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:55.986096 18417 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:55.987105 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:55.988027 18337 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:55.823994 22551 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.994822 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:55.996316 18413 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:55.949119 22470 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.001116 18489 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:56.002871 18337 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:18:56.007654 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:56.008531 18338 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:55.948474 22332 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:55.887256 22328 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.876596 22365 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:55.984169 22567 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:55.966133 22570 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.018956 18335 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:18:56.019001 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 60237.3us
I20260709 13:18:56.017697 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:55.997076 22544 consensus_meta.cc:287] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.698s	user 0.005s	sys 0.005s
I20260709 13:18:56.017642 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:56.044368 18337 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:55.939491 22433 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.037000 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:56.017710 22175 consensus_meta.cc:287] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.000s
I20260709 13:18:56.002569 22547 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:55.979857 22361 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:55.982776 22546 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:18:56.050437 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.903585 22562 consensus_queue.cc:237] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:56.063117 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:56.071894 18416 raft_consensus.cc:2368] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11.
I20260709 13:18:56.053295 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:55.982084 22358 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.073135 18337 raft_consensus.cc:2410] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:18:56.073387 18308 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:56.065018 18342 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:18:55.996716 22377 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:56.060972 22104 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:56.067932 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:56.069517 19027 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:56.070809 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:56.089501 18343 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
W20260709 13:18:56.075245 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 84558.7us
I20260709 13:18:56.077301 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:56.066517 19062 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:18:56.082594 18308 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:56.092722 22568 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:56.091593 18336 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 5.
I20260709 13:18:56.098148 18344 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:18:56.101454 18490 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:18:56.102413 18492 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:56.061420 22332 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:56.106864 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.083688 22218 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:56.112054 22104 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:56.113667 18416 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:56.052289 22544 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.093717 22175 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:56.115787 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.129976 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:56.131268 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.145167 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 108258us
I20260709 13:18:56.109858 22545 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.153739 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:56.099220 22377 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:56.186221 22568 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:56.187042 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:56.187197 22568 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:56.191118 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.195792 18416 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:18:56.199906 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 91123.1us
I20260709 13:18:56.146039 22104 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:18:56.185316 22454 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:56.182303 22546 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:18:56.237146 18411 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:56.208168 22454 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:56.174914 22545 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.212826 22152 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:56.227181 22328 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:56.249939 22586 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:18:56.237210 22365 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:56.249212 22573 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
I20260709 13:18:56.245489 22454 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:56.252673 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 101122us
I20260709 13:18:56.268471 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:56.269222 22579 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:18:56.279299 18414 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
W20260709 13:18:56.312706 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 218597us
I20260709 13:18:56.311654 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:56.347043 18486 raft_consensus.cc:2393] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:56.273886 18413 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:18:56.345767 18308 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:56.357868 18489 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:56.257885 22590 consensus_queue.cc:1059] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
W20260709 13:18:56.359370 22594 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:18:56.348583 22577 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:56.275285 22588 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:18:56.349226 22152 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:56.362339 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 94005.8us
W20260709 13:18:56.368037 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 165490us
W20260709 13:18:56.306514 22587 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:56.373579 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:56.366685 22152 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:56.382650 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:56.383380 18413 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.344303 22555 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.374174 18414 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.374235 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.375813 18416 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:56.386545 19027 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:56.388171 19027 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:56.378429 22470 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.379549 22590 raft_consensus.cc:3055] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:18:56.288676 22583 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:18:56.391469 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:56.390262 19027 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:56.393178 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.394426 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.395022 18412 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:56.395772 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.395790 18338 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:18:56.368088 22599 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.398499 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:56.402736 18485 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:56.403918 19027 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:56.389971 22567 raft_consensus.cc:697] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:56.391814 22592 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:56.389942 22590 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:56.413730 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:56.391701 22175 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:56.388911 22498 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:18:56.390853 22104 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:18:56.424829 22175 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.431522 22470 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:56.425755 22564 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:56.392025 22555 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.408533 22348 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:18:56.450227 18413 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:56.437554 22547 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:56.397531 22598 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:18:56.427778 22550 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:56.475471 22550 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.475955 22550 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.412181 22606 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:56.481539 22358 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:56.400177 22597 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:18:56.483485 22551 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:56.483909 22152 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:56.484479 22152 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:56.484398 22550 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:56.485049 22152 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.443987 22599 raft_consensus.cc:697] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:56.487242 22599 consensus_queue.cc:237] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:56.487965 22580 log.cc:927] Time spent T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.297s	user 0.000s	sys 0.002s
I20260709 13:18:56.443006 22545 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:56.396759 18226 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b345033a56994fff90990b7d03324074 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d6cd7c600ec4ab2b5cac479f05d4c0f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:18:56.492934 18226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 96902.1us
I20260709 13:18:56.494141 22555 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:56.458585 22607 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:18:56.502146 22567 consensus_queue.cc:237] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.518544 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.519697 18410 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:56.490155 22590 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.520761 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.521276 22590 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:56.521948 22550 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:56.522419 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.523883 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.524482 18418 raft_consensus.cc:2376] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10. Re-sending same reply.
I20260709 13:18:56.525451 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:56.449153 18414 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:56.419565 22592 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.457262 18411 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:56.432413 22534 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.462962 18485 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:56.489969 22361 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:56.552363 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:56.445971 22175 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:56.528005 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 130740us
I20260709 13:18:56.531454 18416 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:56.534034 18418 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:56.527408 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.548470 18309 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:56.546133 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.560074 18419 raft_consensus.cc:2368] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11.
I20260709 13:18:56.560916 18340 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:56.568034 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:56.568809 18338 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:56.536132 22138 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:56.575002 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:56.577538 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:56.577986 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 174163us
I20260709 13:18:56.578011 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:56.579902 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:56.542423 22592 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.581823 18410 raft_consensus.cc:2368] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9.
I20260709 13:18:56.551608 22547 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:56.582846 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:56.584399 19027 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:56.588485 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:56.588729 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:56.589221 18414 raft_consensus.cc:2368] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10.
I20260709 13:18:56.567557 22365 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:56.595256 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:56.596350 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:56.592509 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:18:56.576700 22570 consensus_meta.cc:287] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.000s
I20260709 13:18:56.601583 18338 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:56.607791 22264 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:56.611133 22577 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:56.611670 22577 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.616814 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:56.620313 18414 raft_consensus.cc:2376] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7. Re-sending same reply.
I20260709 13:18:56.616946 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.592123 22348 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.618347 22604 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:56.587221 22361 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:56.621670 18410 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:56.628113 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:56.632320 18338 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:18:56.628424 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:56.629722 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:56.632869 18491 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:56.629722 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:56.636276 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:56.632880 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:56.638947 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:56.586460 22547 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:56.639537 18414 raft_consensus.cc:2376] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10. Re-sending same reply.
I20260709 13:18:56.642268 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.642874 18412 raft_consensus.cc:2376] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12. Re-sending same reply.
I20260709 13:18:56.643712 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.646185 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.646621 18340 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:56.646922 18412 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:18:56.647909 18412 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:56.649902 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:56.653312 18343 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:18:56.659471 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:56.661324 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:56.665176 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:56.666566 18416 raft_consensus.cc:2376] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12. Re-sending same reply.
I20260709 13:18:56.668586 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.674921 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:56.675880 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.720070 19027 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:56.630369 22604 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:56.805593 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:56.665343 22564 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:56.816809 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 96793.7us
I20260709 13:18:56.665198 22152 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:56.828039 18416 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:56.831748 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:56.836946 19059 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:56.831894 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:56.837826 19058 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.839833 18491 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:18:56.673592 22358 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:56.826335 22334 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.842397 22334 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.635847 22348 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.625672 22570 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.844153 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:56.846333 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:56.715984 22546 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:56.862382 18414 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:56.858283 19054 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:56.818871 22332 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:56.870100 22614 consensus_queue.cc:1059] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.230s
I20260709 13:18:56.870931 22593 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:56.871084 22334 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:56.871575 22600 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:56.872339 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:18:56.873039 22615 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:18:56.873317 18412 raft_consensus.cc:2368] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11.
I20260709 13:18:56.879379 22614 raft_consensus.cc:3055] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:56.879812 22614 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:56.880637 22614 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:56.891263 18382 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:56.892673 22387 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:56.893193 22387 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:56.894279 22387 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.804864 22606 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.716153 22595 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.389s
W20260709 13:18:56.962383 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 69683.8us
I20260709 13:18:56.897189 19058 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:18:56.945024 18341 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:57.302245 19026 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:57.095932 22454 consensus_meta.cc:287] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.794s	user 0.007s	sys 0.003s
I20260709 13:18:57.303112 22454 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:56.950136 22470 consensus_queue.cc:1059] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.354s
I20260709 13:18:57.261251 22613 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:57.279290 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:57.284297 22614 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.305094 22613 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:57.232187 22175 consensus_meta.cc:287] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.000s
W20260709 13:18:56.931972 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.315335 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.084565 18418 consensus_meta.cc:287] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.001s
I20260709 13:18:57.317193 18418 raft_consensus.cc:2410] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:56.896777 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:57.280944 18339 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:18:57.133150 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:56.926416 18337 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
W20260709 13:18:57.115054 18457 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.016s	sys 0.064s
W20260709 13:18:57.321856 18457 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.018s	sys 0.067s
W20260709 13:18:57.322372 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 732431us
I20260709 13:18:57.318784 18412 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:18:56.804463 22604 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.351310 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:57.352344 18410 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:57.221552 22567 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.300997 22348 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:56.825999 22365 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:57.354771 22567 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.355343 22365 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:57.356432 22547 consensus_meta.cc:287] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.686s	user 0.004s	sys 0.004s
I20260709 13:18:57.356822 22567 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:57.305121 22454 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:57.357421 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:57.095654 22546 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.358091 18344 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:18:57.261523 22554 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.358209 22546 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:57.360271 22554 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.361644 22546 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:56.916335 22592 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.356848 22547 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.079568 22551 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:57.363457 22551 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.363734 19057 raft_consensus.cc:1240] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:57.363826 22551 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.364220 22592 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:57.364949 22592 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:57.365679 22547 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:57.214617 22584 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.366426 22547 consensus_queue.cc:1059] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:57.362293 22554 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:57.366813 22584 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.367614 22554 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:57.368078 22554 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.369196 22584 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:57.349391 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:57.369966 22606 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.370434 18339 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:57.371482 19062 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:18:57.372192 22606 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:57.133597 22536 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:57.078063 22590 consensus_meta.cc:287] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.005s
W20260709 13:18:56.913205 22603 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:18:57.385986 18310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.010s	sys 0.031s
W20260709 13:18:57.423875 18310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.020s	sys 0.036s
I20260709 13:18:57.149897 22612 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.148643 22104 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:57.361536 22577 consensus_meta.cc:287] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.749s	user 0.012s	sys 0.000s
I20260709 13:18:57.426795 22591 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.445195 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:57.445302 22591 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.446148 18342 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:57.446815 22544 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:56.953960 22545 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.427024 18339 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:57.428617 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:57.430491 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:57.432354 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:57.300146 22498 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:57.434392 18336 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:56.950572 22611 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.350823 22534 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:57.451332 18343 raft_consensus.cc:2410] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:57.366421 22613 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:57.468343 19027 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.029s	sys 0.034s
I20260709 13:18:57.418702 22584 raft_consensus.cc:3055] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:57.456965 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:57.475400 18339 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.458074 18336 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: [10.11-11.12]
I20260709 13:18:57.348661 22175 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.461395 22591 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:57.459388 22545 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.450647 22577 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.487946 22545 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:18:57.473157 19027 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.029s	sys 0.034s
I20260709 13:18:57.386912 22554 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:57.474614 18492 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:57.476899 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:57.484746 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:57.487864 22175 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:57.440541 22348 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.488444 22577 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:57.472769 22387 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.012s	sys 0.027s
W20260709 13:18:57.466153 22599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.015s	sys 0.024s
I20260709 13:18:57.496181 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:57.482093 22593 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.024s	sys 0.042s
I20260709 13:18:57.495193 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:57.512843 19058 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:57.515488 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:57.440188 22536 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.475065 22584 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:57.518606 19053 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:57.496421 22387 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.013s	sys 0.027s
I20260709 13:18:57.518432 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:57.529549 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:18:57.496589 22599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.016s	sys 0.024s
I20260709 13:18:57.531981 18336 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:57.513696 22593 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.025s	sys 0.042s
I20260709 13:18:57.546291 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:57.546586 19059 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:57.451295 22104 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.561753 19056 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:57.468807 22498 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:57.449251 22612 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.581683 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:18:57.584121 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 280269us
I20260709 13:18:57.585314 22599 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:57.562954 22593 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:57.512269 22348 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.564972 22358 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.594969 18336 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:57.597810 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:57.598026 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:57.613181 18484 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:57.613453 18488 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:18:57.609433 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:18:57.613587 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.609937 19026 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:57.620610 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:57.618268 22592 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:57.618243 22627 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.634341 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:57.635077 18412 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:57.636472 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:57.637068 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:57.637291 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:57.647524 18410 raft_consensus.cc:2393] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:57.649940 18418 raft_consensus.cc:2410] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:18:57.650753 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:57.651329 18488 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:18:57.647294 22627 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.656525 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:57.657409 18336 raft_consensus.cc:2368] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:18:57.483016 22611 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.812125 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:57.812980 18491 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.614989 22534 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:57.817866 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:57.639715 22554 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.639070 22606 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.636188 22592 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.611799 22175 consensus_queue.cc:1059] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:18:57.610853 22599 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.868810 22534 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.898820 22599 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:57.902137 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:57.902926 18344 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.910310 22628 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:57.910691 22628 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:57.911489 22628 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.912688 22628 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:57.876442 22546 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.915328 22546 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.919080 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:57.919888 18488 raft_consensus.cc:2393] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:57.920696 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:57.921283 18488 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:57.921929 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:57.922305 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:57.922930 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:57.923455 18336 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:57.922343 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:57.939553 18339 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:18:57.941553 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:57.942096 18491 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:57.879971 22606 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.881038 22104 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:57.817162 22218 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:57.947059 22218 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:57.950366 18484 raft_consensus.cc:2393] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:57.951872 18343 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:57.952283 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:57.952996 19054 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:57.953817 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:57.954222 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:57.611001 22584 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.887147 18458 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:57.887755 22630 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.956773 18344 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:18:57.957176 22630 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:57.922298 22138 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:57.958242 22138 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.887930 22636 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.960109 22636 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.888271 22577 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.889266 22629 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.890728 22611 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:57.894078 22554 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.894698 22498 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:57.621328 22358 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.895818 22612 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:57.896296 22593 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:57.954340 19054 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:57.998756 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:57.881806 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:57.993054 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:18:57.887693 22551 consensus_meta.cc:287] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.523s	user 0.004s	sys 0.004s
W20260709 13:18:58.000232 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 113167us
I20260709 13:18:57.995100 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:57.999439 19054 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.003036 18336 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:18:58.003175 18486 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:58.003692 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:57.946269 22592 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:58.002228 18458 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:57.889282 22348 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.009675 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.012929 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:58.011649 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:57.901124 22534 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.010561 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:58.017583 18487 raft_consensus.cc:2393] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:18:58.011739 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:57.922724 22377 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:57.972157 22175 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:58.016302 18343 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:58.016302 18492 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:58.018239 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:57.994796 22591 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:18:58.011058 18457 connection.cc:256] RPC call timeout handler was delayed by -1.2974441439998827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 13:18:58.022481 18344 raft_consensus.cc:2368] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
W20260709 13:18:58.022332 18457 connection.cc:256] RPC call timeout handler was delayed by -1.2668441439998332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
I20260709 13:18:58.033438 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1028) took 1315 ms. Trace:
I20260709 13:18:58.033905 22554 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.034195 22591 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.036484 22591 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.033933 19062 rpcz_store.cc:276] 0709 13:18:56.718183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.718289 (+   106us) service_pool.cc:224] Handling call
0709 13:18:56.841853 (+123564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.371966 (+530113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.033150 (+661184us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54006c0a54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:58.033349 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217435008}
I20260709 13:18:58.038487 22636 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.038609 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:58.039417 19062 raft_consensus.cc:2368] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8.
I20260709 13:18:58.040143 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:58.040467 18344 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:58.040688 19062 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:18:58.043430 22606 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.005081 22629 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.009531 22498 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:18:58.060089 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 45698.3us
I20260709 13:18:58.064174 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.065471 18342 raft_consensus.cc:2410] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:18:58.010878 22630 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:58.067339 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:58.013103 22599 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.018666 22104 raft_consensus.cc:2764] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:18:58.010283 22218 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.019091 22607 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:57.997781 22577 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.018656 22632 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:58.086279 18342 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:58.009958 22551 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.093756 19054 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:58.096975 19054 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:58.122293 22546 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.123927 22642 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.124610 22642 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:58.073952 22630 consensus_queue.cc:1059] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:18:58.133453 22563 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.134450 22606 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:58.135103 22606 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.073491 22599 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.064368 22175 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.206902 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:58.205031 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:58.213330 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:58.072968 22498 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:18:58.235031 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 227023us
I20260709 13:18:58.236371 18308 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:58.237859 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:58.238651 18414 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:58.238698 19025 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:58.241842 18338 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: [8.9-9.10]
I20260709 13:18:58.147388 19062 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:58.137873 22606 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:58.205173 18342 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:18:58.198400 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 338970us
W20260709 13:18:58.264394 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.246483 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:58.249189 22546 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:58.146266 22536 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.203917 22563 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.145197 22627 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.204169 22387 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:58.149118 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:58.266194 18410 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:18:58.266121 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.261380 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:58.217549 22628 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.217795 22636 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:18:58.294684 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 227484us
I20260709 13:18:58.247342 22611 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.298666 22640 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.298795 22387 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.299000 18341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 879) took 2279 ms (client timeout 2091 ms). Trace:
I20260709 13:18:58.303125 19027 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:58.274892 22612 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:58.314035 18341 rpcz_store.cc:269] 0709 13:18:56.019853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.046612 (+ 26759us) service_pool.cc:224] Handling call
0709 13:18:58.298797 (+2252185us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b540007ec54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:58.298932 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1965028608}
I20260709 13:18:58.258882 22358 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:58.312734 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 289572us
I20260709 13:18:58.314934 19027 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:58.316965 18457 connection.cc:256] RPC call timeout handler was delayed by -1.1939441439999428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 13:18:58.317464 18457 connection.cc:256] RPC call timeout handler was delayed by -1.1265595779998421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
I20260709 13:18:58.276923 22175 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.147258 22632 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.320562 18384 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:58.293390 22546 raft_consensus.cc:697] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:58.332504 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 267386us
I20260709 13:18:58.312826 22606 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.313661 22536 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:58.336496 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 114170us
I20260709 13:18:58.316803 22612 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.329316 22607 raft_consensus.cc:697] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:58.340754 22612 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.342129 22365 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.344597 22546 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.345501 22138 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:58.348014 22138 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.348649 18344 raft_consensus.cc:1240] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:58.293645 22563 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.319700 22634 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:58.332085 22537 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:58.329355 22613 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:58.351806 22536 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:58.370981 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 63063.1us
I20260709 13:18:58.371920 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:58.312178 22628 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.314670 22611 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.326529 22636 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.353905 22433 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:58.317214 22640 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.318356 22387 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.386233 18384 leader_election.cc:400] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:18:58.341590 22607 consensus_queue.cc:237] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:58.378720 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:58.376406 22536 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.393425 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:58.351469 22606 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.380050 22634 raft_consensus.cc:697] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:58.397019 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:58.392774 22604 consensus_meta.cc:287] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.967s	user 0.012s	sys 0.001s
I20260709 13:18:58.386647 22630 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:58.388336 22651 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:18:58.435106 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 56481.3us
I20260709 13:18:58.432960 18457 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:58.424814 22635 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:58.396486 22599 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.387087 22642 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.426544 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:58.435662 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:58.391047 22652 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:58.399911 22537 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:58.447207 18487 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:58.448068 22648 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:58.449270 22606 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.428287 22632 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.375340 22498 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:58.451382 22625 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.905s	user 0.003s	sys 0.000s
I20260709 13:18:58.438051 22651 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:18:58.453105 22621 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.934s	user 0.000s	sys 0.001s
I20260709 13:18:58.488880 22563 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.488977 22387 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.425323 22577 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.489517 22661 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.455561 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.489742 22387 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:58.490484 18344 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:18:58.490171 22661 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.491719 22636 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:58.455561 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:58.453794 22433 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:58.503825 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:58.434973 22630 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.428857 22604 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.510983 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:58.432075 22633 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:18:58.469413 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.464166 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:18:58.512880 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 48784us
W20260709 13:18:58.513499 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.473479 18488 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:58.469177 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:58.515376 19062 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:18:58.438912 22551 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:58.476578 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 43683.8us
I20260709 13:18:58.516036 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:58.516327 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:58.516805 18488 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:18:58.440640 22152 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:58.470089 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.480098 18489 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:58.395911 22629 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.494640 18486 raft_consensus.cc:2410] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:58.459125 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:58.499938 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:58.504455 18414 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
W20260709 13:18:58.522801 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 67651.4us
I20260709 13:18:58.505244 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.505968 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.508813 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:58.523910 18416 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.523914 18340 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:18:58.454921 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:58.514714 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:58.515430 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:58.526724 18338 raft_consensus.cc:2410] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:18:58.480329 22655 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:58.520920 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:58.494128 22661 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.527338 18410 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.477344 22218 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:18:58.530572 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:58.532552 18416 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:58.532892 19054 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:18:58.533686 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:58.531165 18339 raft_consensus.cc:1240] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:58.534515 19054 raft_consensus.cc:2410] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:18:58.466162 22642 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:18:58.466578 22599 consensus_queue.cc:1059] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 13:18:58.530678 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 58802.1us
I20260709 13:18:58.541564 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:58.541786 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:58.542354 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:58.542634 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:58.443563 22635 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.543229 19062 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:18:58.537216 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:58.543465 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:58.543994 18488 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:58.539084 18492 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:58.545181 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:58.518251 22577 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:58.522818 22636 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:58.540380 18308 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:58.550311 18308 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:58.551282 18308 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:58.519086 22152 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:58.553092 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:58.553560 18418 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.552563 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:58.557797 18489 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:58.559501 18457 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:58.538019 22652 raft_consensus.cc:3055] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:58.562738 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:58.563858 19062 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:18:58.507117 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:18:58.566879 18382 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:58.567557 18412 raft_consensus.cc:606] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:58.548825 22365 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:58.470211 22634 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.548405 22651 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:58.554553 22138 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:58.558061 22568 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:58.560523 22104 raft_consensus.cc:3055] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:58.570358 18457 leader_election.cc:400] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11.
I20260709 13:18:58.557183 22152 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.557358 22358 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:58.554682 22218 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:58.554262 22636 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:58.605106 18457 leader_election.cc:400] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9.
I20260709 13:18:58.563490 22652 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:58.548552 22657 consensus_queue.cc:1059] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:18:58.569330 22599 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:58.569068 22628 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:58.606209 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1029) took 1887 ms. Trace:
I20260709 13:18:58.641093 18457 leader_election.cc:403] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:18:58.641321 18418 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:58.585908 22365 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.610713 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:58.649976 19062 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 5.
I20260709 13:18:58.603660 22104 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:18:58.616125 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 73838.7us
I20260709 13:18:58.579814 22635 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.558553 22577 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.649500 22365 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.662820 22104 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.664791 22104 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.678323 22652 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.680040 22652 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.687546 22564 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.688292 22564 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.690042 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:18:58.690789 18412 raft_consensus.cc:606] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:58.691110 18412 raft_consensus.cc:614] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:58.693905 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 88929.9us
I20260709 13:18:58.694960 18457 leader_election.cc:400] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10.
W20260709 13:18:58.642444 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 76175.3us
I20260709 13:18:58.647027 19060 rpcz_store.cc:276] 0709 13:18:56.718424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.719337 (+   913us) service_pool.cc:224] Handling call
0709 13:18:56.832852 (+113515us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:56.833310 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.833350 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:56.913666 (+ 80316us) log.cc:844] Serialized 52 byte log entry
0709 13:18:57.285559 (+371893us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:57.362382 (+ 76823us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.614697 (+252315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.614798 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.450761 (+835963us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:18:58.593873 (+143112us) raft_consensus.cc:1685] finished
0709 13:18:58.605995 (+ 12122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.606150 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141651,"prepare.queue_time_us":67041,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":35610,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":18924,"spinlock_wait_cycles":9464064,"thread_start_us":623436,"threads_started":2,"wal-append.queue_time_us":558053}
I20260709 13:18:58.610364 22640 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.594480 22568 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.655524 22667 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:58.606017 22612 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.652568 22664 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.642554 22636 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:58.709849 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 107929us
W20260709 13:18:58.710269 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 54924.7us
I20260709 13:18:58.712702 18308 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:58.693452 22635 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9.
I20260709 13:18:58.714690 18457 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:58.702343 22568 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:58.726195 22218 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:58.726282 22604 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.726806 22218 raft_consensus.cc:697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:58.727463 22667 raft_consensus.cc:697] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:58.728382 22667 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:58.727741 22218 consensus_queue.cc:237] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:58.736249 22646 log.cc:927] Time spent T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.419s	user 0.000s	sys 0.001s
W20260709 13:18:58.720712 22592 consensus_meta.cc:287] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.702s	user 0.007s	sys 0.006s
I20260709 13:18:58.738767 22592 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.739172 22630 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.740962 22592 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:58.732589 22599 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:58.742609 22536 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.708154 22666 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:18:58.744791 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.742990 22599 raft_consensus.cc:697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:58.745095 22612 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:58.751724 18413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:18:58.752720 22152 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:58.608803 22498 consensus_queue.cc:1175] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "20e06cff39b649c48d342b7431135303" responder_term: 9 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:58.758919 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 888) took 2120 ms. Trace:
I20260709 13:18:58.760852 18337 rpcz_store.cc:276] 0709 13:18:56.638800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.661037 (+ 22237us) service_pool.cc:224] Handling call
0709 13:18:58.758747 (+2097710us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540007eed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:58.758855 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597706496}
I20260709 13:18:58.760025 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 939) took 1163 ms. Trace:
I20260709 13:18:58.753023 22570 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.762269 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:58.762225 18490 rpcz_store.cc:276] 0709 13:18:57.596869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.596999 (+   130us) service_pool.cc:224] Handling call
0709 13:18:57.610291 (+ 13292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.897737 (+287446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.897769 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.897810 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:57.897840 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.759747 (+861907us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54003539d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:58.759802 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.759937 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660612480}
I20260709 13:18:58.763139 22152 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:58.766528 18410 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:58.767061 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.768392 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.769142 18336 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:58.769850 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.763797 22152 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:58.773387 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.775674 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.773445 18458 leader_election.cc:400] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8.
I20260709 13:18:58.776285 18458 leader_election.cc:403] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:18:58.776650 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.777390 18337 raft_consensus.cc:2410] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:58.775590 18342 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 4.
I20260709 13:18:58.777876 22152 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.778469 22152 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.778571 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.777488 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:58.779933 22598 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:58.750851 22599 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.780419 22598 raft_consensus.cc:697] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:58.781440 22598 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.783258 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.783506 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:58.783880 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:58.784361 18336 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:58.784444 18344 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:58.786896 22626 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.132s	user 0.002s	sys 0.000s
I20260709 13:18:58.788888 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 887) took 2150 ms. Trace:
I20260709 13:18:58.789325 18335 rpcz_store.cc:276] 0709 13:18:56.638098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.638253 (+   155us) service_pool.cc:224] Handling call
0709 13:18:56.667986 (+ 29733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.578598 (+910612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.578646 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.578705 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:57.578750 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.788644 (+1209894us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b5400416ed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:58.788705 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.788835 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093597568}
I20260709 13:18:58.796986 22546 raft_consensus.cc:3055] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:58.797441 22546 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:18:58.773087 22365 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.798362 22546 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:58.799340 22546 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.801600 18342 raft_consensus.cc:2393] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:58.801752 22152 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:18:58.803918 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.804334 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.804760 22152 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:58.805359 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:58.805495 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.809006 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:18:58.809787 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 98713.7us
I20260709 13:18:58.810468 18457 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:58.810963 18344 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:58.820152 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.821005 18344 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:18:58.830155 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.784205 22104 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8.
I20260709 13:18:58.830358 18413 raft_consensus.cc:606] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:58.831460 18458 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:58.819258 22679 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:58.816992 22630 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:58.909137 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 77755.4us
W20260709 13:18:58.915926 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.982299 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:58.983325 18344 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
W20260709 13:18:58.988124 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 177709us
I20260709 13:18:58.834189 22597 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:58.834403 22545 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.990846 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 285051us
I20260709 13:18:58.990971 18458 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:58.955694 22635 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:58.994588 18344 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:18:58.995563 18458 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:58.996456 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:58.952316 22630 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.834038 22679 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.986902 22550 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:58.981971 22152 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:59.006603 18457 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:58.993295 22536 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:59.007736 22562 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:59.008490 22666 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:59.009114 22655 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:59.011845 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:59.012056 22664 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:59.013288 19026 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:18:59.076006 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 62829.7us
I20260709 13:18:59.014109 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:59.077033 18485 raft_consensus.cc:2368] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9.
I20260709 13:18:59.014915 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:59.078114 18490 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:18:59.020470 22365 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.015436 22564 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:59.016347 22661 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:59.017115 22630 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:58.990051 22632 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:59.018219 22597 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:59.018821 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1016) took 2175 ms. Trace:
I20260709 13:18:59.007018 22677 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:59.057121 22152 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.096028 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.096858 18419 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:59.062784 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 56241.8us
I20260709 13:18:59.063952 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:59.004938 22682 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:18:58.994524 22545 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.065879 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.105331 18416 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.067322 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.068122 22675 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:18:59.072767 18491 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:58.997421 22635 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:59.082322 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:59.107646 18411 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.108065 19058 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.083290 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:59.015733 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 890) took 1522 ms. Trace:
I20260709 13:18:59.084616 19062 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:59.085634 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:59.086706 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:59.111409 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:59.112056 19059 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:59.089300 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.022783 22679 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.097764 18410 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:18:59.114095 18418 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:59.089224 22661 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.099220 18457 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:59.110695 18339 rpcz_store.cc:276] 0709 13:18:57.493157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.038892 (+545735us) service_pool.cc:224] Handling call
0709 13:18:58.039133 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.534408 (+495275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.015501 (+481093us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540003b1d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:59.015677 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130972544}
I20260709 13:18:59.112066 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:59.093859 19061 rpcz_store.cc:276] 0709 13:18:56.843838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.859889 (+ 16051us) service_pool.cc:224] Handling call
0709 13:18:57.285899 (+426010us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.889700 (+603801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.889733 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.890223 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.211624 (+321401us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:58.369021 (+157397us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.369309 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.018417 (+649108us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400580a54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:59.018464 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.018509 (+    45us) raft_consensus.cc:1685] finished
0709 13:18:59.018597 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.018730 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":996,"prepare.queue_time_us":216789,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":1166,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":8987,"spinlock_wait_cycles":1387663744,"thread_start_us":414904,"threads_started":2,"wal-append.queue_time_us":436911}
I20260709 13:18:59.111443 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:59.115520 19054 raft_consensus.cc:2410] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:18:59.115644 19060 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.079314 22655 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:59.093200 22536 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:59.116724 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:59.119915 22547 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:59.120299 22547 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:59.120703 22547 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.092289 22597 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:59.063330 22550 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.102695 22152 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.109540 22635 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.136806 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:59.149560 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:59.150338 19054 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:59.137497 19026 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:18:59.159368 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:59.160140 19061 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.117445 22661 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.096065 22632 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:59.162214 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:59.162278 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:59.131182 22655 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.138149 22597 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:59.167171 19059 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
W20260709 13:18:59.166496 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 170108us
I20260709 13:18:59.169188 19058 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:59.103549 22677 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:59.156975 22555 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:59.136745 22536 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:18:59.181499 18419 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:18:59.182561 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:59.200264 19054 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:59.181051 22555 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.201769 19054 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.194410 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:59.180415 18411 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:59.199208 22470 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:59.187467 22632 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:59.239539 22555 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:59.199069 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 487223us
I20260709 13:18:59.197162 18416 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:18:59.260242 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:59.198364 19060 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:18:59.185142 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:59.198998 19061 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:18:59.268185 18384 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:59.255957 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 156833us
I20260709 13:18:59.267823 19059 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:18:59.270135 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:59.183406 22677 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:59.255173 22377 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:18:59.261540 22470 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:18:59.310690 18457 connection.cc:256] RPC call timeout handler was delayed by -1.2106309529999635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 13:18:59.297901 22666 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:59.296660 22564 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:59.268858 22657 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.270037 22684 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:59.302438 22677 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:18:59.319905 18457 leader_election.cc:336] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.799s (SENT)
I20260709 13:18:59.300669 22664 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:59.315280 18491 raft_consensus.cc:2955] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 3 to 5, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:59.328646 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.332199 18411 raft_consensus.cc:2376] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10. Re-sending same reply.
I20260709 13:18:59.329401 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:18:59.322705 22636 consensus_meta.cc:287] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.004s
I20260709 13:18:59.320515 22634 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.336081 18411 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:59.321553 22545 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:59.336483 18457 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:59.313580 22671 consensus_queue.cc:1059] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:18:59.302044 22562 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:18:59.300450 22536 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.324635 22684 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:59.307489 22667 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:18:59.342558 18308 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:59.326242 22570 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.315178 22377 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.336962 22636 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.333367 22550 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:59.355244 22688 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:59.356591 22470 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.333344 22690 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.357270 22152 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.376192 19057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1026) took 2658 ms. Trace:
W20260709 13:18:59.386960 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 45050.5us
I20260709 13:18:59.395012 19057 rpcz_store.cc:276] 0709 13:18:56.717653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.719260 (+  1607us) service_pool.cc:224] Handling call
0709 13:18:56.805591 (+ 86331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.364194 (+558603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.375900 (+2011706us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b540059ea54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:59.376119 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1283097984}
I20260709 13:18:59.376729 22564 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:59.396441 22564 raft_consensus.cc:697] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:18:59.394286 22687 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:18:59.394111 22555 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.397274 22152 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.401659 22555 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:59.324637 22657 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:59.404389 22657 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:59.405122 22547 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.377893 22685 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:59.406594 19054 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:59.406929 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 87052.6us
W20260709 13:18:59.407548 18457 leader_election.cc:336] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.915s (SENT)
I20260709 13:18:59.407915 18457 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:59.407970 22547 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:59.408917 18457 leader_election.cc:336] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 2.159s (SENT)
I20260709 13:18:59.397593 22564 consensus_queue.cc:237] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:59.410430 22696 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:59.409314 18457 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:59.333940 22677 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:59.411864 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.371500 22684 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:59.377562 22599 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:59.432816 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:59.433207 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:59.439957 18485 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:18:59.440507 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:59.440730 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:59.441612 18485 raft_consensus.cc:2393] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:18:59.434597 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:59.443290 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:59.435504 18384 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:59.341180 22634 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.446471 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:59.445447 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:59.454870 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:59.431458 22657 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:59.462766 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:59.463419 18485 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.457993 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:18:59.459621 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:18:59.378132 22570 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:18:59.461160 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 372012us
I20260709 13:18:59.465328 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:59.465754 22570 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:59.466038 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:18:59.466991 22636 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:18:59.467051 22546 consensus_meta.cc:287] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.667s	user 0.007s	sys 0.004s
I20260709 13:18:59.415634 22683 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:18:59.482113 22652 consensus_meta.cc:287] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.802s	user 0.004s	sys 0.008s
W20260709 13:18:59.455015 22568 consensus_meta.cc:287] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.000s
I20260709 13:18:59.443112 22562 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:59.416069 22690 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:59.482748 22568 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.482831 22562 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:59.484866 22568 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.486263 18342 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:59.485790 18414 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:18:59.486966 18414 pending_rounds.cc:85] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 11
I20260709 13:18:59.487181 18414 pending_rounds.cc:107] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:18:59.487401 18414 raft_consensus.cc:2889] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:59.466101 18343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 2102) took 1651 ms (client timeout 2042 ms). Trace:
I20260709 13:18:59.481827 22700 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:18:59.484526 22562 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.441627 22696 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:59.468349 22377 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.479620 19057 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:59.494796 18343 rpcz_store.cc:269] 0709 13:18:57.814814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.953986 (+139172us) service_pool.cc:224] Handling call
0709 13:18:59.465889 (+1511903us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b5400235ad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:18:59.466013 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141023104}
I20260709 13:18:59.459591 22547 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.442685 22664 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:18:59.505535 22334 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:59.511204 22652 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:59.514614 22683 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:59.532435 22630 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.533437 22611 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:59.534126 18487 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:18:59.442196 22699 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:18:59.570904 22655 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.573457 22655 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.529533 22547 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.576294 22562 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.657755 22547 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:59.664536 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:59.665578 19061 raft_consensus.cc:2393] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 6: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:59.667308 18309 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:59.522934 22696 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.674763 18309 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:18:59.675127 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 217258us
I20260709 13:18:59.613826 22666 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:59.691186 18384 leader_election.cc:400] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:18:59.691596 18384 leader_election.cc:403] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:59.692233 22666 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:18:59.698630 22690 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:59.700629 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:59.700841 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:59.703356 18309 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:59.705737 18384 leader_election.cc:400] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:18:59.706079 18384 leader_election.cc:403] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:59.706686 18485 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:18:59.706501 18309 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:18:59.708482 19059 raft_consensus.cc:2393] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:18:59.707864 22704 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:18:59.700827 22568 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:59.719336 18309 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:18:59.705410 22550 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:59.710688 22666 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:18:59.716846 22679 consensus_meta.cc:287] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
I20260709 13:18:59.706511 22690 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:59.713158 22699 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
W20260709 13:18:59.730786 22705 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:18:59.732066 22696 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.733361 22677 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:59.729622 22377 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:59.734201 22377 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:59.734478 22708 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:18:59.734603 22377 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:59.726735 22664 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:18:59.742507 22634 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:18:59.744122 22691 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:59.744570 22691 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.744874 22691 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:59.748104 22597 consensus_meta.cc:287] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.000s
I20260709 13:18:59.748822 22597 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.715162 22563 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:18:59.752014 22334 raft_consensus.cc:993] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:18:59.752712 22334 raft_consensus.cc:1081] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:18:59.754948 22630 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:18:59.765974 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 46840.6us
I20260709 13:18:59.724996 22550 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:59.768586 22550 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:59.768937 19057 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:59.727370 22679 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.770387 22707 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:18:59.770848 22635 consensus_meta.cc:287] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.000s
I20260709 13:18:59.771291 22635 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.770381 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:59.772409 19059 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:59.773128 18489 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:59.774036 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 46397.6us
I20260709 13:18:59.760001 22666 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:59.774930 22550 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:18:59.775538 22550 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.775758 22666 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.779353 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:59.780009 18343 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:18:59.782903 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.790310 18343 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:59.727908 22706 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:59.790781 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:18:59.773706 22635 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.794612 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.796684 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.797338 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.798569 18416 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:18:59.798859 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.799258 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.777771 22550 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.799497 18417 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:18:59.800853 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.803854 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.800971 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.803797 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.805647 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.806432 18417 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:18:59.806622 18410 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:18:59.807929 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.809118 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.810446 18457 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:18:59.807103 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.812798 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1025) took 3095 ms. Trace:
I20260709 13:18:59.814424 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.815244 18416 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.759850 22684 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.811997 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:59.813153 19055 rpcz_store.cc:276] 0709 13:18:56.717349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.719467 (+  2118us) service_pool.cc:224] Handling call
0709 13:18:59.415446 (+2695979us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:18:59.415670 (+   224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.416109 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.416150 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.421847 (+  5697us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.674375 (+252528us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:59.812144 (+137769us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.812460 (+   316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.812525 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.812563 (+    38us) raft_consensus.cc:1685] finished
0709 13:18:59.812629 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.812742 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1853,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":8273,"spinlock_wait_cycles":9422592,"thread_start_us":333663,"threads_started":2,"wal-append.queue_time_us":273736}
W20260709 13:18:59.802769 22661 consensus_meta.cc:287] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.001s
I20260709 13:18:59.808650 18344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37920
I20260709 13:18:59.831511 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.832223 22661 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.832782 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.834278 22661 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.834792 22679 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.834915 22684 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.833609 18414 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:18:59.837342 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.818938 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.819567 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.841141 18344 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:59.819763 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:59.821475 18457 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:59.829888 18419 raft_consensus.cc:2410] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:18:59.816752 22635 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:59.841522 18344 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.849007 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:59.850015 18336 raft_consensus.cc:2393] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:18:59.851187 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:59.851816 19055 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.855579 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.857229 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.854331 22635 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:18:59.835003 22670 raft_consensus.cc:3055] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:59.859411 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.856312 18308 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:18:59.868544 18418 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.859184 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.870632 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.871459 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2524) took 1440 ms. Trace:
I20260709 13:18:59.871902 18492 rpcz_store.cc:276] 0709 13:18:58.430827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.432094 (+  1267us) service_pool.cc:224] Handling call
0709 13:18:58.432380 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.545425 (+113045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.871269 (+1325844us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400374bd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:18:59.871412 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244749696}
I20260709 13:18:59.873760 18336 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:59.876283 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.876626 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.865933 18344 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:18:59.881409 19055 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:59.882081 18335 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.856514 22684 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:59.859401 22709 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:18:59.886070 18416 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:18:59.905689 22377 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.910249 18339 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:59.885740 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.904304 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.910913 18457 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:59.858709 22690 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.906673 18344 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:18:59.858877 22661 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:59.916501 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.876258 22591 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:59.857908 22564 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:18:59.922168 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.915449 18418 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:18:59.916399 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:18:59.919380 18410 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:59.859370 22635 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:59.905694 22684 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.924561 18457 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:18:59.928025 18418 raft_consensus.cc:3055] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:59.925209 18417 raft_consensus.cc:2368] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10.
I20260709 13:18:59.874167 22670 raft_consensus.cc:740] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:59.927764 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:18:59.928447 18418 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:18:59.928710 19055 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:59.913004 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:18:59.917332 22630 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:59.931051 18410 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:59.916616 22679 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.934505 18457 leader_election.cc:400] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10.
I20260709 13:18:59.918140 22661 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.885092 22562 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:18:59.919020 22597 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.921093 22591 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:18:59.929220 18418 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.939764 22711 consensus_queue.cc:1059] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:18:59.930334 22684 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:59.932083 22657 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:59.944145 22657 raft_consensus.cc:697] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:59.945011 22657 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.929973 22377 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.943526 19055 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:18:59.938386 22661 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:59.949599 18418 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.942534 22591 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.938174 22679 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.929023 22690 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.941479 22630 raft_consensus.cc:697] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:18:59.956658 22577 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.934046 22632 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:18:59.959851 18418 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:18:59.963487 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:59.971479 18336 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:59.965080 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:18:59.974685 18337 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:18:59.965641 18226 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b345033a56994fff90990b7d03324074 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d6cd7c600ec4ab2b5cac479f05d4c0f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:18:59.966259 22584 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:59.981393 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.988011 22690 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.988713 18336 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:59.989596 19053 raft_consensus.cc:2410] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:18:59.990346 22606 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.990803 22606 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.989704 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:18:59.991923 19057 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:18:59.993994 22632 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:59.995589 22679 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:18:59.996521 22630 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:18:59.997519 18410 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:00.001209 18336 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.003002 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:00.003651 18337 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:18:59.999146 22632 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:18:59.985776 22691 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:00.061900 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:00.062539 19054 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:00.065243 19053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 1027) took 2549 ms (client timeout 3048 ms). Trace:
I20260709 13:19:00.066323 22607 raft_consensus.cc:3055] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:00.066757 22607 raft_consensus.cc:740] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:00.081789 18336 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:00.077566 19054 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
W20260709 13:19:00.088119 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.065825 19053 rpcz_store.cc:269] 0709 13:18:57.515536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.586660 (+ 71124us) service_pool.cc:224] Handling call
0709 13:19:00.064983 (+2478323us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b5400643a54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:00.065165 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5462872832}
I20260709 13:18:59.963330 22670 consensus_queue.cc:260] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:00.292588 22722 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
I20260709 13:19:00.072961 22691 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:00.310034 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:00.312505 22679 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:00.313264 22679 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:00.316906 22679 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:00.283227 22498 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.281244 22377 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:00.325862 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:00.330864 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:00.306490 18337 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:19:00.333760 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.339164 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:00.088485 22591 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:00.340078 18337 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:00.344718 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:00.394946 18340 raft_consensus.cc:1240] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:00.406365 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2183) took 1891 ms. Trace:
I20260709 13:19:00.406791 18493 rpcz_store.cc:276] 0709 13:18:58.514505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.514633 (+   128us) service_pool.cc:224] Handling call
0709 13:18:58.514906 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.563094 (+ 48188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.563125 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.563171 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:58.563216 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.406120 (+1842904us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b5400258854. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:00.406172 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.406306 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110380800}
W20260709 13:19:00.407529 19025 connection.cc:256] RPC call timeout handler was delayed by -1.2176637249999658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260709 13:19:00.331758 22567 raft_consensus.cc:3055] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:00.410056 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 2233) took 1078 ms. Trace:
I20260709 13:19:00.410460 18419 rpcz_store.cc:276] 0709 13:18:59.328986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.329123 (+   137us) service_pool.cc:224] Handling call
0709 13:19:00.407129 (+1078006us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54003ecbd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:00.407254 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141797760}
I20260709 13:19:00.425954 18335 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:19:00.340801 22498 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:00.439774 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:00.342626 22377 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:00.411194 22567 raft_consensus.cc:740] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:00.459190 18230 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.524s	user 0.015s	sys 0.012s
I20260709 13:19:00.407318 22661 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:00.346278 22607 consensus_queue.cc:260] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:00.489688 22607 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.548136 22567 consensus_queue.cc:260] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:00.551280 22498 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:00.631686 22684 consensus_meta.cc:287] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.681s	user 0.004s	sys 0.004s
I20260709 13:19:00.632189 22684 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:00.632835 22377 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:00.633438 22635 consensus_meta.cc:287] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.003s
I20260709 13:19:00.638118 22635 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:00.644428 22635 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:00.633658 22567 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:00.650287 22726 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:19:00.654098 22661 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:00.658620 22684 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:00.755537 22648 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:19:00.788331 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 961) took 1346 ms. Trace:
I20260709 13:19:00.788733 18489 rpcz_store.cc:276] 0709 13:18:59.442389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.477282 (+ 34893us) service_pool.cc:224] Handling call
0709 13:18:59.477643 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.773526 (+295883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.788090 (+1014564us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54001b7454. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:00.788270 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679129856}
I20260709 13:19:00.793037 22591 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:00.836735 22670 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:00.878973 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.879892 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.918433 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 848) took 1853 ms. Trace:
I20260709 13:19:00.918901 18415 rpcz_store.cc:276] 0709 13:18:59.065139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.065250 (+   111us) service_pool.cc:224] Handling call
0709 13:18:59.066415 (+  1165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.416166 (+349751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.416198 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.416239 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:59.416267 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.918120 (+1501853us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540010ac54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:00.918188 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.918341 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803934080}
I20260709 13:19:00.926927 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37140 (request call id 28) took 2191 ms. Trace:
I20260709 13:19:00.926049 18230 maintenance_manager.cc:643] P ea3145ed28eb426e9222df0873a0b8d5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.386s	user 0.187s	sys 0.088s Metrics: {"bytes_written":30185,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":277922,"dirs.run_cpu_time_us":433,"dirs.run_wall_time_us":12065,"drs_written":1,"lbm_read_time_us":46688,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":2,"lbm_write_time_us":364986,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":9,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":220253,"threads_started":2,"update_count":12,"wal-append.queue_time_us":491107}
I20260709 13:19:00.930307 18231 maintenance_manager.cc:419] P ea3145ed28eb426e9222df0873a0b8d5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11151 bytes on disk
I20260709 13:19:00.932560 18230 maintenance_manager.cc:643] P ea3145ed28eb426e9222df0873a0b8d5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":316,"lbm_reads_lt_1ms":4}
I20260709 13:19:00.936038 18413 rpcz_store.cc:276] 0709 13:18:58.735267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.736823 (+  1556us) service_pool.cc:224] Handling call
0709 13:19:00.926719 (+2189896us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b54001c5cd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eed6853 00007f40a3ea460a 00007f409d42a7d4 00007f409d42a762 00007f409d42a691 00007f409d42a60c 00007f409d4298c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:00.926827 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179028864}
W20260709 13:19:00.939622 18382 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.212s (SENT) [suppressed 16 similar messages]
I20260709 13:19:00.942399 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:00.944949 19026 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:00.945966 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:00.950553 22612 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:00.952373 19025 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.009s	sys 0.025s
W20260709 13:19:00.952742 19025 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.010s	sys 0.025s
W20260709 13:19:00.953003 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 542884us
W20260709 13:19:00.953419 19025 connection.cc:256] RPC call timeout handler was delayed by -1.0484637249999196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
I20260709 13:19:00.956339 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:00.957247 18340 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:00.960526 19026 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:19:00.961107 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.962141 22672 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:00.962675 22672 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:00.964550 22672 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:00.960522 22733 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:00.980288 22737 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.980793 22733 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:00.982000 22733 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:00.985526 22737 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:00.988780 22737 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:00.993431 22737 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:00.994217 22737 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:00.986264 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 914) took 1923 ms. Trace:
I20260709 13:19:01.022871 18342 rpcz_store.cc:276] 0709 13:18:59.062761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.093173 (+ 30412us) service_pool.cc:224] Handling call
0709 13:19:00.986060 (+1892887us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540007eed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:00.986203 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552198016}
I20260709 13:19:00.991489 22562 raft_consensus.cc:3055] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:01.062991 22562 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:01.065851 22562 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:01.018704 22651 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.067342 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:01.067703 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:01.067938 18418 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:01.068260 18418 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:01.068425 18335 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:19:01.069506 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 60941.1us
W20260709 13:19:01.070920 18384 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.018s	sys 0.000s
I20260709 13:19:01.070889 22104 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:01.071355 18384 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.018s	sys 0.000s
W20260709 13:19:01.071645 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 973860us
I20260709 13:19:01.071493 22104 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:01.073789 22104 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:01.019968 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.043566 22737 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.076016 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:01.076745 18335 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:01.053624 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2366) took 1261 ms. Trace:
I20260709 13:19:01.078624 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:01.078398 18418 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:01.077679 18341 rpcz_store.cc:276] 0709 13:18:59.792090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.793468 (+  1378us) service_pool.cc:224] Handling call
0709 13:18:59.809291 (+ 15823us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:59.816218 (+  6927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.816252 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:59.820217 (+  3965us) log.cc:844] Serialized 52 byte log entry
0709 13:19:00.995818 (+1175601us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b1800484ba0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:19:01.027825 (+ 32007us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:01.027872 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.027973 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.053308 (+ 25335us) raft_consensus.cc:1685] finished
0709 13:19:01.053329 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.053558 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2936,"raft.queue_time_us":8247,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":6398,"spinlock_wait_cycles":23769472,"thread_start_us":31772,"threads_started":1,"wal-append.queue_time_us":1230365}
W20260709 13:19:01.015230 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 54793.4us
I20260709 13:19:01.079445 18418 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:01.081269 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:01.085189 22498 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:01.085703 22498 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.086009 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:01.086521 18412 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:01.087778 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:01.088613 18417 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:01.087821 22498 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:01.090238 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:01.090797 18415 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.091302 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:01.092190 19027 connection.cc:256] RPC call timeout handler was delayed by -1.9160620029999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2861s for a response
I20260709 13:19:01.094213 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:01.094383 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:01.094821 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:01.095081 18417 raft_consensus.cc:2410] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:01.095409 19058 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:01.098397 22736 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.099088 22642 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.098875 22736 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.099562 22642 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.101507 22642 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:01.101518 22736 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:01.102345 22736 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:01.102837 22736 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.103893 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:01.104596 19062 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:19:01.104784 22736 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:01.105403 22736 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.106503 19062 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:19:01.109088 18491 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:01.109527 22640 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.110288 18489 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:01.110419 22640 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:01.111442 18492 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:01.095010 18413 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.112447 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.112795 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:01.113204 18485 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:01.113425 18342 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:01.104811 22358 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.114349 22358 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:01.116464 22358 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:01.116935 22358 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.117336 22358 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.112416 22640 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:01.118613 18339 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:01.122160 18415 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:01.123171 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:01.126075 19058 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:01.126096 18336 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:01.127208 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:01.128049 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 46869.7us
I20260709 13:19:01.128804 18309 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.129616 18344 raft_consensus.cc:1275] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:01.129734 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:01.131101 18413 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:01.124250 18342 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:01.125011 18412 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:01.132231 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:01.134068 18485 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:19:01.134327 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.123570 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 103662us
I20260709 13:19:01.135799 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:01.135887 19025 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:01.125479 22642 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.137132 22642 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.137936 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:01.138195 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:01.138949 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:01.139357 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:01.141460 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:01.147697 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:01.210914 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:01.211584 19058 raft_consensus.cc:2393] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:01.135918 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:01.212508 18485 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.212699 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:01.213405 18491 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.212173 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.165545 22377 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.274730 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.275055 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.275578 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.275897 18493 raft_consensus.cc:2410] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:01.198632 18412 raft_consensus.cc:2410] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 13 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:19:01.167021 18417 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:01.278796 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:01.279057 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:01.279392 18416 raft_consensus.cc:2376] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10. Re-sending same reply.
I20260709 13:19:01.279582 18336 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:01.140681 19055 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:19:01.199249 19056 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:01.199764 19061 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:01.273499 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:01.212287 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:01.282433 18492 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.282743 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:01.283535 19057 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:01.199904 19062 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:01.284765 18487 raft_consensus.cc:2410] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:01.285450 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.287034 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:01.198943 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.200310 18414 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
W20260709 13:19:01.288244 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.203787 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 75070.4us
I20260709 13:19:01.207785 18418 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:19:01.151360 18335 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:01.290179 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:01.290771 19057 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.292906 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:01.296664 19061 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:01.212235 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:01.273705 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:01.274437 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.275869 18382 leader_election.cc:336] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.181s (SENT)
I20260709 13:19:01.300222 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:01.300817 19062 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.299060 18382 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:01.200147 18486 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:01.304031 18485 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:19:01.306345 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:01.307036 19061 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:01.307464 18485 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:01.307910 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:01.308260 19061 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:01.308975 19058 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:01.306165 22737 raft_consensus.cc:2764] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:01.310737 22737 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:01.311172 22737 raft_consensus.cc:697] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:01.299831 18309 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:01.316130 18309 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.316495 19056 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:19:01.319178 19058 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:01.322870 18492 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:01.321197 18309 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:01.212841 22604 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:01.316502 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.324538 18485 raft_consensus.cc:2410] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:01.326246 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.326330 18491 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:01.326957 18486 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:19:01.327780 19056 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:19:01.311988 22737 consensus_queue.cc:237] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.328213 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.289870 22387 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.328792 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:01.307251 22562 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.331694 18486 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:19:01.328435 19056 pending_rounds.cc:85] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 9
I20260709 13:19:01.337529 19056 pending_rounds.cc:107] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:19:01.337868 19056 raft_consensus.cc:2889] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:01.333391 19062 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 6.
I20260709 13:19:01.335058 19055 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:01.323277 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:01.341614 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:01.342285 19056 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:01.343120 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:01.343798 19056 raft_consensus.cc:2368] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12.
I20260709 13:19:01.343866 22612 raft_consensus.cc:697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:01.344636 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:01.344951 22612 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.345927 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:01.346544 19056 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:01.347369 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:01.347572 19058 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:01.347972 19056 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:01.347740 22348 consensus_queue.cc:1059] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:01.348572 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:01.348826 22348 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:01.345417 19027 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:01.350525 22348 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:01.351142 22348 raft_consensus.cc:3055] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:01.351454 22348 raft_consensus.cc:740] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:01.352250 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:01.353396 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:01.354478 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:01.354808 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:01.355931 19058 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:01.358731 19062 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:01.289943 22377 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:01.382691 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:01.408612 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.386015 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:01.410257 18485 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:01.299649 22735 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:19:01.415220 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:01.415822 18338 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.416194 22606 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:01.417471 22358 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:01.418049 22358 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:01.419296 22377 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:01.419803 22377 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:01.420244 22377 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.421221 22733 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:01.423099 22640 consensus_queue.cc:1059] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:01.425226 22640 consensus_queue.cc:1059] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:01.426126 22671 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.426651 22671 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.365281 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:01.432003 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 66793.9us
I20260709 13:19:01.432868 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.380884 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:01.359359 18410 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:01.383185 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:01.435974 18491 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:01.408851 18337 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:01.360707 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:01.358508 18416 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:01.357075 19058 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:01.370916 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:01.442399 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.451359 18492 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:01.451970 18485 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:01.462752 18486 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:19:01.388144 22742 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:19:01.336697 22706 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:01.464372 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.470877 18416 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:01.340065 22604 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:01.476969 18415 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:01.484774 18491 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:19:01.486953 18338 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:01.487550 22706 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:01.487811 22746 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:01.487752 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 54958.9us
I20260709 13:19:01.502952 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:01.503916 18415 raft_consensus.cc:2410] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:01.339130 22387 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:01.488687 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 167573us
W20260709 13:19:01.489799 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 353698us
W20260709 13:19:01.486989 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 141616us
I20260709 13:19:01.517154 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:01.517666 19027 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:01.496286 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:01.521159 19060 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:01.486179 22640 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:01.523057 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:01.526281 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.496759 22358 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:01.496356 22671 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:01.527194 18491 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:19:01.527987 22640 raft_consensus.cc:697] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:01.353077 22348 consensus_queue.cc:260] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.529251 22387 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:01.497038 22604 raft_consensus.cc:697] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:01.539328 19057 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:01.541138 19056 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
W20260709 13:19:01.562155 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 349903us
I20260709 13:19:01.519836 22746 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:01.567579 18491 raft_consensus.cc:1240] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:01.570070 22365 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:01.572207 22348 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.562768 22671 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.585647 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:19:01.585938 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 68355.5us
I20260709 13:19:01.586284 18416 raft_consensus.cc:2376] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8. Re-sending same reply.
I20260709 13:19:01.579257 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:01.586858 19027 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:01.587503 18410 raft_consensus.cc:2410] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 13 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
W20260709 13:19:01.581393 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 64406.9us
I20260709 13:19:01.588510 19025 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:01.588855 19027 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:01.590320 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.591117 18491 raft_consensus.cc:2410] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:01.574432 22604 consensus_queue.cc:237] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.597738 22735 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:01.601740 22735 raft_consensus.cc:2764] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:01.577777 19026 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:01.567248 22387 raft_consensus.cc:3055] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:01.602841 22387 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:01.603932 22387 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.604598 22606 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:01.506598 22377 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:01.589309 22733 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:01.589751 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:01.606418 22733 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:01.606819 22733 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.607874 22735 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:01.608505 22735 consensus_queue.cc:1059] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:01.609608 22751 raft_consensus.cc:3055] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:01.589854 22365 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.610013 22751 raft_consensus.cc:740] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:01.610452 22365 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.610867 22751 consensus_queue.cc:260] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.612203 19025 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.612596 22365 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:01.612937 22734 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:01.613466 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.613309 19025 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:01.614317 22734 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:01.614444 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:01.614813 22734 raft_consensus.cc:697] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:01.615643 22734 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.616976 22733 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.618270 22606 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:01.618105 22640 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.618907 22606 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:01.605619 22387 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:01.620242 22606 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.622385 19027 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:01.641253 22749 raft_consensus.cc:2764] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:01.642256 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.642582 22746 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:01.643465 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.644614 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:01.645110 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 352296us
I20260709 13:19:01.621630 22671 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:01.647966 22671 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:01.649210 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:01.649524 19027 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:01.589414 22752 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:01.654064 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.657931 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.657833 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:01.633279 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.658975 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.648478 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:01.621289 22736 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:01.661880 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:01.664904 18344 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:01.665470 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:01.621408 22743 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:01.671873 18413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:01.672618 18413 raft_consensus.cc:606] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.675776 19061 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:01.634315 22745 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:01.660701 22612 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:01.661494 22104 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:01.577019 22706 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.679597 22736 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.679718 22752 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:01.681524 22747 raft_consensus.cc:3055] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:01.686245 22612 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.705404 22612 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:01.686156 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 163153us
I20260709 13:19:01.710997 18309 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:01.718782 22604 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:01.719722 22604 raft_consensus.cc:697] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:01.720913 22604 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.724757 22753 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:01.725229 22753 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:01.726393 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.727991 22104 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:01.728468 22104 raft_consensus.cc:697] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:01.690310 22743 raft_consensus.cc:697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:01.689852 22671 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:19:01.729722 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 453838us
I20260709 13:19:01.734650 22104 consensus_queue.cc:237] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:01.733148 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 54034.3us
I20260709 13:19:01.737728 18309 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:01.740610 22691 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:01.741185 22691 raft_consensus.cc:697] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:01.742084 22691 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.726298 22736 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.737980 22348 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:19:01.746107 22348 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:01.746459 22348 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:01.716733 22612 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.727003 22747 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:01.732760 22753 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:01.749724 18341 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:01.754266 22672 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:01.760582 22612 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:01.763118 22743 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.764707 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:01.765333 19056 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:19:01.767416 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:01.768002 19056 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:01.768412 22733 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:01.773243 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 159995us
I20260709 13:19:01.776868 18308 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:01.777954 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.810127 18309 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:01.811542 18419 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:01.817049 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:01.818405 19025 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:01.819597 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.822106 22752 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:01.822820 22752 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:01.823484 22752 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:01.821583 19025 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.825963 22612 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:01.827647 19025 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:01.828946 22612 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:01.738888 22671 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.816315 22377 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.836954 22138 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:01.843391 22138 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.843026 22377 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.843775 22138 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:01.848870 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.855216 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.855726 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.856173 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.853519 22138 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.775980 22757 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:01.860121 19061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:53696
W20260709 13:19:01.882618 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 144871us
W20260709 13:19:01.863776 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.915627 18384 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.845722 22377 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:01.896224 19061 raft_consensus.cc:606] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.917713 19061 raft_consensus.cc:614] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:01.893390 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 228004us
I20260709 13:19:01.861985 19025 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.918599 18384 leader_election.cc:400] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12.
I20260709 13:19:01.919018 18384 leader_election.cc:403] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:19:01.909775 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 99876.3us
W20260709 13:19:01.916525 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 166837us
I20260709 13:19:01.858872 22604 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:01.921336 18458 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:01.930984 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:01.861394 22635 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:01.864773 22454 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.860865 22612 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:01.944536 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:01.919986 18309 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:01.809518 22348 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:01.917279 22684 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:01.961642 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 144243us
I20260709 13:19:01.951254 22138 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:01.970163 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 53670.9us
I20260709 13:19:01.941576 22377 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.931854 22691 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:01.941666 22604 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.981542 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:01.984782 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 122855us
I20260709 13:19:01.981935 18308 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:01.997748 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:01.998844 19061 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:01.958964 22684 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:01.958544 22743 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:01.946236 22707 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12.
I20260709 13:19:02.078814 19059 raft_consensus.cc:1240] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:01.996673 18308 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:01.992054 22358 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
W20260709 13:19:02.082082 22774 log.cc:927] Time spent T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:19:02.008940 19083 debug-util.cc:398] Leaking SignalData structure 0x7b08002e33a0 after lost signal to thread 17231
I20260709 13:19:02.081976 22612 consensus_queue.cc:1059] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:01.976157 22768 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.089547 19061 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:02.145671 18411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:01.902148 22747 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:02.146405 18411 raft_consensus.cc:606] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:01.948832 22635 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:01.953291 22454 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:01.992372 22604 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:01.959039 22746 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 13:19:01.900024 22757 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:02.174288 22762 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
W20260709 13:19:02.174680 22766 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:19:02.176388 22757 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:02.179701 22663 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:02.180261 22663 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:02.180740 22663 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:02.155161 22640 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:19:01.977056 22767 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:02.137813 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 216569us
I20260709 13:19:02.083132 22138 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:02.107465 22684 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:02.148501 19083 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8300 after lost signal to thread 18276
I20260709 13:19:01.994400 22691 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:02.141712 22760 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:19:02.155170 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 158546us
I20260709 13:19:01.985033 22377 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.167377 22747 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:02.167711 22454 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:02.168308 22671 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:02.168424 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:02.154708 22768 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:02.170964 22642 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:02.162657 22706 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:02.183858 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.986928 22591 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:02.186607 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 231910us
W20260709 13:19:02.244308 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.284202 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.243374 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:19:02.267020 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.267450 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:02.267639 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 288814us
I20260709 13:19:02.271518 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1261) took 1144 ms. Trace:
I20260709 13:19:02.290536 19053 rpcz_store.cc:276] 0709 13:19:01.127485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.154884 (+1027399us) service_pool.cc:224] Handling call
0709 13:19:02.271452 (+116568us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:02.274736 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 321972us
I20260709 13:19:02.268862 22767 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:02.292549 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:02.295536 22757 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:02.299299 22773 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:19:02.302925 22793 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:02.293252 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:02.293958 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:02.307082 18491 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:02.308570 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:02.309249 18342 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:02.309275 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:02.310429 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:02.311457 18486 raft_consensus.cc:2410] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:19:02.317130 18486 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:19:02.317533 18486 pending_rounds.cc:85] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 9
I20260709 13:19:02.317765 18486 pending_rounds.cc:107] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:19:02.318032 18486 raft_consensus.cc:2889] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:02.321533 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:02.322530 18492 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:19:02.323355 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:02.247349 22707 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:19:02.272280 22138 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:02.325124 22759 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:02.325362 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:02.328626 18415 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:02.329437 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:02.333521 18411 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:02.330430 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:02.331362 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:02.336247 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:02.336926 19059 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:02.339581 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:02.340905 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:02.341763 18340 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:19:02.283589 22591 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:19:02.345801 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.293953 22706 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:02.312487 22767 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:02.361491 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 170194us
I20260709 13:19:02.347254 22591 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:02.363850 22138 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.374737 22759 raft_consensus.cc:3055] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:02.382419 18411 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
W20260709 13:19:02.395290 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 83730us
W20260709 13:19:02.398550 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.399212 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 85303.5us
I20260709 13:19:02.399945 18382 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:02.407749 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.394415 22759 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:02.401299 22642 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.424609 22770 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 13:19:02.440289 19083 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3e00 after lost signal to thread 18368
W20260709 13:19:02.441823 19083 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3f40 after lost signal to thread 18443
W20260709 13:19:02.443313 19083 debug-util.cc:398] Leaking SignalData structure 0x7b0800408280 after lost signal to thread 18444
W20260709 13:19:02.444824 19083 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd7c0 after lost signal to thread 18517
W20260709 13:19:02.445191 19083 debug-util.cc:398] Leaking SignalData structure 0x7b0800374500 after lost signal to thread 18518
W20260709 13:19:02.447489 19083 debug-util.cc:398] Leaking SignalData structure 0x7b0800297fa0 after lost signal to thread 19086
W20260709 13:19:02.447880 19083 debug-util.cc:398] Leaking SignalData structure 0x7b0800330ca0 after lost signal to thread 19087
I20260709 13:19:02.426496 22387 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.424676 22801 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:02.436089 22454 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.427934 22797 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.437681 22795 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.436133 22635 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:02.535279 18411 raft_consensus.cc:1217] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 8.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:19:02.535565 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:02.538539 18411 raft_consensus.cc:1240] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:19:02.536329 18418 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:02.537004 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:02.536127 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:02.438328 22642 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:02.424881 22706 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:02.548381 18384 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:02.543624 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:02.563531 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:02.543184 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:02.554049 18417 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:02.427950 22794 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 13:19:02.575914 18412 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:02.595009 18413 raft_consensus.cc:1275] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:02.528436 22377 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:02.542441 22797 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.515985 22387 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:02.520489 22787 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:19:02.607142 18416 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
W20260709 13:19:02.610401 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 179293us
I20260709 13:19:02.644279 19025 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:02.646118 22786 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.609367 22792 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:02.609421 22691 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:02.641330 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 269759us
I20260709 13:19:02.652242 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:02.654523 22793 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:02.654944 22793 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:02.655344 22793 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:02.661725 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:02.667666 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:02.711154 18344 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:02.686506 22753 consensus_meta.cc:287] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.917s	user 0.013s	sys 0.000s
I20260709 13:19:02.669088 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:02.673779 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:02.712237 18343 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:02.712549 18412 raft_consensus.cc:2410] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:19:02.679177 22635 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.675817 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:02.676882 18415 raft_consensus.cc:2410] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:02.678115 18491 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:02.679661 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:02.660514 22775 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 13:19:02.683943 22498 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:02.681263 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:02.682559 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:02.645618 19025 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:02.722657 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 77124.6us
I20260709 13:19:02.537901 22454 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.690050 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:02.668435 22789 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:02.709149 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.660050 22687 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:02.659015 22799 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.747514 18338 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:19:02.727232 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 65576.1us
W20260709 13:19:02.732242 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 169736us
I20260709 13:19:02.533332 22801 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.667932 22800 consensus_queue.cc:1059] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:19:02.542348 22795 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.678141 22684 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.770056 22825 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:19:02.716780 22753 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.778885 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:02.744225 22808 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:02.778964 18338 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:02.743937 22826 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:02.817710 22663 consensus_meta.cc:287] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.000s
I20260709 13:19:02.794405 22796 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:02.809193 22792 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:02.795871 19061 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:02.767084 22786 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:19:02.744547 22498 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:02.780397 22787 raft_consensus.cc:3055] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:02.782960 22747 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.808531 22753 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:02.812269 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 45411.1us
W20260709 13:19:02.782078 22811 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:19:02.813361 18344 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:19:02.814248 18343 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:02.815598 18384 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:02.816313 22807 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:02.821002 22604 consensus_meta.cc:287] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.652s	user 0.008s	sys 0.000s
W20260709 13:19:02.779743 22819 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:19:02.825618 22348 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:02.719671 22635 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:02.789566 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.834734 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.777619 22768 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:02.780251 22642 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:02.809230 18341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 917) took 1457 ms (client timeout 1829 ms). Trace:
I20260709 13:19:02.792871 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:02.764845 22799 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.780165 22800 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
W20260709 13:19:02.901628 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 86103.7us
I20260709 13:19:02.874603 22790 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.880967 22787 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:02.909386 18341 rpcz_store.cc:269] 0709 13:19:01.351918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.352024 (+   106us) service_pool.cc:224] Handling call
0709 13:19:02.809026 (+1457002us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54000582d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:02.809157 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":874116864}
I20260709 13:19:02.896781 22797 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:02.925166 22795 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:02.922727 22138 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:02.927588 22799 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:02.839718 22663 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:02.909018 22387 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:03.003955 22753 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.922834 22684 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:02.899667 22818 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:19:02.900007 22747 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.924055 22801 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:02.923226 22829 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:19:03.031311 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 129805us
I20260709 13:19:02.922370 22454 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:02.904906 22807 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.935477 22635 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:02.915992 22735 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:02.937808 22759 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.960541 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.035876 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:02.961002 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:02.963251 18419 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:02.907888 22604 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.971351 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:02.976051 22663 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:02.974213 22138 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:02.998066 22828 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:02.998245 22672 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.998122 22648 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.001322 22736 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:03.025092 22753 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:03.030678 18382 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:02.905086 22745 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:02.963073 22793 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:02.982625 22767 consensus_meta.cc:287] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.002s
I20260709 13:19:03.026116 22751 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.039682 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.041527 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.050872 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:03.050347 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:03.055044 19061 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:03.055485 18412 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:19:03.056556 18412 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:03.051712 19027 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:03.059365 19027 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:03.052423 19062 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:03.052681 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:03.063097 19061 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:03.068806 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.069667 18419 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:03.045929 22498 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:03.069870 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:02.968518 22790 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.050390 22745 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:03.075901 19054 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:03.053031 22835 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:03.073103 22827 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:03.086124 18412 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:03.058195 22767 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.092052 22767 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.048933 22787 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:03.093117 22813 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.495s	user 0.007s	sys 0.000s
I20260709 13:19:03.093526 22787 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.095497 22790 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.049018 22648 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.047633 22828 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.099469 22807 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.100569 22648 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.096786 18414 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:03.100871 22828 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.048950 22672 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.102981 22672 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.081218 22348 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.105270 22348 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.107398 22348 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.109086 22138 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.110602 22747 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.112087 22753 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:03.114010 22604 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.118912 22779 raft_consensus.cc:3055] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:03.119349 22779 raft_consensus.cc:740] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:03.081822 22745 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:03.126770 22591 consensus_meta.cc:287] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.731s	user 0.012s	sys 0.000s
I20260709 13:19:03.127327 22591 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.129426 22591 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.130290 22793 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.132884 22706 consensus_queue.cc:1059] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:19:03.134503 22805 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.532s	user 0.008s	sys 0.002s
I20260709 13:19:03.137873 22752 raft_consensus.cc:3055] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:03.139423 22752 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:03.140242 22752 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.141346 22752 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:03.142551 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 349733us
I20260709 13:19:03.143292 18457 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:03.144170 22826 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:03.144747 22826 consensus_queue.cc:1059] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:03.145511 22826 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:03.146083 22823 raft_consensus.cc:3055] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:03.146435 22823 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:03.147184 22823 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.148377 22823 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.149024 18492 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:03.149313 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:03.150189 18493 raft_consensus.cc:2410] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:03.152122 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:03.152652 18491 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:03.154675 18492 raft_consensus.cc:1240] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:03.156797 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:03.158620 18309 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:03.159890 22604 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:03.160398 22604 raft_consensus.cc:697] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:03.161420 22604 consensus_queue.cc:237] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.163941 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:03.165578 18419 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:03.166700 18412 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:03.168591 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.169111 22365 raft_consensus.cc:3055] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:03.169464 22365 raft_consensus.cc:740] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:03.169003 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:03.171519 22104 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.171643 18413 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:03.172649 18412 raft_consensus.cc:2410] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:19:03.171994 22104 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:03.167711 18458 connection.cc:256] RPC call timeout handler was delayed by -1.7579476469998099s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 13:19:03.176095 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:03.176348 18458 connection.cc:256] RPC call timeout handler was delayed by -1.7102476469997328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 13:19:03.178158 18458 connection.cc:256] RPC call timeout handler was delayed by -1.6814476469999136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 13:19:03.179337 18458 connection.cc:256] RPC call timeout handler was delayed by -1.6274476469998262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 13:19:03.179620 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:03.179607 18458 connection.cc:256] RPC call timeout handler was delayed by -1.5851476469997579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:19:03.180887 18458 connection.cc:256] RPC call timeout handler was delayed by -1.5302476469998965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
W20260709 13:19:03.192703 18458 connection.cc:256] RPC call timeout handler was delayed by -1.2935476469997411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
W20260709 13:19:03.193094 18458 connection.cc:256] RPC call timeout handler was delayed by -1.2386476469998797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
W20260709 13:19:03.193480 18458 connection.cc:256] RPC call timeout handler was delayed by -1.2179476469998463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 13:19:03.193852 18458 connection.cc:256] RPC call timeout handler was delayed by -1.2170476469998448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260709 13:19:03.180469 18491 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:03.196511 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:03.199371 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:03.200137 18488 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:03.201612 18382 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:03.203073 18458 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:03.206035 22104 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:03.205948 18458 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:03.206573 22104 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:03.206924 22104 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:03.207239 22104 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:03.207744 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:03.214874 18458 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:03.217100 18382 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:03.235394 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 92150.6us
I20260709 13:19:03.198637 22793 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:03.237653 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.233423 18458 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:03.216209 22753 consensus_queue.cc:1059] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:19:03.236835 18457 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:03.170233 22365 consensus_queue.cc:260] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.210952 22675 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:03.195570 22706 consensus_queue.cc:1059] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:19:03.198962 22562 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:19:03.216327 22796 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:19:03.275274 18457 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:03.213903 22788 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:03.239061 22800 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:03.242223 22640 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:03.204382 22823 consensus_queue.cc:1059] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:19:03.213691 22651 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:03.238929 22663 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:19:03.235760 22498 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:19:03.280170 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:03.265513 22675 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.279053 22104 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.310977 22675 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:03.312263 22104 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.246991 22793 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.314513 22793 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.291025 22651 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:03.308727 22365 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:03.316924 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.274595 22795 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:03.322072 22651 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.323868 22745 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.326287 22635 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:03.276778 22768 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.330725 22768 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:03.331259 22768 raft_consensus.cc:697] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:03.333562 18416 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:03.280826 22801 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:19:03.343669 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:03.380369 18336 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:03.383445 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.387833 18337 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:03.404567 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2271) took 1076 ms. Trace:
I20260709 13:19:03.409363 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.280740 22640 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.283687 22826 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:03.420495 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:03.405305 18414 rpcz_store.cc:276] 0709 13:19:02.328626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.330999 (+  2373us) service_pool.cc:224] Handling call
0709 13:19:02.353344 (+ 22345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.101281 (+747937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.404256 (+302975us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54000a8cd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:03.404483 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1709297024}
W20260709 13:19:03.416872 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 137386us
I20260709 13:19:03.418184 18384 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:03.419857 22104 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.454885 22104 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:03.454262 18457 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:03.470582 22104 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:03.470855 18457 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:03.471451 22104 consensus_queue.cc:1059] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:03.478866 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 191580us
I20260709 13:19:03.386945 22348 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.487284 18486 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:03.487280 18485 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:19:03.488773 22104 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.488839 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:03.489753 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 71970.3us
I20260709 13:19:03.407645 22794 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:03.510819 18493 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:03.507999 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:03.422000 22640 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:03.515784 18337 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:03.522627 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:03.523511 18335 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:03.425833 22795 raft_consensus.cc:697] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:03.490597 22793 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:03.534287 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 54519us
I20260709 13:19:03.487664 22672 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.527590 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:03.487947 22800 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:03.510419 18240 catalog_manager.cc:5697] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 5 to 11, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 11 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:03.539141 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.511816 22826 raft_consensus.cc:697] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:03.535760 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.517792 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:03.521966 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.584101 18338 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:03.514860 18485 pending_rounds.cc:85] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 6
I20260709 13:19:03.585613 18485 pending_rounds.cc:107] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:19:03.586074 18485 raft_consensus.cc:2889] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:03.586324 18488 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:03.515529 22104 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.572347 18339 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:03.565183 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.514178 22498 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:03.586207 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 71228us
I20260709 13:19:03.588910 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.511914 22788 raft_consensus.cc:3055] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:03.589561 18337 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:03.592132 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.595382 18339 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:03.521024 22835 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:03.524700 22745 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.518126 22794 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.602185 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:03.618862 18492 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:03.625850 18485 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:03.601735 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.602066 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.627691 18335 raft_consensus.cc:2410] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
W20260709 13:19:03.617874 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.628355 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.590817 22672 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.630172 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.630343 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:03.631610 22672 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.632777 18410 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:03.632777 18490 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:03.629709 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.602885 18418 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:03.565989 22793 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.646430 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.648928 18384 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:03.649621 22104 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.637681 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:03.603341 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:03.639896 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.640738 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.607497 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.644341 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:03.652470 18418 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:03.662076 18492 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:03.663460 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:03.664263 18338 raft_consensus.cc:1240] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:19:03.522456 22348 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:03.632951 22856 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:03.669406 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:03.673818 18485 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:03.677839 22104 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:03.681535 18484 raft_consensus.cc:2376] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6. Re-sending same reply.
I20260709 13:19:03.683398 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:03.683629 18338 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:19:03.679015 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.680400 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:03.596599 22788 raft_consensus.cc:740] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:03.626358 22835 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.614964 22791 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.693840 22839 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:03.694698 22839 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:03.655045 22825 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.663561 22591 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.695660 22839 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.696569 22827 raft_consensus.cc:697] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:03.694068 22562 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:19:03.637557 22794 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:03.700399 18340 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:03.702919 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:03.704207 19026 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:03.706823 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.658869 22793 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:03.711436 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.712908 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:03.712826 18339 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
W20260709 13:19:03.714962 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 545998us
I20260709 13:19:03.717499 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:03.764853 18484 raft_consensus.cc:2376] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8. Re-sending same reply.
I20260709 13:19:03.719194 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:03.723063 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.766193 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:03.766690 18338 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:19:03.766222 18492 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:03.686414 22672 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:03.767699 18485 raft_consensus.cc:2393] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:19:03.769364 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 65234.7us
I20260709 13:19:03.769613 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:03.774108 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 55016us
I20260709 13:19:03.722215 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:03.666574 22753 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:19:03.705199 22835 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.783984 19025 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:03.777220 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:03.714344 22734 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.786073 18486 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:03.714555 22736 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.790736 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.793350 18340 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:03.569017 22768 consensus_queue.cc:237] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.800767 22734 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.803166 22734 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:03.804339 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:03.790194 22735 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:03.806306 22843 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:19:03.696300 22795 consensus_queue.cc:237] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.760993 22818 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:19:03.797266 22672 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:03.797441 22562 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:03.761073 22751 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:19:03.798658 22827 consensus_queue.cc:237] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.760761 22606 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:19:03.761108 22749 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.800305 22769 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:03.799878 22736 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.850963 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.710286 22743 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:03.762995 22745 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:03.663017 22797 consensus_queue.cc:1059] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:19:03.781085 22737 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:03.710263 22825 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.698798 22800 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.803707 22734 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:19:03.663198 22846 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:19:03.818759 22562 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:03.870918 22562 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:03.815698 22672 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.874130 22672 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:03.875579 22736 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:03.714154 22591 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.879869 22591 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.880010 22801 raft_consensus.cc:3055] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:03.880726 22801 raft_consensus.cc:740] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:03.855618 22855 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:19:03.857887 22787 consensus_meta.cc:287] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.764s	user 0.005s	sys 0.005s
I20260709 13:19:03.866432 22737 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:03.846478 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 787111us
I20260709 13:19:03.698386 22791 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:03.863108 22675 consensus_meta.cc:287] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.547s	user 0.004s	sys 0.006s
I20260709 13:19:03.881896 22801 consensus_queue.cc:260] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:03.882634 22847 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:03.883010 18488 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:19:03.888568 18410 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:03.892572 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.892879 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.893178 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.893610 18337 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:03.902623 18411 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:19:03.896449 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:03.896588 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:03.902693 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:03.905464 18486 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:19:03.899942 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:03.906353 18338 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:03.851723 18340 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:03.900137 18488 pending_rounds.cc:85] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 8
I20260709 13:19:03.909952 18488 pending_rounds.cc:107] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:19:03.910329 18488 raft_consensus.cc:2889] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:03.914961 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:03.919415 18343 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:03.922035 18342 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:03.927050 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.927757 18410 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:03.928530 22806 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:03.929031 22825 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.929267 22736 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:03.929857 22736 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.931473 22348 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:03.932590 22736 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:03.933239 22706 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.890380 22675 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:03.935798 22675 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:03.897322 22790 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:03.936718 22790 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:03.808110 22788 consensus_queue.cc:260] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.937608 22790 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.938803 18340 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:03.939059 22790 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:03.916808 22591 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:19:03.944860 22801 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.944957 22793 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:03.946933 18490 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:03.948441 22844 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.375s	user 0.003s	sys 0.001s
I20260709 13:19:03.856171 22745 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.953822 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:03.885566 18240 catalog_manager.cc:5697] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 3 to 6, term changed from 6 to 9, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to <none>, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1), VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2), VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3), VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 9 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:19:03.953297 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 48122.5us
I20260709 13:19:03.953023 22784 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.956665 19061 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:03.956955 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:03.957661 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:03.790565 22826 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.959556 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:03.960196 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:03.962888 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:03.965847 18343 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:03.885731 22737 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.966442 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:03.963177 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:03.846863 22831 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:19:03.963660 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:03.891607 22791 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:03.886947 22670 raft_consensus.cc:3055] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:03.847074 22749 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.958858 22745 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:03.961898 22736 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.949450 22779 consensus_queue.cc:260] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.970614 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:04.017444 18486 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:04.018173 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:04.018442 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:03.970175 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:03.860795 22743 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:04.012531 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 234760us
I20260709 13:19:03.933039 22562 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.055179 22835 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:04.056948 22562 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:03.968343 18338 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:03.997777 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:04.002470 19053 raft_consensus.cc:1240] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:04.058708 18413 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:04.059294 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:04.059597 22684 raft_consensus.cc:993] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:19:04.060113 22684 raft_consensus.cc:1081] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:19:04.060493 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:03.998059 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 212828us
I20260709 13:19:04.022883 22860 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.062927 22860 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.064002 22818 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:04.065194 22860 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.065569 22733 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.065724 22612 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:04.024125 18410 raft_consensus.cc:2410] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:19:04.061650 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.066140 22733 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.066799 19053 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:04.067130 22806 consensus_queue.cc:1059] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:04.067948 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:04.068343 22733 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.068876 19053 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:04.069648 22640 consensus_meta.cc:287] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.000s
I20260709 13:19:04.070079 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:04.071313 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:04.071904 18492 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:19:04.072757 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:04.073837 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:03.971953 19054 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:19:03.972668 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:04.011925 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.092346 19053 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:04.023023 19058 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:19:03.994365 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:04.093129 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.028038 22749 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:03.990406 22792 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:04.029310 22651 consensus_meta.cc:287] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.001s
I20260709 13:19:03.988538 22670 raft_consensus.cc:740] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:03.972364 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.031140 22779 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.972024 22672 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.037417 22794 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:03.967485 22591 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:19:04.043844 22743 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.041898 22706 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:04.051898 22752 consensus_meta.cc:287] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.910s	user 0.008s	sys 0.003s
I20260709 13:19:04.120748 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.011325 22793 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:03.997215 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.122524 18458 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:04.123294 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2559) took 1433 ms. Trace:
I20260709 13:19:03.956799 22784 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.069585 18485 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:04.126026 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.126902 19057 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:04.089335 18484 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:04.128512 18458 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:04.092551 18344 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:03.973851 22825 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:04.093317 18415 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:19:04.096122 18418 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:04.097528 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:04.091884 19025 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:04.132453 19059 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:04.103781 22104 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.105378 18486 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
W20260709 13:19:04.110044 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 332851us
W20260709 13:19:04.115934 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.115195 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.120612 18491 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:04.124198 19026 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:04.098729 22562 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.137425 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:04.138362 18382 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:04.138792 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.139716 18458 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:04.123651 18487 rpcz_store.cc:276] 0709 13:19:02.726165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.747611 (+ 21446us) service_pool.cc:224] Handling call
0709 13:19:02.755703 (+  8092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.794875 (+ 39172us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:02.830152 (+ 35277us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.253200 (+423048us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.253252 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:03.253297 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.123083 (+869786us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b54001b6f54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:04.123124 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.123244 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35167,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":23387,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":2604,"spinlock_wait_cycles":89556864,"thread_start_us":385490,"threads_started":1,"wal-append.queue_time_us":825092}
I20260709 13:19:04.133239 22104 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.143286 18384 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:04.143057 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:04.147722 18490 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:19:04.070089 22640 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.013285 22736 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:04.151247 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 59434.9us
I20260709 13:19:04.153622 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.154945 19053 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:04.107456 22612 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.131995 22454 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:04.151697 22793 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.163106 22612 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:04.163372 22104 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:04.148669 22846 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:04.167939 22846 consensus_queue.cc:1059] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:04.168928 22846 raft_consensus.cc:3055] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:04.169302 22846 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:04.169955 22864 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:04.143872 22791 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:04.170421 22857 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.269s	user 0.000s	sys 0.002s
I20260709 13:19:04.170662 22791 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.171090 22791 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:04.170270 22846 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.171617 22736 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.172200 22846 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:04.131898 22792 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.172948 22792 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.158071 22825 raft_consensus.cc:3055] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:04.174295 22825 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:04.175136 22825 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.150871 22706 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:04.109387 22651 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.176795 22706 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:04.177206 22706 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.177488 22759 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:04.178733 22651 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:04.179482 18493 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:04.180342 19057 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:04.180884 22769 consensus_queue.cc:1059] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:04.182063 22769 raft_consensus.cc:3055] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:04.182418 22769 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:04.183209 22769 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.148504 22684 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:04.148628 22562 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.181396 22792 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:04.184744 18490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:19:04.220058 18490 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:04.220357 18338 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: [11.11-13.12]
I20260709 13:19:04.220628 18490 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:04.159924 19025 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:04.186810 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:04.187712 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:04.222414 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:04.222951 18343 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:04.108821 22860 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:19:04.197153 18226 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b345033a56994fff90990b7d03324074 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d6cd7c600ec4ab2b5cac479f05d4c0f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:04.205163 18414 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:04.227433 18384 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:04.153973 22790 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:04.230400 19061 raft_consensus.cc:1240] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:04.141762 22743 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:19:04.142066 22787 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:19:04.159453 22808 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.173863 22753 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:04.230250 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:04.170436 22864 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:04.240495 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 116419us
I20260709 13:19:04.239261 18343 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:04.242415 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:04.193167 18457 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:04.231781 22769 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:04.248817 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 55795.4us
W20260709 13:19:04.250515 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 90653.1us
I20260709 13:19:04.256054 19025 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:04.231458 22790 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.204504 22856 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:19:04.244374 22864 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.271194 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.271524 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:04.275467 18490 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:04.156332 22670 consensus_queue.cc:260] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:04.237308 22753 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:04.244542 22747 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.273599 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.279315 19053 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:04.248000 22831 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:04.280355 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.251302 22786 raft_consensus.cc:3055] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:04.287055 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.291350 22749 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:04.293411 22749 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:19:04.261371 22790 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:04.259697 22800 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:04.296972 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.308563 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:04.305613 19059 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:04.273342 22801 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.274078 22827 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:04.293483 18490 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:04.315418 22104 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:04.314237 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:04.240943 22808 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.311269 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.270604 22835 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.322458 19053 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:04.308389 22749 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:19:04.322818 22743 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.286890 22786 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:04.279654 22862 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:04.324482 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:04.330983 19053 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:04.286480 22591 raft_consensus.cc:3055] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:04.279852 22863 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:04.321349 22635 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.325528 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:04.342178 19059 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:04.277421 22818 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:19:04.348133 19060 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:04.326687 22663 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:04.329541 22862 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.305418 22800 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.316864 22827 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.304625 22798 raft_consensus.cc:3055] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:04.333065 22591 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:19:04.448719 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 478369us
W20260709 13:19:04.451385 18309 leader_election.cc:336] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 1.591s (SENT)
W20260709 13:19:04.325670 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.455400 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.362840 19053 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:04.536926 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.352355 22663 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.329965 22743 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.558394 22663 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:04.559446 22873 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:19:04.561035 22743 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.370108 22784 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.373719 22786 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.399710 22791 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.564882 22786 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:04.566581 22791 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:04.369488 22798 raft_consensus.cc:740] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:04.569505 22798 consensus_queue.cc:260] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:04.572191 22798 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:04.401346 22808 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:04.574059 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.369288 22827 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:04.367933 22800 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.583534 22591 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:04.585163 22591 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:04.321429 22801 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.363278 22866 consensus_queue.cc:1059] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:19:04.366214 22862 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:04.388912 22868 log.cc:927] Time spent T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:04.466792 22562 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:04.469457 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 454513us
I20260709 13:19:04.611725 22562 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:04.612231 22562 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:04.613761 22562 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.615556 22562 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:04.615320 22864 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.617619 22864 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.365197 22733 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.154s
I20260709 13:19:04.337127 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:04.540022 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:19:04.662040 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 122309us
I20260709 13:19:04.662135 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.663319 19061 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:04.664481 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:04.666337 22365 raft_consensus.cc:2764] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:04.607499 22672 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:04.607520 22743 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:04.669661 22743 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.671034 22788 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:04.672612 22743 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.586784 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:04.674026 18490 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
W20260709 13:19:04.674208 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 361850us
I20260709 13:19:04.606441 18309 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:04.602293 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 350478us
W20260709 13:19:04.676239 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 225159us
I20260709 13:19:04.676469 22792 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.676883 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:04.602818 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.330219 22753 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.369624 22640 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:04.689172 22562 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:04.624125 18308 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:04.690562 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 66623.6us
W20260709 13:19:04.624914 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.694012 18488 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:04.625419 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.625594 19054 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
W20260709 13:19:04.630450 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.631219 19058 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:04.634342 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:04.635643 22876 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:04.637288 22801 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:04.639051 22684 raft_consensus.cc:697] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:04.639881 22826 consensus_queue.cc:1059] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:04.680241 22794 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:04.695489 22218 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:04.665897 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.688575 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:04.688972 22753 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:04.697408 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.701978 22792 consensus_queue.cc:1175] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" responder_term: 14 status { last_received { term: 12 index: 12 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:19:04.705991 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.706115 22745 consensus_meta.cc:287] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.695s	user 0.007s	sys 0.012s
I20260709 13:19:04.712661 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:04.678190 22365 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:04.721824 22737 consensus_meta.cc:287] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.730s	user 0.012s	sys 0.006s
I20260709 13:19:04.722071 22877 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.722901 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:04.725108 18486 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:04.716298 22218 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.738981 22635 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:04.734931 22826 consensus_queue.cc:1243] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:04.757714 22800 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:04.760185 22759 consensus_meta.cc:287] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.007s
I20260709 13:19:04.762526 22877 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.760411 22876 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.767462 18492 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:04.746462 22635 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:04.813103 19059 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:04.814831 19061 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:04.815923 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:04.816494 19061 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:04.737322 22218 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:04.820412 19061 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:19:04.739815 22684 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:04.824831 22648 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.835903 22663 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.837347 19025 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:04.839383 22736 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:04.839813 22736 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.840152 22736 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:04.841022 22876 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:04.842849 22877 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:04.843595 19059 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:04.845131 22663 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:04.830173 22648 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.734860 22737 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.805749 22635 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:04.861894 22737 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.737669 22745 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.864828 22745 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:04.813171 22862 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.868026 22862 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.869504 19053 raft_consensus.cc:2393] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:04.869247 19027 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:04.872505 22790 consensus_meta.cc:287] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.005s
W20260709 13:19:04.873049 22779 consensus_meta.cc:287] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.762s	user 0.014s	sys 0.003s
I20260709 13:19:04.842857 22800 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:04.873129 22862 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.873111 22790 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:04.889974 22736 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.890735 22790 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.927825 22862 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.928776 22862 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.931850 22862 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.932164 22764 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.932978 22764 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.935250 22827 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:04.954039 22764 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.961769 19057 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:04.965265 22706 consensus_meta.cc:287] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.779s	user 0.005s	sys 0.012s
I20260709 13:19:04.965870 22706 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:04.968739 22706 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.973205 22736 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:04.983053 22827 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:06.292436 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.296308 18340 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:06.297823 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:06.299566 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:06.300428 18340 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:19:06.301419 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:06.302184 18340 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.309962 18340 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:19:06.311306 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:06.312415 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 1.64671e+06us
I20260709 13:19:06.313261 22904 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:06.312155 18340 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:06.313496 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:06.314735 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:06.314394 22904 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:06.316054 18340 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:19:06.317014 18307 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:06.319118 22904 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:06.319590 22905 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:06.319761 22904 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:06.320083 22905 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:06.320257 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:06.320544 22905 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.321697 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 979) took 1293 ms. Trace:
I20260709 13:19:06.321883 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:06.323153 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:06.324419 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:06.322218 18489 rpcz_store.cc:276] 0709 13:19:03.507903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.508032 (+   129us) service_pool.cc:224] Handling call
0709 13:19:03.508461 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:03.508969 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:03.509032 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.509688 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.183906 (+674218us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b18003c7180. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:19:04.717670 (+533764us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:04.724693 (+  7023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.730874 (+  6181us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.730936 (+    62us) raft_consensus.cc:1685] finished
0709 13:19:04.730953 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.801113 (+ 70160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12057,"raft.queue_time_us":11726,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":138,"spinlock_wait_cycles":37394176,"thread_start_us":474967,"threads_started":1,"wal-append.queue_time_us":1052738,"wal-append.run_cpu_time_us":2299,"wal-append.run_wall_time_us":1037373}
I20260709 13:19:06.325199 18340 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
W20260709 13:19:06.325759 18414 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2249) took 2724 ms (client timeout 1999 ms). Trace:
I20260709 13:19:06.322197 22904 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:06.326237 18414 rpcz_store.cc:269] 0709 13:19:03.601071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.602087 (+  1016us) service_pool.cc:224] Handling call
0709 13:19:06.325341 (+2723254us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5400109354. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:06.325547 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320419712}
I20260709 13:19:06.329516 22905 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:06.330678 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.331274 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.332139 22905 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:06.332571 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.331700 18307 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:06.334630 18414 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:06.334816 22905 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:06.336282 18307 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:06.337257 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:06.338402 18414 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:06.338893 18416 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:06.341269 22904 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.341946 22905 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:06.346884 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:06.348045 22905 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:06.349061 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:06.349996 18413 raft_consensus.cc:2410] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:19:06.351384 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:06.352166 18413 raft_consensus.cc:2410] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:06.353667 18413 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:06.355088 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:06.355819 18413 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:06.356904 19026 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:06.358043 18307 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:06.362685 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:06.363629 22904 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:06.364096 22905 raft_consensus.cc:2764] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 13:19:06.473263 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 1.79641e+06us
W20260709 13:19:06.484964 19026 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.505s (SENT) [suppressed 17 similar messages]
I20260709 13:19:06.537135 22905 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:06.539083 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 172688us
W20260709 13:19:06.539655 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 173423us
I20260709 13:19:06.534351 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 933) took 2614 ms. Trace:
I20260709 13:19:06.541334 18384 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:06.541370 18344 rpcz_store.cc:276] 0709 13:19:03.919704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.920276 (+   572us) service_pool.cc:224] Handling call
0709 13:19:04.075962 (+155686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.129670 (+ 53708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.533894 (+2404224us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54001662d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:06.534155 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357420800}
I20260709 13:19:06.543622 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:06.544202 18307 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:06.545431 22905 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.537999 22909 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.549052 22909 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:06.549748 22913 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:06.550622 22913 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:06.551626 22909 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:06.552726 22909 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:06.553337 22913 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:06.554523 22909 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:06.555385 22913 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:06.559926 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 75011.9us
I20260709 13:19:06.556370 22913 raft_consensus.cc:697] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:06.563318 18307 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:06.564301 22365 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:06.566879 18384 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:06.568701 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:06.570348 22909 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:06.570828 22909 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.571262 22909 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:06.572659 22912 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:06.573748 22904 consensus_queue.cc:1059] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:06.574649 22904 consensus_queue.cc:1243] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:06.575210 22904 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:06.575521 22910 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:06.576166 22910 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:06.576733 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2406) took 2392 ms. Trace:
I20260709 13:19:06.577381 22910 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:06.579589 22910 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:06.575544 22904 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:06.573525 22912 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:06.584102 22912 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:06.582078 22904 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:06.584832 22912 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:06.587335 22786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.533s	user 0.001s	sys 0.011s
W20260709 13:19:06.590204 22786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.536s	user 0.002s	sys 0.011s
I20260709 13:19:06.584833 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:06.573585 22365 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:19:06.593469 22904 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.577170 18339 rpcz_store.cc:276] 0709 13:19:04.184538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.184716 (+   178us) service_pool.cc:224] Handling call
0709 13:19:04.185046 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.185401 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:04.185429 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.224242 (+ 38813us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.724493 (+500251us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:06.576174 (+1851681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.576317 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.576365 (+    48us) raft_consensus.cc:1685] finished
0709 13:19:06.576377 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.576545 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17414,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":15116,"thread_start_us":417752,"threads_started":1,"wal-append.queue_time_us":342752,"wal-append.run_cpu_time_us":2459,"wal-append.run_wall_time_us":1035618}
I20260709 13:19:06.596055 18339 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:06.606427 22792 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:06.607242 22792 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:06.606771 22913 consensus_queue.cc:237] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:06.608933 22792 raft_consensus.cc:697] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:06.610064 22792 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:06.617434 22905 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:06.622650 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:06.633459 22912 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:06.635344 22909 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:06.642468 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:06.644593 22909 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:06.646216 22912 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:06.646819 22912 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.647267 22912 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:06.647792 18412 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:19:06.656740 18412 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:19:06.657963 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:06.658933 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:06.658020 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:06.660804 18417 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.663179 22801 raft_consensus.cc:3055] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:06.663586 22801 raft_consensus.cc:740] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:06.664507 22801 consensus_queue.cc:260] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:06.665853 22801 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.671087 22769 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:06.672825 22769 consensus_queue.cc:1059] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:06.677465 22912 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:06.677781 22736 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:19:06.679594 22736 consensus_queue.cc:1243] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:06.680513 22912 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:06.681068 22736 raft_consensus.cc:3055] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:06.681854 22736 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:06.673681 22769 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:06.678709 18413 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
W20260709 13:19:06.689146 18384 connection.cc:256] RPC call timeout handler was delayed by -1.0869656059999215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260709 13:19:06.689798 18417 raft_consensus.cc:2410] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:06.707043 22736 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:06.708870 22736 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.709004 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:06.709851 18492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 2601) took 2000 ms (client timeout 1879 ms). Trace:
W20260709 13:19:06.710697 18492 rpcz_store.cc:269] 0709 13:19:04.713974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.716088 (+  2114us) service_pool.cc:224] Handling call
0709 13:19:06.709628 (+1993540us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b54003548d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:06.709763 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91925376}
I20260709 13:19:06.711371 22707 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:06.712118 18413 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:06.712976 18412 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:06.716030 18417 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:19:06.716427 18417 pending_rounds.cc:85] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 10
I20260709 13:19:06.716665 18417 pending_rounds.cc:107] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:19:06.717948 18417 raft_consensus.cc:2889] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:06.730135 22909 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.730862 22909 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:06.733395 22909 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:06.748387 22218 consensus_meta.cc:287] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.917s	user 0.012s	sys 0.008s
I20260709 13:19:06.756068 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:06.763754 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:06.764107 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:06.757282 18489 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:06.765864 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:06.767139 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:06.767678 18489 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.770190 22218 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:06.764458 18492 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 6.
I20260709 13:19:06.762055 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:06.760699 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:06.771162 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:06.775209 18493 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.775449 18338 raft_consensus.cc:2393] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:06.776502 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:06.777076 18338 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:06.779251 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:06.780022 18490 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:06.782617 18411 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 13:19:06.785184 19053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 1081) took 2477 ms (client timeout 1966 ms). Trace:
I20260709 13:19:06.785600 18338 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:06.789167 22218 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:06.790659 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:06.791299 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.792382 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:06.794938 18411 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:19:06.785743 19053 rpcz_store.cc:269] 0709 13:19:04.307325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.535983 (+228658us) service_pool.cc:224] Handling call
0709 13:19:06.784901 (+2248918us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54005b0254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:06.785059 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685572864}
I20260709 13:19:06.789644 22648 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:06.778833 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:06.802349 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.802891 18343 raft_consensus.cc:2410] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:19:06.803099 18457 connection.cc:256] RPC call timeout handler was delayed by -1.4544030669999302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
I20260709 13:19:06.813015 18343 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:06.815687 18493 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:19:06.816219 19053 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:06.817278 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1285) took 2470 ms. Trace:
I20260709 13:19:06.818228 18412 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 9: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:06.817840 19053 rpcz_store.cc:276] 0709 13:19:04.347425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.815158 (+2467733us) service_pool.cc:224] Handling call
0709 13:19:06.815688 (+   530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.816860 (+  1172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.817192 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:06.824987 18457 connection.cc:256] RPC call timeout handler was delayed by -1.0347513439999148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
I20260709 13:19:06.826242 22801 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.826313 22736 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:19:06.826864 22801 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:06.830812 18457 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:06.833906 22769 raft_consensus.cc:3055] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:06.834371 22769 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:06.832684 22801 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:06.838878 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1284) took 2506 ms. Trace:
I20260709 13:19:06.837795 22769 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:06.840638 19059 rpcz_store.cc:276] 0709 13:19:04.330057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.851015 (+520958us) service_pool.cc:224] Handling call
0709 13:19:04.939246 (+ 88231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.960272 (+ 21026us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:04.971394 (+ 11122us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.829291 (+1857897us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.836494 (+  7203us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:06.836583 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.836657 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.836784 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38333,"prepare.queue_time_us":9037,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":17876,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":341,"thread_start_us":72281,"threads_started":1,"wal-append.queue_time_us":1845754}
I20260709 13:19:06.842662 18338 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:06.849907 18489 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:06.854976 22768 consensus_queue.cc:1059] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:06.856069 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.860024 22769 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:06.860162 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1276) took 2590 ms. Trace:
I20260709 13:19:06.860947 19060 rpcz_store.cc:276] 0709 13:19:04.269657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.285591 (+ 15934us) service_pool.cc:224] Handling call
0709 13:19:04.285910 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.348609 (+ 62699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.845493 (+2496884us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b54000bf754. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:06.859936 (+ 14443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126003584}
I20260709 13:19:06.866986 18338 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:19:06.876796 18458 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.122s	user 0.027s	sys 0.043s
I20260709 13:19:06.882820 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:06.884109 18410 raft_consensus.cc:2410] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:06.885787 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:06.886349 19060 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:06.886866 22818 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:06.887022 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1085) took 2160 ms. Trace:
I20260709 13:19:06.887621 19060 rpcz_store.cc:276] 0709 13:19:04.726243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.866780 (+2140537us) service_pool.cc:224] Handling call
0709 13:19:06.870525 (+  3745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.886777 (+ 16252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.886971 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:06.888339 19062 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:06.888907 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1086) took 2087 ms. Trace:
I20260709 13:19:06.889034 19060 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:19:06.889544 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.889595 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1087) took 2074 ms. Trace:
I20260709 13:19:06.890400 19060 rpcz_store.cc:276] 0709 13:19:04.814943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.888446 (+2073503us) service_pool.cc:224] Handling call
0709 13:19:06.888717 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.889382 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.889548 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:06.889215 19062 rpcz_store.cc:276] 0709 13:19:04.801948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.887552 (+2085604us) service_pool.cc:224] Handling call
0709 13:19:06.887894 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.888661 (+   767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.888861 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:06.909410 18486 consensus_meta.cc:287] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 2.155s	user 0.017s	sys 0.013s
I20260709 13:19:06.909865 18486 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
W20260709 13:19:06.917016 18458 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.162s	user 0.028s	sys 0.043s
W20260709 13:19:06.917716 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 2.16311e+06us
W20260709 13:19:06.921554 18486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 2596) took 2227 ms (client timeout 2075 ms). Trace:
W20260709 13:19:06.923872 18486 rpcz_store.cc:269] 0709 13:19:04.683177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.683391 (+   214us) service_pool.cc:224] Handling call
0709 13:19:06.910633 (+2227242us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:06.935581 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 100795us
W20260709 13:19:06.943885 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.962981 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.962551 18457 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:06.967068 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:06.967418 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:06.967872 18343 raft_consensus.cc:2393] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:06.968532 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:06.970604 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1089) took 2155 ms. Trace:
I20260709 13:19:06.971112 19060 rpcz_store.cc:276] 0709 13:19:04.815547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.891097 (+2075550us) service_pool.cc:224] Handling call
0709 13:19:06.891367 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.891627 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:06.891906 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.969728 (+ 77822us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.970209 (+   481us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.970264 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:06.970320 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.970398 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.970527 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":895,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":8621,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":173,"thread_start_us":68422,"threads_started":1}
I20260709 13:19:06.977870 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:06.978947 18338 raft_consensus.cc:2410] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:06.983181 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:06.984143 22930 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:06.984848 22928 raft_consensus.cc:3055] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:06.984737 22930 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:06.985247 22928 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:06.986212 22928 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:06.986907 22930 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:06.987500 22928 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.988968 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1083) took 2329 ms. Trace:
I20260709 13:19:06.989351 19053 rpcz_store.cc:276] 0709 13:19:04.687274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.829572 (+2142298us) service_pool.cc:224] Handling call
0709 13:19:06.832181 (+  2609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.836898 (+  4717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.836934 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.838005 (+  1071us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.857871 (+ 19866us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:06.857978 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.858082 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.988689 (+130607us) raft_consensus.cc:1685] finished
0709 13:19:06.988714 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.988879 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2838,"raft.queue_time_us":3551,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":638,"thread_start_us":14375,"threads_started":1,"wal-append.queue_time_us":100643}
W20260709 13:19:06.997056 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 54431.5us
I20260709 13:19:06.981438 22768 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.007767 22768 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:07.015141 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.016227 22768 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:07.017421 22768 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:07.018242 22764 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.018776 22769 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:07.018962 18419 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:19:07.019136 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.025789 22818 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.019881 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.026508 22818 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:07.027274 19027 connection.cc:256] RPC call timeout handler was delayed by -1.5126634920000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 13:19:07.027873 19027 connection.cc:256] RPC call timeout handler was delayed by -1.2969591349999519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
W20260709 13:19:07.028282 19027 connection.cc:256] RPC call timeout handler was delayed by -1.2822634919998563s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 13:19:07.028797 19027 connection.cc:256] RPC call timeout handler was delayed by -1.2345634920000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
I20260709 13:19:07.029390 22818 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:07.030089 22736 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.031525 22736 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.032702 19053 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:07.020015 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:07.034780 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:07.035897 22736 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:07.030679 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:07.036928 18338 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:07.038352 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:07.039876 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:07.040874 19060 raft_consensus.cc:2410] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:19:07.041628 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.042567 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:07.043689 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:07.044575 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:07.066200 19053 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:07.066763 19055 raft_consensus.cc:2410] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:19:07.068197 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:07.041615 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:07.069315 19060 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:07.045506 22764 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.071465 22454 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.072193 22764 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:07.073104 22764 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.075398 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:07.076210 19060 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:07.077318 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:07.078356 19060 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:07.073721 22764 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.047209 22932 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:07.084013 22932 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:07.085664 22764 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:07.085892 19027 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:07.086164 22932 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:07.088486 22764 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:07.089178 22764 raft_consensus.cc:697] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:07.047678 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 47183.7us
I20260709 13:19:07.090430 18457 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:07.090155 22764 consensus_queue.cc:237] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.091601 22635 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:07.092598 22934 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:07.092963 22635 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:07.094513 22663 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:07.046399 22769 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.050879 22736 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:07.096235 22635 consensus_queue.cc:1059] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:07.096091 22736 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.096167 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:07.097357 22635 raft_consensus.cc:3055] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:07.051438 22818 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.097708 22635 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:07.098170 22818 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.098719 22635 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.053265 22768 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:07.100104 22635 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:07.098209 19025 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:07.100479 22818 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:07.053831 22933 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.112481 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:07.113029 19060 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:07.072052 22454 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:07.113790 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:07.114584 18489 raft_consensus.cc:2410] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:07.093155 22934 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:07.043829 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:07.086912 19027 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:07.025969 18458 connection.cc:256] RPC call timeout handler was delayed by -1.8728179620002265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 13:19:07.106269 19055 raft_consensus.cc:2410] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:19:07.110530 19053 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:07.058854 22938 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:07.116636 18458 connection.cc:256] RPC call timeout handler was delayed by -1.8521179620001931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
I20260709 13:19:07.117321 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.117781 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.121273 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:07.121760 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:07.117357 22736 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:07.121079 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:07.115623 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.106220 22818 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:07.123719 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.127200 18411 raft_consensus.cc:2410] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:19:07.130075 18458 connection.cc:256] RPC call timeout handler was delayed by -1.4727419460000419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 13:19:07.130615 18458 connection.cc:256] RPC call timeout handler was delayed by -1.3431419460000598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
W20260709 13:19:07.131006 18458 connection.cc:256] RPC call timeout handler was delayed by -1.2383179620001101s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28340000000000004s for a response
W20260709 13:19:07.131484 18458 connection.cc:256] RPC call timeout handler was delayed by -1.1942866980000417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
W20260709 13:19:07.131873 18458 connection.cc:256] RPC call timeout handler was delayed by -1.1753179620002356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2904s for a response
W20260709 13:19:07.132247 18458 connection.cc:256] RPC call timeout handler was delayed by -1.0787537490002705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
W20260709 13:19:07.132612 18458 connection.cc:256] RPC call timeout handler was delayed by -1.0623419460000605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2335s for a response
I20260709 13:19:07.134071 18492 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:07.128161 22736 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:07.119737 22927 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:07.138270 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:07.139127 18410 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:07.137313 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:07.100425 22768 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.138159 22736 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.142659 22736 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:07.142874 18514 debug-util.cc:398] Leaking SignalData structure 0x7b08001a90c0 after lost signal to thread 17231
I20260709 13:19:07.143394 22784 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:19:07.144750 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:07.145093 19062 raft_consensus.cc:1240] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:07.145432 18485 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:07.146556 18309 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:07.147423 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 60618.6us
I20260709 13:19:07.128253 22218 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.150962 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:07.173233 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1084) took 2445 ms. Trace:
I20260709 13:19:07.173818 19059 rpcz_store.cc:276] 0709 13:19:04.709801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.844803 (+2135002us) service_pool.cc:224] Handling call
0709 13:19:06.905641 (+ 60838us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.908242 (+  2601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.908274 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.908853 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.113804 (+204951us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:07.113841 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.113900 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.154599 (+ 40699us) raft_consensus.cc:1685] finished
0709 13:19:07.154623 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.155013 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":150,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":94,"thread_start_us":204581,"threads_started":1,"wal-append.queue_time_us":228606}
W20260709 13:19:07.176271 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 78127.7us
I20260709 13:19:07.177057 19025 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:07.177881 22784 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:07.179476 19025 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:07.180158 22784 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:07.180653 22784 raft_consensus.cc:697] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:07.181577 22784 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.137463 22928 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.190642 19053 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
W20260709 13:19:07.191313 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 44864.4us
I20260709 13:19:07.116153 22933 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:07.194988 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 52883us
I20260709 13:19:07.148247 22818 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:07.147148 22932 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:07.129452 22938 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:07.218041 22914 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.616s	user 0.003s	sys 0.002s
I20260709 13:19:07.236095 19027 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:07.245055 22825 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:07.246698 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:07.252473 19057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1272) took 2984 ms. Trace:
I20260709 13:19:07.269901 19057 rpcz_store.cc:276] 0709 13:19:04.268417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.270095 (+  1678us) service_pool.cc:224] Handling call
0709 13:19:04.270470 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.970954 (+700484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.252169 (+2281215us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54006202d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:07.252414 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583983360}
I20260709 13:19:07.255038 18309 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:07.255790 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1078) took 3278 ms. Trace:
I20260709 13:19:07.255703 22932 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.259394 22933 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:07.260632 19054 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1280) took 2980 ms (client timeout 1702 ms). Trace:
I20260709 13:19:07.260182 22934 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:07.261174 22928 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:07.264168 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.266439 22939 log.cc:927] Time spent T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:19:07.197332 22769 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:07.199695 22818 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:07.195168 22218 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:07.275293 18413 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:07.274160 19054 rpcz_store.cc:269] 0709 13:19:04.280612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.283585 (+  2973us) service_pool.cc:224] Handling call
0709 13:19:07.260382 (+2976797us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54005f2b54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:07.260537 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776151296}
I20260709 13:19:07.280563 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.271126 22935 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.288901 18419 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:07.297425 18486 raft_consensus.cc:1240] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:07.271467 19056 rpcz_store.cc:276] 0709 13:19:03.977551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.977659 (+   108us) service_pool.cc:224] Handling call
0709 13:19:03.989502 (+ 11843us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.159843 (+170341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.159873 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.160325 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.457657 (+297332us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:04.525261 (+ 67604us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.570398 (+ 45137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.255266 (+2684868us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54001b08d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:07.255313 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.255359 (+    46us) raft_consensus.cc:1685] finished
0709 13:19:07.255447 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.255589 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5258,"prepare.queue_time_us":111566,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":27833,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":216,"spinlock_wait_cycles":378583936,"thread_start_us":362003,"threads_started":2,"wal-append.queue_time_us":375601,"wal-append.run_cpu_time_us":3357,"wal-append.run_wall_time_us":1054758}
I20260709 13:19:07.299356 18484 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:19:07.300465 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 118222us
I20260709 13:19:07.280843 22743 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:07.304052 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.304052 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:07.305768 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:07.305444 18419 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:07.309397 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.309559 18418 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:07.310043 18419 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:07.310763 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.310899 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.311609 18419 raft_consensus.cc:2393] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 14: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:07.307068 18492 raft_consensus.cc:2410] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:07.288726 22818 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:07.313807 18418 raft_consensus.cc:1217] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 9.10->[11.11-14.13]   Dedup: 11.11->[12.12-14.13]
I20260709 13:19:07.314379 18418 pending_rounds.cc:85] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 11
I20260709 13:19:07.314621 18418 pending_rounds.cc:107] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:19:07.314877 18418 raft_consensus.cc:2889] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:07.280614 22706 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:07.204659 22927 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:07.317899 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:07.329010 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 129640us
I20260709 13:19:07.330152 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:07.331923 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 122593us
I20260709 13:19:07.332978 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:07.316890 22706 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:07.334378 22706 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:07.302372 22935 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.307761 22743 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.358301 22743 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.303254 22933 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.374308 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.374785 18490 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:07.374090 18309 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:07.306066 22768 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:07.375262 18486 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
W20260709 13:19:07.382477 22865 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 2.997s	user 0.015s	sys 0.013s
I20260709 13:19:07.382578 22218 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:07.383420 22218 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:07.393468 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.396641 22927 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:07.400367 22737 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:07.401182 22635 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:07.404412 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 2147) took 3556 ms. Trace:
I20260709 13:19:07.414055 18413 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:07.406436 18484 raft_consensus.cc:2410] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:19:07.407840 22769 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:07.409232 18485 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:07.410089 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:07.430013 19026 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:07.430402 22737 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:07.430840 22737 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:07.431255 22737 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.431588 19026 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:07.432395 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 58410us
I20260709 13:19:07.433364 18309 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:07.434670 18309 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:07.436558 19026 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:07.418066 18335 raft_consensus.cc:1240] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:07.417847 22218 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.420013 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:07.420143 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:07.420683 22932 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:07.453640 18492 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:07.421046 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:07.422106 22928 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:07.423399 19027 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:07.425027 18382 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:07.464800 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:07.465368 18382 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:07.426370 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.409047 22768 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:07.438352 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 953) took 1140 ms. Trace:
I20260709 13:19:07.451298 18493 raft_consensus.cc:2376] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12. Re-sending same reply.
I20260709 13:19:07.465477 18338 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:07.426218 18486 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:07.414248 18341 rpcz_store.cc:276] 0709 13:19:03.848394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.848581 (+   187us) service_pool.cc:224] Handling call
0709 13:19:03.860435 (+ 11854us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:03.867418 (+  6983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.867454 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:03.868023 (+   569us) log.cc:844] Serialized 52 byte log entry
0709 13:19:04.224029 (+356006us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:04.224071 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.224134 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.295109 (+3070975us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:07.403968 (+108859us) raft_consensus.cc:1685] finished
0709 13:19:07.403990 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.404246 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":305513,"raft.queue_time_us":126,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":310085,"spinlock_wait_cycles":13060480,"thread_start_us":353342,"threads_started":1,"wal-append.queue_time_us":488857}
I20260709 13:19:07.397271 22736 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.505388 18384 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:07.456283 22902 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 1.205s	user 0.001s	sys 0.007s
I20260709 13:19:07.508329 22946 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.508510 22747 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:07.510213 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.527634 18415 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:07.510766 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.511364 22753 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:07.511834 22922 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.649s	user 0.002s	sys 0.000s
I20260709 13:19:07.450757 22591 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:07.394560 22933 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:07.516619 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 140919us
I20260709 13:19:07.458199 22769 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:07.462700 22749 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:07.528877 18413 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:07.504782 22825 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:07.452620 22784 consensus_queue.cc:1059] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:19:07.455936 22764 consensus_queue.cc:1059] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:19:07.531113 22747 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.562808 22747 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:07.563385 22942 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 13:19:07.528311 18415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 883) took 1189 ms (client timeout 1565 ms). Trace:
W20260709 13:19:07.564749 18415 rpcz_store.cc:269] 0709 13:19:06.338712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.509762 (+1171050us) service_pool.cc:224] Handling call
0709 13:19:07.528239 (+ 18477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:07.529894 22753 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:07.567718 22753 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.506853 18344 rpcz_store.cc:276] 0709 13:19:06.298334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.545870 (+247536us) service_pool.cc:224] Handling call
0709 13:19:06.546477 (+   607us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:06.546959 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.546993 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.547543 (+   550us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.560302 (+ 12759us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:06.598936 (+ 38634us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.599143 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.599212 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.217321 (+618109us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:07.438024 (+220703us) raft_consensus.cc:1685] finished
0709 13:19:07.438115 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.438276 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53349,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":6758,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":2764,"spinlock_wait_cycles":776841472,"thread_start_us":47635,"threads_started":2,"wal-append.queue_time_us":53636}
I20260709 13:19:07.458072 22951 raft_consensus.cc:3055] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:07.548126 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:07.548362 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.546733 22825 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.545338 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:07.548671 22734 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:07.545102 22769 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.550804 22784 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:07.553045 18411 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:19:07.557126 22797 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.544608 22749 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:07.558298 22764 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:07.560985 22918 log.cc:927] Time spent T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.731s	user 0.001s	sys 0.002s
W20260709 13:19:07.564388 22943 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:19:07.637938 22764 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:07.567327 22938 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:07.642577 22736 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:07.594619 22825 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:07.597266 22769 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.539741 22864 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.646793 22949 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:19:07.646260 22864 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.649358 22864 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:07.636346 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 172506us
I20260709 13:19:07.652551 18384 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:07.653801 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:07.577596 22951 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:07.653708 22807 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:07.566694 22935 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:07.656806 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 222216us
I20260709 13:19:07.660610 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:07.595283 22734 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.639178 22749 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.597719 22784 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:07.672250 22959 consensus_queue.cc:1059] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:07.674068 22959 raft_consensus.cc:3055] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:07.674535 22959 raft_consensus.cc:740] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:07.675642 22959 consensus_queue.cc:260] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.676340 22825 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.677372 22959 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.679312 22825 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:07.672626 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 140770us
I20260709 13:19:07.683669 18309 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:07.683826 18382 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:07.661096 22807 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:07.666433 22797 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:07.667707 22734 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:07.696827 19026 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:19:07.698850 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.664297 22743 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:07.705000 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.642632 22764 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.696156 22807 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:07.711642 22946 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:07.712062 22946 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.712397 22946 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:07.711664 22737 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.714407 22737 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:07.715035 22737 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.706461 22956 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.715890 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2411) took 3521 ms. Trace:
I20260709 13:19:07.716303 22956 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:07.695403 22218 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:07.715514 22737 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.716480 18335 rpcz_store.cc:276] 0709 13:19:04.194819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.194988 (+   169us) service_pool.cc:224] Handling call
0709 13:19:04.229574 (+ 34586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.466680 (+3237106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.715512 (+248832us) spinlock_profiling.cc:243] Waited 3.16 s on lock 0x7b54000e0bd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:07.715798 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7275683200}
I20260709 13:19:07.718151 22894 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:07.718568 22894 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:07.718935 22894 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.718984 22737 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:07.716900 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.719954 22454 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:07.668253 22938 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:19:07.717520 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:07.733065 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.733850 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.737460 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:07.737411 22706 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.738946 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:07.739717 18490 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:07.739915 22706 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:07.746004 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:07.746747 18493 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:07.754606 22753 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:07.763033 22954 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:07.763177 22753 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:07.764312 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:07.764933 18493 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.765053 22951 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.766242 22951 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.760226 22749 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.772373 18493 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:07.773713 18382 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:07.774662 22753 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:07.775130 22753 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:07.775794 22956 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:07.777067 22753 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:07.779143 22218 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:07.779376 22825 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:07.780618 22218 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:07.781888 22825 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:07.782080 18309 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:07.782203 22960 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:07.782684 22818 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.783177 22960 raft_consensus.cc:2764] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:07.783502 22591 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:07.783924 22591 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:19:07.704929 22792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.091s	user 0.021s	sys 0.006s
I20260709 13:19:07.726052 22642 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:07.789245 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 92495.4us
I20260709 13:19:07.702556 22797 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:19:07.791224 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.794498 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:07.795807 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:07.796630 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:07.797696 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:07.799746 18341 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.801294 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:07.725888 22959 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:19:07.800153 18337 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:07.805270 19027 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:07.788802 22792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.021s	sys 0.006s
I20260709 13:19:07.803524 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.803004 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.804108 18411 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:07.804184 18344 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:07.804410 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.802290 19026 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:07.807130 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.808938 18417 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:19:07.809075 18410 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:07.815734 22952 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:07.816228 22952 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:07.817691 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.818081 22864 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:07.818226 22907 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.475s	user 0.004s	sys 0.004s
I20260709 13:19:07.818889 18419 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
W20260709 13:19:07.819154 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 148695us
I20260709 13:19:07.819955 18458 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:07.817327 22952 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.823274 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 885) took 1483 ms. Trace:
I20260709 13:19:07.827602 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.823711 18414 rpcz_store.cc:276] 0709 13:19:06.339428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.339582 (+   154us) service_pool.cc:224] Handling call
0709 13:19:06.339951 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.340345 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:06.340362 (+    17us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.340807 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.342342 (+  1535us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:06.342384 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.342451 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.817489 (+1475038us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:07.821224 (+  3735us) raft_consensus.cc:1685] finished
0709 13:19:07.821246 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.823180 (+  1934us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310219520,"thread_start_us":1136,"threads_started":1,"wal-append.queue_time_us":1546}
I20260709 13:19:07.812016 22818 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:07.821105 22924 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.935s	user 0.003s	sys 0.000s
I20260709 13:19:07.830430 18418 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:07.807408 22938 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:07.822245 22454 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.839483 18458 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:07.840956 22964 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:07.802539 22591 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.836838 22938 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:07.823274 22747 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:07.880903 18413 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
W20260709 13:19:07.881861 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.857954 22935 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:07.868582 22938 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.845507 22769 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.893962 22952 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:07.888512 22706 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.874332 22642 raft_consensus.cc:697] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:07.906442 22747 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:07.847993 22818 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:19:07.909536 18457 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:07.953570 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 44143.6us
W20260709 13:19:07.906526 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 67168.2us
W20260709 13:19:07.910441 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 67900.3us
I20260709 13:19:07.889938 22591 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:07.917490 22908 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.570s	user 0.005s	sys 0.000s
I20260709 13:19:07.920321 22784 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.914075 22706 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:08.015592 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 53952.8us
I20260709 13:19:07.923336 22642 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.928574 22794 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.930253 22959 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:07.931097 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.931890 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:07.938468 22769 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:07.939106 22764 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.941200 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.942291 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:07.943753 18411 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:19:07.944846 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:07.873456 22797 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:07.913956 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:08.028705 18458 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:07.948906 18410 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:07.956339 18341 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:19:07.949697 22743 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:07.922111 22946 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.025367 18413 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:08.007560 22454 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:08.025817 18417 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:08.029300 18492 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:07.867888 22807 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:08.031944 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 76129.1us
I20260709 13:19:08.025784 19061 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:19:08.048110 22917 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 1.343s	user 0.006s	sys 0.000s
I20260709 13:19:08.049532 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 956) took 1750 ms. Trace:
I20260709 13:19:08.052800 18339 rpcz_store.cc:276] 0709 13:19:06.299362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.597249 (+297887us) service_pool.cc:224] Handling call
0709 13:19:06.597654 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.598534 (+   880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.598575 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.607930 (+  9355us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.685435 (+ 77505us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:06.685471 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.685533 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.949332 (+1263799us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:08.049225 (+ 99893us) raft_consensus.cc:1685] finished
0709 13:19:08.049246 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.049456 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"spinlock_wait_cycles":635065600,"thread_start_us":64989,"threads_started":1,"wal-append.queue_time_us":46197}
I20260709 13:19:08.022830 22956 raft_consensus.cc:476] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 13:19:08.060755 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:08.041538 22454 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.067116 22454 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.065481 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 886) took 1725 ms. Trace:
I20260709 13:19:08.070109 18416 rpcz_store.cc:276] 0709 13:19:06.339760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.344195 (+  4435us) service_pool.cc:224] Handling call
0709 13:19:06.344600 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.345044 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.345059 (+    15us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.345484 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.347082 (+  1598us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:06.347119 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.347192 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.916842 (+1569650us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:08.061575 (+144733us) raft_consensus.cc:1685] finished
0709 13:19:08.061595 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.065419 (+  3824us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":194033,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":157,"spinlock_wait_cycles":1346338048,"thread_start_us":1202,"threads_started":1,"wal-append.queue_time_us":1622}
I20260709 13:19:08.072009 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:08.072696 18416 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:08.073431 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:08.075042 22894 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.076519 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:08.077196 22894 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:08.077376 18411 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:08.077968 22933 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:08.078428 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1270) took 3810 ms. Trace:
I20260709 13:19:08.078807 18415 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:08.066175 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:08.082149 22749 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:08.082963 22706 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:08.083638 19056 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 13. Current term is 14. Ops: [12.12-13.13]
I20260709 13:19:08.083937 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:08.084563 19062 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.071094 22935 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:08.082809 22749 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:08.078831 19058 rpcz_store.cc:276] 0709 13:19:04.267747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.271613 (+  3866us) service_pool.cc:224] Handling call
0709 13:19:04.271897 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.698348 (+426451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.078178 (+3379830us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540026e8d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:08.078374 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825536384}
I20260709 13:19:08.057224 22960 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:08.034348 22794 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:08.118355 22903 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 1.867s	user 0.006s	sys 0.008s
I20260709 13:19:08.118934 19053 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:08.120334 18416 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:08.121259 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.122313 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:08.126514 18492 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:08.099804 22706 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:19:08.128312 22706 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:08.128736 22706 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:08.129992 22706 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.131641 22706 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:08.132503 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 942) took 1838 ms. Trace:
I20260709 13:19:08.133407 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2593) took 4026 ms. Trace:
I20260709 13:19:08.139164 22946 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:08.106868 22749 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:08.061360 22959 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:08.141047 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 53356.2us
I20260709 13:19:08.142951 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:08.152237 18416 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.141973 18342 rpcz_store.cc:276] 0709 13:19:06.294295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.940084 (+1645789us) service_pool.cc:224] Handling call
0709 13:19:07.940490 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:07.940787 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.940819 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.941340 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.061878 (+120538us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:08.061941 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.062004 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.132210 (+ 70206us) raft_consensus.cc:1685] finished
0709 13:19:08.132229 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.132349 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":120170,"threads_started":1,"wal-append.queue_time_us":189023}
I20260709 13:19:08.139777 19025 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:08.143116 18487 rpcz_store.cc:276] 0709 13:19:04.107184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.154076 (+ 46892us) service_pool.cc:224] Handling call
0709 13:19:04.164112 (+ 10036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.135584 (+2971472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.135633 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:07.135689 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:07.138288 (+  2599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.133010 (+994722us) spinlock_profiling.cc:243] Waited 2.93 s on lock 0x7b54003fb454. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:08.133055 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.133223 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6741636864}
I20260709 13:19:08.145254 18382 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:08.066596 22792 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 13:19:08.184027 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 44348.5us
I20260709 13:19:08.184847 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:08.188236 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:08.123857 22960 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.205159 22348 consensus_queue.cc:1059] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:19:08.206190 22218 raft_consensus.cc:3055] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:08.206401 22971 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:08.206581 22218 raft_consensus.cc:740] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:08.207741 22218 consensus_queue.cc:260] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.208856 22218 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.193188 22956 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:08.210616 22794 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:08.210460 22956 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.213234 22956 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:08.189888 22591 consensus_queue.cc:1059] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:19:08.213930 22454 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:08.214490 22591 consensus_queue.cc:1243] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:08.215003 22591 raft_consensus.cc:3055] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:08.215298 22591 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:08.215968 22959 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:08.140674 22734 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.216114 22591 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.217584 22591 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.218298 22734 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:08.221115 22749 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.222196 22218 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.222756 22218 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.186733 22753 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:08.226912 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:08.229382 19062 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:08.191553 22946 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:08.232297 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.234578 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 174011us
I20260709 13:19:08.264424 18411 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:08.225052 22769 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:08.299158 22938 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.269448 22769 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:08.303754 22769 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.232043 22753 raft_consensus.cc:697] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:08.306499 22951 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.307135 22951 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.306959 22753 consensus_queue.cc:237] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:08.309224 22218 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:08.312426 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:08.313468 19053 raft_consensus.cc:2393] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:08.315176 22807 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:08.232923 22971 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:08.316749 22971 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.321616 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:08.322396 18419 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:08.322329 22951 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:08.341636 18416 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:08.369671 19061 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:08.370172 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 171711us
W20260709 13:19:08.373273 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.373847 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.375483 22913 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.730s	user 0.013s	sys 0.006s
I20260709 13:19:08.382066 22825 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:08.384881 22913 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.745s	user 0.013s	sys 0.006s
I20260709 13:19:08.385340 22825 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.216109 22454 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:08.389021 22825 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:08.372870 22938 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:08.395037 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 141481us
W20260709 13:19:08.397074 18307 leader_election.cc:336] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.697s (SENT)
W20260709 13:19:08.407254 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 88278.4us
I20260709 13:19:08.409391 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:08.406421 22737 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:08.411648 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 395035us
I20260709 13:19:08.391621 22218 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:08.411106 22994 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:08.405802 22591 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:08.436699 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.453786 18419 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
W20260709 13:19:08.524015 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 70806.1us
I20260709 13:19:08.465090 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:08.540416 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 112129us
I20260709 13:19:08.468231 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:08.709712 18457 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:08.710330 18339 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:08.710681 18457 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:08.589763 19027 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:08.483742 18418 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:08.467391 18341 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
W20260709 13:19:08.584095 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 187037us
I20260709 13:19:08.712078 18341 pending_rounds.cc:85] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 9
W20260709 13:19:08.443142 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 420854us
I20260709 13:19:08.712626 18341 pending_rounds.cc:107] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:19:08.713014 18341 raft_consensus.cc:2889] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:08.707441 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:08.714572 18335 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:08.714695 18484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 2608) took 1406 ms (client timeout 1724 ms). Trace:
W20260709 13:19:08.716209 18484 rpcz_store.cc:269] 0709 13:19:07.308238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.308363 (+   125us) service_pool.cc:224] Handling call
0709 13:19:08.604138 (+1295775us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b5400291dd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:08.714606 (+110468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172641536}
W20260709 13:19:08.721715 18307 leader_election.cc:336] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.733s (SENT)
I20260709 13:19:08.722311 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:08.459311 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:08.412086 22960 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:08.481566 22906 log.cc:927] Time spent T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 2.153s	user 0.008s	sys 0.000s
I20260709 13:19:08.718511 22635 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:08.604517 22950 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 13:19:08.490844 22990 log.cc:927] Time spent T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:08.464833 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:08.581818 22734 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:08.466125 22946 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.728417 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:08.604218 22965 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.019s	sys 0.044s
W20260709 13:19:08.777725 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.739378 22635 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.589550 22612 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.786687 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:08.787065 22612 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.787490 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:08.788223 18492 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:08.789234 22612 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:08.458436 22786 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:08.790129 22786 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.792084 22786 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:08.738085 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:08.794664 18410 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:08.654908 22706 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:08.489657 22769 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.626227 22745 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:08.730014 18457 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:08.744989 18336 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
W20260709 13:19:08.805006 18336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 943) took 2510 ms (client timeout 2579 ms). Trace:
I20260709 13:19:08.751493 22733 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:08.737752 22218 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:08.719336 22994 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.777452 22960 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:08.572748 22743 consensus_queue.cc:1175] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "20e06cff39b649c48d342b7431135303" responder_term: 12 status { last_received { term: 11 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:08.411084 22737 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.755980 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:08.756878 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.824626 18337 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:08.759059 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 169349us
I20260709 13:19:08.773754 19026 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:08.757416 22779 consensus_queue.cc:1059] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 13:19:08.778590 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 66078us
I20260709 13:19:08.785965 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:08.786257 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.786561 22894 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.491590 22825 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.263s
I20260709 13:19:08.738093 19058 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:08.795907 18339 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:08.801031 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:08.943228 18342 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:08.731467 22591 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.802536 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:08.803964 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:08.751644 22985 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:08.815294 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 85442.5us
W20260709 13:19:08.805431 18336 rpcz_store.cc:269] 0709 13:19:06.294728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.464482 (+2169754us) service_pool.cc:224] Handling call
0709 13:19:08.804939 (+340457us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:08.820298 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 107262us
I20260709 13:19:08.823928 22964 raft_consensus.cc:2764] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:19:08.829675 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 56014.5us
W20260709 13:19:08.939379 22962 log.cc:927] Time spent T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:19:08.799125 22734 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.476348 22975 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:19:08.833536 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.818984 22745 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.941956 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:08.938467 22786 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:08.821245 22933 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:08.780861 22946 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:08.795549 22635 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.951061 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 950) took 2653 ms. Trace:
I20260709 13:19:09.023955 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:08.951520 18410 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:08.951333 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:08.829069 19027 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:08.953845 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.831605 22769 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:08.953855 19026 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:19:09.027073 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 198058us
I20260709 13:19:08.943996 22958 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:09.021101 18487 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
W20260709 13:19:09.029508 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.030093 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.023900 18340 rpcz_store.cc:276] 0709 13:19:06.297225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.326006 (+ 28781us) service_pool.cc:224] Handling call
0709 13:19:06.326318 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.326737 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.326762 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.327239 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.328171 (+   932us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:06.328215 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.328284 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.480782 (+2152498us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:08.941652 (+460870us) raft_consensus.cc:1685] finished
0709 13:19:08.941673 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.951003 (+  9330us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":193,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":142,"spinlock_wait_cycles":1391129856,"thread_start_us":536,"threads_started":1,"wal-append.queue_time_us":916}
W20260709 13:19:09.030375 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.023043 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.022387 18339 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:09.049206 22786 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:08.948727 22985 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:08.830403 22706 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:08.823779 22733 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:09.061043 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.027138 18419 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:08.958842 22975 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:09.063764 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.064510 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:09.066511 18484 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:09.064482 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 97272.4us
I20260709 13:19:09.021906 22825 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.064711 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:09.021857 22938 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.078779 22938 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.080178 18342 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:09.081167 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.082422 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:08.946918 22894 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:09.086984 18338 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.066442 18340 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:09.063740 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.068364 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.088406 18336 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:09.068981 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:09.089460 18489 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:09.072180 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:09.072602 22995 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:19:09.025576 22933 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:09.075017 22745 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.050311 22749 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:09.051560 22960 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.077633 22768 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:09.059031 22958 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:09.084064 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.085186 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.081521 22938 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.087924 18485 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:09.092096 18487 raft_consensus.cc:1240] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:09.058429 22982 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.058607 22985 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.096421 18488 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:09.106698 18493 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:09.112336 18339 raft_consensus.cc:2410] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:19:09.119328 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.110796 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.087883 22786 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:09.096168 22933 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.132496 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:09.128083 18489 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:09.131388 18458 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:09.087386 22825 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:09.117300 22749 raft_consensus.cc:697] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:09.165402 18340 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:09.166498 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:09.168063 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.169210 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.169625 18338 raft_consensus.cc:2410] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:19:09.133049 23015 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.169997 18336 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:09.187160 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:09.187943 18485 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.164987 22938 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:09.202514 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 101761us
I20260709 13:19:09.156472 23018 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:09.219816 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:09.220685 18410 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:09.113904 22960 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.224071 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:09.224639 18410 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:09.198239 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 170402us
W20260709 13:19:09.203589 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 249771us
I20260709 13:19:09.126602 22982 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.236461 18419 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:09.209587 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:09.208091 18514 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5d60 after lost signal to thread 18276
I20260709 13:19:09.202028 22938 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:09.244943 18342 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.246853 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.247617 18339 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 14: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:09.248631 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.248063 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.217739 22218 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:09.256304 18336 raft_consensus.cc:2410] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:19:09.226317 22737 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:09.230032 22968 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:09.262545 18335 consensus_meta.cc:287] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.003s
I20260709 13:19:09.269083 18335 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:19:09.265458 18342 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:09.274711 18485 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:09.278723 19053 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:09.249569 22938 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.286454 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.287150 18485 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:19:09.197165 23015 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.255344 22999 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.249405 22801 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:09.207055 22958 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.298233 18335 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:19:09.289469 23010 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:19:09.291320 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:09.303248 19057 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
W20260709 13:19:09.307204 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 75306.3us
I20260709 13:19:09.305594 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 990) took 4969 ms. Trace:
I20260709 13:19:09.310523 18491 rpcz_store.cc:276] 0709 13:19:04.274765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.274956 (+   191us) service_pool.cc:224] Handling call
0709 13:19:04.275330 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:04.298130 (+ 22800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.298175 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:04.310712 (+ 12537us) log.cc:844] Serialized 52 byte log entry
0709 13:19:09.211363 (+4900651us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b5400313920. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee46090 00007f409ee536b8 00007f409eedc92b 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c
0709 13:19:09.226494 (+ 15131us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:09.226561 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.237071 (+ 10510us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.237137 (+    66us) raft_consensus.cc:1685] finished
0709 13:19:09.237154 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.244117 (+  6963us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22305,"raft.queue_time_us":22431,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":8929,"spinlock_wait_cycles":145059584,"thread_start_us":244143,"threads_started":1,"wal-append.queue_time_us":243661,"wal-append.run_cpu_time_us":3104,"wal-append.run_wall_time_us":1080520}
I20260709 13:19:09.317737 23026 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:09.318292 23026 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.320302 23026 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.282470 22968 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:09.304270 23006 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:19:09.322551 22968 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.296764 22999 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.327364 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.328423 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.328946 18339 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:09.329377 22960 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.329679 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:09.331949 18337 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.502s	user 0.004s	sys 0.004s
I20260709 13:19:09.332271 18337 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
W20260709 13:19:09.334136 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.334630 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.336164 22825 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:09.336607 23015 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.336887 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:09.337684 23016 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:19:09.338028 18339 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:09.259691 22749 consensus_queue.cc:237] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.297402 22994 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:09.292671 22946 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:09.241206 22786 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.225116 23018 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.347445 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.350193 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.351770 18340 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.301855 22706 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:09.354228 18336 raft_consensus.cc:1240] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:09.354271 18458 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:09.358971 18484 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:19:09.370363 18340 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:09.373399 22591 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.352385 22985 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.375856 22985 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.375916 22801 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.378118 18492 raft_consensus.cc:2393] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 7: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:09.383736 18410 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:09.390228 22981 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:09.392271 22988 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.796s	user 0.002s	sys 0.000s
I20260709 13:19:09.353799 22894 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:09.350325 22635 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:09.438329 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 87418.1us
I20260709 13:19:09.387511 22591 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.451728 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:09.409904 22733 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:09.456631 22978 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.254s	user 0.005s	sys 0.011s
I20260709 13:19:09.456401 22985 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:19:09.460876 22991 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.989s	user 0.003s	sys 0.003s
I20260709 13:19:09.462744 18491 raft_consensus.cc:2368] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12.
W20260709 13:19:09.477514 18514 debug-util.cc:398] Leaking SignalData structure 0x7b08001bb1e0 after lost signal to thread 18368
W20260709 13:19:09.477895 18514 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0480 after lost signal to thread 18369
W20260709 13:19:09.478958 18514 debug-util.cc:398] Leaking SignalData structure 0x7b08003bca20 after lost signal to thread 18443
W20260709 13:19:09.479153 18239 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54880 (request call id 258) took 30420 ms (client timeout 15000 ms). Trace:
W20260709 13:19:09.480062 18514 debug-util.cc:398] Leaking SignalData structure 0x7b08003aaec0 after lost signal to thread 18517
W20260709 13:19:09.480515 18514 debug-util.cc:398] Leaking SignalData structure 0x7b0800340960 after lost signal to thread 18518
I20260709 13:19:04.233402 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:09.481770 18514 debug-util.cc:398] Leaking SignalData structure 0x7b0800386420 after lost signal to thread 19086
W20260709 13:19:09.482100 18514 debug-util.cc:398] Leaking SignalData structure 0x7b0800273380 after lost signal to thread 19087
W20260709 13:19:09.482620 18514 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8b60 after lost signal to thread 22675
W20260709 13:19:09.483125 18514 debug-util.cc:398] Leaking SignalData structure 0x7b08003c31c0 after lost signal to thread 22791
W20260709 13:19:09.483752 18514 debug-util.cc:398] Leaking SignalData structure 0x7b0800273240 after lost signal to thread 22856
W20260709 13:19:09.483978 18514 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1cc0 after lost signal to thread 22857
W20260709 13:19:09.484177 18514 debug-util.cc:398] Leaking SignalData structure 0x7b08003bb0c0 after lost signal to thread 22862
W20260709 13:19:09.484513 18514 debug-util.cc:398] Leaking SignalData structure 0x7b08003b2740 after lost signal to thread 22875
W20260709 13:19:09.484725 18514 debug-util.cc:398] Leaking SignalData structure 0x7b0800380440 after lost signal to thread 22876
W20260709 13:19:09.484926 18514 debug-util.cc:398] Leaking SignalData structure 0x7b08003ddcc0 after lost signal to thread 22877
W20260709 13:19:09.485301 18514 debug-util.cc:398] Leaking SignalData structure 0x7b0800350520 after lost signal to thread 22893
I20260709 13:19:09.486229 18339 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:09.488989 18458 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:09.468156 22933 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:09.463407 22981 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:19:09.492811 22985 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:09.481292 18240 catalog_manager.cc:5697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 5 to 6, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 6 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:09.506222 19057 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:09.506664 22933 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:09.508978 22635 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.509259 18240 catalog_manager.cc:5697] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.514605 18240 catalog_manager.cc:5697] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 9 to 10, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 10 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.510795 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:09.516156 19055 raft_consensus.cc:2410] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:19:09.516597 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1300) took 1128 ms. Trace:
W20260709 13:19:09.512682 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.509224 22980 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 1.022s	user 0.002s	sys 0.004s
I20260709 13:19:09.533169 22999 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:09.533273 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:09.534744 18308 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:09.536471 18308 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:09.516882 19055 rpcz_store.cc:276] 0709 13:19:08.388677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.412267 (+ 23590us) service_pool.cc:224] Handling call
0709 13:19:09.510635 (+1098368us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:19:09.516520 (+  5885us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14130944}
I20260709 13:19:09.505070 22981 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.538511 22218 consensus_queue.cc:1059] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:09.539340 22218 raft_consensus.cc:2764] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:19:09.540076 22218 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:09.541401 22218 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.542162 22806 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:09.542498 22806 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:09.543277 22806 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:09.544472 22806 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:09.547832 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.504328 18457 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:09.522914 18240 catalog_manager.cc:5697] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:09.523700 22670 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.493114 22982 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.530817 23018 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.449546 22591 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.549770 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:09.566665 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:09.556751 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 52507.8us
I20260709 13:19:09.523582 22706 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.565186 22663 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:09.564954 18240 catalog_manager.cc:5697] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.563244 22218 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:09.582448 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:09.585527 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 89672.3us
I20260709 13:19:09.585865 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:09.587567 19055 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:09.586041 22706 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.590031 22706 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.590473 22706 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.591455 22981 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:09.571228 23001 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.590875 22706 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.595121 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:09.594208 23001 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.565658 22999 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:09.582890 18384 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:09.576336 22733 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:09.605221 22218 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:09.613591 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.597800 18240 catalog_manager.cc:5697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 8 to 11, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 11 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:09.614017 22218 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.614267 18489 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:09.614497 22218 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.615947 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:09.616061 18240 catalog_manager.cc:5697] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 5 to 8, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 8 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:09.618136 22734 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:09.567490 22960 consensus_queue.cc:1059] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:19:09.619264 22960 consensus_queue.cc:1243] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:09.619760 22960 raft_consensus.cc:3055] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:09.620065 22960 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:09.620951 22960 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:09.623077 18343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 982) took 1133 ms. Trace:
I20260709 13:19:09.584748 23017 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:19:09.623497 18343 rpcz_store.cc:276] 0709 13:19:08.489447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.572193 (+ 82746us) service_pool.cc:224] Handling call
0709 13:19:08.590734 (+ 18541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.026670 (+435936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.026701 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.026742 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:09.027961 (+  1219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.622834 (+594873us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54002d19d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:09.622882 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.623019 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":865779456}
I20260709 13:19:09.586150 22933 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.624969 22933 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.625237 22999 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.627656 22999 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:09.604045 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.604667 18457 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:09.617646 18240 catalog_manager.cc:5697] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.572472 19025 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:09.608916 18384 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:09.605245 22938 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:09.610109 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:09.631227 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 58840.2us
I20260709 13:19:09.631680 18485 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:19:09.585269 22663 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.611585 22591 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.576198 22864 consensus_queue.cc:1059] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:19:09.611116 22792 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:09.629016 18484 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:09.647316 18419 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:19:09.637933 19025 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:09.648320 19025 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:09.644523 18240 catalog_manager.cc:5697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 5 to 6, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 6 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.613932 22733 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.584618 22982 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:19:09.597666 23027 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:09.479478 18239 rpcz_store.cc:269] 0709 13:18:39.058699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.058914 (+   215us) service_pool.cc:224] Handling call
0709 13:19:09.478927 (+30420013us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:55.996053 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:56.130083 (+134030us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:56.130165 (+    82us) write_op.cc:435] Acquired schema lock
0709 13:18:56.130194 (+    29us) tablet.cc:662] Decoding operations
0709 13:18:56.442798 (+312604us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:56.442904 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:56.442942 (+    38us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:18:56.451477 (+  8535us) tablet.cc:701] Row locks acquired
0709 13:18:56.451537 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:18:56.451763 (+   226us) write_op.cc:270] Start()
0709 13:18:56.451902 (+   139us) write_op.cc:276] Timestamp: P: 1783603136451655 usec, L: 0
0709 13:18:56.451931 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:18:56.452654 (+   723us) log.cc:844] Serialized 4714 byte log entry
0709 13:18:58.144344 (+1691690us) op_driver.cc:464] REPLICATION: finished
0709 13:18:58.396160 (+251816us) write_op.cc:301] APPLY: starting
0709 13:18:58.435115 (+ 38955us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:58.469591 (+ 34476us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:58.469715 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:58.470886 (+  1171us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:58.471234 (+   348us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 13:18:58.471286 (+    52us) write_op.cc:312] APPLY: finished
0709 13:18:58.471704 (+   418us) log.cc:844] Serialized 89 byte log entry
0709 13:18:58.472623 (+   919us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:58.472778 (+   155us) write_op.cc:454] Released schema lock
0709 13:18:58.472858 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:58.507724 (+ 34866us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:58.509489 (+  1765us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3355679,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":228382,"apply.run_cpu_time_us":4458,"apply.run_wall_time_us":92112,"num_ops":12,"prepare.queue_time_us":194980,"prepare.run_cpu_time_us":93911,"prepare.run_wall_time_us":649899,"raft.queue_time_us":842407,"raft.run_cpu_time_us":25227,"raft.run_wall_time_us":185019,"replication_time_us":1692171,"thread_start_us":808190,"threads_started":4,"wal-append.queue_time_us":633625,"wal-append.run_cpu_time_us":76948,"wal-append.run_wall_time_us":2381095}]]}
I20260709 13:19:09.651652 22792 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:19:09.654268 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 45389.3us
I20260709 13:19:09.646701 22960 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.643440 22663 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.644049 22913 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:19:09.661551 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:09.662423 18419 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:09.664976 23032 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:09.665439 23032 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:09.643625 22635 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.661672 22684 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.668845 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:09.666061 22663 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.646467 22981 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:09.670209 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:09.670266 18240 catalog_manager.cc:5697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.668880 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:09.654624 22733 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:09.666716 22792 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:09.686143 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 119578us
I20260709 13:19:09.627733 22933 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:09.675042 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 65427.1us
I20260709 13:19:09.646648 22786 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:09.669725 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:09.678785 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:09.679855 19057 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:09.682382 18416 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:09.690225 18411 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:09.691176 18382 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:09.691397 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:09.692193 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:09.692387 18486 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:09.651502 22734 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:19:09.666570 22971 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:09.698869 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:09.675550 22747 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.686268 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:09.687952 18308 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:09.649381 22999 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:19:09.675280 23021 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.665834 23032 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:09.683741 18240 catalog_manager.cc:5697] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 6 to 7, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 7 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.672607 18419 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:09.681777 22749 raft_consensus.cc:3055] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:09.703613 18485 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:09.700194 18382 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:09.686616 22981 raft_consensus.cc:697] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:09.693281 22786 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:09.756656 22786 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:09.707161 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.759851 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.760231 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.696522 19025 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:09.761096 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 64672.8us
I20260709 13:19:09.761737 19025 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:09.707404 22938 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:09.707568 23021 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:09.764447 23021 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.768500 22764 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:09.768908 22764 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:09.769272 22764 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:09.770370 22958 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.770814 22958 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.771159 22958 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.771855 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:09.772423 19059 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:09.775759 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.776400 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2293) took 1850 ms. Trace:
I20260709 13:19:09.776749 18418 rpcz_store.cc:276] 0709 13:19:07.925675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.925827 (+   152us) service_pool.cc:224] Handling call
0709 13:19:08.483500 (+557673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.711973 (+228473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.776214 (+1064241us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54003629d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:09.776344 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281453824}
I20260709 13:19:09.778321 18342 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 13:19:09.778657 18342 pending_rounds.cc:85] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 12
I20260709 13:19:09.778860 18342 pending_rounds.cc:107] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:19:09.779057 18342 raft_consensus.cc:2889] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:09.705475 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:09.779646 18416 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.714582 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.702093 22670 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:09.701967 22663 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.714993 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.718122 22825 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.718688 18489 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:09.784819 18335 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:09.675063 23027 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.699054 22973 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:09.703317 22971 raft_consensus.cc:697] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:09.723392 22946 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:09.798592 22218 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:09.782896 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:09.727948 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:09.727612 18309 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:09.799810 18410 raft_consensus.cc:2368] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
W20260709 13:19:09.800261 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 72742.8us
I20260709 13:19:09.800676 22218 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:09.800840 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:09.721679 19027 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:09.801688 23001 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:09.730154 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.802482 18343 raft_consensus.cc:2376] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14. Re-sending same reply.
I20260709 13:19:09.803596 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.730721 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.806427 18336 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:09.806525 22218 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:09.807461 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.756656 22985 raft_consensus.cc:3055] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:09.808264 22985 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:09.808403 18336 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:09.809410 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.731444 22591 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.810516 18485 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:09.810192 22591 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.812778 22591 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.731611 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:09.736948 23036 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:19:09.813587 18412 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:09.708595 22749 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:09.732551 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.814158 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:09.814761 22749 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.815289 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.815843 18335 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:09.815960 22749 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:09.816479 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 94893.8us
I20260709 13:19:09.816680 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.817464 18335 raft_consensus.cc:2410] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:19:09.712292 22806 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.818174 22806 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.819448 22965 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:09.819968 22965 raft_consensus.cc:697] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:09.820232 22806 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.820883 22965 consensus_queue.cc:237] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.821635 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:09.822250 18412 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.747287 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2413) took 1017 ms. Trace:
I20260709 13:19:09.824733 18338 rpcz_store.cc:276] 0709 13:19:08.729993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.984823 (+254830us) service_pool.cc:224] Handling call
0709 13:19:09.747047 (+762224us) spinlock_profiling.cc:243] Waited 55.4 ms on lock 0x7b54002d0ad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:09.747228 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127403264}
W20260709 13:19:09.749256 23003 log.cc:927] Time spent T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.963s	user 0.001s	sys 0.002s
I20260709 13:19:09.747051 22706 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:09.752301 22997 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.278s	user 0.002s	sys 0.003s
I20260709 13:19:09.680795 22684 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:09.705972 22747 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.828884 22747 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.829422 19027 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:09.755139 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.829761 22684 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:09.755753 22981 consensus_queue.cc:237] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:09.781694 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.782051 19058 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:09.759389 22998 log.cc:927] Time spent T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 1.305s	user 0.000s	sys 0.010s
W20260709 13:19:09.844055 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 130192us
I20260709 13:19:09.845526 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.783341 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:09.846539 18342 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:09.846753 18418 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:09.721122 22975 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.787871 18240 catalog_manager.cc:5697] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 8 to 9, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 9 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.792228 18486 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:09.792887 22825 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:09.853860 18340 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:09.854063 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.854380 22894 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:09.854821 22894 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:09.855171 22894 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:09.858322 18488 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:09.858697 18488 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:09.859432 18488 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.860466 18488 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:09.861874 18343 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:09.862056 23018 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:19:09.863180 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.863840 18343 raft_consensus.cc:2376] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12. Re-sending same reply.
I20260709 13:19:09.864415 22784 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.869128 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:09.871834 18343 raft_consensus.cc:2410] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:19:09.873338 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.848666 22946 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:09.874536 22946 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.874745 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.875053 22946 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:09.876189 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.876896 18343 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:09.794854 23027 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:09.795499 22797 raft_consensus.cc:3055] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:09.796160 18417 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:09.681334 22635 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:09.883334 22797 raft_consensus.cc:740] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:09.884941 22635 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:09.886409 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.887473 18343 raft_consensus.cc:2410] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:09.891098 18240 catalog_manager.cc:5697] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 6 to 7, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 7 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.798458 22971 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.892899 18240 catalog_manager.cc:5697] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 3 to 10, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 10 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.727031 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:09.728420 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:09.895501 19055 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:09.895443 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:09.809193 22985 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:09.825762 23005 log.cc:927] Time spent T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.876s	user 0.003s	sys 0.000s
I20260709 13:19:09.827240 18337 raft_consensus.cc:2393] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:09.781040 19059 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:09.908833 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 1095) took 1449 ms. Trace:
I20260709 13:19:09.909271 19059 rpcz_store.cc:276] 0709 13:19:08.459525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.459663 (+   138us) service_pool.cc:224] Handling call
0709 13:19:09.771710 (+1312047us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:19:09.908754 (+137044us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11862272}
W20260709 13:19:09.813256 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.840777 18413 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:19:09.910457 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:09.910526 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.911257 18341 raft_consensus.cc:2376] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12. Re-sending same reply.
I20260709 13:19:09.911257 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:09.913441 18335 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 14: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:09.841091 18416 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:09.848435 18412 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:09.845638 18384 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:09.917260 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 71706.3us
I20260709 13:19:09.918862 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:09.851971 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 151833us
I20260709 13:19:09.850965 18336 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:09.852283 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:09.894244 22975 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:09.896313 19058 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:09.933601 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:09.936666 18490 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:09.944348 23032 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:09.945482 18411 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:09.945890 18488 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:19:09.945834 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.946655 18488 pending_rounds.cc:85] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 10
I20260709 13:19:09.946916 18488 pending_rounds.cc:107] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:19:09.952330 18488 raft_consensus.cc:2889] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:09.952531 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.955576 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.951514 18384 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:09.958226 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.958953 18487 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:09.932690 23018 raft_consensus.cc:2764] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:09.962009 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:09.964681 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.960966 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:09.973527 18488 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:19:09.946744 22684 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:09.990882 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.990808 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:09.950474 22912 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.959246 22985 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:10.000375 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 981) took 1511 ms. Trace:
I20260709 13:19:10.000581 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.000761 18384 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:10.001052 18344 rpcz_store.cc:276] 0709 13:19:08.489157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.507832 (+ 18675us) service_pool.cc:224] Handling call
0709 13:19:08.508247 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.508504 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:08.745414 (+236910us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.781652 (+ 36238us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.739969 (+958317us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b1800454120. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdec455 00007f409eed4060 00007f409eee6716 00007f409eef7287 00007f409eef7208
0709 13:19:09.764336 (+ 24367us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b1800454120. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:19:10.000004 (+235668us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.000065 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:10.000129 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.000199 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.000320 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16498,"prepare.queue_time_us":1268659,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":31958,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":7906,"spinlock_wait_cycles":42590720,"thread_start_us":299853,"threads_started":2}
I20260709 13:19:10.008910 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.009259 18488 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:09.947981 22753 consensus_queue.cc:1059] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:19:10.026371 18487 raft_consensus.cc:2410] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:10.026856 18344 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:19:10.027593 18344 pending_rounds.cc:85] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 10
I20260709 13:19:10.027930 18344 pending_rounds.cc:107] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:19:10.028263 18344 raft_consensus.cc:2889] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:10.030923 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:10.032698 22825 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:10.034066 22825 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:10.034518 22825 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.034941 22825 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:10.039927 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:10.041702 22670 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:10.041774 22747 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:10.042514 22670 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:10.043157 22753 raft_consensus.cc:3055] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:10.043650 22753 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:10.044615 22753 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.047381 18484 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:19:10.047461 22753 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:09.976254 23038 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:10.053052 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:10.055420 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:10.057315 18384 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:10.061887 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:09.994570 23022 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:10.063406 18338 raft_consensus.cc:2410] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:10.068322 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:10.068500 18489 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:09.968545 22794 consensus_queue.cc:1059] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:19:10.073416 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.087323 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.087965 18488 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:10.088763 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:10.087365 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.089367 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.089721 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.091025 18488 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:10.091609 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:10.096261 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:10.089329 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:10.098541 18489 raft_consensus.cc:2410] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:10.099259 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:10.029604 23018 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:10.131903 18490 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:19:10.135387 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 61079us
I20260709 13:19:10.136893 18490 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:19:10.105266 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 1.06341e+06us
W20260709 13:19:10.141001 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.141067 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:09.998636 22684 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.158092 18487 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:10.160810 18490 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:19:10.161170 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 103910us
I20260709 13:19:10.162873 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:10.163281 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:10.165889 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:10.166723 18413 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:10.171865 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:10.172784 18413 raft_consensus.cc:2393] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 14: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:10.069820 23022 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.137964 22635 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:10.164265 18419 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:10.182145 18413 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:10.182070 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:10.140563 22769 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:10.130302 22994 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:10.193794 18419 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:10.194397 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:10.204293 18411 raft_consensus.cc:2393] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:10.204758 22956 raft_consensus.cc:3055] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:10.205350 22956 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:10.104357 23001 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:19:10.196780 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:10.093976 22749 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.179184 22670 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:10.102259 22792 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.213518 22866 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.218s
W20260709 13:19:10.214048 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 51253.1us
I20260709 13:19:10.180506 23022 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:10.215392 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:10.216785 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:10.095007 22973 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:19:10.218606 18384 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:10.154013 22864 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:19:10.073549 23038 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.184199 22635 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.215104 22866 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:10.219878 22733 consensus_meta.cc:287] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.001s
I20260709 13:19:10.179451 23018 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:10.218501 22663 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:10.218128 23012 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:10.236052 22745 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:10.282083 23012 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:10.282521 23012 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:10.284611 18415 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:10.280999 23022 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:10.222311 23017 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:19:10.236804 22797 consensus_queue.cc:260] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:10.238008 22684 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:10.226627 22635 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:10.299204 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:10.225703 22960 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:10.242416 23043 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:19:10.213563 22749 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.215412 22792 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:10.250224 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.250226 23032 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:10.256510 22958 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.310585 22797 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:10.311275 22958 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:10.266088 22981 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:19:10.226235 22866 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.311986 22866 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:10.313298 22981 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:10.318161 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:10.318830 18335 raft_consensus.cc:2376] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16. Re-sending same reply.
I20260709 13:19:10.318221 19058 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:10.320454 22737 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:10.320901 22737 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:10.323670 22866 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.224397 22670 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:10.326725 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:10.327579 18343 raft_consensus.cc:2393] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 15: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:10.325794 22866 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:10.262132 22807 raft_consensus.cc:3055] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:10.264034 23038 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:10.264375 22938 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:10.206844 22971 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:19:10.266057 22986 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.346240 22986 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.321780 22737 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.347585 22737 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:10.348278 22986 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:10.300204 22956 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.351082 22956 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:10.267146 18493 raft_consensus.cc:2410] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:10.267963 18384 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:10.212311 22994 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.225611 23027 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:10.274976 19061 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:10.275364 22733 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.278331 23046 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.281195 23018 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:10.308494 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.374696 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:10.331563 18488 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:10.375602 18341 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:10.331667 18487 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:10.330509 22807 raft_consensus.cc:740] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:10.224174 22786 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.303304 22946 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.342971 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:10.387962 18485 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:10.352509 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 159720us
I20260709 13:19:10.227210 23021 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:10.361289 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 93467.5us
I20260709 13:19:10.396862 18384 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:10.290381 22764 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.366809 19053 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:10.367827 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.369225 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.332188 23022 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:10.379601 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 1029) took 1040 ms. Trace:
I20260709 13:19:10.405050 18491 rpcz_store.cc:276] 0709 13:19:09.330979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.331128 (+   149us) service_pool.cc:224] Handling call
0709 13:19:10.369794 (+1038666us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400374bd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:10.369901 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267891584}
W20260709 13:19:10.380445 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.406546 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:10.406916 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.384243 19061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1301) took 1975 ms (client timeout 1779 ms). Trace:
I20260709 13:19:10.303978 22663 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:19:10.364169 22986 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:10.368937 22743 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.400785 19054 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:10.402305 18382 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:10.341718 22960 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.353984 22894 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:10.413004 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:10.417794 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:10.407681 19061 rpcz_store.cc:269] 0709 13:19:08.408908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.409084 (+   176us) service_pool.cc:224] Handling call
0709 13:19:10.384018 (+1974934us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b5400489254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:10.384147 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4288512896}
W20260709 13:19:10.427714 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.410867 18342 raft_consensus.cc:1240] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:10.430011 18344 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:10.424094 18457 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:10.431134 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:10.431838 18344 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:10.427912 18382 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:10.434837 19059 raft_consensus.cc:2410] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:10.437151 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:10.437932 18336 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:10.451905 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:10.452931 18308 leader_election.cc:400] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
I20260709 13:19:10.453299 18308 leader_election.cc:403] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:10.454818 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:10.457227 18457 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:10.464092 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 58897.8us
I20260709 13:19:10.464978 18308 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:10.427160 22958 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.368916 23027 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.427287 22913 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:10.428695 22753 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:10.468503 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:10.482399 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.482628 18338 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:10.478783 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:10.480105 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 175011us
I20260709 13:19:10.482169 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.483645 19060 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:10.483901 19055 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 7.
I20260709 13:19:10.475586 18485 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:19:10.481709 18308 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:10.422431 22792 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:19:10.485770 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:10.499982 19057 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:10.386530 23046 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.491945 18413 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:10.500643 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:10.492380 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:10.422292 23012 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.477341 22591 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:10.514688 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:10.514807 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:10.515230 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:10.497318 22994 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:10.455502 22642 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:10.428550 22743 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.503298 18410 raft_consensus.cc:1275] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:10.460353 19058 raft_consensus.cc:2955] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:10.504391 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.511039 19060 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:10.523085 19026 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:10.515763 18415 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:10.516499 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:10.426705 22985 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:19:10.485524 22753 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.524729 19026 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:10.499686 23032 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:10.481612 23022 consensus_queue.cc:1059] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:19:10.548955 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 56682.7us
I20260709 13:19:10.502117 22913 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:10.545627 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:10.512023 23038 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:10.541399 18339 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:10.543725 19026 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:10.556020 19056 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:10.485661 22958 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.532925 22642 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.558465 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:10.566251 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.536247 22753 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:10.502218 22825 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.540539 22975 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:10.562625 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:10.575836 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:10.555909 22663 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:10.605049 18488 raft_consensus.cc:1240] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:10.591502 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:10.603669 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 45291.9us
I20260709 13:19:10.561305 23038 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.502370 22807 consensus_queue.cc:260] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:10.622525 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.563885 22784 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:10.558264 22938 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:10.621944 18487 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:10.547585 23056 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:10.630503 18488 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:10.547724 22745 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:10.564635 22642 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:10.618150 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:10.560011 22971 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:19:10.555820 22994 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:19:10.602553 22736 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:19:10.664517 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 46478.5us
I20260709 13:19:10.608521 22866 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:10.673095 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:10.561131 23032 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:10.690294 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.691268 18485 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:10.679090 18384 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:10.609474 22663 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.622398 22749 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:10.631731 23038 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:10.641381 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 140842us
W20260709 13:19:10.684000 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 226841us
W20260709 13:19:10.684489 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.730331 18410 raft_consensus.cc:1240] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:10.685178 18339 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:10.657171 23056 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.682857 22938 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:10.695411 23024 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:10.696655 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:10.763912 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 67428.9us
W20260709 13:19:10.699844 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.714468 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:10.714366 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.714973 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:10.715350 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:10.715862 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.663002 22733 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:10.673864 22706 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:10.680787 23049 log.cc:927] Time spent T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:19:10.800985 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.721560 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.722846 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.673131 23022 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:10.723543 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.725589 22786 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:10.675544 22807 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:10.727339 18457 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:10.686760 23037 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:10.682370 22736 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:10.766377 18419 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:10.768481 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.815412 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.773729 18416 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:10.772253 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:10.722028 22663 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:10.804265 19054 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:10.778164 22684 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:10.685907 23048 log.cc:927] Time spent T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:19:10.774627 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:10.810915 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.811389 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.826843 18339 raft_consensus.cc:2368] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12.
I20260709 13:19:10.811947 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.826917 18485 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:10.827688 19059 raft_consensus.cc:2410] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:10.816648 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.772984 19055 raft_consensus.cc:2393] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:10.756680 23056 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:10.818017 19062 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:10.687830 22806 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
W20260709 13:19:10.819383 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 152714us
I20260709 13:19:10.828780 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:10.805490 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.847509 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.848534 18487 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:19:10.815471 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 88223.6us
I20260709 13:19:10.800638 22894 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:10.844847 18344 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:10.807392 23024 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:10.855971 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.856833 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.859834 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.692889 22913 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:10.818043 22736 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:10.866007 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:10.869020 18339 raft_consensus.cc:2368] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:10.870103 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:10.822942 23062 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:10.868010 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:10.874464 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:10.876631 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.880244 18339 raft_consensus.cc:2393] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:10.908002 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:10.913689 18492 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:10.908185 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.914563 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:10.811758 22981 consensus_queue.cc:1059] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:19:10.919020 18491 raft_consensus.cc:2410] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:10.927027 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:10.850189 22960 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:10.938980 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:10.849637 23012 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:10.863457 22786 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:10.904208 23044 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:10.947721 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.957855 18485 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:10.956651 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:10.958644 18344 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:10.953455 19057 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:19:10.945734 18336 raft_consensus.cc:2410] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:10.961889 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:10.962746 19059 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:19:10.864480 23046 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:10.971168 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:10.974435 18344 raft_consensus.cc:1240] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:10.983554 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.995827 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:10.999429 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:10.828492 23075 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.130s
W20260709 13:19:10.961577 22635 consensus_meta.cc:287] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.003s
I20260709 13:19:10.956943 22786 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.963264 23027 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:11.050268 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.977705 22825 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:10.997058 22958 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:10.875447 23060 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
W20260709 13:19:11.036588 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 190134us
I20260709 13:19:11.030638 18492 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:11.083704 18458 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:11.086861 18415 consensus_meta.cc:287] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.001s
I20260709 13:19:11.088338 18415 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:11.090170 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:11.087409 19025 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:11.073084 18344 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:11.090799 18492 raft_consensus.cc:2376] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12. Re-sending same reply.
I20260709 13:19:10.971580 22960 consensus_queue.cc:1059] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 13:19:11.090180 19058 consensus_meta.cc:287] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 13:19:11.096371 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:11.096673 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:11.103224 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:11.119158 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:11.105980 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:11.106138 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:11.123821 19056 raft_consensus.cc:2393] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:11.123245 18491 raft_consensus.cc:2410] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:11.126508 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:11.123808 19059 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:11.093691 19062 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
W20260709 13:19:11.096837 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 249585us
I20260709 13:19:11.129606 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:11.130326 18415 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:11.130259 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:11.135634 18488 raft_consensus.cc:2393] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:11.033166 22786 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.138563 18384 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:11.107646 23044 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:19:11.152654 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:11.114404 23057 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.427s	user 0.001s	sys 0.000s
I20260709 13:19:11.160439 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:11.161214 18412 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.161234 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:11.163604 19056 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:11.020287 23071 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.151s
I20260709 13:19:11.155263 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:11.168777 19062 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:10.977270 22938 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.165218 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:11.165705 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:11.154479 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:11.173738 18344 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:11.035727 22635 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.184674 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:11.147122 22706 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:11.150074 23032 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:11.201010 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:11.160634 23012 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:11.208634 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:11.181156 23065 log.cc:927] Time spent T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.410s	user 0.001s	sys 0.000s
I20260709 13:19:11.221165 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:11.222180 18336 raft_consensus.cc:2393] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:11.226356 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:11.232918 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.233894 18344 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:11.228365 18412 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:11.156598 22684 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:19:11.185854 22960 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:11.236765 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 60998.9us
I20260709 13:19:11.237185 18489 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:11.096704 23024 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.241943 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:11.245800 18308 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:11.246521 19059 raft_consensus.cc:2410] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:11.230406 19062 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:11.247591 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:11.256345 19059 raft_consensus.cc:1240] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:19:11.257887 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:11.276482 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2240) took 1281 ms. Trace:
I20260709 13:19:11.276989 18484 rpcz_store.cc:276] 0709 13:19:09.995393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.048722 (+ 53329us) service_pool.cc:224] Handling call
0709 13:19:10.049131 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.049605 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.049659 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.060577 (+ 10918us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.435548 (+374971us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:10.680948 (+245400us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.682921 (+  1973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.682999 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.276255 (+593256us) raft_consensus.cc:1685] finished
0709 13:19:11.276275 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.276415 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1648,"prepare.queue_time_us":445590,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":8489,"raft.queue_time_us":21257,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":178,"thread_start_us":473919,"threads_started":2,"wal-append.queue_time_us":519833}
I20260709 13:19:11.271621 18307 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:11.258209 23027 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.257972 23095 raft_consensus.cc:3055] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:11.257499 23012 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:11.306437 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:11.281185 23078 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 13:19:11.306898 19062 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8. Ops: [6.7-7.8]
I20260709 13:19:11.304284 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:11.272130 23018 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:11.316052 18343 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:11.314718 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:11.317685 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:11.319247 18485 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:11.321700 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:11.324674 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:11.324851 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:11.325398 18492 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:11.261559 23032 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:19:11.305449 23096 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:11.331295 22747 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:11.331467 18384 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:11.332891 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:11.336998 19056 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12. Ops: [10.8-11.9]
I20260709 13:19:11.268209 23076 consensus_queue.cc:1059] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:19:11.338529 23093 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.339968 23101 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:11.340603 23091 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:11.341643 23092 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:11.342864 23088 log.cc:927] Time spent T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:19:11.268942 23022 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:19:11.384531 22958 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:11.299057 22706 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:11.384721 23106 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:11.385105 22958 raft_consensus.cc:697] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:11.385977 23057 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:11.386061 22958 consensus_queue.cc:237] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.348351 18457 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:11.349042 23108 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:11.387687 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:11.388284 18485 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:11.346427 23077 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:19:11.354300 23056 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.330632 18344 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:11.355836 23103 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:11.269340 22960 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:11.400744 22960 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:11.357082 23037 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:11.358389 22635 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:11.359714 23021 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:11.402204 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.403187 22737 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:11.403369 19027 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:11.403965 23056 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:11.403767 22737 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.404533 23056 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.405303 19057 raft_consensus.cc:2393] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:11.406118 22737 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:11.361627 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:11.364037 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:11.354830 22753 consensus_meta.cc:287] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.749s	user 0.010s	sys 0.000s
I20260709 13:19:11.386816 22747 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.410547 22753 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:11.411275 23074 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.067s	user 0.001s	sys 0.001s
I20260709 13:19:11.411813 18411 raft_consensus.cc:2393] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:11.412585 22747 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:11.412767 22753 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:11.367012 22807 consensus_meta.cc:287] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.000s
W20260709 13:19:11.413465 23100 log.cc:927] Time spent T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 13:19:11.367650 18487 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:19:11.414644 18487 raft_consensus.cc:3055] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:11.414992 18487 raft_consensus.cc:740] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:11.415423 23080 log.cc:927] Time spent T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:19:11.415560 22663 consensus_meta.cc:287] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.000s
I20260709 13:19:11.368371 22736 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:11.370294 23061 log.cc:927] Time spent T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.646s	user 0.002s	sys 0.000s
I20260709 13:19:11.415716 18493 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:19:11.417579 22736 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:11.418650 23046 raft_consensus.cc:2955] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:11.305833 23095 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:11.422600 23095 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:11.423302 23038 consensus_meta.cc:287] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.000s
I20260709 13:19:11.379350 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:11.380710 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 49332.1us
I20260709 13:19:11.423866 23038 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:11.381332 23018 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:11.427472 23018 raft_consensus.cc:697] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:19:11.429131 22986 consensus_meta.cc:287] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.002s	user 0.006s	sys 0.005s
I20260709 13:19:11.431947 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:11.432788 18337 raft_consensus.cc:2393] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:19:11.341697 22591 consensus_meta.cc:287] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.809s	user 0.008s	sys 0.000s
W20260709 13:19:11.383100 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 295772us
I20260709 13:19:11.378805 23012 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:11.351714 22956 consensus_meta.cc:287] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.000s	user 0.016s	sys 0.000s
I20260709 13:19:11.316249 23097 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:11.450220 19025 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:11.391762 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.392970 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1045) took 1140 ms. Trace:
I20260709 13:19:11.329079 23032 consensus_queue.cc:1243] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:11.398299 23106 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.460135 23106 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.460513 23058 raft_consensus.cc:3055] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:11.461093 23058 raft_consensus.cc:740] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:11.461457 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2463) took 1035 ms. Trace:
I20260709 13:19:11.371663 23096 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:11.462160 23058 consensus_queue.cc:260] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:11.462874 23096 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.463444 23058 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.461823 18342 rpcz_store.cc:276] 0709 13:19:10.425757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.478196 (+ 52439us) service_pool.cc:224] Handling call
0709 13:19:10.478516 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.478838 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:10.478866 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.479271 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.720671 (+241400us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:10.720714 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.722014 (+  1300us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.461233 (+739219us) raft_consensus.cc:1685] finished
0709 13:19:11.461253 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.461398 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4180,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":15229,"thread_start_us":201727,"threads_started":1,"wal-append.queue_time_us":653259}
I20260709 13:19:11.415808 18487 consensus_queue.cc:260] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.445575 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:11.443261 22807 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:19:11.465698 18487 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.466166 23098 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.466670 23098 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.468787 23098 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:11.472390 22786 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.429685 22986 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:11.474272 18410 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:11.475253 22956 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.475886 22956 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.477713 23027 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:11.460685 23038 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:11.496065 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:11.497109 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2304) took 1006 ms. Trace:
I20260709 13:19:11.480022 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1106) took 1070 ms. Trace:
I20260709 13:19:11.498301 19058 rpcz_store.cc:276] 0709 13:19:10.409369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.409531 (+   162us) service_pool.cc:224] Handling call
0709 13:19:10.409951 (+   420us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:10.428829 (+ 18878us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:11.123581 (+694752us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.391839 (+268258us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:11.439757 (+ 47918us) log.cc:844] Serialized 78 byte log entry
0709 13:19:11.439949 (+   192us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:11.439985 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.440051 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.479787 (+ 39736us) raft_consensus.cc:1685] finished
0709 13:19:11.479814 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.479970 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204826,"raft.queue_time_us":187215,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":33436,"thread_start_us":63858,"threads_started":1,"wal-append.queue_time_us":182015}
I20260709 13:19:11.423897 23095 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.444751 22591 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
I20260709 13:19:11.453095 18490 rpcz_store.cc:276] 0709 13:19:10.252404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.252525 (+   121us) service_pool.cc:224] Handling call
0709 13:19:10.252816 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.487615 (+234799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.487645 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.490479 (+  2834us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.659765 (+169286us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:10.659820 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.659909 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.392722 (+732813us) raft_consensus.cc:1685] finished
0709 13:19:11.392749 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.392902 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17997,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"thread_start_us":402347,"threads_started":2,"wal-append.queue_time_us":338180}
W20260709 13:19:11.514901 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 55270.5us
I20260709 13:19:11.500916 18340 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:11.497612 18411 rpcz_store.cc:276] 0709 13:19:10.490534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.490651 (+   117us) service_pool.cc:224] Handling call
0709 13:19:11.481679 (+991028us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54001c52d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:11.497026 (+ 15347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2060656512}
I20260709 13:19:11.507108 19053 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:11.511880 18309 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:11.517830 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:11.528075 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:19:11.518934 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 80425.5us
W20260709 13:19:11.506119 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 63189.6us
I20260709 13:19:11.475286 22946 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:11.486924 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 215372us
I20260709 13:19:11.433706 23108 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:11.523523 18487 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:19:11.523706 18415 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:11.494077 22807 raft_consensus.cc:3055] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:11.529898 19025 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:11.535161 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:11.501287 22981 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.446749 22663 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.551702 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:11.554702 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:11.555374 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:11.538671 22956 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:11.556056 18493 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.556653 23097 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:11.556818 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:11.557490 18484 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:11.559633 23038 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:11.561851 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2460) took 1137 ms. Trace:
I20260709 13:19:11.535367 18485 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:11.541636 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:11.536590 18487 pending_rounds.cc:85] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 7
I20260709 13:19:11.563392 18487 pending_rounds.cc:107] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 6.8
W20260709 13:19:11.553543 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.563906 18487 raft_consensus.cc:2889] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:11.520357 22635 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:11.569651 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 57877.8us
I20260709 13:19:11.571178 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:11.571779 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:11.572070 18307 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:11.562496 18341 rpcz_store.cc:276] 0709 13:19:10.424816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.457080 (+ 32264us) service_pool.cc:224] Handling call
0709 13:19:10.457427 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:10.457893 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.457948 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:10.484592 (+ 26644us) log.cc:844] Serialized 52 byte log entry
0709 13:19:10.909591 (+424999us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:10.958385 (+ 48794us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.318640 (+360255us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.329966 (+ 11326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.330116 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.561582 (+231466us) raft_consensus.cc:1685] finished
0709 13:19:11.561611 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.561780 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14215,"prepare.queue_time_us":50724,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":80,"raft.queue_time_us":328735,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":29449,"thread_start_us":724861,"threads_started":2,"wal-append.queue_time_us":647535}
I20260709 13:19:11.569262 18414 raft_consensus.cc:2393] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:11.521370 23056 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:19:11.522792 23027 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:11.565325 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:11.572711 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:11.580885 18492 raft_consensus.cc:2368] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 13. Current term is 14.
I20260709 13:19:11.540040 22786 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:11.541185 22807 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:11.580183 22956 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:11.586861 22956 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:11.587248 22956 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:11.589444 22975 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:11.589898 22975 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:11.590404 22975 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.560343 23021 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:11.591187 23021 raft_consensus.cc:697] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:11.592139 23021 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.593071 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:11.566082 23071 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.593816 18344 raft_consensus.cc:2393] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:11.594172 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:11.594874 18414 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:11.595129 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:11.594812 22807 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.595734 18344 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:19:11.595952 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:11.596202 22807 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:11.597283 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:11.541335 22999 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:19:11.597752 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:11.599879 18339 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:11.601855 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2247) took 1536 ms. Trace:
I20260709 13:19:11.597831 18414 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.607000 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:11.599028 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:11.480932 23018 consensus_queue.cc:237] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.583084 18493 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:11.629071 18411 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:11.603557 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:11.604682 18335 raft_consensus.cc:1240] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:19:11.652124 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:11.649837 18489 rpcz_store.cc:276] 0709 13:19:10.065255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.135177 (+ 69922us) service_pool.cc:224] Handling call
0709 13:19:10.135559 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.252842 (+1117283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.601572 (+348730us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400258d54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:11.601791 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2532792576}
I20260709 13:19:11.675571 18339 raft_consensus.cc:2393] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:11.660460 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:11.651680 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:11.680413 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:11.681501 18411 raft_consensus.cc:2393] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:11.603953 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:11.739625 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 414814us
I20260709 13:19:11.741158 18342 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:11.600194 23105 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.585570 22591 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:11.747370 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:11.585855 23027 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:11.599206 23112 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:11.658871 22747 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.684206 23093 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.743556 19053 raft_consensus.cc:2955] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:11.735020 22961 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.610108 22635 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:11.610592 22736 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.600356 23063 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:11.651036 23075 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.756259 18411 raft_consensus.cc:1240] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:11.659005 23032 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.684221 23092 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.594213 23071 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.610289 23038 consensus_queue.cc:1059] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.147s
W20260709 13:19:11.746383 23062 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.006s	sys 0.024s
I20260709 13:19:11.759049 22956 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.742633 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:11.734931 23097 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:11.542012 23108 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:11.652582 22806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.010s	sys 0.016s
I20260709 13:19:11.744453 23091 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:11.753364 22642 consensus_meta.cc:287] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.072s	user 0.013s	sys 0.000s
I20260709 13:19:11.767450 18344 raft_consensus.cc:1240] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:19:11.751341 22894 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.753681 23027 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.753505 23017 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.768193 22913 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.760933 23112 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:11.783416 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 245147us
W20260709 13:19:11.781942 23062 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.006s	sys 0.024s
I20260709 13:19:11.788384 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:11.798676 19027 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:11.764310 22747 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:11.787319 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:11.786113 22806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.010s	sys 0.017s
I20260709 13:19:11.797318 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:11.786096 23101 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:11.754185 23105 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:11.801241 23082 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.570s	user 0.004s	sys 0.000s
I20260709 13:19:11.805413 19027 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:11.777390 23075 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.840107 19027 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:11.780694 23032 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.800968 23062 raft_consensus.cc:697] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:11.819679 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:11.858857 18490 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:11.797457 18487 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:11.859724 19027 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:11.765525 23093 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.828047 18489 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
W20260709 13:19:11.833604 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 46623.1us
I20260709 13:19:11.884435 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:11.804075 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:11.885746 18485 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:19:11.850651 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.823414 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.799013 22894 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:11.829660 23101 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.794562 22642 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.829352 23056 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:19:11.860698 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 288049us
I20260709 13:19:11.787704 23092 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:11.805143 22913 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:11.802134 23017 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:11.924888 23017 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:11.926644 23087 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.584s	user 0.003s	sys 0.000s
I20260709 13:19:11.843482 22806 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:11.902309 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:11.858256 22706 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.844826 22999 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.836553 22825 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
W20260709 13:19:11.905057 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.848421 22985 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:11.852622 22663 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:11.909744 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:11.912822 22913 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:11.915947 23093 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:11.899443 23101 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.918020 23105 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:11.902863 22736 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.919556 23032 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:11.790093 23091 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.921435 22642 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:11.921967 23063 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:12.009110 23063 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.009788 22747 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:12.011219 23063 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:11.919605 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.011941 19059 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
W20260709 13:19:11.938714 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 103083us
I20260709 13:19:11.848120 22946 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:19:12.013283 18382 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:11.953549 23109 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:11.849614 22958 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:19:11.943642 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 101719us
I20260709 13:19:11.947466 18307 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:11.951936 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.943495 19025 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:11.953534 18414 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:11.991683 18416 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:19:11.842823 22635 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:11.931835 23056 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:11.998252 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1043) took 1759 ms. Trace:
I20260709 13:19:11.955197 22786 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:11.940640 23114 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:12.022385 22946 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:12.022284 23109 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:12.022739 23115 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:19:12.056424 22946 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:12.023237 23116 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.057621 23116 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:12.057657 22946 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:12.024415 23119 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:19:12.025038 23105 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.061523 23136 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:12.061424 23105 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:12.026546 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 79205.4us
I20260709 13:19:12.034864 18486 rpcz_store.cc:276] 0709 13:19:10.238679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.250096 (+ 11417us) service_pool.cc:224] Handling call
0709 13:19:10.250440 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:10.453044 (+202604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.453073 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:10.459886 (+  6813us) log.cc:844] Serialized 52 byte log entry
0709 13:19:10.866185 (+406299us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:10.866225 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.866287 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.925846 (+1059559us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:11.986427 (+ 60581us) raft_consensus.cc:1685] finished
0709 13:19:11.986450 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.998157 (+ 11707us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20168,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":32713472,"thread_start_us":549112,"threads_started":2,"wal-append.queue_time_us":842443}
I20260709 13:19:12.016245 22985 raft_consensus.cc:697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:11.976764 22706 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.025478 22975 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.044045 22956 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.056381 22786 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:12.021317 22764 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:12.041319 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:12.138813 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 97611.5us
I20260709 13:19:12.034533 23113 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:12.019383 23093 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:12.068285 18343 raft_consensus.cc:1275] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:12.062199 23136 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:12.102960 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:12.135831 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:12.139889 18458 leader_election.cc:400] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12.
I20260709 13:19:12.147603 18458 leader_election.cc:403] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:19:11.981585 22806 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:12.099534 23060 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.012s	sys 0.022s
W20260709 13:19:12.149101 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 46216.2us
I20260709 13:19:12.153126 19057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1322) took 1027 ms. Trace:
I20260709 13:19:12.153612 19057 rpcz_store.cc:276] 0709 13:19:11.125945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.126229 (+   284us) service_pool.cc:224] Handling call
0709 13:19:12.152905 (+1026676us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54001473d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:12.153058 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639480064}
I20260709 13:19:12.065033 23046 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:12.099315 23097 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:12.047263 22736 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:19:12.156533 23111 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:12.159216 23118 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12.
I20260709 13:19:12.164420 22806 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.144941 22663 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:12.148917 23060 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.013s	sys 0.022s
W20260709 13:19:12.166466 23120 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:19:12.168833 18458 leader_election.cc:400] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:12.214515 18458 leader_election.cc:403] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:12.161036 22956 consensus_queue.cc:1059] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:19:12.191599 22706 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.193186 23091 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.193907 23112 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.194600 22786 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.000975 23062 consensus_queue.cc:237] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.195861 23056 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:12.144892 22784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.010s	sys 0.027s
I20260709 13:19:12.149408 22894 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:12.204188 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 185194us
I20260709 13:19:12.209586 18490 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:12.235026 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:12.201792 23095 consensus_meta.cc:287] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.671s	user 0.007s	sys 0.001s
W20260709 13:19:12.229691 22784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.011s	sys 0.028s
I20260709 13:19:12.242079 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.242254 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:12.155342 23093 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.245942 19057 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:12.246418 19058 raft_consensus.cc:2393] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:12.212240 23111 raft_consensus.cc:697] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:12.245180 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.247864 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:12.249101 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.255764 19058 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:12.256024 19060 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:12.250372 18309 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:12.250694 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 307278us
I20260709 13:19:12.208164 23136 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.217285 23137 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:12.263479 19057 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:12.266185 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:12.208797 23097 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:12.270494 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 120681us
I20260709 13:19:12.268132 18338 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:12.241628 22958 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.207315 23046 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:12.272112 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 103498us
I20260709 13:19:12.274780 18458 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:12.241325 23125 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:19:12.265686 23113 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:12.277487 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.267678 23137 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:12.281424 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:12.286707 19062 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:12.271572 22975 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:12.275502 22663 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.291493 19058 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:12.244813 22985 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.281075 23113 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.297065 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.303391 19061 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:12.301345 19058 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:12.302603 18491 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:12.284739 23060 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:12.306846 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:12.309505 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:12.313232 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.313659 23046 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.314195 19056 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:12.315459 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.315269 23111 consensus_queue.cc:237] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:12.320075 23101 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.323499 19054 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:12.278429 22958 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.327940 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:12.328943 18309 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:12.330063 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.357300 18309 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:12.358742 23101 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.299080 23109 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.302453 23113 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:12.353163 22975 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:12.352928 23063 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:12.362854 23027 consensus_meta.cc:287] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 13:19:12.375010 23027 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.377115 23027 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.360824 23095 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:12.378487 23095 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.378881 23095 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:12.374007 22975 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.362293 23046 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:12.384194 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:12.385171 18458 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:12.367342 23118 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:12.396778 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:12.399420 19054 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
W20260709 13:19:12.387984 23132 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.177s	user 0.001s	sys 0.001s
I20260709 13:19:12.406196 18458 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:12.397446 22784 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:12.411335 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.396435 23046 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:12.413448 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:12.413869 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:12.370652 23137 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:12.431318 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:12.432098 18493 raft_consensus.cc:2410] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:12.424914 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:12.432757 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:12.433640 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:12.428606 22784 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.405550 22981 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.434584 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:12.491747 19056 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:12.435271 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:12.431372 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:12.493360 18343 raft_consensus.cc:2410] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:12.387791 23109 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:19:12.443758 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.443975 18336 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 7.
I20260709 13:19:12.441959 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:12.444676 19055 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:12.445981 18342 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:12.445904 18337 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:12.411392 23093 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.411144 23101 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:12.498692 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:12.499403 18489 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:12.500275 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:12.508734 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:12.509546 18487 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:19:12.501374 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:12.452091 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:12.485900 19025 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.631s (SENT) [suppressed 37 similar messages]
W20260709 13:19:12.473016 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.444505 22807 consensus_meta.cc:287] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.848s	user 0.014s	sys 0.000s
I20260709 13:19:12.416337 23060 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:19:12.517669 18489 raft_consensus.cc:2393] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:12.519297 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:12.414183 23118 consensus_queue.cc:1059] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:19:12.525763 18342 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
W20260709 13:19:12.529274 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 94239.3us
I20260709 13:19:12.445683 23062 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:19:12.487584 23027 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:12.533326 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.535650 18487 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:19:12.538697 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 52813.5us
I20260709 13:19:12.541512 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:12.561967 23140 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.199s	user 0.004s	sys 0.000s
I20260709 13:19:12.573977 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2311) took 1133 ms. Trace:
I20260709 13:19:12.574522 18419 rpcz_store.cc:276] 0709 13:19:11.440588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.441711 (+  1123us) service_pool.cc:224] Handling call
0709 13:19:11.442200 (+   489us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:11.448133 (+  5933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.448178 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:11.851018 (+402840us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b2c001026c8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:19:11.894528 (+ 43510us) log.cc:844] Serialized 52 byte log entry
0709 13:19:12.231046 (+336518us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:12.231086 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.231180 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.560242 (+329062us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:12.573654 (+ 13412us) raft_consensus.cc:1685] finished
0709 13:19:12.573678 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.573883 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5476,"raft.queue_time_us":13745,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":13752448,"thread_start_us":286435,"threads_started":1,"wal-append.queue_time_us":388468}
I20260709 13:19:12.580304 23075 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.582777 18487 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:12.586200 23106 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.587437 22749 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:12.590958 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2476) took 1267 ms. Trace:
I20260709 13:19:12.619421 18340 rpcz_store.cc:276] 0709 13:19:11.323587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.377319 (+ 53732us) service_pool.cc:224] Handling call
0709 13:19:11.395168 (+ 17849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.526520 (+131352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.590293 (+1063773us) spinlock_profiling.cc:243] Waited 85.6 ms on lock 0x7b540018bad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:12.590890 (+   597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196886400}
I20260709 13:19:12.596644 23146 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:12.517498 23097 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:12.489423 22946 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.591078 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2308) took 1438 ms. Trace:
I20260709 13:19:12.528738 23101 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:19:12.630965 18416 rpcz_store.cc:276] 0709 13:19:11.152941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.153152 (+   211us) service_pool.cc:224] Handling call
0709 13:19:11.160327 (+  7175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.019548 (+859221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.590862 (+571314us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54000a91d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:12.591025 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911224192}
I20260709 13:19:12.609573 23027 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.634615 22946 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.674881 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:12.647125 22975 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:12.611544 23046 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.650768 22958 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:12.674489 23167 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:12.681630 23136 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:12.692821 23152 log.cc:927] Time spent T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:19:12.692385 23136 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.689478 23096 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:12.715157 23160 log.cc:927] Time spent T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
W20260709 13:19:12.722661 23157 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:19:12.726686 23136 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:12.727670 23113 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.686223 23101 consensus_queue.cc:1059] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:19:12.741886 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 200473us
I20260709 13:19:12.742394 23104 raft_consensus.cc:3055] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:12.742822 23104 raft_consensus.cc:740] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:12.743299 18458 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:12.743753 23104 consensus_queue.cc:260] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.744813 23104 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.746390 23084 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:12.746701 23084 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:12.747391 23084 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.748203 23084 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:12.752589 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 2182) took 1153 ms. Trace:
I20260709 13:19:12.753002 18338 rpcz_store.cc:276] 0709 13:19:11.597225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.597542 (+   317us) service_pool.cc:224] Handling call
0709 13:19:12.750739 (+1153197us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54001653d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:12.750853 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367092608}
I20260709 13:19:12.738639 23113 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.758710 18458 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:12.758149 23167 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:12.764477 23167 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.764838 23167 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:12.779057 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:12.782187 18307 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:12.781765 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:12.783831 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:12.784888 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:12.786147 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:12.787714 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:12.763991 23063 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:12.790297 18307 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:12.766472 23060 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:12.792376 23106 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.793179 23167 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.794212 23176 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:12.795115 23103 raft_consensus.cc:3055] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:12.795490 23103 raft_consensus.cc:740] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:12.788520 23174 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:12.796555 23174 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.797755 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:12.803524 18307 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:12.784469 23097 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:12.784108 23113 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:12.802505 23162 log.cc:927] Time spent T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:19:12.790192 23108 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:12.766330 23169 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:19:12.821588 23027 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.808058 23060 raft_consensus.cc:697] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:12.823534 22999 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:12.823237 23060 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.824083 22999 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.826582 22999 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:12.788586 22663 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:12.802628 23118 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:12.813066 23103 consensus_queue.cc:260] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:12.813885 23148 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:12.807576 23111 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:19:12.806180 23093 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.806015 23075 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:12.802240 23174 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:12.816222 23167 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:12.818462 23159 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.384s	user 0.000s	sys 0.003s
I20260709 13:19:12.788434 23095 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.837805 23148 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.839103 23111 consensus_queue.cc:1243] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:12.852844 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2650) took 1066 ms. Trace:
I20260709 13:19:12.840687 23071 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:12.849108 23024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.496s	user 0.020s	sys 0.001s
W20260709 13:19:12.849648 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 63541.6us
I20260709 13:19:12.834461 23118 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:12.839993 23169 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:12.853255 18488 rpcz_store.cc:276] 0709 13:19:11.786724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.442593 (+655869us) service_pool.cc:224] Handling call
0709 13:19:12.444663 (+  2070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.444869 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:12.633360 (+188491us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.852495 (+219135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.852543 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:12.852608 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.852672 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.852788 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":478,"prepare.queue_time_us":188763,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":1188,"raft.queue_time_us":856,"thread_start_us":360715,"threads_started":2}
I20260709 13:19:12.857358 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:12.851444 22764 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.860136 23075 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:12.860636 18308 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:12.862486 23095 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:12.863967 22764 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:12.853809 23024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.502s	user 0.020s	sys 0.001s
I20260709 13:19:12.866873 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:12.851498 23106 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.871325 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.870106 22764 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:12.874931 18309 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:12.876003 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:12.871503 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.876642 19057 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:12.877355 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:12.878072 18336 raft_consensus.cc:2368] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16.
I20260709 13:19:12.852653 23148 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:12.873560 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:19:12.864077 23173 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:19:12.880679 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.859930 23118 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.865367 22591 raft_consensus.cc:3055] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:12.880185 23027 consensus_queue.cc:1059] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:19:12.875885 23113 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:12.879333 23167 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:12.881248 23180 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:12.887562 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:12.898873 18309 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:12.902064 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:12.882452 23093 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:12.888055 18491 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:19:12.892285 19058 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:12.892347 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:12.893131 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:12.883124 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:12.903823 19060 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:12.904287 19058 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:12.894551 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:12.884603 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:12.879034 23095 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:12.905356 19062 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:12.907370 19057 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:12.889091 22591 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:12.910753 18309 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:12.866041 23174 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:12.903162 23093 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:12.916275 23093 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:12.864421 23075 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:12.918246 23095 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:12.935851 19062 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:19:12.882527 23169 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:12.944296 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.948275 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 141798us
I20260709 13:19:12.914690 23111 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:12.922246 23046 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:12.969810 19060 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:12.979494 18309 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:12.981209 18492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 1060) took 1656 ms (client timeout 1631 ms). Trace:
W20260709 13:19:12.981727 18492 rpcz_store.cc:269] 0709 13:19:11.324677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.363739 (+ 39062us) service_pool.cc:224] Handling call
0709 13:19:12.980973 (+1617234us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400291dd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:12.981117 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392202624}
I20260709 13:19:12.914186 23113 consensus_queue.cc:1059] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 13:19:13.112174 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.987176 23097 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:13.124430 23167 raft_consensus.cc:697] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:13.138003 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:12.986254 23046 raft_consensus.cc:697] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:13.191113 18336 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
W20260709 13:19:13.177436 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.191993 19027 leader_election.cc:400] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16.
I20260709 13:19:13.213490 19027 leader_election.cc:403] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:19:13.227188 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:13.190133 23113 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:13.233155 22961 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16.
I20260709 13:19:13.233520 23113 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:13.236472 23113 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:13.237396 23097 raft_consensus.cc:697] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:13.238547 23097 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.242805 23106 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.243443 23106 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:13.244266 22635 raft_consensus.cc:3055] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:13.244643 22635 raft_consensus.cc:740] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:13.245579 23106 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:13.245498 22635 consensus_queue.cc:260] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.251982 22635 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:13.254041 23168 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:13.259958 22946 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:13.261345 23075 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:13.262038 23095 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.263309 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:13.263890 18338 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:13.264663 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:13.265210 18338 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:19:13.266966 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:13.268356 18338 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:13.270289 19027 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:13.275959 19060 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:13.128104 23027 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:13.287869 18338 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:13.191810 22736 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:13.292158 18307 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:13.312330 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:13.313529 19060 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:13.315932 18338 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:19:13.316325 18338 pending_rounds.cc:85] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 7
I20260709 13:19:13.316543 18338 pending_rounds.cc:107] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:19:13.290036 23180 raft_consensus.cc:697] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:13.316782 18338 raft_consensus.cc:2889] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.318538 23180 consensus_queue.cc:237] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:13.320924 18338 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:13.322719 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:13.323213 18492 pending_rounds.cc:85] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 5
I20260709 13:19:13.323534 18486 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:13.323551 18492 pending_rounds.cc:107] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:13.324659 18488 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:13.325034 18492 raft_consensus.cc:2889] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.327330 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:13.327932 18488 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:13.329196 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:13.330574 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:13.331348 18486 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:13.333549 23062 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:13.335990 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:13.337814 23062 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:13.339437 18458 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:13.341287 23062 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:13.341784 23062 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:13.342676 23062 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.344127 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2323) took 1751 ms. Trace:
I20260709 13:19:13.349268 22825 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:13.349758 18307 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:13.350633 23113 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.351065 23113 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:13.351486 23113 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:13.354460 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 1.34115e+06us
I20260709 13:19:13.344518 18410 rpcz_store.cc:276] 0709 13:19:11.592511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.735541 (+143030us) service_pool.cc:224] Handling call
0709 13:19:11.735894 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.736099 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:11.753410 (+ 17311us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.896474 (+143064us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.898842 (+  2368us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.379367 (+480525us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b18003e8600. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:19:13.343667 (+964300us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b18003e8600. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f409bdf1a40 00007f409bdec4e4 00007f409bdec455 00007f409eed4060 00007f409eee6716 00007f409eef7287 00007f409eef7208
0709 13:19:13.343809 (+   142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.343860 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:13.343901 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.343963 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.344076 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7830,"prepare.queue_time_us":30303,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":93,"raft.queue_time_us":1452703,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":161,"spinlock_wait_cycles":104641920,"thread_start_us":142512,"threads_started":1,"wal-append.queue_time_us":290351,"wal-append.run_cpu_time_us":2220,"wal-append.run_wall_time_us":1144662}
I20260709 13:19:13.355715 18382 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:13.357790 22642 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:13.358592 22642 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.361867 19062 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:19:13.362512 19062 pending_rounds.cc:85] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 9
I20260709 13:19:13.362802 19062 pending_rounds.cc:107] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:19:13.363056 19062 raft_consensus.cc:2889] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.364565 18382 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:13.365521 18338 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:19:13.365890 18338 pending_rounds.cc:85] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 12
I20260709 13:19:13.366199 18338 pending_rounds.cc:107] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:19:13.367020 18338 raft_consensus.cc:2889] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.368745 18309 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:13.369540 22825 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:13.280818 22749 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:13.369971 22825 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:13.387619 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.392145 23021 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:13.392349 22961 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:13.393893 22737 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:13.397361 18226 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b345033a56994fff90990b7d03324074 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d6cd7c600ec4ab2b5cac479f05d4c0f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:13.400065 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:13.400637 23104 consensus_meta.cc:287] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
I20260709 13:19:13.400931 18343 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.398792 23167 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.402555 22786 raft_consensus.cc:3055] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:13.402927 22786 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:13.405804 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.407519 18419 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:19:13.369721 23092 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:13.309978 23168 consensus_queue.cc:1243] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:19:13.409845 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.405138 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.414274 18415 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:13.362562 22736 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:13.415880 23096 consensus_meta.cc:287] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.002s
W20260709 13:19:13.416715 23118 consensus_meta.cc:287] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.000s
I20260709 13:19:13.417176 23118 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.371995 22999 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:19:13.316768 23027 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.419283 23118 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:13.419904 23176 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.420405 23176 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.420979 23027 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:13.422294 23182 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.426s	user 0.001s	sys 0.000s
I20260709 13:19:13.389324 22749 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.422868 22749 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.306497 23109 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:13.423738 23109 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.406355 22825 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:13.426370 23046 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.417754 22736 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:13.430580 23148 consensus_meta.cc:287] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.542s	user 0.004s	sys 0.004s
I20260709 13:19:13.431102 23148 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:13.434921 18410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:13.435846 18410 raft_consensus.cc:606] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:13.403761 22786 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.436497 22786 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.411556 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.435763 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.439185 18415 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:13.307035 22956 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 13:19:13.440227 23133 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.440871 23133 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.442312 18335 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:13.443725 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 79760.7us
I20260709 13:19:13.444435 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:13.444996 19060 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:13.438611 18419 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:13.361486 23106 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:13.447008 18309 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:13.450939 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:13.450970 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:13.452265 18416 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:13.452567 18487 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:13.452704 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:13.448778 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.456370 18419 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 15: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:13.425681 23109 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:13.455178 18412 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:13.462989 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:13.461431 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:13.466809 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:13.466805 18491 pending_rounds.cc:85] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 5
I20260709 13:19:13.469148 18491 pending_rounds.cc:107] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:13.469419 18491 raft_consensus.cc:2889] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.469439 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:13.470394 18493 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:19:13.487022 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:13.487910 18493 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:13.360765 23113 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:13.492110 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.401264 23116 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:13.494124 18419 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:13.454632 22753 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:13.497460 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:13.414166 23022 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:13.517644 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:13.522205 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:13.531805 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.530753 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:13.544476 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:13.575037 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.575955 18419 raft_consensus.cc:2368] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13.
I20260709 13:19:13.527156 23148 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:13.542598 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:13.609941 18337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.024s	sys 0.084s
I20260709 13:19:13.455734 23092 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:19:13.625521 18337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.026s	sys 0.084s
W20260709 13:19:13.627251 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.635857 18487 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:13.637631 18339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.004s	sys 0.019s
W20260709 13:19:13.640264 18339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.004s	sys 0.019s
W20260709 13:19:13.519829 22985 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.001s	sys 0.022s
I20260709 13:19:13.498996 22792 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.493896 23174 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:13.659021 18343 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:13.659754 18412 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:13.493635 23012 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:13.577872 22913 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.528959 22764 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:13.578799 22797 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.530755 22986 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:13.663452 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:13.494450 23103 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.670140 23113 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:13.675974 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.704483 23183 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:19:13.497584 22956 consensus_queue.cc:1059] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.165s
I20260709 13:19:13.493335 22999 consensus_queue.cc:1059] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.168s
I20260709 13:19:13.705410 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:13.625069 23169 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:13.706478 22764 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.709812 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.713498 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.714216 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.650266 23092 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:13.738008 18416 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:13.716902 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.739074 18417 raft_consensus.cc:2393] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 8: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:19:13.717223 18342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.061s	sys 0.154s
W20260709 13:19:13.741477 18342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.061s	sys 0.155s
I20260709 13:19:13.713717 22894 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:19:13.689692 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 182505us
I20260709 13:19:13.724208 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.626318 23022 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:13.663203 22985 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.002s	sys 0.022s
I20260709 13:19:13.722847 22753 raft_consensus.cc:697] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:13.754400 22975 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:13.754989 22975 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.757712 22975 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:13.756080 22753 consensus_queue.cc:237] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:13.759644 23022 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:13.744971 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:13.763146 23133 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:13.763350 18415 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:13.767357 23097 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.767859 23097 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:13.770987 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:13.746745 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.747792 18412 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:13.748713 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:13.745941 18487 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:13.751421 18417 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:13.719699 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.749991 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.771615 22784 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:13.782883 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:13.784154 18337 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:13.703328 23012 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:13.679896 22792 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.772471 22825 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.772286 23097 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:13.774816 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:13.777968 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:13.781201 18382 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:13.741122 22764 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:13.730595 23148 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.858287 18490 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:13.858171 23148 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:13.860394 23148 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:13.848953 23101 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:13.862522 23101 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.864101 23176 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:13.746192 23092 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:13.864758 23101 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:13.868413 23192 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:19:13.870113 22784 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:13.870616 22784 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:13.870862 23198 log.cc:927] Time spent T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:19:13.871129 22784 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:13.873253 22807 raft_consensus.cc:993] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:19:13.791347 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.720355 22913 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.876338 18414 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:13.775432 22894 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.718021 22797 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.878995 22894 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:13.879225 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:13.879508 22797 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:13.722728 22986 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.881343 22986 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:13.881856 18419 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:13.850107 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 72250.5us
W20260709 13:19:13.882810 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.884871 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 110133us
I20260709 13:19:13.850004 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:13.886193 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 105038us
I20260709 13:19:13.885958 18337 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:19:13.853029 18415 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:13.782490 23133 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:13.894675 18411 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:13.892515 22670 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:13.911391 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.911901 18419 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
W20260709 13:19:13.913487 18341 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.018s	sys 0.027s
I20260709 13:19:13.894696 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.877731 22913 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:13.892778 23058 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:13.896521 22894 consensus_queue.cc:1059] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 13:19:13.896751 23093 consensus_meta.cc:287] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.980s	user 0.004s	sys 0.008s
W20260709 13:19:13.914042 18341 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.018s	sys 0.027s
W20260709 13:19:13.911362 23197 log.cc:927] Time spent T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:19:13.912909 23177 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:19:13.913058 22797 raft_consensus.cc:1081] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:19:13.920655 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:13.921384 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:13.915076 23180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.011s	sys 0.019s
W20260709 13:19:13.928326 19027 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.038s
W20260709 13:19:13.928776 19027 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.007s	sys 0.039s
I20260709 13:19:13.851824 22749 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:13.931529 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 306695us
W20260709 13:19:13.929298 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 551206us
I20260709 13:19:13.918974 23058 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.910676 22999 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:19:13.952847 19061 raft_consensus.cc:1240] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:13.954499 18412 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:19:13.934268 23018 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.002s	sys 0.051s
W20260709 13:19:13.928221 23180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.011s	sys 0.019s
I20260709 13:19:13.928776 23093 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:13.950714 23058 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.947310 23101 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:13.973528 23060 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.139s	user 0.010s	sys 0.025s
I20260709 13:19:14.012925 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:14.016956 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:13.994230 23018 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.002s	sys 0.052s
I20260709 13:19:14.020228 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.022516 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:14.025519 19055 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 12: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:19:14.022517 23060 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.190s	user 0.011s	sys 0.025s
I20260709 13:19:13.996711 22971 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.035493 18336 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:14.049345 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:14.078195 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.084857 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.085142 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.085638 18412 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:14.030958 23097 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.033488 23180 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:14.025416 23101 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.112727 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.118333 18308 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:14.142469 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 228622us
I20260709 13:19:14.114434 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.143913 18308 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:14.112257 23158 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 1.431s	user 0.013s	sys 0.006s
I20260709 13:19:14.114629 18413 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:19:14.144970 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 227029us
W20260709 13:19:14.116684 23194 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:19:14.108013 22792 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.070842 22971 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.144084 18412 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
W20260709 13:19:14.001332 23095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.018s	sys 0.040s
I20260709 13:19:14.132043 22986 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:14.155565 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.150877 18413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:14.116146 22764 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.146013 18384 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:14.147516 23106 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:14.098066 18415 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:14.147660 22956 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:14.145215 23097 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.168484 23137 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:14.179872 18413 raft_consensus.cc:606] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:14.199467 18413 raft_consensus.cc:614] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:14.200793 23092 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.194952 18412 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:14.156306 23176 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:14.164363 22749 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:14.094971 23200 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
W20260709 13:19:14.181687 23167 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.011s	sys 0.015s
W20260709 13:19:14.172547 23095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.020s	sys 0.052s
I20260709 13:19:14.146139 23180 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:14.194785 22956 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:14.202775 22985 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:14.217175 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1068) took 1927 ms. Trace:
I20260709 13:19:14.221855 18484 rpcz_store.cc:276] 0709 13:19:12.290257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.296430 (+  6173us) service_pool.cc:224] Handling call
0709 13:19:12.320711 (+ 24281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.321140 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.321176 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.321767 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.409067 (+ 87300us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:12.409111 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.409185 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.111974 (+1702789us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b2400248798. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bc759c4 00007f409bc73acb 00007f409be2edc9 00007f409be2ea55 00007f409be2e09d 00007f409ea6010e 00007f409ea7788c 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221
0709 13:19:14.216608 (+104634us) raft_consensus.cc:1685] finished
0709 13:19:14.216630 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.217117 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1342,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":3216128,"thread_start_us":86837,"threads_started":1,"wal-append.queue_time_us":323133}
W20260709 13:19:14.208148 23167 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.012s	sys 0.017s
I20260709 13:19:14.189989 23113 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:19:14.206871 22825 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.190680 22986 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:14.227476 22743 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:14.222055 22956 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.236711 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1020) took 1353 ms. Trace:
I20260709 13:19:14.216805 23169 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:14.237216 18342 rpcz_store.cc:276] 0709 13:19:12.883771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.883874 (+   103us) service_pool.cc:224] Handling call
0709 13:19:12.884141 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.889269 (+  5128us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:12.948912 (+ 59643us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.741941 (+793029us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.751488 (+  9547us) log.cc:844] Serialized 26 byte log entry
0709 13:19:13.751638 (+   150us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:13.751675 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.751747 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.236458 (+484711us) raft_consensus.cc:1685] finished
0709 13:19:14.236484 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.236643 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1765,"prepare.queue_time_us":506564,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":4725,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":31777,"thread_start_us":798649,"threads_started":2,"wal-append.queue_time_us":971837}
I20260709 13:19:14.239943 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:14.240840 18342 raft_consensus.cc:2393] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 15: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:14.227025 23093 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.244673 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:14.250176 18410 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
W20260709 13:19:14.250957 23201 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:14.251154 23180 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:14.251339 22986 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:14.251695 23092 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.252488 22971 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:14.208408 23176 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.256016 18412 raft_consensus.cc:606] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:14.241665 23203 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:19:14.255211 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:14.249732 23137 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:14.226577 22985 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:14.268306 22642 consensus_meta.cc:287] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.909s	user 0.013s	sys 0.000s
I20260709 13:19:14.268764 22642 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:14.278914 23101 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:14.282094 23207 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 13:19:14.265045 23209 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:19:14.284392 18488 raft_consensus.cc:2410] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:19:14.285017 23188 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.285601 22985 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.285495 23188 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:14.298225 23176 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.253136 23169 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:14.301470 22764 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:14.308425 23103 consensus_meta.cc:287] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.000s
W20260709 13:19:14.316570 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 264795us
I20260709 13:19:14.310385 23097 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.310592 23176 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.312268 22784 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:14.313588 23215 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:14.315014 23106 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:14.309247 23058 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:14.333053 18416 raft_consensus.cc:2393] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:14.318792 23169 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:14.318794 23176 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.337960 23176 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:14.348134 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 201962us
I20260709 13:19:14.349201 18308 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:14.350562 18308 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:14.351022 23103 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:14.351521 23103 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:14.352012 23103 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:14.346026 23105 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:14.356976 18308 leader_election.cc:400] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13.
I20260709 13:19:14.358418 18308 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:14.359508 22784 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:14.358289 23108 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:14.362361 23097 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:14.372390 18308 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:14.361008 23106 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:19:14.387077 23095 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:14.388696 23095 consensus_queue.cc:1059] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:19:14.389375 23178 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 1.534s	user 0.005s	sys 0.009s
I20260709 13:19:14.389672 23075 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:14.390101 23075 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:14.390887 23075 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.394563 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.395164 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.398577 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.407577 22591 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.408681 22591 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.409164 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.410861 18415 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:14.412003 23113 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:14.412575 23113 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.414229 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.414969 18412 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:14.381501 23227 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
W20260709 13:19:14.398567 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.378269 23058 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:14.383946 23097 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:14.376819 23092 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.415328 22946 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:14.395742 18413 raft_consensus.cc:2376] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10. Re-sending same reply.
I20260709 13:19:14.382346 23093 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.418383 19027 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:14.378168 23103 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.425729 19054 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:14.386330 22825 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:14.422398 23046 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:14.430841 19059 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:14.373183 23108 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:19:14.433043 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:14.435623 19055 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:14.435938 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:14.435868 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:14.436640 19062 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:14.438624 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:14.435645 22764 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:14.439980 23113 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:14.441619 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 295679us
I20260709 13:19:14.442417 18384 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:14.446520 19059 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:14.441668 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 939) took 2933 ms. Trace:
I20260709 13:19:14.444283 19026 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:14.429101 22946 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:14.450220 19062 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:14.450765 18337 raft_consensus.cc:1240] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:14.447494 18418 rpcz_store.cc:276] 0709 13:19:11.507935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.508084 (+   149us) service_pool.cc:224] Handling call
0709 13:19:11.508489 (+   405us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:11.508961 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:11.598751 (+ 89790us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b48001c0158. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a3e05aa1 00007f40a3dfcb37 00007f40a3dfc9ca 00007f40a3ef426f 00007f40a3ef3f37 00007f40a3f0855c 00007f40a3f08508 00007f40a3f08488 00007f40a3f08443 00007f40a3f076ec 00007f40a2e31a96
0709 13:19:11.829237 (+230486us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.714768 (+1885531us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:13.728186 (+ 13418us) log.cc:844] Serialized 52 byte log entry
0709 13:19:14.191016 (+462830us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:14.191377 (+   361us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.441129 (+249752us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b18003d66c0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f409bdf1a40 00007f409bdec4e4 00007f409bdec455 00007f409eed4060 00007f409eee6716 00007f409eef7287 00007f409eef7208
0709 13:19:14.441331 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.441412 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.441451 (+    39us) raft_consensus.cc:1685] finished
0709 13:19:14.441463 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.441586 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1447031,"prepare.queue_time_us":30264,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":1694971,"raft.run_cpu_time_us":1172,"raft.run_wall_time_us":82273,"spinlock_wait_cycles":13515904,"thread_start_us":1182887,"threads_started":4,"wal-append.queue_time_us":571646,"wal-append.run_cpu_time_us":1056,"wal-append.run_wall_time_us":1001086}
I20260709 13:19:14.456118 19055 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
W20260709 13:19:14.455808 23231 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:19:14.462078 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.453919 22743 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:14.443198 22825 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:14.443091 23133 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:14.463322 18384 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:14.427456 23097 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.429490 23092 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:14.466367 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.470671 18417 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:14.463196 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.473519 18418 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:14.453508 23113 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.433881 23093 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:14.476878 18419 raft_consensus.cc:2393] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:14.478927 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.479137 19026 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:14.479923 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.476243 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.437745 23046 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.482570 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.489689 22825 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:14.490736 22981 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:14.491711 23103 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.492575 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:14.458527 23227 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:19:14.480983 18418 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:14.495715 19026 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:14.495085 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.494789 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.468871 23221 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.521193 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:14.527158 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:14.527666 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.528230 18419 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:14.495038 22999 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:14.471832 23106 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:19:14.489573 22591 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:19:14.517891 22981 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:14.526046 23058 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:14.475677 23133 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.538385 18417 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:14.529989 22784 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:14.541013 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 83954.9us
I20260709 13:19:14.494380 23143 consensus_queue.cc:1059] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:19:14.539186 18419 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:14.530138 23202 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:14.541579 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:14.542233 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.481868 23113 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.549131 23113 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.543948 22956 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.545392 18309 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:14.555450 18344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 1019) took 1674 ms (client timeout 1660 ms). Trace:
W20260709 13:19:14.555984 18344 rpcz_store.cc:269] 0709 13:19:12.882811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.882922 (+   111us) service_pool.cc:224] Handling call
0709 13:19:14.555207 (+1672285us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002751d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:14.555370 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3013205760}
I20260709 13:19:14.546542 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.545449 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:14.563448 23103 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:14.563915 23103 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:14.564764 23103 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.566640 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.571112 18419 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:14.572891 18417 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:14.574029 18417 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:14.575019 18417 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:14.579051 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1040) took 1309 ms. Trace:
I20260709 13:19:14.579473 18335 rpcz_store.cc:276] 0709 13:19:13.269799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.466103 (+196304us) service_pool.cc:224] Handling call
0709 13:19:13.466384 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.466566 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:13.497404 (+ 30838us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.516881 (+ 19477us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.566901 (+1050020us) spinlock_profiling.cc:243] Waited 9.36 ms on lock 0x7b18003fcd60. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f409ea92d70 00007f409ea86293 00007f409ea7bcea 00007f409ea7c23a 00007f409eee6a2a 00007f409eef60bf 00007f409eef6038
0709 13:19:14.578515 (+ 11614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:14.578587 (+    72us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:14.578647 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.578825 (+   178us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.578984 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13339,"prepare.queue_time_us":255106,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":10907,"spinlock_wait_cycles":21519232}
I20260709 13:19:14.582999 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.588225 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:14.588769 19055 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:14.589587 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:14.591779 22956 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.602125 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.603278 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.604260 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.604404 18335 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:14.605233 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.584332 22999 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:14.554867 22786 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:14.605906 18415 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:14.614162 19055 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:14.615150 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:14.615684 19055 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:14.616582 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:14.617316 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.608305 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:14.608577 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:14.610737 18336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 1028) took 1665 ms (client timeout 1969 ms). Trace:
I20260709 13:19:14.607981 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:14.620224 18336 rpcz_store.cc:269] 0709 13:19:12.945391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.226888 (+281497us) service_pool.cc:224] Handling call
0709 13:19:14.610525 (+1383637us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54000e10d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:14.610686 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850343296}
W20260709 13:19:14.612114 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.621443 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:14.620333 19058 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:14.610236 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:14.627998 23227 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:14.630064 18418 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:14.631311 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.632076 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:14.632705 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:14.632781 18344 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:14.570483 23103 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:14.633754 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.578264 23024 raft_consensus.cc:3055] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:14.635919 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:14.579026 22797 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.612784 23092 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:14.628497 23137 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.637833 23097 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.687561 18412 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:14.638753 23105 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:14.639436 23176 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:14.611017 23236 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:19:14.635459 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:14.652844 19053 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:19:14.653595 18417 raft_consensus.cc:1240] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:14.654604 18419 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15. Ops: [13.12-14.13]
I20260709 13:19:14.658188 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:14.658672 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:14.617358 19055 raft_consensus.cc:2393] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 16: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:14.636782 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:14.671764 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:14.652676 18415 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:14.652061 19027 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:14.679013 18338 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:14.683162 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:14.684382 18457 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:14.611245 22999 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:14.611922 22786 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:14.699826 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:14.703207 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:14.705005 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:14.725845 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:14.726612 18485 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:14.711505 18337 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.712942 18338 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:14.662395 23024 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:14.709617 18336 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:14.678385 23227 raft_consensus.cc:697] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:14.708204 23235 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:19:14.748728 18489 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:14.750736 18384 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:14.740866 18344 raft_consensus.cc:1275] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:14.725544 18491 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:14.752225 18384 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:14.742270 18336 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:14.759358 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:14.761739 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:14.706125 23169 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:14.686318 22797 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.743273 18487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:19:14.773597 18487 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:14.773846 18493 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:19:14.774103 18487 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:14.770104 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:14.770529 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:14.778748 18491 raft_consensus.cc:2410] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:14.739289 23101 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.690302 23137 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:14.651650 22981 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.797181 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:14.744592 23062 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:14.706862 23105 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.803741 18487 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.779829 23225 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:14.813761 18487 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.708884 23176 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.809371 18489 raft_consensus.cc:1240] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:14.753409 23060 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:14.753547 23167 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:14.818451 18491 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:19:14.822249 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 70265.8us
I20260709 13:19:14.821420 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:14.823563 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:14.761610 23018 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:14.805691 23046 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.781286 23093 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:14.824853 18493 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:14.766544 22747 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:14.830236 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:14.764464 23163 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:19:14.833225 18491 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:14.836357 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 184344us
I20260709 13:19:14.833940 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:14.837350 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 2294) took 1508 ms. Trace:
I20260709 13:19:14.837833 18488 rpcz_store.cc:276] 0709 13:19:13.328851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.328963 (+   112us) service_pool.cc:224] Handling call
0709 13:19:14.836377 (+1507414us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54001b7954. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:14.837292 (+   915us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2186029440}
I20260709 13:19:14.827186 22670 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:14.781747 23169 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.780292 22807 consensus_queue.cc:1059] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:19:14.831384 22743 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:14.834456 23062 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:14.826290 23060 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.810348 23101 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.827673 22786 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:14.852605 23247 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:19:14.852792 22797 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.853163 23169 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:14.854686 23191 log.cc:927] Time spent T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 1.145s	user 0.004s	sys 0.006s
I20260709 13:19:14.826450 22999 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.827777 23167 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.838428 22981 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:14.911908 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 212489us
I20260709 13:19:14.962497 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:14.913334 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 225835us
I20260709 13:19:14.964258 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:14.965837 18308 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:14.966877 23168 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:14.968900 18342 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:14.969157 23092 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:14.969033 23163 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:14.919313 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1022) took 2033 ms. Trace:
W20260709 13:19:14.919610 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 160224us
I20260709 13:19:14.839078 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:14.977739 18335 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:14.974279 18341 rpcz_store.cc:276] 0709 13:19:12.885674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.885783 (+   109us) service_pool.cc:224] Handling call
0709 13:19:12.886055 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.888508 (+  2453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.888536 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.894256 (+  5720us) log.cc:844] Serialized 26 byte log entry
0709 13:19:13.278857 (+384601us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:13.924331 (+645474us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.924648 (+   317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.924718 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.854127 (+929409us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:14.918442 (+ 64315us) raft_consensus.cc:1685] finished
0709 13:19:14.918622 (+   180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.919023 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2127,"prepare.queue_time_us":116541,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":11372,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":9206,"spinlock_wait_cycles":102494464,"thread_start_us":978598,"threads_started":2,"wal-append.queue_time_us":622504}
I20260709 13:19:14.930727 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:14.863883 22764 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:14.846979 22747 raft_consensus.cc:3055] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:14.981994 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:14.983362 18487 raft_consensus.cc:2393] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 8: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:14.821734 23024 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.003147 23024 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.005219 23255 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:15.006650 23255 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:15.010995 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 955) took 1291 ms. Trace:
W20260709 13:19:15.011188 23254 consensus_queue.cc:1175] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" responder_term: 11 status { last_received { term: 11 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 11 index: 10 } }
I20260709 13:19:15.011478 18411 rpcz_store.cc:276] 0709 13:19:13.719550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.719687 (+   137us) service_pool.cc:224] Handling call
0709 13:19:13.719945 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.896182 (+176237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.010457 (+1114275us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b540010b654. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:15.010810 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401138560}
I20260709 13:19:15.015048 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:15.016145 18488 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:14.872583 23137 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:14.880370 23167 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.854720 23176 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.868564 23221 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:14.884083 23225 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:14.833703 23227 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.026324 18416 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
W20260709 13:19:14.945813 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.030341 23133 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:15.031315 23133 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.840433 22670 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:19:14.946372 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 102213us
I20260709 13:19:15.032466 22670 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.975080 23018 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:19:15.035069 23133 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.037746 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:14.959055 23105 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.946430 18457 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:15.039739 23221 consensus_queue.cc:1059] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:15.040723 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 94869.4us
I20260709 13:19:14.960711 22825 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.042229 22825 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.017495 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:14.970062 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:14.914613 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.849093 22743 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:14.975163 22807 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:14.975270 23060 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.981907 22747 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:14.859429 23101 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:14.984439 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:14.933883 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:15.045234 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:15.038394 23133 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:15.044637 18344 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
W20260709 13:19:15.058256 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 66200.2us
I20260709 13:19:15.052913 22743 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:15.051775 23255 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:15.066107 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 100511us
I20260709 13:19:15.076730 18308 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:15.077853 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:15.080181 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:15.053171 22807 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:15.082574 22807 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.086846 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:15.087155 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:15.088397 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:15.089524 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:15.090235 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:15.090780 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2660) took 1630 ms. Trace:
I20260709 13:19:15.091202 18490 rpcz_store.cc:276] 0709 13:19:13.460395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.460595 (+   200us) service_pool.cc:224] Handling call
0709 13:19:13.460967 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.858683 (+397716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.090331 (+1231648us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5400437e54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:15.090611 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913262336}
I20260709 13:19:15.091934 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:15.092397 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:15.093137 18490 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:15.095135 22825 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:15.095908 18492 raft_consensus.cc:1275] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:15.098134 18488 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:19:15.058599 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 125104us
I20260709 13:19:15.048542 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.105901 23255 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:15.043241 18384 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:15.047171 23168 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:15.059273 23101 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:15.116276 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:15.121016 18491 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:19:15.122452 18337 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:19:15.123116 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1129) took 1816 ms. Trace:
I20260709 13:19:15.123682 19061 rpcz_store.cc:276] 0709 13:19:13.306922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.307309 (+   387us) service_pool.cc:224] Handling call
0709 13:19:13.307593 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.953370 (+645777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.122484 (+1169114us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54004885d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:15.122914 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1483355904}
I20260709 13:19:15.124029 22946 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.046283 23163 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.134982 23101 raft_consensus.cc:697] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:15.137120 23249 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.109119 23092 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:15.058689 22670 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.115538 23168 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:15.155562 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 112456us
I20260709 13:19:15.157059 23075 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:15.166432 18489 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:15.097759 18492 raft_consensus.cc:2955] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:15.174672 18337 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:15.176396 19062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:19:15.177444 19062 raft_consensus.cc:606] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:15.177928 19062 raft_consensus.cc:614] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:15.179535 18490 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:19:15.185467 23046 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:15.186450 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.177937 23221 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:15.195058 18486 raft_consensus.cc:2410] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:15.055126 22747 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:15.215637 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 43906.7us
I20260709 13:19:15.222743 19054 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:15.225363 22736 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.226078 22736 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.229471 22747 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:15.230510 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.215540 23221 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.230576 19061 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
W20260709 13:19:15.244215 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 167721us
I20260709 13:19:15.237128 23221 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:15.230368 22736 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:15.267063 18339 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:15.236091 23092 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.258047 22894 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:19:15.237620 23133 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:19:15.310912 23168 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.318163 23264 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.266100 23101 consensus_queue.cc:237] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:15.247213 23257 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.188701 23249 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:15.342496 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 49130.9us
I20260709 13:19:15.347085 23018 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:15.347486 23018 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:15.348593 23018 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.349735 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1130) took 1329 ms. Trace:
I20260709 13:19:15.349962 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.350780 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 954) took 1637 ms. Trace:
I20260709 13:19:15.352221 18414 rpcz_store.cc:276] 0709 13:19:13.713424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.713987 (+   563us) service_pool.cc:224] Handling call
0709 13:19:15.320580 (+1606593us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54002a6054. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:15.350574 (+ 29994us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316675328}
I20260709 13:19:15.345368 18382 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:15.356943 23263 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.062s	user 0.003s	sys 0.000s
W20260709 13:19:15.367771 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 70334.9us
I20260709 13:19:15.349798 23018 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:15.368322 23168 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:15.382323 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 85055.3us
I20260709 13:19:15.389274 23133 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.392235 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:15.350250 19060 rpcz_store.cc:276] 0709 13:19:14.019985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.020101 (+   116us) service_pool.cc:224] Handling call
0709 13:19:14.020404 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.020800 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.020843 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.021298 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.106868 (+1085570us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b18002e1620. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:19:15.294863 (+187995us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:15.303357 (+  8494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.344991 (+ 41634us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.345035 (+    44us) raft_consensus.cc:1685] finished
0709 13:19:15.345051 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.349529 (+  4478us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21541,"raft.queue_time_us":2761,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2734,"spinlock_wait_cycles":4106496,"thread_start_us":81616,"threads_started":1,"wal-append.queue_time_us":1247567}
I20260709 13:19:15.360335 22807 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:15.400436 23219 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 1.156s	user 0.003s	sys 0.003s
I20260709 13:19:15.402469 18343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2487) took 1633 ms. Trace:
I20260709 13:19:15.404003 18343 rpcz_store.cc:276] 0709 13:19:13.768566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.880264 (+111698us) service_pool.cc:224] Handling call
0709 13:19:13.880620 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.880944 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.880971 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.881398 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.145761 (+264363us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:14.145801 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.145868 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.312900 (+1167032us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:15.401992 (+ 89092us) raft_consensus.cc:1685] finished
0709 13:19:15.402020 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.402271 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2490,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4431,"spinlock_wait_cycles":21840768,"thread_start_us":263954,"threads_started":1,"wal-append.queue_time_us":344225}
I20260709 13:19:15.405479 23108 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:15.407061 22946 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:15.412335 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:15.413139 18337 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
W20260709 13:19:15.414232 23103 consensus_meta.cc:287] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.737s	user 0.015s	sys 0.006s
I20260709 13:19:15.415237 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:15.416105 18341 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:15.417186 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:15.418054 18342 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:15.414292 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:15.419281 18344 raft_consensus.cc:2410] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:15.408831 22807 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:15.395985 18384 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:15.466737 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.553709 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:15.456398 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2482) took 1689 ms. Trace:
I20260709 13:19:15.589059 18343 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
W20260709 13:19:15.522266 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.526117 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 130680us
W20260709 13:19:15.456033 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.450204 18308 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:15.517333 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1351) took 1083 ms. Trace:
I20260709 13:19:15.589320 18339 rpcz_store.cc:276] 0709 13:19:13.767324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.767654 (+   330us) service_pool.cc:224] Handling call
0709 13:19:14.611084 (+843430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:15.296293 (+685209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.455392 (+159099us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54000e10d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:15.456139 (+   747us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b54000e10d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:15.456309 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3404385024}
I20260709 13:19:15.604295 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:15.603147 19054 rpcz_store.cc:276] 0709 13:19:14.434285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.435638 (+  1353us) service_pool.cc:224] Handling call
0709 13:19:15.517081 (+1081443us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54007602d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:15.517264 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1256681984}
W20260709 13:19:15.510380 23024 consensus_meta.cc:287] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.506s	user 0.014s	sys 0.000s
W20260709 13:19:15.565006 23274 log.cc:927] Time spent T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:19:15.395833 22670 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:15.470046 23262 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.008s
W20260709 13:19:15.473100 23268 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:19:15.609532 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 159460us
I20260709 13:19:15.512696 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 2350) took 1248 ms. Trace:
W20260709 13:19:15.611694 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 237394us
I20260709 13:19:15.469901 23163 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.610922 18309 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:15.458503 23188 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:15.614701 18410 rpcz_store.cc:276] 0709 13:19:14.110292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.114188 (+  3896us) service_pool.cc:224] Handling call
0709 13:19:15.322571 (+1208383us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001c57d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:15.358824 (+ 36253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243888000}
I20260709 13:19:15.525801 22913 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:19:15.468607 23249 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:15.606527 23092 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:15.625785 18410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:15.643606 18410 raft_consensus.cc:606] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:15.643976 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.643978 18410 raft_consensus.cc:614] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:15.645483 22956 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:15.646059 22956 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.646554 22956 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:15.650133 18307 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:15.656416 23024 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:19:15.659770 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.660020 18309 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:15.661078 23097 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:15.642789 23075 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:15.676481 23075 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.677002 23075 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.677874 23097 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.680346 23097 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:15.685775 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:15.686491 18484 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
W20260709 13:19:15.687183 23265 log.cc:927] Time spent T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.426s	user 0.004s	sys 0.000s
I20260709 13:19:15.688696 18485 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:19:15.694247 23266 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.325s	user 0.000s	sys 0.002s
I20260709 13:19:15.695973 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2317) took 1222 ms. Trace:
I20260709 13:19:15.394651 23264 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:15.701669 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 58301.9us
I20260709 13:19:15.671012 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:15.696502 18416 rpcz_store.cc:276] 0709 13:19:14.473389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.493706 (+ 20317us) service_pool.cc:224] Handling call
0709 13:19:15.695712 (+1202006us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b540011d5d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:15.695899 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153881472}
I20260709 13:19:15.675362 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:15.669377 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1051) took 1219 ms. Trace:
I20260709 13:19:15.669313 19061 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:15.674386 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:15.702972 18491 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:15.706295 18486 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
W20260709 13:19:15.706455 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 83023.8us
I20260709 13:19:15.656319 22913 consensus_queue.cc:1243] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:19:15.707351 18487 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:15.708757 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:15.709265 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:15.710069 23092 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:15.655632 22807 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:15.717530 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.479298 23257 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:15.713299 22807 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:15.728713 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 370731us
I20260709 13:19:15.703616 18340 rpcz_store.cc:276] 0709 13:19:14.433040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.527829 (+ 94789us) service_pool.cc:224] Handling call
0709 13:19:14.528031 (+   202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.550644 (+ 22613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.550676 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.551085 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.614724 (+ 63639us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:14.615110 (+   386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.604073 (+988963us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b5400058cd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:15.607571 (+  3498us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.617592 (+ 10021us) raft_consensus.cc:1685] finished
0709 13:19:15.617617 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.652281 (+ 34664us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4250,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":2538,"spinlock_wait_cycles":51309312,"thread_start_us":63378,"threads_started":1,"wal-append.queue_time_us":36826,"wal-append.run_cpu_time_us":1650,"wal-append.run_wall_time_us":1054950}
I20260709 13:19:15.726174 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:15.721768 23097 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:15.718236 22913 consensus_queue.cc:1059] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:19:15.731576 22807 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:15.750634 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.751451 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.753041 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.753676 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.754470 19056 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:15.754549 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.755901 19060 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:15.756556 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2363) took 1141 ms. Trace:
I20260709 13:19:15.757000 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.757792 19057 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:15.759372 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.760095 19062 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
W20260709 13:19:15.763234 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 54108.5us
I20260709 13:19:15.768301 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.765403 18339 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:15.747774 23092 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:15.756928 18412 rpcz_store.cc:276] 0709 13:19:14.615410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.688431 (+ 73021us) service_pool.cc:224] Handling call
0709 13:19:14.716731 (+ 28300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:14.926964 (+210233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.927047 (+    83us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:14.928659 (+  1612us) log.cc:844] Serialized 52 byte log entry
0709 13:19:15.113244 (+184585us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:15.168615 (+ 55371us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.181707 (+ 13092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.756013 (+574306us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54002a6554. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:15.756065 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.756123 (+    58us) raft_consensus.cc:1685] finished
0709 13:19:15.756220 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.756385 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9918,"prepare.queue_time_us":64867,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":21896,"raft.run_cpu_time_us":546,"raft.run_wall_time_us":68723,"spinlock_wait_cycles":236028160,"thread_start_us":290589,"threads_started":2,"wal-append.queue_time_us":287680}
W20260709 13:19:15.777793 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 117978us
I20260709 13:19:15.764252 23097 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:15.797057 18458 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:15.798447 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:15.799381 18458 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:15.800819 19056 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:15.807117 23188 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:15.807600 23188 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:15.807992 23188 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:15.803462 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 90701.6us
I20260709 13:19:15.813220 18307 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:15.821714 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.822781 23012 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:15.826876 23097 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.818544 23168 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:15.830320 18384 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:15.830510 23168 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.831084 23168 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:15.831339 23264 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:15.832289 23058 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:15.834139 22894 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:15.818575 23101 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:19:15.836511 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.837275 23163 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:15.837729 23163 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:15.837929 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.838249 23163 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:15.838968 19056 raft_consensus.cc:2410] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:15.839893 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.840039 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:15.841114 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.841434 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:15.842414 18340 raft_consensus.cc:2410] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 14 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:19:15.843401 19056 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:19:15.805181 23221 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.847815 23027 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:15.848201 18307 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:15.849610 23093 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:15.850354 23093 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:15.850765 23093 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:15.851863 23257 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:15.856014 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 966) took 1395 ms. Trace:
I20260709 13:19:15.858719 22986 consensus_queue.cc:1059] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:15.859721 22986 consensus_queue.cc:1243] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:19:15.860240 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 818607us
I20260709 13:19:15.861558 23093 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.862761 23202 raft_consensus.cc:3055] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:15.863277 23202 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:15.864549 23093 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:15.864430 23202 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.868880 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:15.869705 19058 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.872763 22956 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:15.810822 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:15.856439 18413 rpcz_store.cc:276] 0709 13:19:14.460325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.462002 (+  1677us) service_pool.cc:224] Handling call
0709 13:19:14.462290 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:14.470519 (+  8229us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:14.470547 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:14.471041 (+   494us) log.cc:844] Serialized 52 byte log entry
0709 13:19:15.522331 (+1051290us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b1800450220. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:19:15.736690 (+214359us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:15.736740 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.745568 (+  8828us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.855557 (+109989us) raft_consensus.cc:1685] finished
0709 13:19:15.855576 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.855837 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42636,"raft.queue_time_us":8598,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":6783,"spinlock_wait_cycles":27992448,"thread_start_us":202019,"threads_started":1,"wal-append.queue_time_us":1368696}
W20260709 13:19:15.877887 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 75065.9us
W20260709 13:19:15.881552 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 68003.7us
I20260709 13:19:15.884312 19053 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:19:15.884748 19053 pending_rounds.cc:85] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 9
I20260709 13:19:15.885084 19053 pending_rounds.cc:107] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:19:15.885462 19053 raft_consensus.cc:2889] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:15.886114 23101 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:15.886551 23018 raft_consensus.cc:3055] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:15.886674 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.887259 23018 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:15.886574 23101 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:15.888724 23101 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.834406 23058 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:15.894893 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:15.897723 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:15.849722 23027 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:15.878293 23202 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:15.899425 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:15.888652 23018 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.884594 23075 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.898828 23221 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:15.927978 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:15.931565 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.933308 19058 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:15.907799 23058 raft_consensus.cc:697] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:19:15.951388 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 76331.8us
I20260709 13:19:15.932723 23255 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:15.962105 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:15.962870 18413 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
W20260709 13:19:15.963644 23277 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.059s	user 0.003s	sys 0.000s
I20260709 13:19:15.964898 23017 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:15.965715 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:15.967629 19058 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:15.966475 18416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:15.971297 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:15.953392 23027 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:15.958815 23272 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:15.981860 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 72929.7us
I20260709 13:19:15.987354 23093 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:15.988162 23093 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:15.988955 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:15.979748 18416 raft_consensus.cc:606] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:15.990533 18416 raft_consensus.cc:614] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:15.959904 23255 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:15.995275 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:15.990767 23018 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:15.996029 23255 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:15.978870 23221 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:15.992834 22956 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:16.017722 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:16.019733 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:16.020008 23222 raft_consensus.cc:3055] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:16.020522 23222 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:16.021935 18419 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:16.021706 23222 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:16.023272 23222 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:16.024657 23111 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:16.025404 23111 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.026049 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:16.028767 23111 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.029901 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:16.031766 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:16.033159 19053 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:16.033267 19061 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:16.033564 19059 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:15.978667 23017 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.034340 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:16.034937 19056 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:19:16.035483 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.036635 23017 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.003768 23027 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.039836 23027 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.043685 23163 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:15.999140 22894 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:16.046298 22894 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.048295 22894 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.055051 22792 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.055784 22792 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.059314 23221 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.061502 23221 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:16.064028 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 53841.6us
W20260709 13:19:16.066372 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 69714.2us
W20260709 13:19:16.069204 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 49609.9us
I20260709 13:19:16.072911 23148 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:16.072746 23168 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:16.074863 18412 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:16.045822 23163 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.084415 18339 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:16.084939 23168 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:16.086532 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:16.011925 23249 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:16.092379 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:16.100373 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:16.107156 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.125908 19056 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:16.014853 23060 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:19:16.128355 22792 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.093680 23093 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:16.090342 23188 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:16.156746 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:16.161775 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.165547 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.165576 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 73311.9us
I20260709 13:19:16.151016 23075 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.076392 23058 consensus_queue.cc:237] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:16.150746 23163 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.176399 23163 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:16.179069 23163 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:16.179628 23163 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:16.180294 23163 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.152177 23168 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:16.174504 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.182250 23168 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:16.183234 22670 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:16.183826 22670 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.184711 23168 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:16.185784 22670 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.186376 23225 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.187191 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:16.187009 23225 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.187884 18412 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:16.174795 23271 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:16.188889 23271 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.189574 23225 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:16.189993 23227 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:16.190383 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:16.191184 23271 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.185704 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:16.199646 18412 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:16.200739 18419 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:16.164809 23264 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:19:16.202965 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.213028 19087 heartbeater.cc:646] Failed to heartbeat to 127.16.211.62:40381 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.16.211.62:40381 timed out after 15.000s (SENT)
I20260709 13:19:16.223381 23188 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:16.223958 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 123697us
I20260709 13:19:16.156023 23249 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.146116 23255 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:16.237998 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 64407us
I20260709 13:19:16.233014 19056 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:16.253811 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:16.254204 19026 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:16.237500 23227 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.240345 23168 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:16.262301 18307 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:16.259027 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:16.264112 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:16.252743 23264 consensus_queue.cc:1243] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:16.267765 18412 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:16.271932 23188 consensus_queue.cc:1059] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:16.275822 23101 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.276429 23163 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:16.278470 22807 consensus_meta.cc:287] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.002s
I20260709 13:19:16.278942 22807 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:16.281231 22807 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:16.282048 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.282294 23027 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:16.282807 23027 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.283205 23027 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:16.286085 23075 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:16.286270 23225 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:16.286846 23075 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.287606 18308 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:16.288587 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:16.267388 23272 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:19:16.290114 22956 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:16.289738 23093 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:16.291288 23093 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.291666 23093 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:16.286096 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 45170.7us
I20260709 13:19:16.294564 19026 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:16.260987 23227 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:16.273548 23092 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:16.301244 18340 raft_consensus.cc:1240] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:16.272179 18416 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:16.268544 23168 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.256381 23271 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:16.317523 18308 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:16.320608 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 82847.1us
I20260709 13:19:16.322940 18308 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:16.339897 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:16.341229 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 70235.1us
I20260709 13:19:16.342178 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:16.343082 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 386353us
I20260709 13:19:16.344882 18343 raft_consensus.cc:2393] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:16.353431 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:16.338621 18241 catalog_manager.cc:5697] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.333642 22956 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:16.380790 22956 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:16.381318 22956 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:16.357059 23271 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:16.384085 23271 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:16.378358 18240 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42284 (request call id 335) took 28626 ms (client timeout 15000 ms). Trace:
I20260709 13:19:16.333145 23111 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:16.362576 18337 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:16.336432 23264 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.319301 23092 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:19:16.363153 23225 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.364234 18489 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:19:16.397732 18489 pending_rounds.cc:85] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 6
I20260709 13:19:16.398185 18489 pending_rounds.cc:107] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:19:16.398483 18489 raft_consensus.cc:2889] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.397774 23225 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.365893 18343 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:19:16.399575 18343 pending_rounds.cc:85] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 12
I20260709 13:19:16.399891 18343 pending_rounds.cc:107] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:19:16.400161 18343 raft_consensus.cc:2889] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.367821 23168 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.400707 23225 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:16.367841 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:16.336459 23163 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.402383 23163 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.370082 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:16.370849 19025 leader_election.cc:336] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.631s (SENT)
I20260709 13:19:16.378530 23148 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:16.405016 19025 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:16.405145 23148 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:16.405789 23148 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:16.378597 18418 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:16.339090 23101 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.396842 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:16.400005 18457 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:16.368372 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:16.367305 18416 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:16.410820 18487 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:16.414891 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:16.415856 18484 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:16.418738 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:16.411674 18241 catalog_manager.cc:5697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 6 to 10, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 10 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:16.388531 23111 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:16.437460 23225 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:16.454407 18491 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:16.455865 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 48839.1us
I20260709 13:19:16.406622 22807 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:19:16.433686 18241 catalog_manager.cc:5697] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:16.439144 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:16.430207 23255 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.466344 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:16.410998 23264 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.461324 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:16.463791 18485 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:16.465154 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:16.482359 18491 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 13: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:16.434018 23222 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:16.434340 23168 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:16.434603 23111 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:16.497648 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:16.495443 18488 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
W20260709 13:19:16.522991 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 180918us
I20260709 13:19:16.507869 18241 catalog_manager.cc:5697] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:16.499722 18382 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:16.526090 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 126167us
I20260709 13:19:16.490321 23202 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.462255 23225 consensus_queue.cc:1059] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:19:16.528077 22894 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:16.539024 23249 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:16.574057 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 278005us
W20260709 13:19:16.577203 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.495110 22792 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:19:16.549220 23163 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.556324 23018 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:16.539999 23221 consensus_queue.cc:1059] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:19:16.553575 23222 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:16.578907 18241 catalog_manager.cc:5697] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:16.603156 23163 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:16.603634 23221 raft_consensus.cc:3055] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:16.603785 23163 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.604352 23221 raft_consensus.cc:740] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:16.606717 23257 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.607452 23257 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.610303 23257 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.607440 23163 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.612859 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:16.613731 18486 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:16.595573 23018 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.614979 23018 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:16.615607 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:16.616380 18493 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:16.617389 23292 consensus_queue.cc:1059] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:19:16.618595 22999 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:16.619164 18241 catalog_manager.cc:5697] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 2 to 5, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 5 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:16.620941 23180 raft_consensus.cc:3055] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:16.621436 23180 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:16.605605 23221 consensus_queue.cc:260] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.628489 23221 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:16.632030 23075 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.633944 22807 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.634651 22807 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.621229 18241 catalog_manager.cc:5697] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 7 to 11, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 11 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:16.637655 22807 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.645123 18241 catalog_manager.cc:5697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 11 to 15, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 15 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:19:16.660230 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.660588 19058 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:16.660061 18241 catalog_manager.cc:5697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 9 to 13, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 13 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:19:16.664512 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 179101us
I20260709 13:19:16.669540 18382 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:16.557971 23202 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.674582 18382 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:16.677058 18241 catalog_manager.cc:5697] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 10 to 12, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 12 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.683971 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:16.684942 18488 raft_consensus.cc:2410] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:16.686185 23257 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.687557 23257 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:16.675748 22807 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:16.691457 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 329813us
W20260709 13:19:16.696403 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.698465 23257 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:16.679448 23222 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:16.680768 23075 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:16.706015 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 296292us
I20260709 13:19:16.703229 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:16.696439 22807 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:16.713810 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:16.711853 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.715168 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:16.715643 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 307528us
I20260709 13:19:16.718806 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:16.704872 23222 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:16.713706 23075 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:16.743854 18241 catalog_manager.cc:5697] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 6 to 9, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 9 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.747094 18308 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:16.715307 22807 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.715039 23297 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.764130 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 184846us
I20260709 13:19:16.734552 23222 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:16.740216 23264 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:16.746304 23097 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.769904 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 62518.8us
W20260709 13:19:16.775451 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 56739.6us
I20260709 13:19:16.777217 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:16.778162 23298 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:16.779794 23298 raft_consensus.cc:2764] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:19:16.386806 18240 rpcz_store.cc:269] 0709 13:18:47.751642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.751828 (+   186us) service_pool.cc:224] Handling call
0709 13:19:16.378135 (+28626307us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:10.840421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:11.180737 (+340316us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:11.209555 (+ 28818us) write_op.cc:435] Acquired schema lock
0709 13:19:11.209600 (+    45us) tablet.cc:662] Decoding operations
0709 13:19:11.343246 (+133646us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:11.343343 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:11.343383 (+    40us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:19:11.344819 (+  1436us) tablet.cc:701] Row locks acquired
0709 13:19:11.344883 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:19:11.345056 (+   173us) write_op.cc:270] Start()
0709 13:19:11.345209 (+   153us) write_op.cc:276] Timestamp: P: 1783603151344988 usec, L: 0
0709 13:19:11.345252 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:19:11.370285 (+ 25033us) log.cc:844] Serialized 6289 byte log entry
0709 13:19:11.925668 (+555383us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b54000497d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eed7e28 00007f40a2912581 00007f40a2911d58 00007f40a29169f1 00007f40a29169a9 00007f40a2916939 00007f40a2916901 00007f40a2915b2d 000000000038f354 000000000038f199
0709 13:19:12.292817 (+367149us) op_driver.cc:464] REPLICATION: finished
0709 13:19:12.498282 (+205465us) write_op.cc:301] APPLY: starting
0709 13:19:12.498392 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:12.731402 (+233010us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:12.731447 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:12.928042 (+196595us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:12.928429 (+   387us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:19:12.928489 (+    60us) write_op.cc:312] APPLY: finished
0709 13:19:12.928911 (+   422us) log.cc:844] Serialized 148 byte log entry
0709 13:19:12.929101 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:12.929272 (+   171us) write_op.cc:454] Released schema lock
0709 13:19:12.929340 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:12.996163 (+ 66823us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:13.085761 (+ 89598us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7452416,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":132520,"apply.run_cpu_time_us":27997,"apply.run_wall_time_us":486110,"cfile_cache_hit":62,"cfile_cache_hit_bytes":64573,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6210,"cfile_init":2,"lbm_read_time_us":40603,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":10,"num_ops":16,"prepare.queue_time_us":469181,"prepare.run_cpu_time_us":63534,"prepare.run_wall_time_us":1124008,"raft.queue_time_us":231592,"raft.run_cpu_time_us":40369,"raft.run_wall_time_us":130039,"replication_time_us":929992,"spinlock_wait_cycles":55295744,"thread_start_us":850571,"threads_started":4,"wal-append.queue_time_us":472635,"wal-append.run_cpu_time_us":15548,"wal-append.run_wall_time_us":2082256}]]}
I20260709 13:19:16.760975 23168 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:16.780611 22999 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:16.787453 22999 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:16.783782 23225 raft_consensus.cc:3055] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:16.789697 23306 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.790935 18241 catalog_manager.cc:5697] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 6 to 10, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 10 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.792033 23240 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:16.768718 23017 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:16.761140 23308 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:16.802174 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.814002 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.820268 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:16.821007 18493 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:16.821974 18458 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:16.820590 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:16.767117 23297 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:16.813431 23027 consensus_meta.cc:287] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.530s	user 0.015s	sys 0.000s
I20260709 13:19:16.798156 23225 raft_consensus.cc:740] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:16.780663 23093 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:16.836678 18487 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:16.842402 18489 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:16.808064 23075 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:16.781512 23227 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:16.848119 23294 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:19:16.852408 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:16.848387 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:16.852998 18416 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:19:16.856678 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:16.788100 23097 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.857013 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:16.857677 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.857832 18342 raft_consensus.cc:2393] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:19:16.858561 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 88830.9us
I20260709 13:19:16.832029 23308 raft_consensus.cc:697] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:16.830639 23202 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:16.853298 18241 catalog_manager.cc:5697] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:16.866555 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:16.844064 23168 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:16.797652 23309 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:19:16.864794 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:16.870707 18340 raft_consensus.cc:2368] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12.
I20260709 13:19:16.874503 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:16.875104 18416 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
W20260709 13:19:16.875526 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.876356 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.881845 18343 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 13: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:16.877897 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:16.882423 19062 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:16.882987 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 150462us
I20260709 13:19:16.815369 23306 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.893767 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:16.894618 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:16.893740 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:16.894361 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:16.899632 18417 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:16.879199 18414 pending_rounds.cc:85] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 8
I20260709 13:19:16.901347 18414 pending_rounds.cc:107] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:19:16.901861 18414 raft_consensus.cc:2889] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.851254 23027 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:16.919453 18338 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:16.904027 18419 raft_consensus.cc:2410] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:16.917230 19026 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:16.907275 18336 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 13: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:16.906797 23225 consensus_queue.cc:260] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:16.923974 18484 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:16.907680 18241 catalog_manager.cc:5697] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 3 to 5, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 5 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:16.909040 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 52439.3us
I20260709 13:19:16.913663 19062 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:16.914011 23060 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:16.918303 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:16.906628 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 56344.1us
W20260709 13:19:16.895990 23293 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:19:16.872670 23168 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:16.957703 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:16.963030 18241 catalog_manager.cc:5697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 8 to 10, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 10 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.872326 23075 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:19:16.972645 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:16.930546 23017 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:16.974145 22946 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:16.973619 23255 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:16.976824 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:16.977249 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 47408us
I20260709 13:19:16.976758 18241 catalog_manager.cc:5697] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 4 to 9, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 9 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.963481 23168 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.878775 23316 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:19:16.987210 19060 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:19:17.010438 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 91536.8us
I20260709 13:19:16.894042 23318 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:19:17.017779 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:17.019863 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:17.023294 18338 raft_consensus.cc:1240] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:19:17.025418 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:16.938302 23018 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:17.007037 22946 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.032867 18344 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:17.033366 18342 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:17.033478 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:17.032377 18309 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:17.031924 18241 catalog_manager.cc:5697] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 7 to 9, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 9 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.967648 23202 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:19:16.985600 22999 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.041402 18458 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:16.971114 23163 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:19:17.038208 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.026507 23225 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:17.047240 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.048136 18419 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:17.048616 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.049572 18338 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:17.044446 18241 catalog_manager.cc:5697] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 10 to 12, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 12 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.051263 18241 catalog_manager.cc:5697] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:17.052084 18241 catalog_manager.cc:5697] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:17.043455 18309 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:17.045416 18411 raft_consensus.cc:2376] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14. Re-sending same reply.
I20260709 13:19:17.038894 22946 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:17.064988 18419 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:19:17.036224 23060 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:17.063395 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.069135 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.065415 18419 pending_rounds.cc:85] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 11
I20260709 13:19:17.072299 18419 pending_rounds.cc:107] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:19:17.072614 18419 raft_consensus.cc:2889] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:17.066431 18309 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:17.072073 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:17.078555 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.089493 18335 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:17.068787 23320 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:17.105165 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 118796us
I20260709 13:19:17.026595 23308 consensus_queue.cc:237] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:17.108486 23093 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:17.108363 23111 consensus_meta.cc:287] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.003s
I20260709 13:19:17.114419 23248 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:17.082372 23319 log.cc:927] Time spent T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:19:17.118288 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:17.130592 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 56884.8us
I20260709 13:19:17.119124 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.080327 23255 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:17.079711 23249 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:17.081745 23297 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.135572 18411 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:19:17.145823 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 108621us
I20260709 13:19:17.140748 23227 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:17.118865 23331 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:17.163446 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:17.167042 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:17.146124 23320 raft_consensus.cc:697] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:17.141595 23111 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.141242 23248 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.171422 23297 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:17.173039 23180 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.181968 22894 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:17.182271 23180 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:17.183902 23297 raft_consensus.cc:697] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:17.183961 22946 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.184952 23297 consensus_queue.cc:237] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.170691 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.173943 23018 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:17.186952 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:17.192582 18342 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
W20260709 13:19:17.194303 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 77529.6us
W20260709 13:19:17.197436 23330 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:19:17.205106 23320 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.207388 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.208045 18342 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:17.171666 23202 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.209652 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:17.214337 23310 log.cc:927] Time spent T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:19:17.162599 23255 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 13:19:17.216918 22956 consensus_meta.cc:287] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.835s	user 0.010s	sys 0.003s
I20260709 13:19:17.228507 22956 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:17.217288 23332 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.186035 23251 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.112s
I20260709 13:19:17.226397 18410 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:17.227444 23163 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:17.243515 23148 consensus_meta.cc:287] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.837s	user 0.011s	sys 0.001s
I20260709 13:19:17.243825 22956 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:17.243947 23148 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.227365 23202 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.246842 23332 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.248494 23202 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.249130 23332 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.208096 23222 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.250087 23163 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.250442 23322 consensus_queue.cc:1059] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:19:17.250864 18412 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:17.252115 23163 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.254298 23148 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.225674 23240 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:17.254952 23240 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.258385 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:17.259137 18484 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:17.260931 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.261533 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:17.261543 18487 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 6.
I20260709 13:19:17.262279 18491 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:17.251987 23222 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.273509 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.274324 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.277432 23188 raft_consensus.cc:3055] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:17.278184 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:17.280125 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 107653us
I20260709 13:19:17.290786 18493 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
W20260709 13:19:17.281018 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.257269 23060 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:17.239907 23255 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.227522 23313 consensus_queue.cc:1059] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:19:17.294351 18487 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:17.290990 18382 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:17.297045 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 117645us
I20260709 13:19:17.281550 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:17.270853 23251 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:17.295672 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:17.295871 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 84385.4us
I20260709 13:19:17.301807 18493 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:17.297582 22792 consensus_queue.cc:1059] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:19:17.302747 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:17.305814 18484 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:17.290462 23188 raft_consensus.cc:740] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:17.311287 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:17.311452 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 115544us
I20260709 13:19:17.312340 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:17.321877 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:17.301313 23148 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:17.314203 23202 raft_consensus.cc:3055] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:17.328976 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.319391 23012 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:17.310575 23251 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.335366 23012 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.335850 23012 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:17.314636 23254 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:17.458596 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.310964 23168 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:17.346048 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.328680 23240 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.319621 23018 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:17.373641 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 51834.6us
I20260709 13:19:17.296636 23060 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:17.351751 23111 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.320210 23271 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:17.351187 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 46943.9us
I20260709 13:19:17.297574 23255 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.502424 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:17.503585 23255 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.330101 23313 consensus_queue.cc:1059] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:19:17.330451 23148 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.505687 22894 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.505993 23148 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.330323 23202 raft_consensus.cc:740] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:17.506263 22894 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:17.467267 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:17.507115 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:17.468127 18491 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:17.469205 23349 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:17.475569 18419 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:19:17.490900 18415 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:17.508262 23349 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:17.509341 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.509231 23349 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.510121 18337 raft_consensus.cc:2393] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:17.510944 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.512013 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.507136 23202 consensus_queue.cc:260] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:17.513062 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:17.513356 23202 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:17.514125 23271 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.508288 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.515856 18344 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:17.516191 23271 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.516425 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:17.516873 23012 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.518922 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:17.519477 23264 raft_consensus.cc:3055] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:17.519932 23264 raft_consensus.cc:740] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:17.520869 23264 consensus_queue.cc:260] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.523902 18491 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:17.524435 23336 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:17.524876 23336 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.525233 23336 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:17.529255 23248 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.471638 18382 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:17.500512 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.501113 23251 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:17.531080 23254 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:17.531577 23254 raft_consensus.cc:697] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:17.532495 23254 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.513754 18337 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:17.552459 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:17.553130 18491 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:17.554656 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 83084.8us
W20260709 13:19:17.559816 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.466889 23221 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:17.497435 22807 consensus_meta.cc:287] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.729s	user 0.010s	sys 0.007s
I20260709 13:19:17.569249 18491 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:17.570333 18489 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:17.533983 23027 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:17.491972 23018 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.576256 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.577126 18491 raft_consensus.cc:2393] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:17.513356 23163 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:17.584336 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:17.595079 23168 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.595670 18491 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:17.576632 23018 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:17.586200 23347 log.cc:927] Time spent T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:19:17.598227 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.598354 18458 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:17.598807 18486 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:17.584442 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.599610 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:17.572556 23221 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:17.577049 22807 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.600586 23221 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:17.590117 23264 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.601027 23306 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:17.597544 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.602137 22807 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.595223 23163 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:17.600026 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:17.604386 23163 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:17.587720 23060 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:17.594076 23097 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.604308 18458 leader_election.cc:400] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12.
I20260709 13:19:17.607649 18458 leader_election.cc:403] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:19:17.607785 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:17.608218 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 136684us
I20260709 13:19:17.608695 18491 raft_consensus.cc:2393] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:17.566416 23346 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:17.611404 18410 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:17.611968 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.612571 18412 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:19:17.612651 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:17.612777 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:17.613729 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.616570 18419 raft_consensus.cc:2368] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:17.623493 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.626720 18414 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:17.640597 18307 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:17.642302 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:17.643086 18307 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:17.648208 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.653455 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:17.654371 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:17.654969 19062 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:17.637760 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.657083 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:17.624228 23346 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.656404 18418 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:17.652326 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:17.614133 23180 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12.
I20260709 13:19:17.659377 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:17.661142 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.661718 18410 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:17.662781 18414 raft_consensus.cc:2368] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12.
I20260709 13:19:17.661484 19053 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:17.663779 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:17.664394 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:17.664682 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.665314 18337 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:19:17.665704 23342 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:17.666164 23342 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.666561 23342 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:17.666549 23251 consensus_queue.cc:1059] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:17.667593 23251 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:17.667948 23251 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:17.668788 23251 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.664397 19057 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:17.670907 18485 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:17.680686 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:17.650492 23097 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:17.660522 23320 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:17.663825 23343 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.214s	user 0.006s	sys 0.001s
I20260709 13:19:17.617053 23168 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:19:17.689324 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:17.650992 23027 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:17.701028 18457 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:17.707912 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:17.710176 19025 leader_election.cc:336] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.505s (SENT)
I20260709 13:19:17.712971 18486 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:19:17.751205 18486 pending_rounds.cc:85] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 9
I20260709 13:19:17.751461 18486 pending_rounds.cc:107] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:19:17.751721 18486 raft_consensus.cc:2889] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:17.719319 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.683120 18307 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:17.691187 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.697175 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.697489 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:17.755893 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 72869.6us
I20260709 13:19:17.756054 18410 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:17.756408 18492 raft_consensus.cc:2410] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:17.756595 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:17.755095 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.737985 19059 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:17.734637 18384 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:17.738591 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.711745 18417 raft_consensus.cc:1240] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:17.747154 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.761365 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:17.742295 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.686739 23251 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:17.768257 18307 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:17.748871 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.781950 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:17.740877 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 419195us
I20260709 13:19:17.683948 23012 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:17.684203 23320 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:17.690902 23346 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:17.781206 18341 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:17.712797 23097 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:17.690541 23257 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:17.782637 18486 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:17.711841 22894 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:17.789335 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.793833 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.796238 23257 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:17.766937 23297 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:17.748847 23027 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:17.789811 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:17.790423 19027 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:17.791810 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 81677.2us
I20260709 13:19:17.700584 23332 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:17.794235 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:17.802704 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:17.797700 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 96778.4us
I20260709 13:19:17.767364 23222 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:17.767355 23351 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.794392 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:17.806540 18413 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:17.696578 23313 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 13:19:17.696723 23225 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 13:19:17.783135 23093 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:17.780049 23248 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:17.800550 18486 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:19:17.786262 23271 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:17.796248 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.802488 22894 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:17.792567 23352 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:17.804358 23027 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:17.815819 18411 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:17.826917 18492 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:17.792299 23320 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:17.807610 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:17.728864 23188 consensus_queue.cc:260] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.814321 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.803344 18485 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:17.691895 23221 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:17.807665 23148 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:17.831314 18340 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:17.795758 23097 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.832355 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:17.828306 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.810014 23111 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:17.809893 23093 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:17.815611 23092 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:17.857421 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:17.861778 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 57780.2us
I20260709 13:19:17.862635 18457 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:17.877835 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 106527us
I20260709 13:19:17.879004 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:17.843065 23354 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:19:17.832679 23248 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:17.841097 23297 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:17.834867 23272 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:17.913753 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 51208.6us
I20260709 13:19:17.812297 23332 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.843345 23292 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:17.810108 23222 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:17.908239 23297 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:17.921332 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 113545us
I20260709 13:19:17.862820 23093 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:17.853683 23188 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.853410 23111 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:17.923457 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.923461 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.936853 18384 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:17.864459 23341 raft_consensus.cc:3055] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:17.861344 23148 raft_consensus.cc:697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:17.948366 18417 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:17.949664 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:17.946696 18412 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:17.815618 23351 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.914027 23060 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:17.990607 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:17.988605 18413 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:19:17.918491 22894 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:18.000173 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:17.944408 23297 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:18.006193 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:18.003901 22894 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.008054 22894 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:18.009290 18412 raft_consensus.cc:2410] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:19:18.012646 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:18.015473 18412 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:18.021934 23060 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:18.022753 23358 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:18.025290 19027 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:17.987267 23111 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:17.950428 23341 raft_consensus.cc:740] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:18.024425 19025 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.175s (SENT) [suppressed 19 similar messages]
W20260709 13:19:18.053139 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 137869us
I20260709 13:19:18.055022 18457 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:18.056074 18417 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:17.922912 23272 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:17.949891 23092 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:18.107583 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.030758 23257 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:18.109028 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 83835.5us
I20260709 13:19:18.115072 18339 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:18.117403 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.118175 19057 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:18.118628 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.119343 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.052636 23271 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:18.003037 23336 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.059178 23264 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:18.122869 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 188666us
W20260709 13:19:18.120999 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 66066.3us
I20260709 13:19:18.038031 23313 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:19:18.126606 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.145648 19053 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 13: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:18.146641 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.147694 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.148339 19053 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:19:18.127453 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:18.129038 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:18.130713 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.132654 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:18.115466 23359 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:19:18.127292 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.177837 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:18.180058 19055 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:18.191236 23222 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:18.192481 23362 log.cc:927] Time spent T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:19:18.194000 23356 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
W20260709 13:19:18.194918 23342 consensus_meta.cc:287] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
I20260709 13:19:18.195299 23342 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.197393 23342 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:18.206472 19054 raft_consensus.cc:2393] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 14: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:18.212778 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:18.213958 19053 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:18.232708 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 49656.7us
I20260709 13:19:18.235299 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:18.240420 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 107497us
I20260709 13:19:18.132637 23378 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:18.241433 18457 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:18.197870 23365 log.cc:927] Time spent T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:19:18.248409 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.204721 23336 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:18.248562 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:18.250777 19059 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:18.076763 23148 consensus_queue.cc:237] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:18.077733 23248 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.242053 23221 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:18.174182 23271 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.276762 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.279357 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.280193 19055 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
W20260709 13:19:18.292447 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 268020us
I20260709 13:19:18.206816 23297 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.300154 23376 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:18.300662 23376 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.300997 23376 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.290524 23379 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:18.194010 22894 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:18.306326 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 63560.1us
I20260709 13:19:18.313417 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.284693 23017 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.317847 19059 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
W20260709 13:19:18.309052 23364 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:19:18.442049 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.443078 19059 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 13: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:18.286537 23356 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:18.297185 23378 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:18.448755 19025 leader_election.cc:336] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.630s (SENT)
I20260709 13:19:18.451241 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:18.451845 18457 leader_election.cc:400] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:18.452358 18457 leader_election.cc:403] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:18.453841 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.454807 19059 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 16: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:18.455495 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.456271 19055 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:18.315289 23255 consensus_queue.cc:1059] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.142s
I20260709 13:19:18.444437 23332 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:18.246479 23341 consensus_queue.cc:260] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.476557 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:18.476603 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.440789 23017 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:18.475248 23357 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.411s	user 0.001s	sys 0.000s
I20260709 13:19:18.473959 23378 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:18.450330 23379 consensus_queue.cc:1059] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:19:18.498203 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:18.451426 23356 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.501032 18384 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:18.511439 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 191650us
W20260709 13:19:18.512362 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.512226 18457 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:18.506430 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:18.518144 18457 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:18.518682 19059 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 13: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:18.519043 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:18.531364 23017 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:18.532029 23017 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:18.532645 23017 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:18.532998 23017 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.533324 23017 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:18.535869 23255 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:18.536574 23255 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:18.543390 19053 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
W20260709 13:19:18.526167 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 319635us
I20260709 13:19:18.559679 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2707) took 1756 ms. Trace:
I20260709 13:19:18.562467 19053 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: [6.7-8.9]
I20260709 13:19:18.521603 23341 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:18.561734 18488 rpcz_store.cc:276] 0709 13:19:16.803454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.804069 (+   615us) service_pool.cc:224] Handling call
0709 13:19:17.467338 (+663269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.476084 (+  8746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.490812 (+ 14728us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:17.495790 (+  4978us) log.cc:844] Serialized 26 byte log entry
0709 13:19:17.720973 (+225183us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b18003812e0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:19:17.838193 (+117220us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:17.838222 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.838275 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.524480 (+686205us) raft_consensus.cc:1685] finished
0709 13:19:18.524510 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.559594 (+ 35084us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":223,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":25286,"spinlock_wait_cycles":36859776,"thread_start_us":117059,"threads_started":1,"wal-append.queue_time_us":423810}
I20260709 13:19:18.567500 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:18.568303 18417 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.517282 23092 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:18.573854 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:18.569350 18491 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:19:18.574407 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 49467us
I20260709 13:19:18.579246 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:18.579661 18457 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:18.579989 18486 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:18.581486 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:18.585014 18457 leader_election.cc:400] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12.
W20260709 13:19:18.569690 23251 consensus_meta.cc:287] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.783s	user 0.010s	sys 0.001s
I20260709 13:19:18.589211 18488 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:18.588948 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:18.590000 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 412197us
I20260709 13:19:18.594765 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.596503 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:18.597033 19059 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:18.592932 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:18.597707 18457 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:18.602028 19056 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:18.587359 23297 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:18.609726 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:18.590531 23388 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
W20260709 13:19:18.600461 23384 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:19:18.612128 18457 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:18.612428 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:18.600540 23369 log.cc:927] Time spent T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:19:18.601296 23018 consensus_meta.cc:287] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.005s	user 0.012s	sys 0.000s
I20260709 13:19:18.617514 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.596846 23271 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:18.631649 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:18.601807 23387 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:18.589744 23272 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:18.637390 23389 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:19:18.638826 19025 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:18.642617 19059 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
W20260709 13:19:18.659694 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 63562.7us
I20260709 13:19:18.615605 23255 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:18.638428 23395 raft_consensus.cc:3055] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:18.666532 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:18.663350 23188 consensus_meta.cc:287] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.001s
I20260709 13:19:18.679306 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:18.644800 23313 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:18.667016 23395 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:18.693840 23395 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:18.695273 23395 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:18.698087 23370 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 13:19:18.698927 23408 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:18.700253 23397 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:19:18.701874 23392 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:19:18.703738 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 71024.5us
I20260709 13:19:18.704864 19025 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:18.706200 23368 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:18.707059 23368 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:18.707073 23264 raft_consensus.cc:2764] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:18.707490 23368 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:18.708654 23368 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:18.710148 23375 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.312s	user 0.001s	sys 0.001s
W20260709 13:19:18.721282 23093 consensus_meta.cc:287] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.721s	user 0.008s	sys 0.002s
I20260709 13:19:18.722240 23356 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:18.698969 23335 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:18.621634 23018 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:18.746395 23372 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.625s	user 0.014s	sys 0.025s
I20260709 13:19:18.747511 23018 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:18.699035 23400 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:18.749480 23400 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.751505 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:18.752177 18411 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
W20260709 13:19:18.755657 23389 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:19:18.757053 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2357) took 1066 ms. Trace:
I20260709 13:19:18.757409 18412 rpcz_store.cc:276] 0709 13:19:17.690829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.017574 (+326745us) service_pool.cc:224] Handling call
0709 13:19:18.019088 (+  1514us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:18.075037 (+ 55949us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:18.138948 (+ 63911us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.449355 (+310407us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:18.462638 (+ 13283us) log.cc:844] Serialized 52 byte log entry
0709 13:19:18.462808 (+   170us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:18.462850 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.464082 (+  1232us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.756853 (+292771us) raft_consensus.cc:1685] finished
0709 13:19:18.756869 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.756996 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72206,"prepare.queue_time_us":34939,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":236654,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":6572,"thread_start_us":299025,"threads_started":1,"wal-append.queue_time_us":326617}
I20260709 13:19:18.752512 23018 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:19:18.761845 18417 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:18.731868 18490 raft_consensus.cc:2410] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:18.698004 23398 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:18.739507 23410 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:18.742762 23352 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:18.751639 23400 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:18.766525 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1112) took 1080 ms. Trace:
I20260709 13:19:18.771729 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.772004 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.753209 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:18.781023 19055 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:19:18.780902 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.640484 23251 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 13:19:18.781785 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 151555us
I20260709 13:19:18.662969 23297 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:18.700299 23382 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:19:18.721761 23027 consensus_meta.cc:287] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.882s	user 0.006s	sys 0.001s
I20260709 13:19:18.733879 18486 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:18.781868 23398 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:18.847939 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:18.834547 18492 rpcz_store.cc:276] 0709 13:19:17.685900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.799857 (+113957us) service_pool.cc:224] Handling call
0709 13:19:17.808553 (+  8696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.827358 (+ 18805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.766184 (+938826us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b54002201d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:18.766456 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41781504}
I20260709 13:19:18.838776 19054 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:18.845804 23352 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:18.646574 23387 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.874405 23352 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.861205 23297 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:18.876405 23352 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:18.877449 18308 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:18.847069 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:18.892498 18343 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:18.849632 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:18.855523 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.893011 18308 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:18.858557 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 179336us
I20260709 13:19:18.838272 18411 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:18.861698 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:18.862470 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:18.863899 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:18.765102 23111 consensus_meta.cc:287] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.002s
I20260709 13:19:18.854785 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:18.868608 18382 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:18.869319 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.898850 18308 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:18.869750 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.721719 23093 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:18.854928 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:18.789292 23272 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:18.880519 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 2217) took 2057 ms. Trace:
I20260709 13:19:18.889797 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:18.884589 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:18.906881 18344 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:18.907110 19058 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 16: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:18.906329 18339 rpcz_store.cc:276] 0709 13:19:16.823481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.823615 (+   134us) service_pool.cc:224] Handling call
0709 13:19:16.846043 (+ 22428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.125494 (+1279451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.880231 (+754737us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001653d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:18.880453 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2917681920}
I20260709 13:19:18.878162 23297 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:18.871120 22894 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:18.683732 23376 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:18.882092 19057 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:18.893175 18336 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:18.856472 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:18.896073 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:18.906548 18308 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:18.867065 23255 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:18.912701 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 44231.6us
I20260709 13:19:18.914363 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:18.917307 19057 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:18.935343 19053 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:18.935889 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:18.901225 23398 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:18.911515 23012 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.912665 23092 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:18.903350 18489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.008s	sys 0.006s
I20260709 13:19:18.868036 23027 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.905448 23271 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:18.903522 23309 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:18.916692 22792 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:18.908528 23358 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.950136 19057 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.936470 18382 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:18.936506 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:18.920590 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:18.948637 18489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.008s	sys 0.006s
I20260709 13:19:18.958585 19062 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:18.906699 23111 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.963696 19057 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.956195 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:18.937553 23148 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:18.971284 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:18.961302 18458 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:18.952663 23309 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.957890 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1099) took 1351 ms. Trace:
I20260709 13:19:18.935030 23297 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:18.971488 18492 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:18.935022 18308 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:18.949211 23292 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:18.979487 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:18.980834 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:18.974470 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:18.960244 23379 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:18.965042 22807 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:18.919452 23272 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.977646 18308 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:18.991921 23332 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:18.992544 23332 raft_consensus.cc:697] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:18.993462 23332 consensus_queue.cc:237] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:18.979447 23408 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:18.999699 23188 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:19.000236 23188 raft_consensus.cc:697] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:19.001150 23188 consensus_queue.cc:237] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.008730 23404 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:18.971299 22894 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.009534 23404 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:19.009888 22894 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:19.021723 23412 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:19:19.022313 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2361) took 1330 ms. Trace:
I20260709 13:19:18.983085 23400 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:19.022972 23400 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.022804 18413 rpcz_store.cc:276] 0709 13:19:17.691884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.811363 (+119479us) service_pool.cc:224] Handling call
0709 13:19:19.022109 (+1210746us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540011cbd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:19.022234 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327335168}
I20260709 13:19:19.023636 23400 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:19.027168 23345 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.521s	user 0.001s	sys 0.002s
I20260709 13:19:18.966908 23378 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:18.968824 22792 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:18.968436 23148 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.029237 23148 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:18.975827 23309 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:19.030870 23394 raft_consensus.cc:3055] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:19.031407 23394 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:18.980508 23097 consensus_meta.cc:287] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.080s	user 0.012s	sys 0.000s
I20260709 13:19:19.032441 23394 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.033049 23097 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:18.954320 23012 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:18.982614 23292 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.045679 23097 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.010339 23387 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.010072 18410 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:19.080222 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 124092us
W20260709 13:19:19.075990 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 98417.1us
I20260709 13:19:19.084045 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:19.085124 18336 raft_consensus.cc:2393] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 16: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:19.088254 18484 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:19.090375 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:19.085752 18308 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:19.092957 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.096635 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:19.097241 18336 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:19.098572 18384 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:19.099532 22792 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:19.100049 18384 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:19.102857 22792 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:19.105005 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:19.106312 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:19.108608 18337 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:19.108891 19058 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: [6.7-8.9]
I20260709 13:19:18.984058 23248 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:19.113131 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:19.115583 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:19.118084 18340 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:19.115967 18457 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:18.972772 18489 rpcz_store.cc:276] 0709 13:19:17.606189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.606303 (+   114us) service_pool.cc:224] Handling call
0709 13:19:17.613774 (+  7471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.649631 (+ 35857us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:18.131336 (+481705us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.957415 (+826079us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:18.957485 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:18.957570 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.957668 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.957816 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59007,"prepare.queue_time_us":365233,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":4010,"raft.queue_time_us":187,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6258,"thread_start_us":1079364,"threads_started":2}
I20260709 13:19:19.126930 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2340) took 2008 ms. Trace:
I20260709 13:19:19.131032 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:19.132800 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.133994 18414 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:19.137578 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:19.138427 22894 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:19.139168 23367 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.139703 23367 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.104447 23240 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:19.142423 23240 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.142941 23376 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:19.144493 23240 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.108218 23092 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:19.147958 18490 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 1107) took 1437 ms (client timeout 1630 ms). Trace:
I20260709 13:19:19.148646 18344 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
W20260709 13:19:19.148562 18490 rpcz_store.cc:269] 0709 13:19:17.684642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.737552 (+ 52910us) service_pool.cc:224] Handling call
0709 13:19:19.108601 (+1371049us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b54003fb454. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:19.122319 (+ 13718us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2232207232}
I20260709 13:19:19.127488 18416 rpcz_store.cc:276] 0709 13:19:17.118558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.118711 (+   153us) service_pool.cc:224] Handling call
0709 13:19:17.145125 (+ 26414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.154872 (+  9747us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:17.179615 (+ 24743us) log.cc:844] Serialized 14 byte log entry
0709 13:19:17.279081 (+ 99466us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b18002548c0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f40a2db058f 00007f409bdef571 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd
0709 13:19:17.301600 (+ 22519us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:17.303771 (+  2171us) log.cc:844] Serialized 26 byte log entry
0709 13:19:17.303896 (+   125us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:17.310383 (+  6487us) log.cc:844] Serialized 14 byte log entry
0709 13:19:17.310586 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.310686 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.517333 (+206647us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b18002548c0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:19:19.026554 (+1509221us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:19.126673 (+100119us) raft_consensus.cc:1685] finished
0709 13:19:19.126705 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.126856 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64856,"prepare.queue_time_us":24674,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":52234,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":16234,"spinlock_wait_cycles":88792448,"thread_start_us":78371,"threads_started":1,"wal-append.queue_time_us":138043}
I20260709 13:19:19.152945 18457 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:19.154336 18492 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:19.089323 22999 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:19.089519 23380 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:19.110874 23394 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.107141 23093 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:19.173766 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.195295 23418 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:19.195843 23418 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:19:19.198830 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.180486 19053 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:19.145865 23092 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.201431 23092 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.201540 23404 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:19.203423 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:19.204331 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2336) took 1606 ms. Trace:
I20260709 13:19:19.205408 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:19.207003 23012 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:19.167200 23387 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:19.183401 18457 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:19.209817 23411 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:19.167750 23379 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:19.169495 23320 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.326s	user 0.004s	sys 0.013s
I20260709 13:19:19.217562 18493 rpcz_store.cc:276] 0709 13:19:17.597530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.599896 (+  2366us) service_pool.cc:224] Handling call
0709 13:19:17.600175 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.606136 (+  5961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.606175 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:17.606214 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:17.606244 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.204074 (+1597830us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b5400259254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:19.204128 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.204265 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13283712}
I20260709 13:19:19.094364 23018 consensus_queue.cc:1059] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:19:19.119524 23248 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.168237 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:19.259732 19058 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:19.222040 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:19.222503 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:19.260730 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2395) took 1448 ms. Trace:
I20260709 13:19:19.166114 23297 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:19.151492 23367 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.209065 23418 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.212188 23111 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:19.275399 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.158617 23027 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:19.265285 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 81986.4us
I20260709 13:19:19.278208 23272 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:19.280193 23395 consensus_meta.cc:287] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.001s
I20260709 13:19:19.265941 18418 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 16: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:19.261137 18417 rpcz_store.cc:276] 0709 13:19:17.812025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.777009 (+964984us) service_pool.cc:224] Handling call
0709 13:19:19.025203 (+248194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.025458 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.025500 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.025556 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:19.025601 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.025660 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.260539 (+234879us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540011cbd0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:19.260672 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396835712}
I20260709 13:19:19.268806 18382 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:19.265199 23351 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.248620 23379 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.192694 23380 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.224462 23408 raft_consensus.cc:697] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:19.283844 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:19.288511 18336 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:19:19.233573 23411 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:19.290130 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:19.251816 23180 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:19.265053 23017 consensus_meta.cc:287] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.731s	user 0.011s	sys 0.004s
I20260709 13:19:19.249008 23404 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:19.264314 23248 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:19.295702 23408 consensus_queue.cc:237] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.298439 23404 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.299465 22946 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:19.301106 23404 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.283269 23297 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.302228 23413 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:19.308934 18493 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:19.309397 19025 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:19.310961 18382 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:19.312500 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:19.313321 18416 raft_consensus.cc:2393] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:19.315358 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:19.316128 18484 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:19.320091 19026 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:19.324307 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:19.291321 23012 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:19.291877 23379 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.286546 23395 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:19.327445 19026 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:19.307753 23411 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.304736 23180 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:19.262662 23320 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:19.328624 23349 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.799s	user 0.020s	sys 0.000s
I20260709 13:19:19.309034 23017 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.350709 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:19.372877 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:19.373517 18336 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:19.307951 23221 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:19:19.328299 23346 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:19.373416 18343 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:19.333235 22792 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:19.383122 23383 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:19.383596 23424 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:19.383901 18336 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:19.354715 23317 consensus_queue.cc:1059] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:19:19.330933 23297 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:19.391731 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 296086us
I20260709 13:19:19.396824 18416 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:19.335884 23012 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:19.340230 23180 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:19.395248 19026 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:19.339516 22999 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:19.376987 23349 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.838s	user 0.020s	sys 0.000s
I20260709 13:19:19.344543 23318 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:19.398167 18412 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:19:19.398109 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:19.398836 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:19.400457 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:19.401793 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:19.412568 18336 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 16: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:19.411556 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:19.415813 18484 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:19.416735 23352 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.420049 18340 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:19.420207 23400 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.422073 23383 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:19.423048 23383 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.424638 18339 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:19.426304 23400 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.435248 23356 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:19.435788 23356 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:19.436864 23356 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.336313 23395 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:19.456710 23292 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:19.482582 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2392) took 1686 ms. Trace:
I20260709 13:19:19.480937 23012 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.511483 18414 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:19.512029 18486 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:19.511483 18412 rpcz_store.cc:276] 0709 13:19:17.796482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.759345 (+962863us) service_pool.cc:224] Handling call
0709 13:19:18.759655 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.411604 (+651949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.482211 (+ 70607us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54001784d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:19.482491 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1467925248}
I20260709 13:19:19.516788 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:19.517871 18484 raft_consensus.cc:2410] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:19.404817 18382 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:19.519654 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.522439 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:19.523387 18492 raft_consensus.cc:2410] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:19:19.523412 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 426857us
W20260709 13:19:19.537212 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 551105us
W20260709 13:19:19.542315 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 137597us
I20260709 13:19:19.542544 18458 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:19.541761 23368 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:19.544225 18488 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:19.549633 23292 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:19.551046 23320 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.538983 23356 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.555205 23380 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.555459 23395 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:19.557138 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2403) took 1261 ms. Trace:
I20260709 13:19:19.561451 18341 raft_consensus.cc:1240] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:19.542330 23422 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.127s	user 0.004s	sys 0.000s
I20260709 13:19:19.402112 23424 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.574012 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:19.577495 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 294620us
I20260709 13:19:19.573009 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:19.564469 23349 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:19.584295 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 438696us
I20260709 13:19:19.571558 18411 rpcz_store.cc:276] 0709 13:19:18.295883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.962272 (+666389us) service_pool.cc:224] Handling call
0709 13:19:18.962622 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.962998 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.963026 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.969561 (+  6535us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.331292 (+361731us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:19.331333 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.331396 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.556914 (+225518us) raft_consensus.cc:1685] finished
0709 13:19:19.556934 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.557063 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3584,"raft.queue_time_us":4385,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3710,"thread_start_us":344702,"threads_started":1,"wal-append.queue_time_us":568675}
I20260709 13:19:19.582257 22946 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:19.537678 23092 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.571189 23163 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.598284 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:19.598449 23400 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:19.599661 23400 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:19.600785 18384 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:19.601778 23257 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:19.563395 22807 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:19:19.602200 23257 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:19.614005 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 71542.3us
I20260709 13:19:19.582890 23380 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:19.627912 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:19.628424 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:19.571175 23251 consensus_queue.cc:1059] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:19:19.587177 23349 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.639735 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:19.640439 18415 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:19.636061 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:19.642810 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:19.637903 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:19.637149 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:19.640450 18344 raft_consensus.cc:2393] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:19.638229 19059 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:19.645764 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:19.642810 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:19.646001 18492 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:19.649758 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:19.648934 19059 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:19.652001 18413 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:19.652117 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:19.654350 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:19.656487 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:19.658195 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:19.643482 19053 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:19.660246 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:19.660573 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:19.661157 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:19.587538 23318 consensus_queue.cc:1059] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:19:19.632731 23257 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.676120 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:19.664085 19058 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:19.665113 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:19.662411 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:19.666146 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:19.666908 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:19.667652 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:19.679762 19054 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.683430 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:19.685515 23404 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.686214 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:19.686115 23404 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:19.688313 23404 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:19.690011 23351 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:19.690970 23092 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.624665 23429 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:19.685309 23418 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:19.693662 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:19.652526 23313 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:19.653093 23349 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.763499 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:19.755627 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:19.765349 18413 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:19.674091 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:19.757030 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:19.762140 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:19.688879 23404 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 13:19:19.747615 23148 consensus_meta.cc:287] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.718s	user 0.008s	sys 0.010s
I20260709 13:19:19.749487 23017 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.773744 23148 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.774355 23017 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:19.774920 23017 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.775699 23148 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.776419 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:19.777083 19058 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:19.777180 23017 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.771384 23092 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:19:19.778342 19061 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:19.769682 18309 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:19.781173 23411 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.782989 18309 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:19.783293 23418 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:19.784051 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:19.784250 18309 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:19.752463 22946 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:19.786158 23424 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.785866 22946 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:19.788468 23398 consensus_meta.cc:287] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.828s	user 0.010s	sys 0.005s
I20260709 13:19:19.788870 23398 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:19.789814 18491 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:19.692339 22894 consensus_queue.cc:1059] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:19:19.789328 23248 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.794682 22894 raft_consensus.cc:3055] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:19.822153 22894 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:19.748811 23093 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:19:19.796252 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:19.801504 23352 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:19.802076 22946 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:19.803045 23431 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:19.803496 23320 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:19.830363 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:19.803977 23332 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:19.748039 23433 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.805019 23379 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.831825 23433 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.810544 23395 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:19.830482 22894 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:19.835572 22894 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.836527 23163 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:19.837752 23400 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:19.815507 18341 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:19.818719 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:19.652294 23380 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.840191 23411 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:19.840576 23255 consensus_meta.cc:287] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.903s	user 0.014s	sys 0.000s
I20260709 13:19:19.841012 18417 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:19.817315 19054 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:19.821352 23368 raft_consensus.cc:3055] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:19.832341 18489 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:19:19.812762 18309 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:19.830438 23320 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:19.844739 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:19.846004 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.852970 18340 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 16: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:19.853717 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:19.855741 18413 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:19.860065 18339 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 12. Ops: []
I20260709 13:19:19.813853 23251 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:19.852402 23320 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.841017 23255 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:19.901687 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:19.902848 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:19.848147 23368 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:19.853502 23240 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:19.911301 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:19.913529 23368 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:19.915295 23394 consensus_meta.cc:287] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.719s	user 0.007s	sys 0.003s
I20260709 13:19:19.768151 23429 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.917651 23429 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.919834 18335 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:19:19.773120 23313 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.923358 18337 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:19.924180 23313 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:19.936393 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:19.936689 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:19.938340 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:19.927145 18335 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:19.948714 18340 raft_consensus.cc:1240] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:19.953667 18492 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:19.954391 18413 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:19.957394 18487 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.888039 23380 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:19.947579 22792 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.975390 22792 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:19.961401 23309 consensus_meta.cc:287] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.930s	user 0.009s	sys 0.004s
W20260709 13:19:19.963213 23180 consensus_meta.cc:287] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.000s
I20260709 13:19:19.964233 23355 raft_consensus.cc:3055] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:19.967162 23257 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.874765 23332 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:19:19.969632 23255 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.983790 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:19.900729 23251 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:19.914687 23368 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:19.985900 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:19:19.981698 23358 consensus_meta.cc:287] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.021s	user 0.006s	sys 0.007s
I20260709 13:19:19.977662 22792 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:19.985311 23426 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:19:19.992799 18413 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.995589 18418 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:19:19.997098 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.999090 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.004688 18487 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:20.006385 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:20.007992 18411 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:19.987993 23355 raft_consensus.cc:740] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:20.011216 19027 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:20.010002 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:20.012073 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:20.014286 18492 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:20.014894 23225 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:20.016538 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 351962us
I20260709 13:19:19.997062 23358 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.024792 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:20.026420 23318 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:20.017305 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:20.026562 19027 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:20.025508 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:20.020507 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 326879us
I20260709 13:19:20.029312 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:19.989511 23180 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:20.006456 23313 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:19.994577 23255 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:19.988332 23309 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.027611 23318 raft_consensus.cc:3055] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:20.038092 18418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
W20260709 13:19:20.038767 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 90898.8us
I20260709 13:19:20.040036 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:20.041324 18307 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:20.047576 18484 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:20.046947 18418 raft_consensus.cc:606] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:20.048192 18418 raft_consensus.cc:614] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:20.018834 23432 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:20.050257 23318 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:20.050927 18382 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:20.053323 23318 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.054726 23318 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.056128 23251 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:20.057030 23432 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:20.063628 23225 consensus_queue.cc:1059] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:20.060385 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:20.051115 23188 consensus_queue.cc:1059] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:19:20.071388 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2362) took 1438 ms. Trace:
I20260709 13:19:20.060914 23148 consensus_queue.cc:1059] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:20.045415 23349 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:20.074415 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 2717) took 1490 ms. Trace:
I20260709 13:19:20.068050 23355 consensus_queue.cc:260] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:20.059213 23441 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:19:20.064706 19027 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:20.121335 18491 rpcz_store.cc:276] 0709 13:19:18.584334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.592630 (+  8296us) service_pool.cc:224] Handling call
0709 13:19:20.074226 (+1481596us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400135454. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:20.074355 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2737080064}
I20260709 13:19:20.034366 23404 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:20.129457 18416 raft_consensus.cc:2368] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:20.081414 18492 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:20.082242 18343 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:19:20.036847 23378 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:19:20.078346 23271 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:20.089522 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1116) took 1110 ms. Trace:
I20260709 13:19:20.151738 18485 rpcz_store.cc:276] 0709 13:19:18.979056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.024284 (+ 45228us) service_pool.cc:224] Handling call
0709 13:19:19.024680 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.025098 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.025132 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:19.025674 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.442938 (+417264us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:19.514422 (+ 71484us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.536163 (+ 21741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.536235 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.089316 (+553081us) raft_consensus.cc:1685] finished
0709 13:19:20.089336 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.089463 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17291,"prepare.queue_time_us":79162,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":25062,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":14513,"thread_start_us":391739,"threads_started":1,"wal-append.queue_time_us":612106}
W20260709 13:19:20.153132 23356 consensus_meta.cc:287] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.001s
I20260709 13:19:20.154320 18485 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:19:20.154675 18485 pending_rounds.cc:85] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 7
I20260709 13:19:20.154877 18485 pending_rounds.cc:107] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:19:20.155100 18485 raft_consensus.cc:2889] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:20.160390 18309 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:20.046402 23313 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.162580 23313 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:20.096855 18418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:20.166888 18418 raft_consensus.cc:606] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:20.167244 18418 raft_consensus.cc:614] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:20.098368 23257 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:20.101277 23255 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:20.107753 23434 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.298s	user 0.001s	sys 0.001s
I20260709 13:19:20.108892 18415 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
W20260709 13:19:20.109125 23439 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.315s	user 0.000s	sys 0.000s
I20260709 13:19:20.110953 23398 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:20.114331 18413 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:20.039826 23449 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:20.124285 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:20.125532 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.126874 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 62261.7us
I20260709 13:19:20.189294 18492 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:20.190240 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:20.127439 23355 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:20.203703 23432 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:20.219302 18411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:20.222999 23358 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.223645 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1121) took 1136 ms. Trace:
I20260709 13:19:20.223563 23358 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.224105 18489 rpcz_store.cc:276] 0709 13:19:19.087207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.153120 (+ 65913us) service_pool.cc:224] Handling call
0709 13:19:19.192008 (+ 38888us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.848303 (+656295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.223367 (+375064us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b5400258354. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:20.223574 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472030592}
I20260709 13:19:20.225567 18489 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:20.117550 18419 rpcz_store.cc:276] 0709 13:19:18.632961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.010601 (+377640us) service_pool.cc:224] Handling call
0709 13:19:19.011036 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.099056 (+ 88020us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:19.409369 (+310313us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.854350 (+444981us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:19.855291 (+   941us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.855450 (+   159us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:19.855482 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.855547 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.071174 (+215627us) raft_consensus.cc:1685] finished
0709 13:19:20.071196 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.071328 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12230,"prepare.queue_time_us":514477,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":12539,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":23131,"thread_start_us":639559,"threads_started":2,"wal-append.queue_time_us":610931}
W20260709 13:19:20.147480 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 106260us
I20260709 13:19:20.228116 18307 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:20.148500 23346 raft_consensus.cc:3055] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:20.149057 23309 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:20.174939 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 996) took 1058 ms. Trace:
I20260709 13:19:20.242432 18410 rpcz_store.cc:276] 0709 13:19:19.116821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.162385 (+ 45564us) service_pool.cc:224] Handling call
0709 13:19:19.198789 (+ 36404us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:19.222881 (+ 24092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.222949 (+    68us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:19.251207 (+ 28258us) log.cc:844] Serialized 52 byte log entry
0709 13:19:19.581937 (+330730us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:19.581992 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.583283 (+  1291us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.107072 (+523789us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:20.174655 (+ 67583us) raft_consensus.cc:1685] finished
0709 13:19:20.174675 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.174885 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1003,"raft.queue_time_us":19390,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10461,"spinlock_wait_cycles":16068992,"thread_start_us":311609,"threads_started":1,"wal-append.queue_time_us":371456}
I20260709 13:19:20.183318 18488 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:20.184777 23180 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:20.130077 23251 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:20.204831 19060 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:20.206020 19054 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:20.250062 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:20.206799 19055 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:20.207229 23449 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.128676 23349 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:20.250181 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:20.254037 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 93713.7us
I20260709 13:19:20.254736 19058 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:20.209812 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2725) took 1245 ms. Trace:
I20260709 13:19:20.209946 23248 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:20.212742 18491 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:20.147805 23455 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:20.214000 23437 log.cc:927] Time spent T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.357s	user 0.002s	sys 0.000s
I20260709 13:19:20.262362 23093 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:20.262552 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:20.214478 22999 raft_consensus.cc:3055] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:20.263461 22999 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:20.264334 23180 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:19:20.252602 23445 log.cc:927] Time spent T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.218s	user 0.002s	sys 0.000s
I20260709 13:19:20.265828 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:20.266280 23431 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.267010 23431 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:20.267299 18307 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:20.267549 23431 raft_consensus.cc:697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:20.268174 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:20.268323 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:20.268533 23431 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.269222 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:20.260725 23449 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.270327 23092 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:20.270522 23271 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.270989 23092 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.271651 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 1002) took 1069 ms. Trace:
I20260709 13:19:20.272028 18417 rpcz_store.cc:276] 0709 13:19:19.201788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.325908 (+124120us) service_pool.cc:224] Handling call
0709 13:19:19.326354 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.841427 (+515073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.271416 (+429989us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54003ecbd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:20.271575 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1183151360}
I20260709 13:19:20.239321 22946 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.240070 23225 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.238963 23346 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:20.238793 23408 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.262146 23455 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:20.274015 19062 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:20.241546 23358 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:20.256011 18486 rpcz_store.cc:276] 0709 13:19:18.964148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.964255 (+   107us) service_pool.cc:224] Handling call
0709 13:19:18.964517 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.512635 (+548118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.209581 (+696946us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54001b7954. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:20.209756 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164837120}
W20260709 13:19:20.278877 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 230501us
I20260709 13:19:20.249737 23342 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.282225 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:20.289667 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:20.245241 23452 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:19:20.243690 23320 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.280869 23225 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:20.307833 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.308131 23225 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:20.308651 23225 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.309096 23225 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.310316 23346 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.311568 23346 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.312619 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:20.313462 23458 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:20.313686 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:20.314335 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:20.314625 18493 raft_consensus.cc:2393] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:20.315064 18344 raft_consensus.cc:2368] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12.
I20260709 13:19:20.315460 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:20.317106 23093 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:20.317729 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:20.318413 18337 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:20.318804 23394 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.320860 18308 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:20.323782 23093 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:20.295254 23342 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.296452 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:20.340833 18341 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 13: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:20.297272 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:20.341513 19058 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.291779 18489 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:20.297744 23060 raft_consensus.cc:3055] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:20.298906 23457 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:20.349869 18342 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:20.300256 23317 raft_consensus.cc:3055] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:20.303071 18487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55650 (request call id 2723) took 1339 ms (client timeout 1648 ms). Trace:
I20260709 13:19:20.360293 19025 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:20.303148 23455 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:20.291078 23248 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:19:20.291183 23309 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:19:20.281708 22946 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.288298 23408 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.347970 18308 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:20.356485 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:20.405362 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 388123us
I20260709 13:19:20.357344 18490 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:20.353339 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:20.359835 18487 rpcz_store.cc:269] 0709 13:19:18.963439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.963579 (+   140us) service_pool.cc:224] Handling call
0709 13:19:20.302902 (+1339323us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54003746d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:20.303015 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2266307456}
I20260709 13:19:20.378362 23163 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.349454 23060 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:20.279508 23180 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:19:20.359345 23317 raft_consensus.cc:740] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:20.381408 23368 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:20.383610 22999 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.385898 23449 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:20.387342 23379 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:20.395062 19055 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:20.400149 19062 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:20.406296 18411 raft_consensus.cc:606] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:20.449841 18411 raft_consensus.cc:614] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:20.407827 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 59940.6us
W20260709 13:19:20.408314 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 55040.4us
I20260709 13:19:20.409005 19058 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:20.452173 18458 leader_election.cc:400] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12.
W20260709 13:19:20.452929 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.445570 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 92959.5us
I20260709 13:19:20.450718 18308 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:20.451643 18493 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:20.404137 23318 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.452504 18458 leader_election.cc:403] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:19:20.409651 23394 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:20.410667 23457 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:20.448112 23368 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.444449 23458 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:20.471925 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:20.449431 23395 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.453881 23418 raft_consensus.cc:3055] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:20.452324 23452 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.452473 22894 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:20.464144 23457 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:20.487725 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:20.445139 23163 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.463972 23394 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:20.454908 23448 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:20.486141 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:20.660873 18341 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:20.485558 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:20.571769 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:20.484596 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:20.661952 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 90237.8us
I20260709 13:19:20.664297 18486 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:20.476958 23368 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:20.646638 23387 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:20.647148 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 240188us
I20260709 13:19:20.648754 18416 raft_consensus.cc:1275] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:20.649689 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:20.670738 18412 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.649989 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:20.650102 18309 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:20.651013 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:20.651479 23342 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:20.652311 23367 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:20.576344 23394 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:20.486414 23378 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:20.652742 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.652966 23453 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:20.654532 23408 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:20.654896 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:20.655624 18487 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:19:20.476805 23332 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:20.657171 23225 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:20.659718 18343 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:20.710734 18493 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
W20260709 13:19:20.647709 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 596812us
I20260709 13:19:20.570501 22894 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.483448 23418 raft_consensus.cc:740] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:20.484452 22999 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:20.571753 23320 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:20.668970 18488 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:20.665534 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:20.474594 23318 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.671824 18410 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:20.670558 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:20.672816 18419 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:20.704438 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:20.801258 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 130772us
I20260709 13:19:20.487044 23395 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.487035 23452 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.706557 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:20.669955 23404 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:20.672017 23317 consensus_queue.cc:260] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.670253 23387 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.737268 18416 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:19:20.660938 23448 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:20.791529 18493 raft_consensus.cc:1240] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:20.796939 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:20.797149 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:20.801964 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.794162 23453 consensus_queue.cc:1243] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:20.610064 23060 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:20.806465 23471 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:20.802297 18384 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:20.827214 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:20.827993 18384 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:20.802958 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.832687 19025 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:20.803018 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:20.805547 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.705210 23367 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.705408 23473 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:20.669893 23292 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 13:19:20.799834 23148 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:20.808995 23356 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:20.790126 23271 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 13:19:20.848300 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:20.826821 23387 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.833885 23349 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:20.860013 18457 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:20.815245 23458 raft_consensus.cc:697] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:19:20.863564 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 58774.9us
I20260709 13:19:20.808736 23180 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:19:20.826401 23320 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.837859 23355 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:20.872668 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 134693us
I20260709 13:19:20.838263 23408 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:20.874063 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.872148 18457 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:20.880306 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:20.878394 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:20.878736 18308 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:20.876762 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.885609 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:20.886234 18415 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:19:20.881254 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:20.881464 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:20.888458 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:20.854777 23470 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:20.873077 23202 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:20.897256 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:20.873687 23356 raft_consensus.cc:697] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:20.875674 22946 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:20.875517 23221 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:20.906461 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:20.858474 23398 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:19:20.853741 23148 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:20.910252 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 77668.4us
I20260709 13:19:20.916617 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:20.879241 23349 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:20.923965 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:20.952502 18415 raft_consensus.cc:2393] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:20.930895 23351 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:20.931910 23380 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.937440 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:20.957540 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:20.957773 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:20.893182 23413 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.963699 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:20.964427 18338 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:20.874949 23453 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:19:20.952200 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:20.969199 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:20.880398 23240 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:19:20.931073 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 78453us
I20260709 13:19:20.955361 23163 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:20.955713 23467 log.cc:927] Time spent T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:19:20.936929 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 45218.5us
I20260709 13:19:20.958747 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:20.958417 18419 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:20.970199 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:20.952840 18384 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:20.883809 23458 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:20.855875 23468 consensus_queue.cc:1059] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.118s
I20260709 13:19:20.950629 23448 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.015363 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:21.038100 18341 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:20.936985 23352 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:21.017853 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 62382.3us
I20260709 13:19:20.880843 23320 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.887238 23408 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:21.024202 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 71452.4us
I20260709 13:19:21.083922 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:21.025205 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 118864us
I20260709 13:19:21.021821 18415 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:21.021216 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:20.901584 23225 consensus_queue.cc:1059] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:19:20.958629 23292 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:21.032578 23349 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:21.033026 23344 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:21.014796 23487 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:19:21.057753 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 80098.2us
I20260709 13:19:21.077669 19025 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:20.958755 23248 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:21.079021 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 200343us
I20260709 13:19:20.937150 23221 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:20.963008 23383 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:21.017426 23381 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.907799 23470 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:20.836761 23379 consensus_queue.cc:1175] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" responder_term: 13 status { last_received { term: 12 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:20.938252 23202 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:21.158746 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.198241 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 174038us
I20260709 13:19:21.222473 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:21.224332 23464 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.573s	user 0.004s	sys 0.000s
I20260709 13:19:21.085260 23395 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:21.232558 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 126487us
I20260709 13:19:21.269394 19027 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:21.084697 23480 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:21.272104 18414 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:21.233238 22894 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:21.100896 23352 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:19:21.262697 23451 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:19:20.978507 23380 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.103917 23472 consensus_queue.cc:1059] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.119s
W20260709 13:19:21.250931 23378 consensus_meta.cc:287] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.539s	user 0.013s	sys 0.012s
I20260709 13:19:21.017287 23481 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.259s
I20260709 13:19:21.103672 23473 raft_consensus.cc:697] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:21.263375 19057 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.157634 23487 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:21.273276 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 195724us
I20260709 13:19:20.978294 23413 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:21.150769 23356 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.137040 23485 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:21.225018 23433 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:21.278827 18308 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:21.254611 23493 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:19:21.265853 23351 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:21.331064 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.417980 18415 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:21.257957 23383 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:19:21.401489 18307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.011s	sys 0.039s
W20260709 13:19:21.426224 18307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.011s	sys 0.039s
I20260709 13:19:21.290504 23352 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:21.334329 23202 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:21.280479 23477 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:21.336143 23491 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:19:21.455962 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2738) took 1639 ms. Trace:
I20260709 13:19:21.272444 23367 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:21.084985 23453 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.498303 18492 rpcz_store.cc:276] 0709 13:19:19.816773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.191205 (+374432us) service_pool.cc:224] Handling call
0709 13:19:20.191555 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.245500 (+ 53945us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:20.245535 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.260468 (+ 14933us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.460936 (+200468us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:20.460987 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.461076 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.163445 (+702369us) spinlock_profiling.cc:243] Waited 7.28 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:21.444019 (+280574us) raft_consensus.cc:1685] finished
0709 13:19:21.444049 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.455889 (+ 11840us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39697,"raft.queue_time_us":42726,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":7887,"spinlock_wait_cycles":16741248,"thread_start_us":168069,"threads_started":1,"wal-append.queue_time_us":290944}
W20260709 13:19:21.359126 23346 consensus_meta.cc:287] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.047s	user 0.012s	sys 0.001s
W20260709 13:19:21.421402 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 337568us
I20260709 13:19:21.332329 23221 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:21.426834 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 548459us
W20260709 13:19:21.293903 18412 consensus_meta.cc:287] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.000s
I20260709 13:19:21.562126 18412 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:21.335343 23408 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:21.284855 23498 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:21.360848 23378 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12.
W20260709 13:19:21.411954 18484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.003s	sys 0.014s
I20260709 13:19:21.400668 22807 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:21.499554 18414 raft_consensus.cc:2410] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:21.407609 23225 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.525225 19057 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:21.267611 23381 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:21.419960 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 141233us
I20260709 13:19:21.444518 23488 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:21.544613 23148 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:21.494546 23492 log.cc:927] Time spent T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.270s	user 0.001s	sys 0.003s
I20260709 13:19:21.442934 23383 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:21.455871 23477 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.332350 23499 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.193s
I20260709 13:19:21.450536 23476 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:21.558874 18338 consensus_meta.cc:287] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.590s	user 0.007s	sys 0.003s
W20260709 13:19:21.559671 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 267749us
W20260709 13:19:21.564604 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.602032 18338 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:21.565944 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:21.570503 23481 consensus_queue.cc:1059] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:21.570736 23413 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:21.571183 23486 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.296s	user 0.003s	sys 0.001s
W20260709 13:19:21.557796 23332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.045s	sys 0.068s
W20260709 13:19:21.574343 18484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.004s	sys 0.014s
I20260709 13:19:21.616256 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:21.541193 23395 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:21.650566 23395 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.652964 23395 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:21.333596 23418 consensus_queue.cc:260] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:21.550040 23487 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:21.529245 23180 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.004s	sys 0.004s
I20260709 13:19:21.445154 23351 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:21.654876 23180 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.004s	sys 0.005s
W20260709 13:19:21.542075 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 272786us
I20260709 13:19:21.657202 19027 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:21.579830 23394 consensus_meta.cc:287] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.843s	user 0.008s	sys 0.004s
I20260709 13:19:21.594935 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:21.600303 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:21.602155 18457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.009s	sys 0.012s
I20260709 13:19:21.668074 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:21.668510 18457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.010s	sys 0.012s
I20260709 13:19:21.585075 23488 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:21.601329 23489 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.607213 22807 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:21.571565 23473 consensus_queue.cc:237] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.524294 23202 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:19:21.579008 23309 consensus_queue.cc:1059] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:19:21.660430 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:21.669094 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:21.669111 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 796976us
I20260709 13:19:21.709470 18338 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:21.710762 18457 leader_election.cc:400] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:21.711200 18457 leader_election.cc:403] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:21.711932 18492 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:19:21.697762 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 81609.8us
I20260709 13:19:21.597555 23240 consensus_queue.cc:1059] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:19:21.602586 23477 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:21.616637 23332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.046s	sys 0.069s
W20260709 13:19:21.600946 23497 log.cc:927] Time spent T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:19:21.713675 19026 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:21.699122 23503 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:19:21.711441 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:21.603557 23475 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.101s
I20260709 13:19:21.588910 23225 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.667565 23429 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:21.700714 23488 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:21.668622 23180 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:21.699069 23394 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:21.724682 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.739132 18308 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:21.751919 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2423) took 1073 ms. Trace:
I20260709 13:19:21.767627 18417 rpcz_store.cc:276] 0709 13:19:20.678986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.679103 (+   117us) service_pool.cc:224] Handling call
0709 13:19:20.679446 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.704442 (+ 24996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.704473 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.792699 (+ 88226us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.894356 (+101657us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:20.894411 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.894497 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.751617 (+857120us) raft_consensus.cc:1685] finished
0709 13:19:21.751646 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.751844 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1327,"raft.queue_time_us":24873,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":91614,"thread_start_us":44720,"threads_started":1,"wal-append.queue_time_us":149395}
W20260709 13:19:21.755033 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 44475.5us
I20260709 13:19:21.769990 18457 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:21.772701 23518 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.772979 23484 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:21.723577 23514 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:21.774258 23514 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:21.776446 23514 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:21.766916 23429 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:21.780041 23429 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:21.781332 23484 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
W20260709 13:19:21.781580 22999 consensus_meta.cc:287] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.980s	user 0.009s	sys 0.001s
I20260709 13:19:21.784735 22999 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:21.781929 23342 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:21.769783 23380 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:21.782363 23516 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:21.785719 23387 consensus_meta.cc:287] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.907s	user 0.008s	sys 0.003s
W20260709 13:19:21.782820 23510 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:19:21.783156 23476 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:21.783861 23519 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:21.787009 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 47998.2us
I20260709 13:19:21.844718 18308 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:21.791605 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:21.773265 23518 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.854236 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:21.855046 18489 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:21.726263 23470 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:21.726195 23320 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:21.786211 23484 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:21.724220 23332 raft_consensus.cc:697] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:21.836242 23515 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.836864 23512 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:21.749868 23378 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:21.718396 23292 consensus_queue.cc:1059] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:19:21.845820 18492 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
W20260709 13:19:21.857240 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 198860us
I20260709 13:19:21.870075 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:21.871287 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.872079 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:21.872959 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:21.769464 23092 consensus_meta.cc:287] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.498s	user 0.014s	sys 0.004s
I20260709 13:19:21.873652 19058 raft_consensus.cc:2368] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12.
I20260709 13:19:21.873737 23092 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:21.862994 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:21.874636 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:21.866953 23484 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.876883 23484 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:21.863390 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 149743us
I20260709 13:19:21.878304 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:21.864058 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:21.833109 23309 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:21.870008 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:21.883564 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:21.785897 23511 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:21.881436 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 111535us
I20260709 13:19:21.708108 23489 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.839877 23408 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:21.837704 23395 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:21.885406 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:21.886881 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:21.767230 23480 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:19:21.891135 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:21.770869 23180 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:21.892284 18457 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:21.893427 19057 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:21.865322 23448 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.902650 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:21.856282 23344 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:21.839031 23387 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:21.900753 18339 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:19:21.901105 18338 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:21.879062 23378 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:21.907372 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:21.911087 19059 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:21.903507 19060 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:21.906680 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:21.838887 23516 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.917681 23516 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:21.894770 23512 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.923998 23512 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:21.925477 23453 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:21.926465 23381 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:21.926039 23502 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:19:21.926299 23494 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:21.895048 23408 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.905797 23342 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:21.938511 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1185) took 1671 ms. Trace:
W20260709 13:19:21.931209 23507 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 13:19:21.940439 23387 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:21.940757 23148 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:21.942993 23518 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:21.972657 23529 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:21.890682 23515 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.974068 19057 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:19:21.976578 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:21.977219 19057 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
I20260709 13:19:21.980461 23060 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:21.908383 23448 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.879433 22807 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.906117 23476 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:21.945386 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 75459.8us
I20260709 13:19:21.958163 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2356) took 1294 ms. Trace:
I20260709 13:19:21.959322 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:21.907058 23344 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:21.908272 23378 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:21.905846 22999 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:21.968608 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:22.025564 19059 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 13: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:19:21.972137 23466 log.cc:927] Time spent T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: Append to log took a long time: real 1.304s	user 0.000s	sys 0.008s
I20260709 13:19:21.985420 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1187) took 1159 ms. Trace:
I20260709 13:19:21.985481 19054 raft_consensus.cc:1217] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 5.6->[6.7-8.9]   Dedup: 8.9->[]
I20260709 13:19:22.028131 19054 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: [6.7-8.9]
I20260709 13:19:21.998010 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:21.958249 23429 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.029819 19057 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:19:21.895249 23395 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.017952 19060 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:22.019513 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:22.020665 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.031890 18342 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:21.859105 23519 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.035828 23395 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:21.964380 19055 rpcz_store.cc:276] 0709 13:19:20.266629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.470208 (+203579us) service_pool.cc:224] Handling call
0709 13:19:20.470516 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.857021 (+386505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.857066 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.857586 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.973405 (+115819us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:20.973455 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.938102 (+964647us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54005b0254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:21.938148 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.938191 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:21.938208 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.938450 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40106,"raft.queue_time_us":29874,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":6460,"spinlock_wait_cycles":834533632,"thread_start_us":81804,"threads_started":1,"wal-append.queue_time_us":347771}
I20260709 13:19:22.016435 18484 rpcz_store.cc:276] 0709 13:19:20.663728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.663832 (+   104us) service_pool.cc:224] Handling call
0709 13:19:20.669956 (+  6124us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:20.671072 (+  1116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.671114 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:20.677308 (+  6194us) log.cc:844] Serialized 52 byte log entry
0709 13:19:21.616985 (+939677us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:21.740801 (+123816us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.754986 (+ 14185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.755057 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.957908 (+202851us) raft_consensus.cc:1685] finished
0709 13:19:21.957946 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.958090 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14503,"prepare.queue_time_us":224692,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":3642,"raft.queue_time_us":26927,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":41462,"thread_start_us":899357,"threads_started":2,"wal-append.queue_time_us":824621}
I20260709 13:19:22.027967 19056 rpcz_store.cc:276] 0709 13:19:20.825944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.826894 (+   950us) service_pool.cc:224] Handling call
0709 13:19:20.848340 (+ 21446us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:19:20.877576 (+ 29236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.877606 (+    30us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:19:20.884902 (+  7296us) log.cc:844] Serialized 104 byte log entry
0709 13:19:21.154464 (+269562us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:21.232467 (+ 78003us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.342132 (+109665us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.342353 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.342428 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.985171 (+642743us) raft_consensus.cc:1685] finished
0709 13:19:21.985191 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.985364 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":221883,"prepare.queue_time_us":81637,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":8232,"raft.queue_time_us":152866,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":96120,"spinlock_wait_cycles":103339904,"thread_start_us":216893,"threads_started":1,"wal-append.queue_time_us":436968}
W20260709 13:19:22.035147 23460 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 1.331s	user 0.008s	sys 0.027s
I20260709 13:19:21.984899 23148 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:22.036545 23453 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:22.015232 23411 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.027415 23344 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.045075 23411 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:22.045879 23180 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:21.891459 23511 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:22.047302 23411 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:22.047963 23511 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:22.046151 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:22.052877 19057 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:22.045338 23344 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:22.053669 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:22.053249 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.062465 18384 leader_election.cc:400] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12.
I20260709 13:19:22.062937 18384 leader_election.cc:403] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:22.071120 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:22.072216 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:22.072808 19057 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:22.060600 18339 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:22.071816 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:22.060004 23352 consensus_meta.cc:287] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.001s
I20260709 13:19:22.013985 23342 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.092918 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.097009 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:22.098994 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 65690.5us
I20260709 13:19:22.100914 18384 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:22.070399 23180 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.060042 23395 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:22.075598 23480 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:22.038285 23429 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:22.082974 19057 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:22.051159 23457 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:21.983853 23494 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:22.077378 23485 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:21.968492 23332 consensus_queue.cc:237] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.031287 22999 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.079119 23448 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.078011 23411 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12.
I20260709 13:19:22.103457 18384 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:22.091599 23394 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.095558 23202 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:22.100920 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.026445 23476 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.098922 23352 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.113517 23498 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:22.144532 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.110797 23504 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:19:22.127485 23383 consensus_meta.cc:287] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.001s
W20260709 13:19:22.149593 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 48870.3us
I20260709 13:19:22.162822 18458 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:22.151515 23509 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:22.151922 23521 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:19:22.152474 23532 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.159415 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1184) took 1958 ms. Trace:
I20260709 13:19:22.128871 23485 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:22.119541 23180 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:22.146615 23248 consensus_meta.cc:287] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.892s	user 0.010s	sys 0.002s
I20260709 13:19:22.150079 23012 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:22.153291 23394 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:22.166360 19061 rpcz_store.cc:276] 0709 13:19:20.201287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.207613 (+  6326us) service_pool.cc:224] Handling call
0709 13:19:20.207958 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.208341 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.208370 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.208860 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.407872 (+199012us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:20.407910 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.407970 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.982996 (+1575026us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:22.148427 (+165431us) raft_consensus.cc:1685] finished
0709 13:19:22.148454 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.159333 (+ 10879us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":14576384,"thread_start_us":198613,"threads_started":1,"wal-append.queue_time_us":442652}
I20260709 13:19:22.187253 23342 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:22.190619 23318 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:22.191875 23519 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:22.192759 23408 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.194337 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37140 (request call id 38) took 1975 ms. Trace:
I20260709 13:19:22.242609 18411 rpcz_store.cc:276] 0709 13:19:20.219014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.219150 (+   136us) service_pool.cc:224] Handling call
0709 13:19:22.194146 (+1974996us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b5400040bd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eed6853 00007f40a3ea460a 00007f409d42a7d4 00007f409d42a762 00007f409d42a691 00007f409d42a60c 00007f409d4298c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:22.194256 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428608896}
I20260709 13:19:22.194638 23476 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:22.196025 22999 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:22.154675 23457 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:22.193681 18343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2548) took 1279 ms. Trace:
I20260709 13:19:22.159830 23498 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:22.236846 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:22.237128 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.146090 23488 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:22.240203 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.162367 23504 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:22.231359 23060 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:22.251127 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.247601 18343 rpcz_store.cc:276] 0709 13:19:20.914021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.915400 (+  1379us) service_pool.cc:224] Handling call
0709 13:19:20.915837 (+   437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:21.164576 (+248739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.230857 (+ 66281us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:21.231597 (+   740us) log.cc:844] Serialized 52 byte log entry
0709 13:19:21.342965 (+111368us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:21.343004 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.193258 (+850254us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54002675d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:22.193308 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.193352 (+    44us) raft_consensus.cc:1685] finished
0709 13:19:22.193365 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.193614 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75260,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":67,"spinlock_wait_cycles":546234624,"thread_start_us":110931,"threads_started":1,"wal-append.queue_time_us":324478}
W20260709 13:19:22.261448 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 209031us
I20260709 13:19:22.253278 18341 raft_consensus.cc:2393] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:22.260231 18336 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
W20260709 13:19:22.231809 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 339578us
I20260709 13:19:22.263510 18457 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.263993 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.264936 18339 raft_consensus.cc:2393] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 7: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:22.264951 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:22.196703 23012 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:22.270309 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.271981 18457 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.274292 18457 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.173619 23485 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:22.241871 23480 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:22.280184 18335 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:22.254206 23498 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:22.264951 23060 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:22.276048 23368 consensus_meta.cc:287] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.598s	user 0.009s	sys 0.004s
I20260709 13:19:22.167580 23383 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.145690 23484 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.290530 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.275530 23379 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:22.289213 18458 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:22.297243 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:22.303170 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.264253 23504 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:22.304374 18457 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.306492 18336 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:22.291227 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.277757 23398 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:22.275643 23394 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:22.278467 23509 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:22.307832 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1130) took 2314 ms. Trace:
I20260709 13:19:22.315011 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:22.315349 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:22.300446 23494 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:22.242997 23532 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.330107 18343 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:22.330533 18490 rpcz_store.cc:276] 0709 13:19:19.993571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.264679 (+271108us) service_pool.cc:224] Handling call
0709 13:19:20.354177 (+ 89498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:20.406107 (+ 51930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.307652 (+1901545us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b5400137750. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:22.307777 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205057920}
I20260709 13:19:22.318089 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:22.337348 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.338094 18416 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:22.338325 18489 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:22.338918 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.339964 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.340528 18412 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:22.340639 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.345091 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.345386 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.346731 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:22.347849 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:22.307802 23368 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.351051 23383 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.329172 23535 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:22.351794 23535 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:22.352155 23535 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:22.338485 23379 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:22.353197 23379 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:22.353564 23379 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:22.355772 23408 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:19:22.351085 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:22.358152 23544 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:22.359879 23368 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:22.360423 23532 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:22.286815 23318 consensus_queue.cc:1059] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:19:22.292061 23060 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:22.203948 23248 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:22.306321 23495 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.276382 23012 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:22.299352 23429 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:22.369762 18336 raft_consensus.cc:1240] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:22.370507 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:22.380709 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.381884 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:22.385866 18340 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:22.382388 23535 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.387874 23535 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.307852 23550 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:22.389839 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:22.392287 23477 consensus_meta.cc:287] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.655s	user 0.005s	sys 0.004s
I20260709 13:19:22.336611 23494 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.329257 23394 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:22.431994 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.440169 18384 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:22.395673 18340 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:22.397167 23484 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.393043 23494 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.402534 23180 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.403895 23453 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:22.404953 23488 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:22.411084 23487 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:22.413774 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2359) took 1749 ms. Trace:
I20260709 13:19:22.415357 22946 raft_consensus.cc:3055] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:22.415257 23060 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.418207 23489 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.420179 19027 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:22.470270 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 50183us
I20260709 13:19:22.471195 19027 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:22.422029 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.424208 23379 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:22.383162 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 65139us
I20260709 13:19:22.425508 18410 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:22.367384 23404 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 1.549s	user 0.010s	sys 0.003s
I20260709 13:19:22.385654 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:22.425439 18414 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2375) took 1544 ms (client timeout 1730 ms). Trace:
I20260709 13:19:22.444793 22792 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:22.451103 23520 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.540s	user 0.003s	sys 0.000s
I20260709 13:19:22.447022 23453 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:22.446688 23383 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:22.392705 23477 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.458040 18491 rpcz_store.cc:276] 0709 13:19:20.664460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.709651 (+ 45191us) service_pool.cc:224] Handling call
0709 13:19:20.716385 (+  6734us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:20.884250 (+167865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.884293 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:20.886105 (+  1812us) log.cc:844] Serialized 52 byte log entry
0709 13:19:21.235153 (+349048us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:21.235248 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.413333 (+1178085us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400122d54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:22.413389 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.413441 (+    52us) raft_consensus.cc:1685] finished
0709 13:19:22.413459 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.413707 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7930,"raft.queue_time_us":8799,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":13652,"spinlock_wait_cycles":253048576,"thread_start_us":390419,"threads_started":2,"wal-append.queue_time_us":461476}
I20260709 13:19:22.443238 23394 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:22.394181 23495 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.301071 23378 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.509727 19027 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:22.457224 23493 raft_consensus.cc:3055] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:22.476089 18343 raft_consensus.cc:2410] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 15 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:19:22.459817 23480 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:22.518726 18414 rpcz_store.cc:269] 0709 13:19:20.881058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.881181 (+   123us) service_pool.cc:224] Handling call
0709 13:19:22.425193 (+1544012us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54000a82d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:22.425374 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883517312}
I20260709 13:19:22.523339 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.461479 22946 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:22.526741 23488 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.518333 23518 consensus_queue.cc:1059] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:19:22.527877 23060 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.529376 23494 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.529603 23379 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:22.549816 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.442932 23509 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.533282 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:22.517736 23404 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:22.555997 18486 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:22.557350 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.524768 23535 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
W20260709 13:19:22.558415 23555 log.cc:927] Time spent T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:19:22.539171 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.561018 19057 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:22.520182 23318 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:22.542435 19058 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:22.544180 23342 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:22.548420 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.545352 23240 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.537716 23383 raft_consensus.cc:697] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:22.555218 23537 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.531519 23453 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:22.540436 23493 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:22.567224 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.515797 23346 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:22.563164 23404 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.581902 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:22.573694 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.584946 18490 raft_consensus.cc:1240] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:22.575673 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:22.547704 23488 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.570497 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.595243 18493 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:22.565474 23318 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.552297 23180 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:22.598945 18340 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:22.577517 23509 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.545563 23480 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.581640 23346 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.591344 23477 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:22.571065 23060 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.597994 23542 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:22.572235 23342 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:22.597743 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:22.622566 19060 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:22.596546 22946 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.604521 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.607102 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.606444 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:22.602773 23552 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:22.624444 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:22.625015 18340 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:22.627059 23378 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.600343 23318 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:22.640846 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.597023 23535 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:22.624837 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.599253 23557 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:22.594834 23404 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.635093 19060 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:22.574388 23240 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.646967 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:22.647316 18417 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:22.605999 23346 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:22.598483 23493 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.582080 23537 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.643018 23557 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:22.664064 18340 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:22.666756 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.652680 23548 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:19:22.667660 18384 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:22.671497 22792 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:22.672022 22792 raft_consensus.cc:697] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:22.672140 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:22.672973 22792 consensus_queue.cc:237] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:22.673538 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:22.674186 18417 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:22.676388 18340 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 16: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:22.640535 23542 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.655866 22946 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:22.685319 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:22.685869 18414 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:22.686487 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:22.708925 23060 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:22.718688 23480 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.719652 23251 raft_consensus.cc:3055] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:22.720005 23488 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.722621 23352 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:22.722927 23542 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.723632 23404 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.684553 23495 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:22.645242 23383 consensus_queue.cc:237] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:22.728356 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.728431 18414 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:22.729436 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.686111 23548 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.688735 23509 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:22.649700 23535 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.655198 23342 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.712638 23493 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:22.714311 23472 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:22.713815 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.720057 23251 raft_consensus.cc:740] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:22.764362 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:22.765249 23251 consensus_queue.cc:260] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.766448 23251 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.766505 23495 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.767050 23495 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.729765 22894 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:22.768208 22894 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.731086 23498 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.735739 23240 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.736902 23504 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.711099 23557 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:22.740303 18335 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 13:19:22.741084 23012 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.774803 18335 pending_rounds.cc:85] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 12
I20260709 13:19:22.742306 19062 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:22.775075 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.709401 23537 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:22.745970 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 127614us
I20260709 13:19:22.778291 18457 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.750653 18340 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:22.754022 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.780663 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.755216 18491 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:19:22.754312 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:22.774736 18412 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:22.775271 18335 pending_rounds.cc:107] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 12.13
I20260709 13:19:22.775717 18413 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:22.781821 18335 raft_consensus.cc:2889] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:22.746779 18417 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:19:22.773975 23455 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:22.784337 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.786602 18484 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:22.785578 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.787874 18491 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:22.791254 23012 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.791538 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.779852 18485 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:22.683514 23453 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.794485 18457 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:22.796703 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.800964 18493 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 14: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:22.801748 23542 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:22.801906 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:22.802356 23542 raft_consensus.cc:697] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:22.803308 23542 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.803848 19055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b972754511104f898e9cbc171aa6c170"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:19:22.804446 19055 raft_consensus.cc:606] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.804771 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 1013) took 1918 ms. Trace:
I20260709 13:19:22.804809 19055 raft_consensus.cc:614] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:22.798445 18308 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:22.806143 23344 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:22.805478 23251 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:22.807103 23465 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 2.158s	user 0.000s	sys 0.013s
I20260709 13:19:22.807447 18457 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:22.808440 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1413) took 2577 ms. Trace:
I20260709 13:19:22.808773 19053 rpcz_store.cc:276] 0709 13:19:20.231375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.231816 (+   441us) service_pool.cc:224] Handling call
0709 13:19:20.232133 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.246081 (+ 13948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.246129 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.246692 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.481359 (+234667us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:20.481401 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.481463 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.806580 (+2325117us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:22.808152 (+  1572us) raft_consensus.cc:1685] finished
0709 13:19:22.808177 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.808364 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7659,"raft.queue_time_us":7845,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7694,"spinlock_wait_cycles":18489088,"thread_start_us":189022,"threads_started":1,"wal-append.queue_time_us":389006}
I20260709 13:19:22.810487 23379 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:22.810985 23379 raft_consensus.cc:697] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:22.811821 23379 consensus_queue.cc:237] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.812574 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.813361 18493 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:22.814587 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 1015) took 1927 ms. Trace:
I20260709 13:19:22.814798 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.815377 18485 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:22.814983 18415 rpcz_store.cc:276] 0709 13:19:20.887005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.107411 (+220406us) service_pool.cc:224] Handling call
0709 13:19:21.107780 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.439340 (+331560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.814385 (+1375045us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54002a5b54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:22.814536 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712898304}
I20260709 13:19:22.816696 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.817628 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.807058 23480 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:22.818568 23480 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.818658 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.819065 23480 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:22.819324 18415 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:22.820106 23506 raft_consensus.cc:3055] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:22.820513 23506 raft_consensus.cc:740] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:22.820911 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.822348 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.822692 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:22.823474 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:22.824189 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.825268 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:22.825748 23163 raft_consensus.cc:3055] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:22.826237 23163 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:22.826728 18493 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:22.820133 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:22.827075 23163 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.828624 18415 raft_consensus.cc:2410] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:22.829223 23535 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.829373 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.829558 23148 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:22.830423 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.831189 18415 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:22.831902 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.832433 18415 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:22.833163 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:22.751693 23509 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.798213 23472 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.840471 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:22.840641 23509 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.840998 23472 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:22.841236 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:22.841524 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:22.842240 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:22.842836 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.843638 18415 raft_consensus.cc:2368] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10.
I20260709 13:19:22.844399 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.805184 18410 rpcz_store.cc:276] 0709 13:19:20.886231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.031393 (+145162us) service_pool.cc:224] Handling call
0709 13:19:22.425338 (+1393945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.521680 (+ 96342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.804593 (+282913us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000a82d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:22.804718 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3204866944}
I20260709 13:19:22.847653 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.848757 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.848963 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.843076 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:22.851454 19060 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:22.853049 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.853394 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:22.854300 18491 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:22.844324 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:22.845541 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.759392 23404 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.856253 18413 raft_consensus.cc:2393] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:22.857028 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:22.862576 19054 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:22.846937 18415 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:22.872699 19025 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.779791 23490 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.793751 23557 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:22.880970 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:22.883072 18410 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:22.881704 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:22.843040 23485 consensus_meta.cc:287] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.001s
I20260709 13:19:22.884474 19025 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.879405 18309 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:22.888350 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:22.890283 19058 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:22.831202 23148 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:22.902819 19059 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:22.751552 23548 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.907743 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2433) took 1046 ms. Trace:
I20260709 13:19:22.912590 18416 rpcz_store.cc:276] 0709 13:19:21.861191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.862162 (+   971us) service_pool.cc:224] Handling call
0709 13:19:21.862460 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.341595 (+479135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.907509 (+565914us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54003629d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:22.907683 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1078619008}
I20260709 13:19:22.907768 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:22.913426 19026 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.913861 18493 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 8.
I20260709 13:19:22.786288 23318 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.793473 23477 consensus_queue.cc:1059] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 13:19:22.916137 18309 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:22.924553 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:22.950016 18484 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:22.925765 18416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:22.950946 18416 raft_consensus.cc:606] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.908147 23251 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:22.934034 18382 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:22.883298 23346 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.899824 23490 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:22.937078 23548 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.937968 23248 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:22.922150 23487 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:22.891003 23332 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:22.903499 23472 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:22.899799 23432 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.939957 23394 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:22.903311 23352 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:22.910467 23531 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:19:23.013571 23531 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:23.013959 23531 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:23.014322 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2551) took 2090 ms. Trace:
I20260709 13:19:23.014854 23531 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.016194 23531 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:22.841607 23398 consensus_queue.cc:1059] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
W20260709 13:19:23.018879 23459 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 2.364s	user 0.005s	sys 0.012s
I20260709 13:19:22.845008 23012 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:19:23.020603 22894 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.951815 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:23.022284 18493 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:23.023296 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:23.024338 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:23.025163 23418 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:22.918596 23309 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:23.026224 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:23.026670 23498 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:22.875501 23404 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.028848 23404 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:23.030030 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:23.031313 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:23.031949 18486 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:23.033162 18486 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:23.014885 18344 rpcz_store.cc:276] 0709 13:19:20.924890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.925112 (+   222us) service_pool.cc:224] Handling call
0709 13:19:20.925407 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.017924 (+ 92517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.017977 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.018033 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:21.018077 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.014091 (+1996014us) spinlock_profiling.cc:243] Waited 92.3 ms on lock 0x7b540007f154. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:23.014152 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.014266 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212296576}
W20260709 13:19:23.037322 18418 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2374) took 2156 ms (client timeout 2172 ms). Trace:
W20260709 13:19:23.037767 18418 rpcz_store.cc:269] 0709 13:19:20.880775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.881039 (+   264us) service_pool.cc:224] Handling call
0709 13:19:23.037120 (+2156081us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b54003ebcd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:23.037243 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4601849728}
I20260709 13:19:23.040491 18484 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:23.041484 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:23.005568 23413 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:23.042251 23413 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:23.043301 23413 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:23.044271 18337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 1095) took 2570 ms (client timeout 1706 ms). Trace:
I20260709 13:19:23.044564 23413 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:23.047027 23351 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:23.048940 18489 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:23.049818 18488 raft_consensus.cc:2393] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 9: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:22.967080 18491 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:22.984476 18382 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:23.050822 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 66425us
W20260709 13:19:23.051463 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.052038 18382 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:23.052579 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.053551 18382 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:22.910753 23485 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:22.995231 19056 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:23.055545 18484 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:23.003065 18416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:23.005335 23457 raft_consensus.cc:3055] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:22.985503 23380 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:22.995011 23332 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.006809 23225 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:23.007577 23490 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:23.009641 23533 raft_consensus.cc:3055] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:23.011148 23495 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:23.012606 23346 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:23.026762 18493 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:19:22.959017 23505 log.cc:927] Time spent T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.389s	user 0.000s	sys 0.003s
I20260709 13:19:23.054850 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:23.114818 18338 raft_consensus.cc:1240] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:23.115301 18491 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:23.115335 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:23.116475 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:23.117370 18491 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:19:23.117682 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:19:23.119165 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.055163 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:23.123162 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:23.055549 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:23.056111 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:23.124339 18492 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
W20260709 13:19:23.054550 18337 rpcz_store.cc:269] 0709 13:19:20.474123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.474279 (+   156us) service_pool.cc:224] Handling call
0709 13:19:23.044040 (+2569761us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b5400416ed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:23.044172 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4848171776}
I20260709 13:19:23.005975 23394 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:23.063634 18382 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:23.126021 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 62480.3us
I20260709 13:19:23.126498 18491 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:23.126734 18382 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:23.128255 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:22.992033 23431 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:23.128926 23431 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.129295 23431 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:23.129528 18491 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:23.062052 23349 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:23.069344 18486 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:23.056775 23509 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:23.050752 23352 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.073905 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:23.163606 18336 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:23.074092 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:23.075690 18417 raft_consensus.cc:1240] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:22.989698 22792 consensus_queue.cc:1059] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:19:22.962519 18490 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:23.174700 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:23.136188 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.136652 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:23.175374 18484 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:23.004263 23494 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.092s
W20260709 13:19:23.137372 19026 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.519s (SENT) [suppressed 13 similar messages]
I20260709 13:19:23.066044 23381 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:23.062508 23457 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:23.065145 23351 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:23.157816 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:23.183532 18341 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:23.179670 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.185487 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 270368us
I20260709 13:19:23.070566 23309 raft_consensus.cc:697] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:23.003232 23432 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.181824 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:23.066471 23404 consensus_queue.cc:1059] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
W20260709 13:19:23.208041 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 258521us
I20260709 13:19:23.082715 23533 raft_consensus.cc:740] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:23.161201 22894 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:23.214152 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:23.134166 23349 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:19:23.222078 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 45454.5us
I20260709 13:19:23.223385 19027 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:23.218480 18336 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:23.176646 23498 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:23.221414 18419 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:23.225858 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:23.232791 19055 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:23.226307 23495 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:23.228104 19054 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:23.160889 23380 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:23.205401 23351 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:23.178108 23352 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:23.253094 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:23.282835 19057 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:23.290725 23499 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:23.291404 23499 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:23.292958 23499 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.294804 23499 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:23.221325 22894 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.295667 22894 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:23.218210 23452 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:23.226943 23349 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:23.253849 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:23.177089 23012 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
W20260709 13:19:23.276162 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 138811us
W20260709 13:19:23.279795 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 75837.3us
I20260709 13:19:23.294899 23317 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.178941 23509 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.252483 23351 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:23.299714 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.241031 23498 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.378301 19025 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:19:23.306452 23574 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:23.282377 23318 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:23.311121 23309 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.263397 23387 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:19:23.297773 23453 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:23.377808 18341 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
I20260709 13:19:23.379390 19060 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:23.379688 19025 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:23.279445 23092 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:23.383636 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:23.373409 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:23.424211 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:23.425443 18484 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:19:23.383008 23498 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:23.388429 23575 log.cc:927] Time spent T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.112s	user 0.001s	sys 0.001s
W20260709 13:19:23.430438 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 57113.3us
I20260709 13:19:23.439352 19026 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:23.433200 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 53569.6us
I20260709 13:19:23.435123 19055 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:23.246809 23533 consensus_queue.cc:260] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:23.414448 23455 consensus_meta.cc:287] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.001s
I20260709 13:19:23.394552 23495 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:23.441337 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:23.274886 23457 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.453591 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:23.454774 19054 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:23.458283 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 235434us
I20260709 13:19:23.459342 18342 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:23.461023 19026 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:23.463548 19026 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:23.460078 23271 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.415867 23490 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:23.471393 23271 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:23.472043 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:23.472709 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:23.423077 23225 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:23.474493 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:23.432420 23318 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:23.480044 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:23.478405 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 296681us
I20260709 13:19:23.492547 19059 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:23.452942 23472 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:23.458431 23495 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.468786 23487 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:23.500809 18307 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:23.502278 18309 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:23.453091 23517 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:23.515501 23517 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.467976 22946 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:23.512135 18486 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:23.514110 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:23.482722 23533 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:23.491637 23457 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:23.488025 23485 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:23.503093 23472 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.511252 23495 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:23.528759 23568 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:19:23.550381 23472 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:23.520133 23487 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.489776 23490 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.500415 23573 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:19:23.495764 23225 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.549423 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:23.551352 23332 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:23.572430 23413 consensus_meta.cc:287] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.000s
I20260709 13:19:23.566341 23487 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:23.591204 18488 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:23.592660 18416 raft_consensus.cc:606] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:23.594512 18416 raft_consensus.cc:614] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:23.616050 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.618621 18493 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:23.627133 19054 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:23.545131 23517 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.647955 19059 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
W20260709 13:19:23.649225 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.649320 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:23.650938 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:23.651922 19054 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 13: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:23.637717 19060 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:23.664712 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:23.665685 19060 raft_consensus.cc:2368] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10.
I20260709 13:19:23.588572 22946 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:23.685130 23581 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:19:23.689491 23394 raft_consensus.cc:3055] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:23.690006 23394 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:23.690877 23394 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:23.693349 23494 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:23.693768 23494 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.694133 23494 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:23.695326 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2556) took 1108 ms. Trace:
I20260709 13:19:23.695677 18338 rpcz_store.cc:276] 0709 13:19:22.586494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.586606 (+   112us) service_pool.cc:224] Handling call
0709 13:19:22.586860 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.115306 (+528446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.695101 (+579795us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54000e0bd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:23.695272 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141256448}
W20260709 13:19:23.632272 23148 consensus_meta.cc:287] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.722s	user 0.007s	sys 0.004s
I20260709 13:19:23.581822 23485 consensus_queue.cc:1059] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 13:19:23.646567 23578 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
W20260709 13:19:23.647003 23531 consensus_meta.cc:287] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.007s
W20260709 13:19:23.646770 23431 consensus_meta.cc:287] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.007s
I20260709 13:19:23.671648 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:23.617676 23473 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:23.628070 23477 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:23.700886 19054 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:23.721515 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:23.749439 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.715046 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:23.758553 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.802052 18335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.011s	sys 0.013s
W20260709 13:19:23.804632 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.760061 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 300232us
W20260709 13:19:23.702136 23571 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 13:19:23.726833 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:23.813155 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 299102us
I20260709 13:19:23.814124 18493 raft_consensus.cc:2393] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:19:23.804793 18335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.011s	sys 0.014s
I20260709 13:19:23.683516 23585 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:23.721189 23473 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.743237 23148 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:23.756587 23509 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:23.702865 23332 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:23.755654 23318 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:23.733970 23515 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:23.733449 23408 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:23.825258 18419 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:19:23.842348 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.824980 23514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.020s	sys 0.040s
I20260709 13:19:23.801043 23485 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:23.830295 19054 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:23.822082 23585 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.701736 22946 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.824239 23473 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:23.846228 19059 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:23.808488 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 306277us
I20260709 13:19:23.721568 23431 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.829381 23332 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.856514 23485 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.856570 23515 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.852897 23514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.021s	sys 0.040s
I20260709 13:19:23.899421 19054 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:19:23.898154 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.899837 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1427) took 1064 ms. Trace:
I20260709 13:19:23.833201 23148 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.838703 23318 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:23.855585 23585 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:23.992393 19053 rpcz_store.cc:276] 0709 13:19:22.835051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.846416 (+ 11365us) service_pool.cc:224] Handling call
0709 13:19:22.871035 (+ 24619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:22.883992 (+ 12957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.884038 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:22.884622 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:19:23.072807 (+188185us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:23.072842 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.072902 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.899631 (+826729us) raft_consensus.cc:1685] finished
0709 13:19:23.899651 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.899781 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12531,"raft.queue_time_us":20871,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":7401,"thread_start_us":187868,"threads_started":1,"wal-append.queue_time_us":425278}
W20260709 13:19:23.996011 19055 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.021s	sys 0.011s
I20260709 13:19:24.000314 19058 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:23.950448 23332 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:24.007956 19055 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.022s	sys 0.011s
I20260709 13:19:23.850234 23408 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:24.024180 18308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.011s	sys 0.037s
W20260709 13:19:24.024609 18308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.011s	sys 0.037s
W20260709 13:19:24.025738 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 655201us
I20260709 13:19:23.961839 23093 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:23.978776 23590 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:24.001667 23490 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:24.044306 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:24.040293 23499 consensus_meta.cc:287] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.745s	user 0.014s	sys 0.000s
I20260709 13:19:24.053483 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.054960 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.055959 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:24.056082 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.056757 18344 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.056838 18338 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:24.058772 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:24.039772 23480 consensus_meta.cc:287] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.220s	user 0.013s	sys 0.000s
I20260709 13:19:24.058872 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:24.065652 18335 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 17: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:24.063637 18343 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:24.070482 19053 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:24.103536 19053 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:24.038856 23590 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.105841 18344 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:24.106227 23590 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:24.106796 23566 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.099s	user 0.003s	sys 0.002s
W20260709 13:19:24.112367 23580 log.cc:927] Time spent T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.589s	user 0.000s	sys 0.010s
I20260709 13:19:24.114393 23432 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:24.118221 23582 log.cc:927] Time spent T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.565s	user 0.004s	sys 0.007s
I20260709 13:19:24.119987 23148 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.122268 22946 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.123884 23318 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:24.126729 23468 raft_consensus.cc:3055] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:24.127302 23468 raft_consensus.cc:740] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:24.128633 23468 consensus_queue.cc:260] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.131799 23468 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:24.132871 23257 consensus_queue.cc:1059] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:24.003794 23515 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:24.133904 23352 consensus_meta.cc:287] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.749s	user 0.004s	sys 0.003s
I20260709 13:19:24.135883 23408 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:24.143373 23352 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:24.136853 22894 consensus_meta.cc:287] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.841s	user 0.006s	sys 0.005s
I20260709 13:19:24.146451 22894 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.149607 23517 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.049764 23225 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.136972 23600 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:24.166180 23600 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.166473 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.167626 18419 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:24.168670 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:24.168836 23600 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.138025 23356 raft_consensus.cc:3055] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:24.169648 23356 raft_consensus.cc:740] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:24.170104 23485 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.170288 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.059302 23514 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.170650 23356 consensus_queue.cc:260] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.171226 23514 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.172279 23356 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.172390 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:24.173053 18418 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:24.173417 23514 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.174652 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.175801 18410 raft_consensus.cc:2393] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:24.176957 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:24.179198 18492 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:19:24.180886 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.181816 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.182554 19059 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:19:24.156284 23549 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:19:24.156503 23457 consensus_meta.cc:287] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.000s
I20260709 13:19:24.155974 23506 consensus_queue.cc:260] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:24.142483 23351 consensus_meta.cc:287] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.750s	user 0.004s	sys 0.005s
W20260709 13:19:24.157536 23592 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:19:24.158859 23431 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.159262 23480 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.161495 18411 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:24.164727 22894 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:24.139371 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.192457 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:24.192625 23418 consensus_meta.cc:287] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 1.167s	user 0.012s	sys 0.003s
W20260709 13:19:24.141160 23498 consensus_meta.cc:287] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.686s	user 0.007s	sys 0.000s
I20260709 13:19:24.211905 18309 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:24.060009 23489 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:24.196326 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:24.197489 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 385503us
I20260709 13:19:24.218528 18487 raft_consensus.cc:1275] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:24.198168 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.198829 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:24.182231 23501 raft_consensus.cc:993] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:19:24.038273 23093 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:24.179822 23317 consensus_meta.cc:287] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.802s	user 0.011s	sys 0.000s
I20260709 13:19:24.201946 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.203048 18417 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:19:24.184475 23533 consensus_meta.cc:287] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.659s	user 0.004s	sys 0.006s
W20260709 13:19:24.210088 23494 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.005s
I20260709 13:19:24.204227 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.205089 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.227182 18344 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:24.141216 23515 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:24.026408 23531 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:24.207480 18382 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:24.208807 18343 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:24.220305 18412 raft_consensus.cc:2410] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:19:24.214385 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.231515 18344 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:24.217564 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:24.227697 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.211834 23506 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.232995 18493 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
W20260709 13:19:24.233803 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.234738 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.235433 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.237289 19061 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 8.
W20260709 13:19:24.221642 23349 consensus_meta.cc:287] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.833s	user 0.006s	sys 0.005s
I20260709 13:19:24.211099 23408 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:24.211318 23512 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:24.254174 19027 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:24.255414 19027 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:24.245597 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.256909 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.248332 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.194965 23429 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:19:24.261201 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:24.251792 18415 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:24.219095 23511 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.196043 23549 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.203585 23351 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.201902 23594 consensus_queue.cc:1059] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:19:24.223676 23418 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.259930 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:24.248764 23499 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:24.229324 23600 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:24.265497 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:24.228744 22894 raft_consensus.cc:1081] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:19:24.272660 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.274260 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.271373 19027 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:24.208361 23485 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:19:24.271602 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.247488 23413 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:24.277829 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:24.278793 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.257602 18410 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:24.281618 18384 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:24.221297 23498 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.258839 23530 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.336067 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.336822 19058 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 17: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:24.224619 23489 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.262837 23517 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:24.336293 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:24.252703 23586 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:24.337697 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.346328 19058 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:24.340534 18336 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:24.341850 18492 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:24.343719 18417 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:24.315138 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 43838.4us
W20260709 13:19:24.356513 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 74949.1us
I20260709 13:19:24.237192 23494 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.270426 23515 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:24.348973 19027 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:24.278218 23495 consensus_meta.cc:287] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.712s	user 0.007s	sys 0.004s
I20260709 13:19:24.252836 23381 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
I20260709 13:19:24.252959 23500 consensus_queue.cc:1059] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:19:24.259181 23257 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:19:24.249549 23531 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.271332 23352 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.375087 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.260069 23349 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.394035 22792 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:24.266546 23512 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.278124 23468 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 13:19:24.339831 23600 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.393298 18491 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:24.397347 18418 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:24.398272 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.432987 19058 raft_consensus.cc:2410] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:19:24.346096 23499 raft_consensus.cc:697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:24.274477 23511 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.360525 23431 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:24.312587 23418 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.370137 23533 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:24.419958 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.385032 23317 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:24.354133 23358 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:24.399468 23590 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.483364 23590 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.266633 23408 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.485517 23590 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.485710 23408 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.392069 23515 raft_consensus.cc:697] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:24.486198 23576 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 1.107s	user 0.005s	sys 0.001s
I20260709 13:19:24.487380 23317 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.487015 23515 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.487844 23317 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:24.488946 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2360) took 3824 ms. Trace:
I20260709 13:19:24.489288 18487 rpcz_store.cc:276] 0709 13:19:20.664677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.711643 (+ 46966us) service_pool.cc:224] Handling call
0709 13:19:22.186890 (+1475247us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b5800143198. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:19:22.187084 (+   194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.218957 (+2031873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.488700 (+269743us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b5400240254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:24.488866 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4682118400}
W20260709 13:19:24.490952 23577 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 1.012s	user 0.006s	sys 0.004s
W20260709 13:19:24.436318 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 78226us
I20260709 13:19:24.436499 18413 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:24.491652 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2756) took 1630 ms. Trace:
I20260709 13:19:24.369760 23413 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.434329 23513 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:24.445463 23586 raft_consensus.cc:697] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:24.447335 18492 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:24.434545 23600 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.403491 23548 consensus_queue.cc:1059] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:19:24.449651 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:24.498378 18410 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:24.450580 23608 log.cc:927] Time spent T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:19:24.450457 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:24.503377 18491 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:19:24.451488 23093 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.388098 23606 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:19:24.459811 23611 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.462314 23480 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.463924 23489 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:24.466429 23609 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:19:24.468303 23487 consensus_meta.cc:287] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.822s	user 0.015s	sys 0.004s
I20260709 13:19:24.468632 23349 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:24.573011 23473 consensus_meta.cc:287] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.668s	user 0.018s	sys 0.004s
I20260709 13:19:24.573490 23473 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.575186 23413 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.576834 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1205) took 1124 ms. Trace:
I20260709 13:19:24.469399 23549 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.469457 23499 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.549796 23611 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.584295 23611 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:24.584692 23549 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.584846 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1438) took 1116 ms. Trace:
I20260709 13:19:24.585201 23549 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.587342 23549 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.473863 23418 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:24.434700 22792 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:24.585311 19056 rpcz_store.cc:276] 0709 13:19:23.468485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.014130 (+545645us) service_pool.cc:224] Handling call
0709 13:19:24.014475 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.029554 (+ 15079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.029699 (+   145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:24.029902 (+   203us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:24.030068 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.584617 (+554549us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b54005ff5d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:24.584666 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.584788 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30498688}
I20260709 13:19:24.589102 22792 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:24.549220 23472 consensus_meta.cc:287] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.976s	user 0.020s	sys 0.000s
I20260709 13:19:24.590505 23472 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.478725 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.490445 23533 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.354717 23530 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.445041 18417 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:24.494298 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.596544 18415 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:24.597559 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:24.492031 18485 rpcz_store.cc:276] 0709 13:19:22.861024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.861145 (+   121us) service_pool.cc:224] Handling call
0709 13:19:22.861462 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:22.861833 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:22.861877 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:22.880928 (+ 19051us) log.cc:844] Serialized 52 byte log entry
0709 13:19:23.057938 (+177010us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:23.057974 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.058040 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.485491 (+1427451us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:24.491405 (+  5914us) raft_consensus.cc:1685] finished
0709 13:19:24.491424 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.491601 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5210,"raft.queue_time_us":89,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":10064,"spinlock_wait_cycles":5996800,"thread_start_us":110712,"threads_started":1,"wal-append.queue_time_us":344774}
I20260709 13:19:24.504560 18492 raft_consensus.cc:1275] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:19:24.506093 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 141613us
W20260709 13:19:24.600494 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.495301 23513 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:24.498329 23358 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:24.536216 23585 consensus_meta.cc:287] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.002s
I20260709 13:19:24.413193 23495 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:24.539671 18457 leader_election.cc:336] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Timed out: RequestConsensusVote RPC to 127.16.211.2:42251 timed out after 1.730s (SENT)
I20260709 13:19:24.608479 18457 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:24.491303 23431 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.535422 18410 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:24.432488 23332 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.546389 23408 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:24.558043 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:24.565197 23586 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.567013 23531 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:24.471014 23512 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.577253 19062 rpcz_store.cc:276] 0709 13:19:23.454773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.454892 (+   119us) service_pool.cc:224] Handling call
0709 13:19:23.465809 (+ 10917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.595584 (+129775us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:24.001573 (+405989us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.185356 (+183783us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:24.185424 (+    68us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:24.185472 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.576585 (+391113us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400487954. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:24.576639 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.576774 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":506732,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":2714,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":6770,"spinlock_wait_cycles":297694464,"thread_start_us":538548,"threads_started":2,"wal-append.queue_time_us":276869}
I20260709 13:19:24.592298 18418 raft_consensus.cc:2393] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:24.592306 19060 raft_consensus.cc:2393] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 12: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:24.594712 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.632333 18343 raft_consensus.cc:2368] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 17.
I20260709 13:19:24.600925 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:24.609436 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 69819.5us
I20260709 13:19:24.542680 18491 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:24.575780 23473 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.621631 23468 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.625984 18419 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:24.608353 23493 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.611199 23477 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.619305 23418 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:24.647568 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 104662us
I20260709 13:19:24.594682 23487 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:24.650373 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.612027 23585 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.640398 23432 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:24.645169 23468 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.641716 23498 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.641160 23163 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.631855 23408 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.648717 23494 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.662604 19057 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 14: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:24.667198 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.669708 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:24.674625 18341 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:19:24.676285 18344 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:24.676611 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:24.677879 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.679821 18341 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:19:24.680179 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.680822 19056 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:24.671638 18457 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:24.683005 18457 leader_election.cc:400] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10.
I20260709 13:19:24.683362 18457 leader_election.cc:403] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:24.683152 18341 raft_consensus.cc:1275] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:24.684554 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:24.684985 23468 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.687336 23271 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.689076 23418 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:24.685108 18337 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:24.689517 23418 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.690004 23418 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:24.659173 23432 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.693131 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.697829 19056 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:24.648350 23493 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.725384 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:24.650523 23477 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.728644 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.732532 19062 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:24.734839 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.739959 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.729943 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:24.664429 23504 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.638368 23513 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.658401 23358 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.700726 23432 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:24.741380 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.696280 23600 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.742157 18340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37920
I20260709 13:19:24.801493 18340 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:24.801950 18340 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.748188 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:24.732141 23611 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10.
I20260709 13:19:24.756160 23530 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:24.806731 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 58617.7us
I20260709 13:19:24.808766 19026 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:24.762051 23542 consensus_queue.cc:1059] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:19:24.766153 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.693313 23512 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 13:19:24.769073 23487 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.769568 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.770818 23493 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.775319 23517 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:24.777034 18489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 1152) took 1954 ms (client timeout 1651 ms). Trace:
W20260709 13:19:24.822077 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 122597us
W20260709 13:19:24.822367 18489 rpcz_store.cc:269] 0709 13:19:22.822319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.845231 (+ 22912us) service_pool.cc:224] Handling call
0709 13:19:24.776838 (+1931607us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400259754. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:24.776950 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443064064}
I20260709 13:19:24.777415 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.779291 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2453) took 1590 ms. Trace:
I20260709 13:19:24.824538 18411 rpcz_store.cc:276] 0709 13:19:23.188804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.188928 (+   124us) service_pool.cc:224] Handling call
0709 13:19:23.214882 (+ 25954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.208929 (+994047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.779085 (+570156us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54001c5cd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:24.779236 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176593280}
I20260709 13:19:24.777025 18338 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:24.826193 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.826882 18338 raft_consensus.cc:2393] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:24.781620 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2559) took 2177 ms. Trace:
I20260709 13:19:24.783506 23500 raft_consensus.cc:3055] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:24.785144 18335 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:24.787926 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.790539 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:24.692981 23498 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:24.830191 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:24.830850 18335 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:24.795912 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.801811 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.742870 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.757325 23317 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.818765 19026 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:24.816387 19053 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:24.799436 23515 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:24.857163 19055 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:24.857421 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.846129 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.858741 18339 raft_consensus.cc:1240] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:24.860342 19058 raft_consensus.cc:2393] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:24.861079 19062 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:24.827178 18342 rpcz_store.cc:276] 0709 13:19:22.604116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.604256 (+   140us) service_pool.cc:224] Handling call
0709 13:19:24.781455 (+2177199us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b540003cad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:24.781561 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1922051968}
I20260709 13:19:24.809691 23529 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:24.864282 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 45988.2us
I20260709 13:19:24.814282 23251 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:24.854090 23499 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:24.866659 19061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 1196) took 2540 ms (client timeout 1677 ms). Trace:
W20260709 13:19:24.884261 19061 rpcz_store.cc:269] 0709 13:19:22.314537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.314663 (+   126us) service_pool.cc:224] Handling call
0709 13:19:24.854801 (+2540138us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b540059ea54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:24.854905 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4387090688}
I20260709 13:19:24.884675 18490 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:24.845395 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:24.871155 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.871634 18309 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:24.872633 23517 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.820668 23530 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:24.875285 23501 consensus_queue.cc:1059] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:24.830526 23611 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:24.879132 23012 consensus_queue.cc:1059] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:24.879727 23413 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:24.880329 23356 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:24.880944 23504 consensus_queue.cc:1059] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:24.882110 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.830214 23533 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:24.885618 18338 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:24.869516 18340 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.822996 23513 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:24.888288 23493 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.925272 23493 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.888464 23499 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:24.801553 23587 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:19:24.927199 23499 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.831627 23500 raft_consensus.cc:740] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:24.901573 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.929579 19054 raft_consensus.cc:2393] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 13: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:24.888973 23589 consensus_queue.cc:1059] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:19:24.903008 18309 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:24.878600 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:24.932238 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2771) took 1678 ms. Trace:
I20260709 13:19:24.932622 18486 rpcz_store.cc:276] 0709 13:19:23.253984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.254267 (+   283us) service_pool.cc:224] Handling call
0709 13:19:23.511891 (+257624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.516362 (+  4471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.932065 (+1415703us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54002927d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:24.932184 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591823104}
I20260709 13:19:24.915516 23530 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.934095 23579 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:24.934343 23530 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.934731 23499 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.849345 23472 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.888419 23251 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.888839 23573 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:24.937005 23499 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.922230 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:24.937804 19062 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:24.938478 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37140 (request call id 40) took 1935 ms. Trace:
I20260709 13:19:24.938886 18416 rpcz_store.cc:276] 0709 13:19:23.002674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.002933 (+   259us) service_pool.cc:224] Handling call
0709 13:19:24.938283 (+1935350us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b54000a91d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eed6853 00007f40a3ea460a 00007f409d42a7d4 00007f409d42a762 00007f409d42a691 00007f409d42a60c 00007f409d4298c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:24.938413 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1228210944}
I20260709 13:19:24.916599 18342 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:24.937184 23251 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.923413 23533 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.940773 23533 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.941496 23585 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.942687 23533 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:24.943239 23533 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:24.943368 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:24.944128 19054 raft_consensus.cc:2368] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 13. Current term is 14.
I20260709 13:19:24.944461 18308 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:24.945262 23351 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.945942 23455 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:24.946051 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:24.946411 23408 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.946502 23455 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:24.947094 23408 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.947624 23408 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.947774 23455 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.913635 23611 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.950945 23431 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.952219 19062 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:24.952643 23611 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:24.953226 23472 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:24.953311 23499 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:19:24.953444 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 74946.7us
I20260709 13:19:24.953866 23472 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.954663 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:24.954885 23600 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.955754 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:24.956141 23477 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.956703 23509 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:24.956964 23501 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:24.957448 23501 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.958067 23509 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:24.955883 23472 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.889024 23529 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.958945 23495 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.959517 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:24.959818 23332 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:24.959553 23495 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:24.960733 23529 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.960625 23495 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.862828 23498 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:24.962939 23506 consensus_meta.cc:287] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.001s
I20260709 13:19:24.963161 23498 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.963478 23514 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.882889 23515 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.964171 23514 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:24.965222 18341 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:19:24.963466 18384 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:24.966394 23515 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:24.967530 23572 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.582s	user 0.007s	sys 0.000s
I20260709 13:19:24.970103 23356 raft_consensus.cc:2764] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:19:24.952369 23621 log.cc:927] Time spent T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:24.972229 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:24.945700 18308 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:24.952915 23589 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:24.994179 23589 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:24.995282 23589 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:24.996805 23589 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:24.998602 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:24.999523 23517 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:24.957798 23501 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:24.993361 18340 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:25.006639 23600 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:25.007244 23600 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.007711 23600 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:24.962889 23495 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:24.963181 23413 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:25.043700 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:25.044320 19054 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.949856 23408 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:25.047019 23394 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.045159 23251 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:25.036422 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 90776.4us
W20260709 13:19:25.079692 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.106709 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 48870.9us
I20260709 13:19:25.108951 19027 leader_election.cc:400] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 17.
I20260709 13:19:25.109315 19027 leader_election.cc:403] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:25.110055 18309 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:19:25.114113 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 289498us
I20260709 13:19:25.114405 18340 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:19:25.049826 23251 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:25.119223 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:25.119961 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.120604 18413 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:25.129117 18309 leader_election.cc:400] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 13. Current term is 14.
I20260709 13:19:25.129451 18309 leader_election.cc:403] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:25.123971 18417 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:25.126011 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:25.132699 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.135586 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.138394 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:25.139055 18340 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.141510 18416 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:25.144326 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.145139 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:25.145721 18415 raft_consensus.cc:3055] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:25.146020 18415 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:25.145182 18413 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:25.127208 19054 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:25.150399 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.151381 18419 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:25.151576 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:25.140718 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:25.218465 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:25.210736 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:25.209830 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:25.162097 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.223021 18486 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 7.
I20260709 13:19:25.183509 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.222031 18489 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
W20260709 13:19:25.115321 18458 connection.cc:256] RPC call timeout handler was delayed by -1.0702437630000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 13:19:25.163934 19025 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:25.171383 19054 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:25.173725 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.228999 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.154117 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.239696 18411 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:25.240790 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:25.241566 18492 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.242498 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:25.241418 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:25.243605 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:25.248456 18485 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:25.116039 23517 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 17.
I20260709 13:19:25.252453 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:25.253224 18491 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:25.254403 18488 raft_consensus.cc:2393] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 9: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:25.106251 23332 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.106484 23408 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:25.269168 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.259235 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.151072 23431 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:25.258293 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:25.265267 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.272977 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.296617 18490 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:25.297416 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.298511 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:25.298866 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:25.299448 18488 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:25.299535 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.300158 18417 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
W20260709 13:19:25.300540 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.300947 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:25.273855 18340 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:25.257845 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:25.302039 18487 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.262966 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:25.278389 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:25.307087 18491 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.153684 23573 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:25.148427 23472 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:25.295394 18419 raft_consensus.cc:2368] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 17.
I20260709 13:19:25.250010 18415 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:25.108296 23432 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:25.218369 23468 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:25.296641 18413 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
W20260709 13:19:25.309651 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.116243 23148 consensus_queue.cc:1059] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 13:19:25.251340 23351 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.326391 18457 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:25.316571 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:25.317231 18382 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:25.312100 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 76719.3us
I20260709 13:19:25.151225 23506 consensus_queue.cc:1059] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.173s
I20260709 13:19:25.235019 23586 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.313064 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:25.353327 18340 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:25.340387 19027 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:25.336293 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:25.354441 18488 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:25.354622 18490 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:25.319435 18492 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:25.334046 23356 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:19:25.343571 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:25.357123 18484 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:25.312914 23517 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:25.343894 23498 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:25.347179 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:25.363874 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:25.322781 18487 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:25.365530 18458 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:25.269707 23512 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:25.351835 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.344956 18457 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:25.355491 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:25.358139 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:25.335820 23383 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:19:25.367509 18484 raft_consensus.cc:2368] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14.
I20260709 13:19:25.367758 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:25.358489 18337 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:25.359241 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:25.368477 18492 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:25.368911 19053 raft_consensus.cc:2368] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14.
I20260709 13:19:25.359264 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:25.341773 23585 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.370824 18488 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:25.324736 19054 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:25.349651 23257 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:19:25.372033 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:25.350018 23495 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:25.317397 23408 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.403430 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:25.404549 19053 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
W20260709 13:19:25.405084 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 66650.2us
I20260709 13:19:25.407138 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:25.407902 23511 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:25.350672 23351 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.371879 23627 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.386212 19054 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.384744 23512 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.369117 23380 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:25.374321 23504 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:25.351758 23630 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:19:25.358633 23468 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:25.389421 23455 raft_consensus.cc:3055] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:25.392139 23383 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:25.383843 23594 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:25.477370 23594 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.480032 23594 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:25.369977 23579 consensus_queue.cc:1059] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:19:25.387111 23498 raft_consensus.cc:697] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:25.481299 23579 raft_consensus.cc:3055] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:25.461653 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 1211) took 2005 ms. Trace:
I20260709 13:19:25.481791 23579 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:25.482102 19060 rpcz_store.cc:276] 0709 13:19:23.456501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.666371 (+209870us) service_pool.cc:224] Handling call
0709 13:19:25.461378 (+1795007us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b54006c0a54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:25.461566 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1994439424}
I20260709 13:19:25.482874 23579 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.484095 19060 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:19:25.484490 23579 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:25.374070 23381 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:19:25.462728 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:25.486702 19053 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:25.486765 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:25.388274 23629 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:25.358165 23332 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.359932 23586 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.388723 23585 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:25.472779 23636 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:19:25.476668 23468 raft_consensus.cc:697] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:25.493321 23629 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.468009 23455 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:25.458719 23504 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:25.508445 23513 consensus_meta.cc:287] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.000s
I20260709 13:19:25.500299 23383 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:25.513429 23549 raft_consensus.cc:3055] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:25.481534 23498 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:25.460830 23627 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.514210 23629 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:25.526098 23586 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:25.519719 23504 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:25.508563 23332 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:25.544395 23468 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.549127 23163 raft_consensus.cc:3055] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:25.549407 23408 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:25.549564 23163 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:25.538053 23431 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:25.550453 23163 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.551462 23163 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:25.550930 23431 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:25.553201 23394 consensus_meta.cc:287] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.000s
W20260709 13:19:25.556639 23418 consensus_meta.cc:287] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.828s	user 0.005s	sys 0.003s
I20260709 13:19:25.556704 23493 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:25.557159 23418 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.558558 23351 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:25.548873 23383 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:25.526804 23549 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:25.559650 23317 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:25.576210 23549 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:25.577396 23549 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:25.540261 23455 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:25.581866 23627 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:25.583488 23600 consensus_meta.cc:287] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.001s
I20260709 13:19:25.595263 23625 raft_consensus.cc:3055] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:25.595763 23625 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:25.586521 23349 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:25.599409 23349 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:25.599810 23625 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.600204 23349 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.601097 23625 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:25.601186 23349 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:25.583889 23457 raft_consensus.cc:3055] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:25.602160 23457 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:25.602939 23457 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.603861 23457 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:25.584374 23530 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:25.589087 23501 consensus_meta.cc:287] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.000s
I20260709 13:19:25.543566 23432 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:25.606454 23501 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.584575 23455 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:25.608435 23501 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:25.585052 23633 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:19:25.589089 23514 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:25.585639 23512 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:25.586197 23500 consensus_queue.cc:260] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:25.610833 23500 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:25.599208 23418 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:25.595237 23600 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:25.614037 23600 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:25.587671 23380 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:25.614720 23380 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:25.609490 23589 consensus_meta.cc:287] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.000s
I20260709 13:19:25.586515 23585 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:25.650573 23573 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 13. Current term is 14.
I20260709 13:19:25.668915 23504 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.690905 23504 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:25.729815 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:25.732645 18338 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:25.734297 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:25.735772 18338 raft_consensus.cc:2393] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 9: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:25.737529 18338 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:25.380827 18340 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:25.739638 18416 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:25.385445 18382 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:25.742378 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.743221 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.743367 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.743719 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.744992 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 337783us
I20260709 13:19:25.745972 18412 raft_consensus.cc:1240] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:19:25.390213 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 1019) took 2555 ms. Trace:
I20260709 13:19:25.747579 18458 leader_election.cc:400] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 pre-election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10.
W20260709 13:19:25.752535 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 511024us
I20260709 13:19:25.333403 18491 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:25.487576 19058 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:25.475255 19054 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:19:25.768719 19054 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:25.487676 19060 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:25.759968 18493 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:25.765174 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:25.683432 23629 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:25.819325 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2580) took 1086 ms. Trace:
I20260709 13:19:25.826577 23394 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:25.826864 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2584) took 1024 ms. Trace:
I20260709 13:19:25.827706 23394 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:25.828974 23394 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:25.829471 23394 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.820099 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:25.831414 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 2277) took 1055 ms. Trace:
I20260709 13:19:25.831804 18344 rpcz_store.cc:276] 0709 13:19:24.776414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.777108 (+   694us) service_pool.cc:224] Handling call
0709 13:19:25.805996 (+1028888us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b5800002a98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7eee 0000000000375939 00007f40a3e2b1e0 00007f40a3ef40c4 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:19:25.831334 (+ 25338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16116864}
I20260709 13:19:25.827399 18342 rpcz_store.cc:276] 0709 13:19:24.802342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.875843 (+ 73501us) service_pool.cc:224] Handling call
0709 13:19:24.876116 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.939989 (+ 63873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.826182 (+886193us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b540007f154. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:25.826651 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92688768}
I20260709 13:19:25.825367 18341 rpcz_store.cc:276] 0709 13:19:24.732568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.739610 (+  7042us) service_pool.cc:224] Handling call
0709 13:19:25.818834 (+1079224us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54000e9cd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:25.819083 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516006784}
I20260709 13:19:25.834131 23530 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:25.835745 23530 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.769572 19053 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:19:25.747303 18414 rpcz_store.cc:276] 0709 13:19:22.809253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.859798 (+ 50545us) service_pool.cc:224] Handling call
0709 13:19:22.898947 (+ 39149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.899167 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:19:22.915497 (+ 16330us) log.cc:844] Serialized 14 byte log entry
0709 13:19:23.211760 (+296263us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.132627 (+920867us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b18003e8180. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f40a2db058f 00007f409bdef571 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd
0709 13:19:24.947430 (+814803us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b18003e8180. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdec455 00007f409eed4060 00007f409eee6716 00007f409eef7287 00007f409eef7208
0709 13:19:24.967232 (+ 19802us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b24001811a8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bc759c4 00007f409bc73acb 00007f409be2edc9 00007f409be2ea55 00007f409be2e09d 00007f409ea6010e 00007f409ea7788c 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221
0709 13:19:25.364112 (+396880us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:25.364185 (+    73us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:25.364252 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.364350 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:25.364499 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":921758,"prepare.queue_time_us":18999,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":8446,"raft.queue_time_us":78708,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":22564,"spinlock_wait_cycles":59672960,"thread_start_us":686843,"threads_started":2,"wal-append.queue_time_us":390276}
W20260709 13:19:25.838369 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 452838us
I20260709 13:19:25.842350 23549 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:25.843300 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 78368.9us
I20260709 13:19:25.844235 18487 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:19:25.846415 23627 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:25.848567 23530 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:25.849292 19055 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:25.845772 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:25.851029 23487 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:19:25.851401 19057 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 1203) took 2401 ms (client timeout 2886 ms). Trace:
I20260709 13:19:25.852054 23487 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.852599 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:25.854122 19059 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:19:25.854663 19056 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:19:25.834189 23394 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:25.851949 19057 rpcz_store.cc:269] 0709 13:19:23.449501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.449623 (+   122us) service_pool.cc:224] Handling call
0709 13:19:25.850940 (+2401317us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400643a54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:25.851176 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2727824640}
I20260709 13:19:25.856102 19059 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:25.856017 19054 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:25.856654 23627 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:25.868108 18487 raft_consensus.cc:2410] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:25.869158 19057 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:25.890468 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:25.910748 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 49549us
I20260709 13:19:25.894493 23627 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:25.914368 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 160548us
I20260709 13:19:25.932857 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:25.661535 23380 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:25.944911 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.951171 18487 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:25.953014 19054 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:19:25.939908 18307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.011s	sys 0.009s
W20260709 13:19:25.958248 19025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.013s	sys 0.021s
W20260709 13:19:25.962495 18307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.013s	sys 0.009s
W20260709 13:19:25.966598 19025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.014s	sys 0.021s
W20260709 13:19:25.969488 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 181339us
W20260709 13:19:25.969370 23271 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.016s	sys 0.003s
I20260709 13:19:25.969952 23642 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.972405 18458 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:25.971908 23271 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.016s	sys 0.003s
I20260709 13:19:25.973623 19059 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:19:25.967756 18339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.010s	sys 0.011s
I20260709 13:19:25.972707 23642 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:25.980820 23548 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:25.981827 23548 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:25.983592 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:25.985006 23548 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:25.985965 23501 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:25.986943 23148 raft_consensus.cc:3055] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:25.987463 23148 raft_consensus.cc:740] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:25.987592 23380 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:25.988574 23487 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:25.989478 18488 consensus_meta.cc:287] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.618s	user 0.012s	sys 0.003s
W20260709 13:19:25.993218 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.994535 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.996363 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.997777 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:25.996394 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.989192 23148 consensus_queue.cc:260] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:25.989220 23509 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.009s	sys 0.018s
W20260709 13:19:25.993760 18343 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.011s	sys 0.007s
I20260709 13:19:26.002547 22894 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.001634 23642 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.010128 19026 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:19:26.011432 18308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.002s	sys 0.019s
I20260709 13:19:26.014081 23629 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:26.016486 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:26.017884 19057 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:26.019797 23499 raft_consensus.cc:3055] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:25.969658 23477 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.077s	sys 0.097s
I20260709 13:19:26.022040 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 2280) took 1226 ms. Trace:
I20260709 13:19:26.025869 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1452) took 1136 ms. Trace:
I20260709 13:19:26.029978 18382 leader_election.cc:400] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14.
I20260709 13:19:26.036830 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:26.037621 23148 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.029632 23630 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:26.039947 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 876022us
W20260709 13:19:26.041754 18339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.010s	sys 0.012s
I20260709 13:19:26.043217 18493 raft_consensus.cc:2393] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 15: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:19:26.046924 18308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.003s	sys 0.019s
W20260709 13:19:26.046216 23509 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.010s	sys 0.018s
W20260709 13:19:26.047809 18343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.011s	sys 0.007s
I20260709 13:19:26.043455 23627 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:26.048318 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 64996.8us
I20260709 13:19:26.048704 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:26.049054 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 89071.6us
W20260709 13:19:26.050288 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.048704 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:26.050442 19059 raft_consensus.cc:2410] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:26.054005 18382 leader_election.cc:403] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:26.056910 23418 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:26.053814 18337 rpcz_store.cc:276] 0709 13:19:24.795606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.829392 (+ 33786us) service_pool.cc:224] Handling call
0709 13:19:26.021447 (+1192055us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54001d0e54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:26.021792 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150099840}
W20260709 13:19:26.066071 23477 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.077s	sys 0.098s
I20260709 13:19:26.076218 23631 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.048314 22894 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:26.077052 18335 consensus_meta.cc:287] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.212s	user 0.009s	sys 0.014s
I20260709 13:19:26.076952 23631 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.077565 18335 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:26.078224 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2582) took 1283 ms. Trace:
I20260709 13:19:26.078634 18335 rpcz_store.cc:276] 0709 13:19:24.794797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.829984 (+ 35187us) service_pool.cc:224] Handling call
0709 13:19:26.078133 (+1248149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:26.079759 23473 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:26.080821 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:26.080660 23473 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.081346 23487 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:26.081645 19059 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:26.082185 23487 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:26.083367 23487 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.085093 23641 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.060165 23630 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:26.086663 18338 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:26.053884 19060 rpcz_store.cc:276] 0709 13:19:24.889412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.770907 (+881495us) service_pool.cc:224] Handling call
0709 13:19:25.771380 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.772081 (+   701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.772118 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.772916 (+   798us) log.cc:844] Serialized 26 byte log entry
0709 13:19:25.959101 (+186185us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:25.959193 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.959343 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.025517 (+ 66174us) raft_consensus.cc:1685] finished
0709 13:19:26.025538 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.025682 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25197,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":36983,"thread_start_us":175685,"threads_started":1,"wal-append.queue_time_us":249881}
I20260709 13:19:26.088042 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:26.089090 18490 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.011s	sys 0.007s
I20260709 13:19:26.089506 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:26.089672 19026 leader_election.cc:400] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 17.
I20260709 13:19:26.091519 23638 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:26.046715 23499 raft_consensus.cc:740] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:26.093364 18335 raft_consensus.cc:1240] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:26.089510 18490 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.011s	sys 0.007s
I20260709 13:19:26.079324 22894 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.069303 19054 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:26.098220 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:26.098755 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 69037.8us
I20260709 13:19:26.099428 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:26.086941 23630 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:26.099857 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 51462us
I20260709 13:19:26.100798 22792 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14.
I20260709 13:19:26.089099 18343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2585) took 1121 ms. Trace:
I20260709 13:19:26.086922 19025 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:26.128535 18344 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 16: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:26.130084 18382 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:26.130858 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:26.131932 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.131579 22792 consensus_queue.cc:1059] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:26.132824 18384 leader_election.cc:400] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14.
I20260709 13:19:26.130141 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:26.132721 22792 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:26.126369 18488 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:26.105783 18343 rpcz_store.cc:276] 0709 13:19:24.967328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.967478 (+   150us) service_pool.cc:224] Handling call
0709 13:19:24.967750 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.967928 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:25.361309 (+393381us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.088299 (+726990us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.088508 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:26.088579 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:26.088674 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.088802 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.089016 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17984,"prepare.queue_time_us":553011,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":18296,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":296,"spinlock_wait_cycles":74087168,"thread_start_us":1091541,"threads_started":2,"wal-append.queue_time_us":632771}
I20260709 13:19:26.148612 23012 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:26.149299 23012 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:26.150606 23012 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.153093 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:26.154114 23629 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:26.154994 23629 raft_consensus.cc:2764] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:26.146497 22894 raft_consensus.cc:3055] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:26.158563 22894 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:26.159986 22894 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.161839 19057 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:26.085831 23641 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.193504 19059 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:26.162640 23349 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:26.162281 23549 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:26.211995 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 82140.5us
I20260709 13:19:26.206700 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:26.162482 23579 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:26.220638 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 133860us
I20260709 13:19:26.203238 22894 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:26.229795 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:26.230055 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:26.230799 18344 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:26.231048 19058 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:26.231328 23473 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.231788 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1460) took 1229 ms. Trace:
I20260709 13:19:26.232208 19058 rpcz_store.cc:276] 0709 13:19:25.002703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.460439 (+457736us) service_pool.cc:224] Handling call
0709 13:19:26.231679 (+771240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:26.233836 19025 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:26.235594 18335 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:26.236387 23498 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:26.236888 23498 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:26.237269 23498 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.236392 23631 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:26.242527 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 89503.3us
I20260709 13:19:26.242842 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1212) took 1539 ms. Trace:
I20260709 13:19:26.243408 19056 rpcz_store.cc:276] 0709 13:19:24.703888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.804886 (+100998us) service_pool.cc:224] Handling call
0709 13:19:25.854117 (+1049231us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.855067 (+   950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.242518 (+387451us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400643a50. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:26.242742 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410847488}
I20260709 13:19:26.245087 18415 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.245873 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:26.246865 23631 raft_consensus.cc:2764] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:26.247438 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:26.228479 22792 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.250216 23657 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.252350 23657 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:26.253489 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.255535 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:26.230525 23468 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:26.260188 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:26.266233 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 188294us
I20260709 13:19:26.265121 23579 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.270056 23542 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.270710 23542 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.271420 23641 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.271535 23579 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.272217 23639 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:26.272738 23639 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.273026 23542 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.273129 23639 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.251240 22792 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.262413 23638 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.259681 23468 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:26.284126 18415 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:26.292843 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:26.293687 18344 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:19:26.292804 18341 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:26.307314 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:26.308604 18343 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:26.310992 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:26.311648 23163 consensus_meta.cc:287] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.760s	user 0.016s	sys 0.002s
I20260709 13:19:26.312196 18484 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
W20260709 13:19:26.314775 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.316480 18384 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:26.316519 23504 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:26.317312 23383 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:26.315552 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.320073 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 2485) took 1150 ms. Trace:
I20260709 13:19:26.321077 18415 rpcz_store.cc:276] 0709 13:19:25.144829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.144940 (+   111us) service_pool.cc:224] Handling call
0709 13:19:26.244166 (+1099226us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b580048d7d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee380aa 00007f409eeba447 00007f409eed2fe7 00007f409eed47de 00007f409eee027c 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c
0709 13:19:26.295182 (+ 51016us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998855936}
I20260709 13:19:26.293489 23468 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.326629 18337 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:26.346819 18384 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:26.322335 23629 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:26.350076 23589 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:19:26.351991 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:26.353307 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:26.355690 23657 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.358795 18485 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:26.358713 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:26.361043 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:19:26.362222 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 128555us
I20260709 13:19:26.326004 23500 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:26.359974 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:26.365502 19027 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:26.370182 18343 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:26.377202 23653 consensus_queue.cc:1059] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:26.378021 23629 raft_consensus.cc:697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:26.381305 23643 log.cc:927] Time spent T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.386s	user 0.002s	sys 0.003s
I20260709 13:19:26.388666 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:26.360261 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 798599us
I20260709 13:19:26.397248 18487 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
W20260709 13:19:26.399288 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 104580us
I20260709 13:19:26.400858 23653 raft_consensus.cc:3055] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:26.401626 18458 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:26.318166 23638 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.404326 23653 raft_consensus.cc:740] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:19:26.421358 23394 consensus_meta.cc:287] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.532s	user 0.013s	sys 0.001s
I20260709 13:19:26.424768 18492 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:26.425726 23477 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:26.431718 23477 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.429425 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:26.431866 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 74167.1us
I20260709 13:19:26.432204 18491 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:26.432230 23477 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:26.434070 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.435317 23640 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:26.435814 23640 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.436201 23640 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:26.439759 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:26.440496 18419 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:26.440761 18308 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:26.442083 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:26.440517 18485 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:26.445729 23455 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:26.445269 23629 consensus_queue.cc:237] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:26.446413 23455 raft_consensus.cc:697] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:26.447881 23455 consensus_queue.cc:237] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:26.432013 23653 consensus_queue.cc:260] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.452199 23653 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:26.452603 23498 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:26.450449 18309 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:26.454183 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 177328us
I20260709 13:19:26.454794 23579 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:26.455158 23579 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:26.455575 23579 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:26.458284 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 97821.8us
I20260709 13:19:26.457890 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:26.458284 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 111588us
I20260709 13:19:26.458341 18309 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:26.468313 18384 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:19:26.469331 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.469830 18308 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:26.364406 23499 consensus_queue.cc:260] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:26.473635 19027 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:26.479638 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:26.488740 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:26.492368 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:26.499147 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:26.499958 18410 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:19:26.501019 18414 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:26.501564 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:26.502290 18413 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:26.503892 18382 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:26.505740 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2588) took 1532 ms. Trace:
I20260709 13:19:26.506320 18419 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:26.506232 18339 rpcz_store.cc:276] 0709 13:19:24.973340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.999686 (+ 26346us) service_pool.cc:224] Handling call
0709 13:19:25.000028 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.000436 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.000473 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.001061 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:19:25.048882 (+ 47821us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b480021e7d8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a3e05aa1 00007f40a3dfcb37 00007f40a3dfc9ca 00007f40a3ef426f 00007f40a3ef3f37 00007f40a3f0855c 00007f40a3f08508 00007f40a3f08488 00007f40a3f08443 00007f40a3f076ec 00007f40a2e31a96
0709 13:19:26.082137 (+1033255us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:26.082246 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.082375 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.505408 (+423033us) raft_consensus.cc:1685] finished
0709 13:19:26.505433 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.505671 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1342,"raft.run_cpu_time_us":1896,"raft.run_wall_time_us":45014,"spinlock_wait_cycles":16952064,"thread_start_us":1057476,"threads_started":1,"wal-append.queue_time_us":1397272}
I20260709 13:19:26.510457 18308 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:26.512295 23092 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:26.512655 23092 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.512964 23092 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.513444 23657 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:26.514067 23642 consensus_queue.cc:1059] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:26.514895 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 70738.6us
W20260709 13:19:26.516036 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 58237.7us
I20260709 13:19:26.517290 18457 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:26.518215 23383 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:26.518712 23383 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:26.518836 23498 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:26.519692 23498 consensus_queue.cc:1059] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:26.519793 23383 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.520637 18336 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:26.521260 23498 raft_consensus.cc:3055] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:26.522114 23589 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:26.522588 23589 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:26.523164 23589 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.523072 18382 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:26.523490 23504 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:26.524863 23504 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:26.525213 23504 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.525529 23504 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:26.522657 23657 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.517674 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:26.526808 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.472149 23509 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:26.477416 23271 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:26.459544 23394 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:26.482594 23641 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:26.532119 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:26.526155 18309 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:26.530131 23630 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.538096 18417 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:19:26.538738 23499 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:26.554189 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:26.539848 23638 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:26.540356 23509 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.540233 23468 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.541003 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:26.542747 23647 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:26.526117 22894 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:19:26.546409 23163 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:26.547166 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:26.547328 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.521724 23498 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:19:26.563957 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 46360us
I20260709 13:19:26.556348 18414 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:26.538718 23477 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.515240 23642 raft_consensus.cc:3055] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:26.559465 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 330368us
I20260709 13:19:26.562747 18418 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:26.563180 18411 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:26.561069 23163 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:26.571645 23163 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.568015 23642 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:26.574333 23473 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:26.537228 23639 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.555984 23641 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.569664 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:26.571084 18384 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:26.556285 23271 raft_consensus.cc:697] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:26.559032 23509 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:26.583276 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 100789us
I20260709 13:19:26.586109 23653 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:26.586778 23653 raft_consensus.cc:697] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:26.586431 23498 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.588023 23498 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:26.587739 23653 consensus_queue.cc:237] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.591262 23639 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:26.590672 18238 catalog_manager.cc:5697] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:26.592145 23639 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:26.592476 23468 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:26.584652 23641 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:26.601217 23640 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.566632 23380 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.626657 23380 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:26.602494 23148 consensus_meta.cc:287] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.002s
I20260709 13:19:26.609516 18309 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:26.604839 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.605418 23431 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:26.561211 23542 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:26.610080 23473 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:26.611760 23477 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:26.612447 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:26.612660 18487 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:26.613000 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:26.613826 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:26.614564 23579 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.616346 23394 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:26.616662 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:26.618551 18490 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:26.567193 23638 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:26.575032 23642 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:26.623490 23012 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:26.575863 23647 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:26.591295 23630 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.592530 23639 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:19:26.681983 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.633867 18338 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:26.682842 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:19:26.683815 18241 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42278 (request call id 371) took 25129 ms (client timeout 15000 ms). Trace:
I20260709 13:19:26.684054 23647 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.669806 23509 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.687824 23509 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.690016 22792 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:26.669605 23163 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:26.673079 18418 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:26.677881 23380 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.674801 18238 catalog_manager.cc:5697] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:26.636269 18485 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:19:26.674511 18491 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:19:26.672391 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:26.679876 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 66912.5us
I20260709 13:19:26.680024 23640 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:26.681646 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 50297.2us
I20260709 13:19:26.603556 23271 consensus_queue.cc:237] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.675475 23012 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:26.670010 23148 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:26.671392 18413 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:26.682538 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:26.669818 23431 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:26.724524 23641 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.671164 23589 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:26.691733 23639 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.744441 18308 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:26.758210 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:26.726704 23012 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:26.725716 18414 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:26.727495 23579 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.734143 23627 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:26.772509 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 248335us
I20260709 13:19:26.774646 18490 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:26.761370 23642 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.761122 23630 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.789137 23504 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.795570 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:26.790247 23431 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:26.785108 23468 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.793736 18484 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:26.798549 18490 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:26.796821 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1216) took 1813 ms. Trace:
I20260709 13:19:26.801397 23468 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.803687 23468 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:26.785537 23627 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.806201 23509 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:26.796358 23163 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:26.684280 18241 rpcz_store.cc:269] 0709 13:19:01.554663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.566392 (+ 11729us) service_pool.cc:224] Handling call
0709 13:19:26.683489 (+25117097us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:17.664014 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:17.664725 (+   711us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:17.664775 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:19:17.664794 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:17.666397 (+  1603us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:17.666506 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:17.666532 (+    26us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:19:17.668031 (+  1499us) tablet.cc:701] Row locks acquired
0709 13:19:17.668077 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:19:17.668244 (+   167us) write_op.cc:270] Start()
0709 13:19:17.668390 (+   146us) write_op.cc:276] Timestamp: P: 1783603157668180 usec, L: 0
0709 13:19:17.668422 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:19:17.669158 (+   736us) log.cc:844] Serialized 7856 byte log entry
0709 13:19:18.535118 (+865960us) op_driver.cc:464] REPLICATION: finished
0709 13:19:18.757519 (+222401us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409bdd20ac 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f40a2912ef0
0709 13:19:19.013754 (+256235us) write_op.cc:301] APPLY: starting
0709 13:19:19.013887 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:19.276416 (+262529us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:19.276457 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:20.305324 (+1028867us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:20.305708 (+   384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:19:20.305769 (+    61us) write_op.cc:312] APPLY: finished
0709 13:19:20.306297 (+   528us) log.cc:844] Serialized 180 byte log entry
0709 13:19:20.617443 (+311146us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:20.677248 (+ 59805us) write_op.cc:454] Released schema lock
0709 13:19:20.736061 (+ 58813us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:20.834804 (+ 98743us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:20.837424 (+  2620us) write_op.cc:454] Released schema lock
0709 13:19:21.971550 (+1134126us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
Metrics: {"mutex_wait_us":1239323,"reported_tablets":46,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":428268,"apply.run_cpu_time_us":62573,"apply.run_wall_time_us":1833672,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87447,"num_ops":20,"prepare.queue_time_us":374318,"prepare.run_cpu_time_us":20381,"prepare.run_wall_time_us":166900,"raft.queue_time_us":341147,"raft.run_cpu_time_us":19309,"raft.run_wall_time_us":402887,"replication_time_us":866528,"spinlock_wait_cycles":13020800,"thread_start_us":1238493,"threads_started":5,"wal-append.queue_time_us":605771,"wal-append.run_cpu_time_us":195198,"wal-append.run_wall_time_us":3989793}]]}
I20260709 13:19:26.813452 23627 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.795584 18238 catalog_manager.cc:5697] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:26.829694 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:26.833551 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 411014us
I20260709 13:19:26.835383 18338 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:26.842221 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1453) took 1952 ms. Trace:
I20260709 13:19:26.841892 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:26.844578 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:26.845502 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:26.847892 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.829443 23468 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.852413 18339 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:26.799698 23630 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:26.853935 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 388276us
I20260709 13:19:26.828626 22894 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:19:26.843019 19053 rpcz_store.cc:276] 0709 13:19:24.889649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.838143 (+948494us) service_pool.cc:224] Handling call
0709 13:19:25.838649 (+   506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.839130 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:19:26.206833 (+367703us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.836426 (+629593us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:26.836472 (+    46us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:26.841990 (+  5518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.842064 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.842170 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1600,"prepare.queue_time_us":293796,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":125726,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":935731,"threads_started":3,"wal-append.queue_time_us":365423}
I20260709 13:19:26.841708 23504 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:26.877414 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 268004us
I20260709 13:19:26.858891 19027 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:26.874837 18491 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 15: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:26.799966 19055 rpcz_store.cc:276] 0709 13:19:24.971226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.852542 (+881316us) service_pool.cc:224] Handling call
0709 13:19:25.852994 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.853495 (+   501us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:25.958516 (+105021us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.767820 (+809304us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.778976 (+ 11156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:26.779042 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:26.783938 (+  4896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.784039 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.784192 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10483,"prepare.queue_time_us":281995,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":136830,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":7512,"spinlock_wait_cycles":7963648,"thread_start_us":671404,"threads_started":3,"wal-append.queue_time_us":460166}
I20260709 13:19:26.882249 19025 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:26.885141 18336 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:19:26.885656 18336 pending_rounds.cc:85] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 8
W20260709 13:19:26.887547 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.889786 18413 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:26.855332 23499 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:26.885962 18336 pending_rounds.cc:107] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:19:26.899834 18336 raft_consensus.cc:2889] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:26.895507 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:26.835172 23092 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:26.891314 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:26.906814 19056 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:26.905016 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:26.910887 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:26.911862 18487 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:19:26.917583 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 188758us
I20260709 13:19:26.918640 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:26.927671 18491 raft_consensus.cc:2393] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 15: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:26.929515 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:26.930284 18487 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:19:26.857864 23468 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:26.935066 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 78012.4us
I20260709 13:19:26.913862 23641 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:26.938619 18343 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:26.941037 23657 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:26.942430 18416 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:19:26.943769 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:26.944213 18489 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:26.944504 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:26.945350 19025 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:26.945978 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 87193.9us
I20260709 13:19:26.948618 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:26.953509 18413 raft_consensus.cc:2410] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:19:26.914903 23455 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:26.957280 18412 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 15: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:26.951071 18416 pending_rounds.cc:85] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 13
I20260709 13:19:26.957803 18416 pending_rounds.cc:107] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:19:26.958175 18416 raft_consensus.cc:2889] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:26.961688 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:26.962566 18418 raft_consensus.cc:2393] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 15: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:26.957623 19027 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:26.974270 18486 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:26.924932 23680 raft_consensus.cc:2764] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:19:26.975649 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:26.937249 23332 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:26.986606 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:26.986620 18410 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:26.988749 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:26.988844 18493 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:26.949764 23589 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:26.919307 23499 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:26.954739 23148 raft_consensus.cc:697] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:27.001853 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.001783 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:27.004431 19055 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:19:27.026747 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:27.039202 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 51767.5us
I20260709 13:19:27.042300 18491 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:27.036243 19058 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:19:27.005501 23498 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.975214 22894 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.002897 18238 catalog_manager.cc:5697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 6 to 10, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 10 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:27.047663 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:27.037554 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:27.048157 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:19:27.048610 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 95453.4us
W20260709 13:19:27.050052 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 46250.3us
I20260709 13:19:27.050316 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.048903 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:26.998347 23349 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.005525 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:27.055584 18418 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:26.998414 23687 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:19:27.065176 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.065930 19058 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:27.063975 18419 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
W20260709 13:19:27.067461 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 122249us
I20260709 13:19:27.064590 19027 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:27.047375 23380 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:19:27.070995 19027 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:27.072407 23675 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:19:27.073550 23674 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:19:27.074090 23681 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:27.074601 23681 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.075021 23681 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:27.078788 23498 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.059051 23680 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:27.082275 23680 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.082638 23680 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:27.086915 23468 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:27.092233 19027 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:27.097508 18413 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:27.099058 23684 raft_consensus.cc:2764] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:27.099875 23640 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:27.099669 23639 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.100533 23685 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:27.102092 18238 catalog_manager.cc:5697] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 5 to 6, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 6 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:27.099985 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.094467 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:26.990538 23549 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:19:27.107343 19061 raft_consensus.cc:2393] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:27.109151 18487 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:27.109112 18457 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:27.110001 18486 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:27.054065 23332 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:27.115459 19057 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:19:27.110845 18412 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:27.119061 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.119971 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:27.120923 18493 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:27.118366 18382 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:27.121435 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.123775 18384 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:27.125152 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:27.126897 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:27.127537 18337 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:19:26.998842 23455 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:27.133329 23653 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.133875 23653 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.134635 19025 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:27.136042 18418 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:27.136562 23653 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:27.058243 22894 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.141842 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.130502 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:27.137583 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:27.138504 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.141868 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:27.140273 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:27.142640 18488 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.142760 18343 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:27.143370 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.139326 18337 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18. Ops: []
W20260709 13:19:27.130189 18307 leader_election.cc:336] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 2.237s (SENT)
I20260709 13:19:27.143652 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.146322 18307 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:27.115587 23640 raft_consensus.cc:697] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:27.118858 23684 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:27.122169 23163 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:27.149106 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:27.150645 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.157088 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:27.157650 18335 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:27.093663 23349 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.138752 23639 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:27.162971 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:27.165041 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 46765.8us
I20260709 13:19:27.206455 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.207080 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:27.208695 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:27.207887 18486 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:27.212075 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 74771us
I20260709 13:19:27.150122 23148 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:27.213704 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 86980.8us
I20260709 13:19:27.213958 23499 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:27.221550 23688 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:19:27.222077 23642 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.229139 23642 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.230122 23629 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.231622 18487 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:19:27.117666 23487 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:19:27.232843 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:27.236418 18488 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:19:27.237167 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:27.237735 19058 raft_consensus.cc:2376] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15. Re-sending same reply.
I20260709 13:19:27.238138 23642 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:27.238183 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.238833 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:27.239523 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.225901 23681 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.240337 18490 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:27.150208 23684 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:27.239586 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.152462 23163 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.243572 23477 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.241621 18309 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:27.247084 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.247558 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.265952 18487 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 15: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:27.251400 18335 raft_consensus.cc:2468] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:27.160686 23638 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.206964 18485 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:27.261204 19057 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:27.171133 22894 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:27.165308 23504 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:27.230759 23629 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.267159 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:27.267944 18493 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:27.166059 23679 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:27.270124 18488 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:27.270133 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:27.271238 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.272639 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.274811 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:27.293728 19058 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:27.275089 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:27.276111 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:27.276607 19027 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:27.166718 23692 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.258579 23163 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:27.164162 23589 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.164528 23676 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.286902 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.287125 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.310491 19056 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 13: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:27.287569 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.311673 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:27.312273 18413 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:27.314008 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.165979 23383 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:27.288650 18410 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 18.
I20260709 13:19:27.278425 18457 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:27.335444 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:27.336118 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 57766.1us
I20260709 13:19:27.289749 23685 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.294600 18484 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:27.294705 19054 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:27.293226 18492 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 7.
I20260709 13:19:27.258355 23657 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:27.299093 18411 raft_consensus.cc:2393] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:27.299706 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.260277 23684 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.301441 18238 catalog_manager.cc:5697] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 6 to 9, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 9 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:27.166594 23683 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.155s
I20260709 13:19:27.337322 18457 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:27.294219 19060 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:27.335489 18309 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:27.292438 23642 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:27.364071 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:27.365044 18417 raft_consensus.cc:1240] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:27.341815 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:27.346309 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.366269 18488 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:27.153705 23640 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.356148 18418 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:27.357612 18415 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:27.166420 23332 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:27.339896 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:27.345698 23012 consensus_meta.cc:287] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:19:27.285660 23477 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:27.374925 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 68110.1us
I20260709 13:19:27.376014 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:27.378047 18337 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:27.381669 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:27.378214 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.380776 18485 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:27.387530 18492 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 15: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:27.345530 23627 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:27.390439 18488 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:27.296563 23693 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:19:27.371132 23642 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.376570 23653 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:27.426148 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.427398 19062 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:27.438659 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:27.416646 18343 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
W20260709 13:19:27.450461 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 173969us
I20260709 13:19:27.450768 23710 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.451409 18238 catalog_manager.cc:5697] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:27.454517 18413 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:27.410392 23487 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:27.357319 23685 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.371735 23657 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:27.425256 23642 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:27.479115 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 133192us
I20260709 13:19:27.376789 23641 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:19:27.370376 23589 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.479208 19027 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:27.425271 23653 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:27.440900 23504 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:27.450691 23711 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:27.386961 23012 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:27.534168 23012 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:27.533094 23504 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.534795 18416 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:27.535418 23657 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:27.526677 23706 log.cc:927] Time spent T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:19:27.530510 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.539175 19053 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:19:27.540151 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.540896 19053 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:27.463717 23487 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.531190 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.550726 19056 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:27.531728 23653 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:27.478746 23710 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.511898 18238 catalog_manager.cc:5697] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 7 to 10, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 10 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:27.540117 23714 raft_consensus.cc:2804] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:27.482336 23349 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:27.420261 23271 consensus_queue.cc:1059] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:19:27.393939 23676 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.547873 19054 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
W20260709 13:19:27.556150 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 218911us
I20260709 13:19:27.455588 23579 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 13:19:27.462837 23639 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
W20260709 13:19:27.571496 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 153674us
I20260709 13:19:27.575335 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:27.552874 23487 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.576921 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:27.513078 23627 raft_consensus.cc:697] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:27.553809 23657 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:27.587863 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 236375us
I20260709 13:19:27.590062 18416 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:27.591711 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:27.592655 18343 raft_consensus.cc:2368] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:19:27.599731 18238 catalog_manager.cc:5697] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 4 to 5, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 5 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:27.600387 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.601145 19053 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 15: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:27.602066 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.602815 19054 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:27.611630 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:27.616626 19056 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:27.598841 23681 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:27.624966 23681 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:27.629128 18486 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:19:27.632568 23721 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:19:27.633021 18491 consensus_meta.cc:287] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.000s
I20260709 13:19:27.633366 18491 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:27.583865 23455 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:27.635350 23707 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:19:27.629999 23684 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.630370 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:27.631217 23380 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:27.599289 23657 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.641733 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:27.643751 18384 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:27.649991 23709 log.cc:927] Time spent T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:19:27.659839 18338 raft_consensus.cc:2393] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:27.553124 23711 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.643044 23271 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.663722 23271 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:27.664274 23691 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:27.664857 23712 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:27.665364 23712 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.666612 23685 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:27.667542 23712 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:27.672533 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:27.645087 18238 catalog_manager.cc:5697] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:27.644281 23380 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.640985 23629 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:27.683027 19055 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:27.675418 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:19:27.685786 23654 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:27.652156 23657 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:27.689194 23717 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:27.689571 23380 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:27.686463 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:27.673578 23691 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:27.686726 23349 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:27.693653 18384 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:27.769079 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 75530.2us
I20260709 13:19:27.743366 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:27.747350 23722 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:27.748409 23684 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:27.732843 22792 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.749619 23711 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:27.700716 23714 raft_consensus.cc:697] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:27.806829 23714 consensus_queue.cc:237] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.750236 23726 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.750618 23685 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.754343 23720 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:19:27.755831 23676 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:27.756201 23627 consensus_queue.cc:237] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:27.758020 23589 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:27.779346 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.672993 23271 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:27.732990 23504 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:27.800536 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 220006us
W20260709 13:19:27.801076 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 67746.4us
I20260709 13:19:27.802517 23713 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:27.803155 23691 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:27.812317 18493 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.000s
I20260709 13:19:27.813401 19056 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:27.816704 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:27.793810 23349 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.794121 23722 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:27.819856 19054 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:27.850835 19053 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
W20260709 13:19:27.851673 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:27.817751 23680 consensus_meta.cc:287] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.735s	user 0.004s	sys 0.010s
I20260709 13:19:27.851073 18493 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
W20260709 13:19:27.854617 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.889127 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 2393) took 1036 ms. Trace:
I20260709 13:19:27.854270 23722 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:27.821086 23685 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.808102 22792 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:27.856781 23092 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:27.850185 23504 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.865725 23713 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:27.906234 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:27.857151 23642 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.854655 23349 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:27.889494 18493 rpcz_store.cc:276] 0709 13:19:26.852789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.156020 (+303231us) service_pool.cc:224] Handling call
0709 13:19:27.889069 (+733049us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:27.896030 19060 consensus_meta.cc:287] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
I20260709 13:19:27.909590 19060 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:27.910866 19060 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:27.912454 23732 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:27.885717 23630 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:27.942176 18336 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:19:27.940253 23690 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:19:27.814965 23726 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.906375 23504 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:27.957592 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:27.941807 23642 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:27.898607 23680 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.971706 18413 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 15: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:27.913004 23732 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.929426 23653 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.975945 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:27.914732 23487 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.981074 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.981104 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.986687 23736 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:27.986756 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:27.969301 23720 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.992901 23720 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:27.995508 23163 consensus_meta.cc:287] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.001s
I20260709 13:19:27.995831 23720 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:27.995921 23163 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:27.998904 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:27.999552 18488 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:28.001763 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:28.002275 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.002458 19054 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:28.002975 23736 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:28.008035 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.008747 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.011327 23680 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:28.011652 23730 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:28.011931 23713 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.012866 18488 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:28.014379 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.003300 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:28.018843 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:28.020467 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:28.025441 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:28.028707 18414 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:28.029213 18418 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:28.032964 18493 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:28.034627 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:28.035300 18337 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:28.038162 19025 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:28.040155 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:28.040350 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:28.040978 18412 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:28.041878 18384 leader_election.cc:400] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:19:28.042503 18384 leader_election.cc:403] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:28.043983 23729 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:28.044519 23729 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:28.044708 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2811) took 1048 ms. Trace:
I20260709 13:19:28.045475 23685 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:28.045395 23729 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.046209 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.046773 18491 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:28.047544 23653 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:27.964517 23589 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 13:19:28.005142 23712 raft_consensus.cc:3055] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:28.068765 19025 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:28.030582 18458 connection.cc:256] RPC call timeout handler was delayed by -2.2540865969999686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2886s for a response
I20260709 13:19:28.072017 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:28.005132 23736 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:28.036397 23680 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:28.035074 23640 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:28.045135 18490 rpcz_store.cc:276] 0709 13:19:26.996745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.401130 (+404385us) service_pool.cc:224] Handling call
0709 13:19:27.425703 (+ 24573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.686257 (+260554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.686291 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.733664 (+ 47373us) log.cc:844] Serialized 26 byte log entry
0709 13:19:27.850894 (+117230us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:27.850926 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.851378 (+   452us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.044505 (+193127us) raft_consensus.cc:1685] finished
0709 13:19:28.044527 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.044656 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":202288,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":7757,"thread_start_us":306262,"threads_started":2,"wal-append.queue_time_us":216465}
I20260709 13:19:28.083930 18418 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:19:28.090579 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.098999 18493 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:28.099611 18491 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:28.106292 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.106943 18490 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:28.045630 23380 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.114584 23349 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.074168 23163 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.113588 23736 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 13:19:28.113293 23738 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:19:28.112191 19025 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:28.075002 23712 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:28.093989 23685 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:28.119525 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:28.127079 23487 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:28.130728 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.132875 18493 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 15: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:28.137804 23712 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:28.152316 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 75959.5us
I20260709 13:19:28.154156 18457 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:28.127103 23732 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.158226 18458 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:28.159392 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.133698 23640 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:28.163241 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:28.119144 23629 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:19:28.166431 18457 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:28.167177 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.158978 23736 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:28.155766 23712 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:28.169523 18493 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
W20260709 13:19:28.163694 18307 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.945s (SENT) [suppressed 19 similar messages]
W20260709 13:19:28.164388 23743 log.cc:927] Time spent T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:19:28.178174 19061 raft_consensus.cc:2368] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9.
I20260709 13:19:28.183004 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.183633 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:28.139683 23746 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:19:28.197384 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:28.192111 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34462 (request call id 2506) took 1153 ms. Trace:
I20260709 13:19:28.194952 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:28.246465 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 62976.5us
I20260709 13:19:28.247697 19060 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:19:28.249181 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 120718us
I20260709 13:19:28.248687 18493 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.184213 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:28.165697 23163 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:28.250519 18416 rpcz_store.cc:276] 0709 13:19:27.038484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.060416 (+ 21932us) service_pool.cc:224] Handling call
0709 13:19:28.191907 (+1131491us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b540011cbd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:28.192038 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988836736}
I20260709 13:19:28.252821 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:28.176007 23640 raft_consensus.cc:697] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:28.176328 23736 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:28.177076 23720 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.179018 23627 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:28.259812 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:28.198489 23735 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.209s	user 0.002s	sys 0.000s
W20260709 13:19:28.184744 23731 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:19:28.272900 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:28.246026 23713 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.185341 23380 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.190163 23349 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.186580 23717 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.266635 23736 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:28.181382 23504 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.278488 23726 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:28.304730 18493 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:28.316381 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.317312 18493 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:28.321720 23504 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.324258 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.327184 18338 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:19:28.329766 23477 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:28.331221 18384 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:28.304277 23380 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.290547 23720 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:28.341794 23504 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:28.356323 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1231) took 1102 ms. Trace:
I20260709 13:19:28.359225 19059 rpcz_store.cc:276] 0709 13:19:27.258065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.258219 (+   154us) service_pool.cc:224] Handling call
0709 13:19:27.267312 (+  9093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.460011 (+192699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.460059 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.514207 (+ 54148us) log.cc:844] Serialized 26 byte log entry
0709 13:19:27.773285 (+259078us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:27.773336 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.773423 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.350132 (+576709us) raft_consensus.cc:1685] finished
0709 13:19:28.356026 (+  5894us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.356239 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20531,"raft.queue_time_us":38000,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":27549,"thread_start_us":397414,"threads_started":2,"wal-append.queue_time_us":395248}
I20260709 13:19:28.291915 23713 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.379559 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2808) took 1523 ms. Trace:
I20260709 13:19:28.314754 23642 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:19:28.379931 18487 rpcz_store.cc:276] 0709 13:19:26.856107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.376244 (+520137us) service_pool.cc:224] Handling call
0709 13:19:27.407290 (+ 31046us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.575930 (+168640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.575962 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.600789 (+ 24827us) log.cc:844] Serialized 26 byte log entry
0709 13:19:27.908313 (+307524us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:27.908358 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.908447 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.127894 (+219447us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:28.374502 (+246608us) raft_consensus.cc:1685] finished
0709 13:19:28.374523 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.379501 (+  4978us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23969,"raft.queue_time_us":170006,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":22090,"spinlock_wait_cycles":4705024,"thread_start_us":400436,"threads_started":2,"wal-append.queue_time_us":314231}
W20260709 13:19:28.383088 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 111390us
W20260709 13:19:28.381124 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 117635us
I20260709 13:19:28.386458 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:28.387049 19059 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:28.391045 23753 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:19:28.391242 23757 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:19:28.392799 23748 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:19:28.393671 18493 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:28.395069 18493 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:28.374971 23504 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:28.375787 23627 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:28.400806 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2399) took 1453 ms. Trace:
I20260709 13:19:28.374603 23380 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:28.412143 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:28.399403 23504 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:28.376713 23640 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.401213 18492 rpcz_store.cc:276] 0709 13:19:26.947651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.393423 (+445772us) service_pool.cc:224] Handling call
0709 13:19:27.440068 (+ 46645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.801907 (+361839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.801954 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.809189 (+  7235us) log.cc:844] Serialized 26 byte log entry
0709 13:19:28.170538 (+361349us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:28.287802 (+117264us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.400476 (+112674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.400559 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.400621 (+    62us) raft_consensus.cc:1685] finished
0709 13:19:28.400636 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.400757 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5647,"prepare.queue_time_us":159720,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":171425,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":12801,"thread_start_us":738137,"threads_started":4,"wal-append.queue_time_us":435115}
I20260709 13:19:28.431522 23751 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:28.432484 23722 consensus_meta.cc:287] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
I20260709 13:19:28.432109 23751 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.432802 23715 raft_consensus.cc:3055] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:28.433313 23715 raft_consensus.cc:740] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:28.432891 23722 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.426863 23762 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:28.434787 23762 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:28.434940 23349 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.435220 23762 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:28.435489 23349 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:28.437466 23349 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:28.437765 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:28.438642 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1476) took 1290 ms. Trace:
I20260709 13:19:28.438890 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:28.439002 19055 rpcz_store.cc:276] 0709 13:19:27.148439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.154332 (+  5893us) service_pool.cc:224] Handling call
0709 13:19:28.438459 (+1284127us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54007d28d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:28.438560 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1069259648}
I20260709 13:19:28.439633 19056 raft_consensus.cc:2393] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 15: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:28.440249 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:28.434175 23715 consensus_queue.cc:260] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.443938 19059 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:28.447332 19055 raft_consensus.cc:2368] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
W20260709 13:19:28.423166 23657 consensus_meta.cc:287] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.003s
I20260709 13:19:28.452690 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:28.453549 19059 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:28.453480 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:28.455930 19057 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:19:28.456578 19057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1233) took 1186 ms. Trace:
I20260709 13:19:28.456887 19057 rpcz_store.cc:276] 0709 13:19:27.271985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.290567 (+ 18582us) service_pool.cc:224] Handling call
0709 13:19:28.455482 (+1164915us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b58001e6f98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:19:28.455684 (+   202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.456334 (+   650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.456525 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55629056}
I20260709 13:19:28.458827 18307 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:28.459649 23692 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:28.460069 23692 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:28.460477 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:28.462972 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:28.469627 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:28.467798 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:28.475195 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.497769 18458 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:28.500805 18307 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:28.501174 23722 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.460462 23692 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.453788 23455 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:28.504087 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:28.506537 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:28.506665 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:28.507540 18416 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 16: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:28.507688 18413 raft_consensus.cc:2393] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 14: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:19:28.508584 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 46084.5us
I20260709 13:19:28.508656 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:28.503182 23271 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:28.511816 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:28.514240 23380 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:28.516348 23163 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:28.505184 23766 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:28.518091 23380 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:28.518633 23380 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:28.520673 23380 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:28.521667 23271 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:28.522802 23271 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.523260 19059 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:19:28.498083 19056 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:19:28.534441 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:28.503305 23746 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:28.535180 19057 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:28.536571 19055 raft_consensus.cc:1240] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:28.465860 23657 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.503328 23752 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:28.505081 23455 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:28.505451 23349 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.546350 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:28.546615 23349 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:28.546371 23455 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:28.548741 23349 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:28.527233 23627 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.555689 23455 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.541834 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:28.543426 18458 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:28.564549 18418 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:28.508261 23690 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.545656 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:28.545516 23752 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:28.569876 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.545991 18416 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:28.541147 19057 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:19:28.551023 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 50301us
I20260709 13:19:28.514279 23720 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:28.564769 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 53330.2us
I20260709 13:19:28.566363 19055 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:28.572528 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:28.573532 18485 raft_consensus.cc:2368] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 13. Current term is 14.
I20260709 13:19:28.561204 23504 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:28.576228 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:28.581755 23717 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:19:28.584971 23770 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:19:28.585083 23717 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.586262 23752 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.587229 23717 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.574187 23690 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.588063 23685 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:28.575486 23769 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:28.589884 23690 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.592819 18489 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:28.619019 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.619716 18490 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:28.620999 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.621032 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.594918 23657 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.582105 23349 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:28.625097 23349 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.595340 19025 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:28.596691 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.598596 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:28.576910 23271 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:28.602381 23776 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:28.603010 18488 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:28.627566 19025 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:28.628079 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.628702 18488 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
W20260709 13:19:28.628871 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 52715us
I20260709 13:19:28.629521 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.545007 23746 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.603734 23498 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.609272 18307 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:28.604275 23720 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.615963 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.629877 18458 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:28.651317 18491 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:28.651969 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.652117 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:28.652262 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:28.630416 18382 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:28.630975 18492 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 15: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:28.653196 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:28.654234 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.613586 23712 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.638280 23726 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:28.662622 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.663291 18488 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:28.664157 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.639655 23746 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.640244 23349 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.633529 19025 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:28.668792 23775 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:28.669421 23775 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:28.670625 23685 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:28.670483 23775 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.655001 18492 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:28.630385 23271 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:28.676357 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 2417) took 1359 ms. Trace:
I20260709 13:19:28.676687 18484 rpcz_store.cc:276] 0709 13:19:27.307278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.341599 (+ 34321us) service_pool.cc:224] Handling call
0709 13:19:28.666821 (+1325222us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b5400135e54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:28.666950 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844351232}
I20260709 13:19:28.655494 23722 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:28.662016 23657 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.679922 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.684026 18488 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:28.681653 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.685460 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:28.685974 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.686218 18410 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:28.633463 23679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.269s	user 0.010s	sys 0.010s
I20260709 13:19:28.679076 18490 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:28.686703 23720 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:28.657120 23690 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:28.657599 23498 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:28.687744 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:28.682994 18411 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:28.684737 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.687137 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.689182 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:28.692535 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2507) took 1392 ms. Trace:
I20260709 13:19:28.692608 19061 raft_consensus.cc:3060] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:28.666340 23627 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:28.690465 18488 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:19:28.687006 23679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.328s	user 0.010s	sys 0.010s
I20260709 13:19:28.695791 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.695902 23776 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:28.696142 18416 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:28.688925 23762 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.690876 18492 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:28.698560 23499 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:19:28.692955 18417 rpcz_store.cc:276] 0709 13:19:27.290179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.290297 (+   118us) service_pool.cc:224] Handling call
0709 13:19:27.295268 (+  4971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.371371 (+ 76103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.678749 (+1307378us) spinlock_profiling.cc:243] Waited 65.9 ms on lock 0x7b54003638d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:28.682474 (+  3725us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151605504}
I20260709 13:19:28.679366 23477 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:19:28.648257 23692 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.683666 23722 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.724772 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.709234 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.726207 18488 raft_consensus.cc:2368] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
I20260709 13:19:28.668825 23349 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:28.710465 18484 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:28.712544 18458 leader_election.cc:400] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9.
I20260709 13:19:28.749580 18458 leader_election.cc:403] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:19:28.716507 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 132467us
I20260709 13:19:28.678426 23271 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:28.716987 18491 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:28.718971 19056 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:28.705827 18410 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:28.753799 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.754608 18493 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:28.755664 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:28.756855 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.757426 18493 raft_consensus.cc:2376] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8. Re-sending same reply.
I20260709 13:19:28.758360 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.759181 18493 raft_consensus.cc:2376] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14. Re-sending same reply.
I20260709 13:19:28.666831 23712 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.764034 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:28.766532 18488 raft_consensus.cc:2376] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9. Re-sending same reply.
I20260709 13:19:28.752144 18384 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:28.767298 18493 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:19:28.768153 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:28.769002 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 56633.1us
I20260709 13:19:28.769800 18458 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:28.772189 18458 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:28.773453 23766 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 8. Current term is 9.
I20260709 13:19:28.773897 23761 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:28.774211 23766 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:28.775050 23768 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:28.774670 23349 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.775556 18309 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:28.777096 18309 leader_election.cc:400] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
I20260709 13:19:28.777338 23349 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.783267 23717 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:28.779547 23692 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.780375 18493 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:28.784083 23690 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:28.766225 23727 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.785071 23727 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.786051 22792 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:28.774338 23710 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:28.782142 23487 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:28.787348 23762 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.709740 23679 raft_consensus.cc:697] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:28.787722 23727 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.768165 23499 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.788760 23679 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:28.789649 23765 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.289s	user 0.002s	sys 0.000s
I20260709 13:19:28.749251 23722 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:28.791800 23499 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:28.792487 18419 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 1059) took 1495 ms (client timeout 1858 ms). Trace:
W20260709 13:19:28.792930 18419 rpcz_store.cc:269] 0709 13:19:27.296983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.297173 (+   190us) service_pool.cc:224] Handling call
0709 13:19:28.792269 (+1495096us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400109354. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:28.792414 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518241024}
I20260709 13:19:28.787031 23487 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.794042 23499 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.795655 23717 raft_consensus.cc:697] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:28.796624 23717 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.688675 23752 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:19:28.798398 22792 raft_consensus.cc:3055] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:28.725484 23776 raft_consensus.cc:697] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:28.798849 22792 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:28.799742 23776 consensus_queue.cc:237] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:28.800135 22792 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.801663 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1482) took 1563 ms. Trace:
I20260709 13:19:28.801931 19058 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:28.802170 19062 rpcz_store.cc:276] 0709 13:19:27.238115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.239240 (+  1125us) service_pool.cc:224] Handling call
0709 13:19:28.801477 (+1562237us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54001473d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:28.801602 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397989632}
I20260709 13:19:28.783146 18488 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:28.777418 18309 leader_election.cc:403] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:28.791911 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2608) took 1439 ms. Trace:
I20260709 13:19:28.807853 18458 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:28.810585 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:28.807507 18336 rpcz_store.cc:276] 0709 13:19:27.352065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.352163 (+    98us) service_pool.cc:224] Handling call
0709 13:19:27.380893 (+ 28730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.958742 (+577849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.791644 (+832902us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b540028d2d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:28.791848 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290245888}
I20260709 13:19:28.724665 23468 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:28.823941 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:28.687254 23720 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:28.801761 22792 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:28.827831 19026 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:28.818375 23692 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.818130 23727 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:28.848927 19056 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:28.859728 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1237) took 1584 ms. Trace:
I20260709 13:19:28.860285 19058 rpcz_store.cc:276] 0709 13:19:27.275434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.299404 (+ 23970us) service_pool.cc:224] Handling call
0709 13:19:28.801602 (+1502198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.802322 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.859458 (+ 57136us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54001473d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:28.859649 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3362215808}
I20260709 13:19:28.836354 23657 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:28.804064 23736 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:28.840824 23455 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:28.869035 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 238902us
I20260709 13:19:28.869683 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:28.827909 23762 consensus_queue.cc:1059] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:19:28.854015 23504 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:28.836119 23163 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:19:28.864259 23710 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.865398 23657 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.888008 18491 raft_consensus.cc:2393] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:28.866191 23685 raft_consensus.cc:697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:28.775601 23768 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.892792 18382 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:28.894362 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:28.903151 19027 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:28.907111 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:28.885036 23726 raft_consensus.cc:697] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:28.893604 23657 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:28.896147 23710 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:28.918998 23777 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:19:28.923996 23736 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:28.972262 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:28.878340 23477 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 13:19:28.930469 23780 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:19:28.910104 23589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.009s	sys 0.011s
I20260709 13:19:28.934821 23720 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:28.899916 23762 consensus_queue.cc:1243] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:28.938987 23768 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:28.941090 23789 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:28.942090 23504 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:28.899793 23012 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:19:28.944149 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:28.915083 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:28.916345 23690 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:28.921183 23708 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:19:28.946913 23712 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:28.947261 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:29.040759 18411 raft_consensus.cc:2410] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:19:28.947449 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:28.949429 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:29.041378 18418 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:28.957513 19061 raft_consensus.cc:2468] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:28.957553 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:28.960155 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:28.975955 18419 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:28.976881 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:28.977005 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:28.978065 23685 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.979050 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:29.044121 18335 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:28.979580 23774 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.979831 23710 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:28.980566 18336 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:28.981367 23726 consensus_queue.cc:237] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:28.984000 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1183) took 1003 ms. Trace:
I20260709 13:19:28.974217 23769 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:28.988808 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 161016us
I20260709 13:19:29.055953 18344 raft_consensus.cc:1240] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:28.957180 23271 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.056563 19026 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:29.015429 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 109494us
I20260709 13:19:29.032410 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:29.036952 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:29.057720 18485 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:29.037204 18413 raft_consensus.cc:1240] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
W20260709 13:19:28.998464 23589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.010s	sys 0.011s
I20260709 13:19:29.078766 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:29.079257 18417 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:29.079607 18344 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:28.952605 18382 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:29.047801 18343 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:29.048096 18339 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:29.049140 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:29.082491 18336 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:29.028445 23504 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.051720 18486 rpcz_store.cc:276] 0709 13:19:27.980943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.981057 (+   114us) service_pool.cc:224] Handling call
0709 13:19:27.981354 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.987669 (+  6315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.987705 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.988204 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:19:28.157525 (+169321us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:28.244659 (+ 87134us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.399614 (+154955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.399665 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.982102 (+582437us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b2400248798. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bc759c4 00007f409bc73acb 00007f409be2edc9 00007f409be2ea55 00007f409be2dfb0 00007f409eaa4488 00007f409eaa4be8 00007f409ea7c398 00007f409ea7776a 00007f409ea76bb6
0709 13:19:28.983690 (+  1588us) raft_consensus.cc:1685] finished
0709 13:19:28.983803 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.983941 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2185,"prepare.queue_time_us":172499,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":138791,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":3124,"spinlock_wait_cycles":137707392,"thread_start_us":400123,"threads_started":3,"wal-append.queue_time_us":201832}
W20260709 13:19:29.092339 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 139893us
I20260709 13:19:29.086771 19026 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:29.091684 18487 raft_consensus.cc:2368] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
I20260709 13:19:29.041414 18488 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:29.093530 18382 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:29.108860 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:29.107210 18382 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:29.125149 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:29.125777 18338 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:29.128679 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:29.128697 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 184668us
I20260709 13:19:29.157397 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:29.129953 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:29.079913 23690 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:29.164628 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:29.165714 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:29.166662 18417 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:29.105068 23504 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:29.118140 23746 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:29.119298 23712 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:29.129153 23589 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:29.178049 18418 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:19:29.173411 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:29.179898 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:29.180212 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:29.128767 23641 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:29.185949 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:29.166857 23499 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.054795 23774 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:29.171170 23477 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:29.158159 23776 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:19:29.218858 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:29.181209 23589 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:29.207741 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 220261us
I20260709 13:19:29.188781 23641 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:29.222896 18341 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:29.167941 23642 consensus_queue.cc:1059] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:19:29.188293 23690 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:29.237892 18308 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:29.243239 18486 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:29.243508 23787 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.244012 23787 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:29.245986 23778 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.379s	user 0.000s	sys 0.003s
I20260709 13:19:29.246114 23795 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:29.246793 23795 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:29.247745 23795 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.248399 23740 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:29.248849 23740 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:29.250010 23791 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:29.250147 23579 raft_consensus.cc:3055] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:29.249759 23740 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.250504 23791 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.250921 23740 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:29.250960 23791 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:29.252863 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:29.235905 23477 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.236140 23589 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:29.238689 23641 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:29.188968 23712 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:29.281466 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 200579us
I20260709 13:19:29.284027 19061 raft_consensus.cc:1240] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:29.241760 23679 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:29.287407 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:29.287827 18458 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:29.241571 23690 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:29.250533 23579 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:29.207247 23499 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:29.305857 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:29.306561 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:29.332370 19056 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:29.294488 23690 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:29.294839 23769 raft_consensus.cc:2804] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:19:29.334187 23722 consensus_meta.cc:287] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.542s	user 0.004s	sys 0.008s
W20260709 13:19:29.341432 23724 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.127s	user 0.002s	sys 0.021s
I20260709 13:19:29.355980 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:29.359885 18486 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
W20260709 13:19:29.356317 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 226457us
I20260709 13:19:29.286208 23477 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.341688 23787 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:29.364987 19062 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:29.296921 23736 consensus_queue.cc:1059] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
W20260709 13:19:29.359127 23724 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.361s	user 0.002s	sys 0.022s
I20260709 13:19:29.349676 23271 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:29.387466 19057 raft_consensus.cc:3055] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:29.387969 19057 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:29.389405 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 151631us
I20260709 13:19:29.390431 18486 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:29.364444 23769 raft_consensus.cc:697] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:29.383877 23754 log.cc:927] Time spent T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 1.184s	user 0.005s	sys 0.000s
I20260709 13:19:29.442106 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:29.443285 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 78434.3us
I20260709 13:19:29.447116 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:29.436090 19057 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.449455 19057 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:29.363544 23722 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.424300 23736 consensus_queue.cc:1243] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:29.428222 23271 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:29.455888 23798 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:29.452935 23818 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:19:29.458680 23793 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:19:29.458961 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:29.466765 23769 consensus_queue.cc:237] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.467660 23477 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:29.475226 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 83641.7us
I20260709 13:19:29.483490 18308 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:29.485687 18307 leader_election.cc:400] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
I20260709 13:19:29.486618 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:29.479082 18338 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:29.469555 23271 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:29.519603 23468 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:29.520292 23468 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.525132 18382 leader_election.cc:400] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 9 election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 9. Current term is 10.
W20260709 13:19:29.526314 19054 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38700 (request call id 1222) took 1610 ms (client timeout 1903 ms). Trace:
W20260709 13:19:29.526762 19054 rpcz_store.cc:269] 0709 13:19:27.916268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.003073 (+ 86805us) service_pool.cc:224] Handling call
0709 13:19:29.526127 (+1523054us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54004ed254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:29.526259 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2545529600}
I20260709 13:19:29.527308 23500 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.527822 23500 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:29.531244 18492 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:29.532439 23751 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:29.533116 23500 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:29.394815 23579 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.532279 18382 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:29.538544 23468 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.539680 23722 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:29.540076 23801 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.244s	user 0.002s	sys 0.000s
I20260709 13:19:29.535266 23500 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:29.506574 18488 raft_consensus.cc:3055] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:29.548506 18488 raft_consensus.cc:740] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:29.489272 23818 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:29.624271 23817 consensus_queue.cc:1059] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:19:29.624878 23814 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:19:29.625133 23817 consensus_queue.cc:1243] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:29.625780 23722 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.626329 23722 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:29.628283 23722 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:29.630481 23797 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.395s	user 0.001s	sys 0.001s
W20260709 13:19:29.630601 23813 log.cc:927] Time spent T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:19:29.630813 23732 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.630558 23589 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:29.631409 23732 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.631879 23271 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.633201 23271 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:29.633251 23732 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:29.634131 23499 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:29.635325 23815 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:29.636710 23642 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:29.637197 23642 raft_consensus.cc:697] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:29.633268 23589 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:29.638072 23642 consensus_queue.cc:237] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:29.641441 23732 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:29.641857 23732 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.643545 23732 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:29.644915 23692 consensus_meta.cc:287] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.797s	user 0.010s	sys 0.000s
W20260709 13:19:29.646996 23657 consensus_meta.cc:287] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.000s
I20260709 13:19:29.647413 23657 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.561903 23816 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:19:29.650529 23810 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:29.650949 23810 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.651264 23810 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:29.566341 23712 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:29.652316 23818 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.562273 18488 consensus_queue.cc:260] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.656021 23719 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.656647 23719 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.645318 23692 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
W20260709 13:19:29.705379 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 254633us
W20260709 13:19:29.714265 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 230654us
I20260709 13:19:29.716490 18492 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:29.718915 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:29.719724 18493 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:29.541838 23500 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.723572 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:29.730288 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.726862 18493 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
W20260709 13:19:29.735858 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.737156 18484 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:29.737891 19057 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:19:29.738250 19057 pending_rounds.cc:85] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 12
I20260709 13:19:29.738463 19057 pending_rounds.cc:107] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:19:29.738672 19057 raft_consensus.cc:2889] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:29.738838 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 252287us
I20260709 13:19:29.743593 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:29.745486 18382 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:29.744051 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:29.751609 18307 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:29.753252 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:29.755807 18487 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:29.756322 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:29.759084 18308 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:29.757051 18493 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:29.641846 23504 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:29.736581 23500 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:29.764707 18382 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:29.765339 18484 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:19:29.768818 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.737593 23657 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:29.771668 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:29.774865 18486 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:29.741395 23736 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.727445 23692 consensus_queue.cc:1059] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:19:29.763268 23717 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:29.780460 23647 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:29.795993 23692 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:29.796649 23816 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:29.797712 23829 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:29.798192 23831 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:19:29.805998 23716 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.675s	user 0.002s	sys 0.021s
W20260709 13:19:29.810034 23693 consensus_queue.cc:1175] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" responder_term: 13 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: [12.10-12.10]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:19:29.811676 23791 consensus_meta.cc:287] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.533s	user 0.004s	sys 0.004s
I20260709 13:19:29.816288 18342 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
W20260709 13:19:29.822450 18226 catalog_manager.cc:4810] Async tablet task ChangeConfig:REMOVE_PEER RPC for tablet b345033a56994fff90990b7d03324074 with cas_config_opid_index 6 failed: Not found: failed to reset TS proxy: No leader found: Tablet b345033a56994fff90990b7d03324074 consensus state has no leader
I20260709 13:19:29.823506 19057 raft_consensus.cc:1240] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:29.824430 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:29.823529 23773 log.cc:927] Time spent T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 1.135s	user 0.001s	sys 0.017s
I20260709 13:19:29.787040 23589 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:19:29.817824 23504 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:29.784469 23736 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:29.763944 23722 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:19:29.834524 18487 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:29.834654 18486 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:29.769752 23751 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:19:29.790608 23717 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.789299 23719 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:29.830850 23647 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:29.847538 23716 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.853s	user 0.002s	sys 0.021s
W20260709 13:19:29.851167 23740 consensus_meta.cc:287] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.003s
I20260709 13:19:29.831650 23692 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:29.857276 23683 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.868775 23825 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:29.870944 23829 raft_consensus.cc:3055] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:29.903525 23647 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:29.898563 23717 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:29.912030 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 126613us
I20260709 13:19:29.850731 23791 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.903934 23692 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:29.906440 23829 raft_consensus.cc:740] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:29.917562 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:29.917721 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 158731us
I20260709 13:19:29.920778 18418 raft_consensus.cc:2410] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:29.918414 18382 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:29.924130 23468 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:29.925312 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:29.924535 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:29.905306 23810 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.929306 18489 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:29.930802 18415 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:19:29.931165 18415 pending_rounds.cc:85] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 10
I20260709 13:19:29.931407 18415 pending_rounds.cc:107] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:19:29.931634 18415 raft_consensus.cc:2889] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:29.934173 23810 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:29.940207 23816 consensus_queue.cc:1059] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:29.941155 23824 raft_consensus.cc:3055] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:29.941524 23824 raft_consensus.cc:740] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:29.915711 23719 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.944161 18410 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:29.946961 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:29.953054 23826 log.cc:927] Time spent T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:29.942301 23824 consensus_queue.cc:260] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.955521 23824 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.958684 23808 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:29.959583 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.959321 23808 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:29.960223 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:29.961547 23808 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:29.961823 18412 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:29.962242 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:29.962751 18414 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:29.906944 23683 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:29.990847 18419 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:19:30.009056 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 81093.4us
I20260709 13:19:30.015643 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.016597 18338 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:30.017874 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.018708 18339 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:30.020383 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:30.020610 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:30.021008 19060 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:30.026252 18489 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:30.027712 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:29.928643 23504 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:30.087134 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:30.089756 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:30.088403 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:30.078157 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 47109us
I20260709 13:19:30.090867 19027 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:30.092186 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.092324 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:30.116882 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:30.114238 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:30.116042 18341 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:30.092645 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:30.146631 19059 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.147522 18487 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.148064 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:30.148315 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 407879us
W20260709 13:19:30.149048 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 109127us
I20260709 13:19:30.147884 18489 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:30.149466 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.044234 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:30.038017 19060 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:19:30.038645 19025 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:30.153672 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:30.152025 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:30.092283 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:30.154295 18413 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:30.114944 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:30.155972 18412 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:30.157297 19061 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 9.
I20260709 13:19:30.158208 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:30.158972 19056 raft_consensus.cc:2410] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:19:30.162091 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 71307.3us
W20260709 13:19:30.163105 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 124530us
I20260709 13:19:30.170585 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.168052 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.171193 19027 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:30.172772 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.166513 18414 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:30.174355 19054 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:19:30.179352 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.184098 18384 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:30.175881 19025 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:30.034420 23713 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:30.188630 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:29.992084 23639 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.190595 18344 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:30.169632 23827 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:19:30.191447 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.116534 23504 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:29.991317 23719 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.168370 23787 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:30.214562 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.087875 23657 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 13:19:30.177369 23473 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.117846 23820 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:19:30.227933 19059 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:30.041814 23810 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
W20260709 13:19:30.228717 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 237445us
I20260709 13:19:30.114288 23768 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 13:19:30.235550 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 2429) took 1575 ms. Trace:
I20260709 13:19:30.234463 18415 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:30.004982 23818 consensus_queue.cc:1059] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.206s
I20260709 13:19:30.198366 23012 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:30.238602 18491 rpcz_store.cc:276] 0709 13:19:28.659963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.751785 (+ 91822us) service_pool.cc:224] Handling call
0709 13:19:30.235360 (+1483575us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400135454. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:30.235495 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273361280}
I20260709 13:19:30.239521 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.160733 23808 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:19:30.201419 23639 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.182785 23798 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:19:30.253468 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.210752 22894 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:19:30.235790 23833 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:19:30.215700 23822 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:30.150128 23829 consensus_queue.cc:260] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.271186 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.210501 23724 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:19:30.263592 23831 raft_consensus.cc:3055] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:19:30.275117 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 99303.2us
I20260709 13:19:30.275422 18341 raft_consensus.cc:2410] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:19:30.272696 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 101656us
I20260709 13:19:30.286988 19027 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:30.296015 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.262735 23468 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:19:30.265260 23835 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
I20260709 13:19:30.218592 23627 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:19:30.285485 19025 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:30.237002 23473 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.284443 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:30.320427 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.260468 23769 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:19:30.344754 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:30.346418 23846 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:19:30.347203 18384 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:30.349174 23012 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:30.349748 23012 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.350275 23012 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:30.350919 23845 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:19:30.352626 23844 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:19:30.353798 23549 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:30.267279 23642 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:19:30.354822 23683 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:30.341828 23500 consensus_meta.cc:287] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.001s
I20260709 13:19:30.358842 23500 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.363305 23719 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:30.370133 23500 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:30.372669 23641 consensus_meta.cc:287] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.078s	user 0.007s	sys 0.006s
I20260709 13:19:30.285562 23831 raft_consensus.cc:740] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:30.373483 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:30.276288 22894 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.373579 23692 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.281646 23148 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:19:30.314433 23787 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:19:30.320295 23504 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.375097 23717 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.320623 23823 consensus_queue.cc:1059] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:19:30.361763 18411 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:30.431725 23853 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:30.432935 23820 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:30.433346 23820 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:30.434471 23823 raft_consensus.cc:3055] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:30.434897 23823 raft_consensus.cc:740] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:30.435714 19057 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
W20260709 13:19:30.418591 23732 consensus_meta.cc:287] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.774s	user 0.016s	sys 0.000s
I20260709 13:19:30.438283 23732 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.439531 18343 raft_consensus.cc:1240] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:19:30.440637 23732 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:30.317711 18487 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
W20260709 13:19:30.385133 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.311866 23468 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.400804 18341 raft_consensus.cc:2393] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:19:30.400795 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 115414us
I20260709 13:19:30.386072 23825 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.426613 18419 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:19:30.430485 23848 log.cc:927] Time spent T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:19:30.444293 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:30.442672 23468 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:30.461206 18410 raft_consensus.cc:2368] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 13. Current term is 14.
I20260709 13:19:30.394858 23641 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.463085 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:30.452983 23713 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.476574 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:30.480238 23851 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:30.480793 23851 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:30.481163 23851 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.484426 23715 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.460608 23732 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.486933 18382 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:30.487854 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 246466us
I20260709 13:19:30.489362 18338 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:30.490511 18307 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:30.495386 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 113873us
I20260709 13:19:30.496022 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:30.496583 18490 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:30.502255 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:30.502981 18341 raft_consensus.cc:2393] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:19:30.503618 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.456287 23825 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.467208 23852 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:19:30.494946 23776 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:30.494388 23849 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.435765 23823 consensus_queue.cc:260] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.527534 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:30.487928 23713 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.530732 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:30.532150 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:30.532512 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 207975us
I20260709 13:19:30.533005 18486 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:30.534441 19027 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:30.537103 19027 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:30.461902 23831 consensus_queue.cc:260] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.558163 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:30.561904 18414 raft_consensus.cc:2393] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:30.493538 23732 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:30.560406 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 69963.6us
I20260709 13:19:30.525550 23653 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:30.565044 18419 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:30.566509 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.529246 23776 raft_consensus.cc:697] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:19:30.559927 23271 consensus_meta.cc:287] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.926s	user 0.007s	sys 0.007s
W20260709 13:19:30.567384 23690 consensus_meta.cc:287] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.202s	user 0.012s	sys 0.001s
I20260709 13:19:30.580052 18341 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:19:30.559154 23639 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:30.529649 23849 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.569730 22894 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:30.593767 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 1171) took 1515 ms. Trace:
I20260709 13:19:30.605172 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:30.616231 18342 rpcz_store.cc:276] 0709 13:19:29.078696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.087746 (+  9050us) service_pool.cc:224] Handling call
0709 13:19:30.593603 (+1505857us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400417dd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:30.593714 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344897280}
I20260709 13:19:30.609812 18340 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:19:30.589618 18414 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:30.617822 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.618636 18342 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:30.596947 18336 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:30.591086 23722 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.592510 23851 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.571244 23839 raft_consensus.cc:476] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Not starting pre-election -- already a leader
I20260709 13:19:30.579727 23473 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:30.595736 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:30.581305 23798 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:30.574802 23789 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:30.629663 18417 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:30.629629 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.592651 23579 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.623160 18490 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:30.613394 18492 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:30.594648 23776 consensus_queue.cc:237] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.584805 23823 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.608296 23852 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:30.608114 23732 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:30.632843 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:30.587106 23690 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:30.639171 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.645488 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:30.646390 18414 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:30.639683 18384 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:30.610312 23717 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:30.606388 23768 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:30.636291 18457 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:30.620657 23639 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:19:30.665459 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:30.609583 23713 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:30.609617 23791 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:30.611790 23849 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:30.582108 23721 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:30.631811 18335 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:19:30.657478 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 151043us
I20260709 13:19:30.635939 23857 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.613216 23468 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.611632 23012 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.676218 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:30.697780 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 160749us
I20260709 13:19:30.627215 23722 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.702293 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:30.697571 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:30.706488 18415 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:30.707805 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:30.708052 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:30.708630 18490 raft_consensus.cc:2368] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15.
I20260709 13:19:30.710034 18307 leader_election.cc:400] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15.
I20260709 13:19:30.711313 18489 raft_consensus.cc:1240] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:30.714784 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.715129 18491 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:30.715011 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:30.718735 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:30.675794 23713 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.723500 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.724251 18336 raft_consensus.cc:2393] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:30.673228 23716 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:30.726161 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:30.727099 18490 raft_consensus.cc:2393] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:30.704358 23717 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.738956 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:30.741344 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:30.744117 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.744716 18335 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:19:30.744796 18384 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:30.710613 23487 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:30.751284 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:30.745877 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 253860us
I20260709 13:19:30.747900 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.748616 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:30.753435 18489 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.690486 23861 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:19:30.752584 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:30.755306 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:30.756224 18414 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:30.756623 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.773450 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:30.757236 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:30.774459 18484 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:30.755522 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:30.775483 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:30.775982 18490 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:30.759325 23784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.034s	sys 0.014s
I20260709 13:19:30.721781 23852 consensus_queue.cc:1059] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:19:30.702715 23721 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.779075 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:30.779753 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.795781 18342 raft_consensus.cc:2393] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 8: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:19:30.777290 23784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.034s	sys 0.014s
I20260709 13:19:30.752599 23716 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:30.705775 23857 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.748883 23869 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:30.789698 23839 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:30.785766 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.785946 23877 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:30.786695 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:30.787572 19057 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:30.802734 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:30.788759 23683 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:30.791730 18489 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 8.
I20260709 13:19:30.730105 23863 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:19:30.730845 23713 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.807896 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:30.799799 18336 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:30.803304 19056 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:30.805610 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:30.672971 23768 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.774184 23798 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:30.813375 23865 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:30.813024 23798 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.772814 23473 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:30.816350 23798 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:30.778789 23822 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:30.820544 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:30.821216 19057 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:30.748706 23732 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:19:30.810676 18489 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.812144 18337 raft_consensus.cc:2410] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:30.811780 23716 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.777825 23873 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:30.817369 19062 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.817610 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:30.749709 23717 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:30.828851 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.803752 18492 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:30.804970 23683 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:30.819447 23869 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:30.823488 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.821384 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:30.840919 19057 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:30.840437 18484 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:30.816747 23647 consensus_meta.cc:287] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.904s	user 0.006s	sys 0.002s
I20260709 13:19:30.846621 19056 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:30.850771 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:30.851171 18342 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:30.839416 23717 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:30.852837 18336 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 11: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:30.852962 18416 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:30.854282 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:30.854975 18489 raft_consensus.cc:2410] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:19:30.833829 23851 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:30.867432 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:30.849066 23683 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.867921 18484 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:30.871335 18490 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:30.872274 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:30.873674 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 423702us
I20260709 13:19:30.874419 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:30.875082 23807 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:30.875808 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 103855us
I20260709 13:19:30.877600 18336 raft_consensus.cc:2393] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 13: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:30.878043 18490 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:30.852792 23690 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:30.880357 19025 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:30.884040 18489 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:30.886756 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.885605 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:30.888746 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 137565us
I20260709 13:19:30.889696 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:30.873674 23791 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:30.850426 23647 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.891357 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.891376 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:30.887130 18382 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:30.897580 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:30.902199 23807 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:30.903110 23866 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:19:30.904450 23776 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:30.906388 23774 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:30.936432 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:30.923599 18336 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 15: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:30.923225 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1243) took 1640 ms. Trace:
I20260709 13:19:30.937661 19055 rpcz_store.cc:276] 0709 13:19:29.282844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.282976 (+   132us) service_pool.cc:224] Handling call
0709 13:19:29.293602 (+ 10626us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.442695 (+149093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.442729 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.622164 (+1179435us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b2c0004d028. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:19:30.622552 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.771755 (+149203us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:30.771792 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.771910 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.907676 (+135766us) raft_consensus.cc:1685] finished
0709 13:19:30.907708 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.923152 (+ 15444us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46490,"raft.queue_time_us":68898,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":7907,"spinlock_wait_cycles":4901120,"thread_start_us":237765,"threads_started":2,"wal-append.queue_time_us":224468}
I20260709 13:19:30.938915 18412 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:19:30.939283 23721 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:30.939666 23647 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:30.940303 23647 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:30.940686 23647 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.941001 23647 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:30.887280 23468 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:30.912032 23722 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:30.886835 23863 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:19:30.943531 23719 raft_consensus.cc:3055] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:30.943980 23719 raft_consensus.cc:740] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:30.935999 23859 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:19:30.936275 23873 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.946478 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:30.946421 23873 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.948509 23873 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:30.949083 23647 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:30.949535 23692 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:30.950310 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:30.933475 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:30.933367 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 46290.7us
I20260709 13:19:30.952548 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:30.953150 18490 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.954027 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.954589 18336 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:30.961753 23468 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:30.964205 23012 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:30.964556 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.965271 18342 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:30.965639 23647 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:30.966107 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:30.966650 18342 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.967342 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:30.968412 18458 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:30.930258 23717 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:30.974771 19025 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:30.957592 23874 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:19:30.977394 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:30.986227 18336 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.981025 18490 raft_consensus.cc:2468] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:30.982925 18342 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:30.995837 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.996964 18342 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:30.955395 23807 raft_consensus.cc:697] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:30.995896 19025 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:30.996959 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:31.006068 18490 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:30.977018 18382 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:31.000746 23871 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:19:31.008149 18490 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:31.001324 18487 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:31.001385 23713 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.008900 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:30.971711 23799 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.016388 23799 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.021031 23468 raft_consensus.cc:2804] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:31.004711 23861 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:31.022063 23861 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:31.022500 23861 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:31.027127 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 50173.6us
I20260709 13:19:31.001315 23719 consensus_queue.cc:260] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.030130 23776 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:31.030786 23776 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:31.030908 23719 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.034349 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:30.991717 23859 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:31.035512 18342 raft_consensus.cc:2393] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 16: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:30.991142 23863 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:31.040311 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.044260 18335 raft_consensus.cc:2410] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:19:31.047081 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:31.047840 18342 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:31.052109 22894 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.052825 22894 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.055649 22894 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.060567 19062 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:31.032063 23776 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.068468 23799 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:31.070631 18487 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:19:31.072691 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 59158.5us
I20260709 13:19:31.083751 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:31.084476 18487 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:31.075968 23468 raft_consensus.cc:697] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:31.074090 23762 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:31.083215 23768 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:31.075522 23851 consensus_queue.cc:1059] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:19:31.183218 18410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2446) took 1224 ms. Trace:
I20260709 13:19:31.185145 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:31.186409 18484 raft_consensus.cc:1240] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:31.190102 18342 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:31.188225 18410 rpcz_store.cc:276] 0709 13:19:29.958572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.963834 (+  5262us) service_pool.cc:224] Handling call
0709 13:19:31.182988 (+1219154us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54003638d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:31.183158 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712871680}
W20260709 13:19:31.195626 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 227290us
I20260709 13:19:31.195844 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:31.196408 18492 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:31.094077 23863 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.087s
I20260709 13:19:31.196395 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:31.197885 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:31.199501 18307 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:31.200975 18382 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:31.186534 23791 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:31.204871 18307 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:31.196889 23895 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:19:31.210777 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:31.211997 18487 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
W20260709 13:19:31.217331 23889 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:19:31.218094 23692 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:31.218673 23887 log.cc:927] Time spent T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:19:31.218729 23692 raft_consensus.cc:697] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:31.219794 23692 consensus_queue.cc:237] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.118165 23807 consensus_queue.cc:237] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:31.226766 23892 log.cc:927] Time spent T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:19:31.213541 23012 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:31.227511 23012 raft_consensus.cc:697] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:31.228346 23012 consensus_queue.cc:237] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.230156 23468 consensus_queue.cc:237] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.118755 23762 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.238683 18492 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:31.204850 23719 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:31.290158 18382 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:31.290617 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:31.291682 23693 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:31.291971 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:31.294554 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.295585 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:31.202847 23716 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:31.212014 23791 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.208048 23579 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:31.300531 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.295313 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 49406.7us
I20260709 13:19:31.296346 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:31.313227 23693 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:31.313637 23693 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:31.314453 23693 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.315780 23693 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:31.317232 23683 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.319463 23683 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.296365 18342 raft_consensus.cc:2393] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 13: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:31.296504 18487 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:31.336222 18492 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:31.336467 18336 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
W20260709 13:19:31.337177 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 45332.1us
I20260709 13:19:31.311267 22894 raft_consensus.cc:2804] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:31.337582 18493 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:19:31.328743 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 316604us
I20260709 13:19:31.344233 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:31.352032 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2636) took 1114 ms. Trace:
I20260709 13:19:31.353211 18382 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:31.354254 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:31.339609 23876 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:31.342919 23653 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:31.367835 18414 raft_consensus.cc:1240] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:31.367041 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.360823 18336 rpcz_store.cc:276] 0709 13:19:30.237667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.351029 (+1113362us) service_pool.cc:224] Handling call
0709 13:19:31.351396 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.351614 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.351654 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:31.351721 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:31.351764 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.351834 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.351963 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.326823 23716 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.357561 23898 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:31.369833 23807 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:19:31.372037 23876 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:31.366735 23823 consensus_meta.cc:287] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.000s
I20260709 13:19:31.367323 23869 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:31.380033 23762 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.393311 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2637) took 1146 ms. Trace:
I20260709 13:19:31.384603 18487 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:31.386526 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:31.394893 18410 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:31.363261 23579 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:31.362360 22894 raft_consensus.cc:697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:31.395799 18382 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:31.393746 18336 rpcz_store.cc:276] 0709 13:19:30.247329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.372668 (+1125339us) service_pool.cc:224] Handling call
0709 13:19:31.392745 (+ 20077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.392923 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.392949 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:31.392988 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:31.393029 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.393099 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.393242 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.392030 23693 consensus_queue.cc:1059] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:19:31.391274 23898 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.392386 23869 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.417151 23869 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.417572 23898 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.413458 23719 raft_consensus.cc:697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:31.429034 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:31.387135 23468 consensus_queue.cc:1059] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:19:31.388695 23837 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:19:31.386837 23721 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:19:31.413735 23776 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:31.458127 18336 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:31.465716 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:31.413473 23893 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:19:31.387212 23861 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.480770 18457 leader_election.cc:400] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 13. Current term is 14.
I20260709 13:19:31.481215 18457 leader_election.cc:403] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:31.483680 18457 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:31.425465 23869 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.489972 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.478844 23776 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:31.490998 18336 raft_consensus.cc:2393] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 13: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:31.487310 22894 consensus_queue.cc:237] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.484330 23898 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 13. Current term is 14.
I20260709 13:19:31.493589 23716 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.497877 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.498698 18336 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 15: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:31.499789 23716 consensus_queue.cc:1059] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:31.500890 23716 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:31.501266 23716 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:31.501686 23716 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:31.499523 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.505880 23719 consensus_queue.cc:237] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.523900 18336 raft_consensus.cc:2376] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12. Re-sending same reply.
I20260709 13:19:31.525243 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.503391 23776 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.504837 23869 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:31.501945 23876 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:31.506907 18410 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:19:31.533576 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.533802 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:31.540313 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.501278 23861 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.537834 18336 raft_consensus.cc:2393] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:31.546312 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:31.548753 18308 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:31.544682 23721 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.550746 18308 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:31.552846 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:31.558049 18344 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.553007 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:31.553277 18340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 1182) took 1373 ms (client timeout 1700 ms). Trace:
I20260709 13:19:31.561383 18490 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:31.561443 18340 rpcz_store.cc:269] 0709 13:19:30.179546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.179707 (+   161us) service_pool.cc:224] Handling call
0709 13:19:31.553068 (+1373361us) spinlock_profiling.cc:243] Waited 57.4 ms on lock 0x7b54004182d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:31.553195 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132106496}
I20260709 13:19:31.579428 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.582908 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.554909 23693 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:31.556061 23774 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:31.588447 23774 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:31.589495 23774 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.590728 23774 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:31.591144 18340 raft_consensus.cc:1240] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:31.556571 23861 raft_consensus.cc:3055] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:31.591805 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 2295) took 1319 ms. Trace:
I20260709 13:19:31.592094 23861 raft_consensus.cc:740] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:31.592272 18340 rpcz_store.cc:276] 0709 13:19:30.272174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.590631 (+1318457us) service_pool.cc:224] Handling call
0709 13:19:31.590970 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.591562 (+   592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.591750 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.593142 23861 consensus_queue.cc:260] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.593998 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2644) took 1250 ms. Trace:
I20260709 13:19:31.594415 23861 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.594370 18340 rpcz_store.cc:276] 0709 13:19:30.343286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.593200 (+1249914us) service_pool.cc:224] Handling call
0709 13:19:31.593512 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.593676 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.593703 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:31.593745 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:31.593777 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.593829 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.593950 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.580497 23721 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.595780 18340 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:31.596369 23825 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.597533 23825 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.599658 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2530) took 1108 ms. Trace:
I20260709 13:19:31.600039 18419 rpcz_store.cc:276] 0709 13:19:30.491136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.491398 (+   262us) service_pool.cc:224] Handling call
0709 13:19:30.508539 (+ 17141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.571299 (+ 62760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.599411 (+1028112us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b54000a7dd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:31.599587 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129426176}
I20260709 13:19:31.596446 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2646) took 1252 ms. Trace:
I20260709 13:19:31.603829 23148 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.604089 18340 rpcz_store.cc:276] 0709 13:19:30.343899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.595367 (+1251468us) service_pool.cc:224] Handling call
0709 13:19:31.595639 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.596239 (+   600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.596402 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.604427 23148 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.607538 23642 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:31.607650 23823 raft_consensus.cc:3055] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:31.608075 23823 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:31.548882 23692 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:31.605715 18340 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:31.609719 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:31.608934 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 1072) took 2440 ms. Trace:
W20260709 13:19:31.612273 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.550688 23579 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:31.614995 18416 rpcz_store.cc:276] 0709 13:19:29.168337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.168485 (+   148us) service_pool.cc:224] Handling call
0709 13:19:29.186368 (+ 17883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.856496 (+1670128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.608696 (+752200us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54000a82d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:31.608857 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3832085376}
I20260709 13:19:31.616269 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 2300) took 1235 ms. Trace:
I20260709 13:19:31.617898 18340 rpcz_store.cc:276] 0709 13:19:30.380511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.605071 (+1224560us) service_pool.cc:224] Handling call
0709 13:19:31.605395 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.615963 (+ 10568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.616198 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.622305 18490 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:31.630640 18344 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:31.631633 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2632) took 1449 ms. Trace:
I20260709 13:19:31.632121 18344 rpcz_store.cc:276] 0709 13:19:30.182441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.201380 (+ 18939us) service_pool.cc:224] Handling call
0709 13:19:31.552703 (+1351323us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b5800002a98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3ea20a0 00007f40a3ea1984 00007f409d41c6d4 00007f409d41c662
0709 13:19:31.631554 (+ 78851us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17309952}
W20260709 13:19:31.635172 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 151553us
I20260709 13:19:31.614053 23692 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.639642 18340 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:31.640662 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 2301) took 1227 ms. Trace:
I20260709 13:19:31.638985 18382 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:31.641476 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:31.654721 18340 rpcz_store.cc:276] 0709 13:19:30.413612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.619263 (+1205651us) service_pool.cc:224] Handling call
0709 13:19:31.639421 (+ 20158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.640329 (+   908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.640594 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.641852 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:31.645788 18418 raft_consensus.cc:1240] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:31.608982 23823 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.653789 18344 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:31.661659 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37928 (request call id 2305) took 1223 ms. Trace:
I20260709 13:19:31.662118 18344 rpcz_store.cc:276] 0709 13:19:30.438532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.634212 (+1195680us) service_pool.cc:224] Handling call
0709 13:19:31.638523 (+  4311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.661412 (+ 22889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.661607 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.668227 23148 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.669938 23579 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.617448 23825 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.670614 18340 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:31.731801 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:31.732980 18344 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:31.731839 23823 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:31.737819 18340 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:31.692032 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.694365 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:31.647259 23692 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:31.740732 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:31.741835 18487 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:31.744737 23825 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.665337 23499 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:31.757718 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:31.672794 23857 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:31.764750 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.765398 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.767434 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.772290 23831 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:31.774053 23499 raft_consensus.cc:697] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:31.775341 23499 consensus_queue.cc:237] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.760716 23716 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.760514 23908 consensus_queue.cc:1059] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:19:31.780320 23716 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:31.780880 23908 raft_consensus.cc:3055] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:31.781296 23908 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:31.781936 23721 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.766462 23796 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:31.782207 23908 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.754905 23791 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.782868 23796 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:31.783281 23796 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.767006 18487 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:19:31.789388 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 238708us
I20260709 13:19:31.790304 18417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2525) took 1646 ms. Trace:
I20260709 13:19:31.790586 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2635) took 1577 ms. Trace:
I20260709 13:19:31.790678 18417 rpcz_store.cc:276] 0709 13:19:30.144260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.144383 (+   123us) service_pool.cc:224] Handling call
0709 13:19:30.177070 (+ 32687us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.630389 (+453319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.790083 (+1159694us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b540032fd54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:31.790253 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040286976}
I20260709 13:19:31.791059 18338 rpcz_store.cc:276] 0709 13:19:30.212943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.259606 (+ 46663us) service_pool.cc:224] Handling call
0709 13:19:30.282303 (+ 22697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.490009 (+207706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.789780 (+1299771us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540007f654. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:31.790526 (+   746us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475642752}
I20260709 13:19:31.797132 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:31.797674 18344 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:31.802135 18485 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:31.808005 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:31.810489 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.794564 23721 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.813187 23721 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.814393 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2527) took 1426 ms. Trace:
I20260709 13:19:31.814873 18412 rpcz_store.cc:276] 0709 13:19:30.387790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.387920 (+   130us) service_pool.cc:224] Handling call
0709 13:19:30.414858 (+ 26938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.939381 (+524523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.814113 (+874732us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54000a91d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:31.814337 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1204651264}
I20260709 13:19:31.816797 23721 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.810554 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.818518 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:31.819885 18338 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:31.819320 18417 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:31.826817 18344 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
W20260709 13:19:31.827880 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.828226 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.828910 18344 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
W20260709 13:19:31.841274 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.845820 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:31.819159 23774 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:19:31.849156 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:31.849713 18344 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:31.828531 23641 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.854281 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:31.855125 18417 raft_consensus.cc:2410] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:19:31.856187 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 97223.9us
I20260709 13:19:31.856976 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:31.859663 18412 raft_consensus.cc:1240] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:31.862749 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:31.868127 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.870764 18344 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:31.871248 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:31.872046 18339 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.870536 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:31.874315 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.875914 18344 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:31.877099 22894 consensus_queue.cc:1059] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:31.877983 18384 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:31.878314 22894 raft_consensus.cc:3055] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:31.878834 22894 raft_consensus.cc:740] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:31.877094 18344 raft_consensus.cc:3055] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:31.880319 18344 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:31.881482 18344 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.882758 18344 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:31.883774 18339 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
W20260709 13:19:31.885123 23926 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:19:31.884790 22894 consensus_queue.cc:260] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.885515 18339 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:31.886071 22894 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:31.886461 19053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1495) took 3076 ms (client timeout 1747 ms). Trace:
W20260709 13:19:31.886906 19053 rpcz_store.cc:269] 0709 13:19:28.810191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.810316 (+   125us) service_pool.cc:224] Handling call
0709 13:19:31.886226 (+3075910us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b540055a5d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:31.886384 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5222007040}
I20260709 13:19:31.891419 23908 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:31.895334 23796 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.897467 23796 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:31.901005 18344 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:19:31.901621 18344 pending_rounds.cc:85] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 7
I20260709 13:19:31.902201 18344 pending_rounds.cc:107] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:19:31.902868 18344 raft_consensus.cc:2889] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:31.902069 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:31.893843 23922 log.cc:927] Time spent T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:19:31.879314 23878 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:31.905036 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:31.907511 22894 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:31.907882 22894 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.908464 22894 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:31.909089 18384 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:31.910488 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.900976 23796 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:31.903258 23012 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:31.915345 22894 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.907038 23713 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:31.913877 23012 raft_consensus.cc:697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:31.917423 18340 raft_consensus.cc:2410] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:19:31.902781 23504 consensus_queue.cc:1059] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:19:31.918859 22894 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.912262 23868 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:31.912856 23878 raft_consensus.cc:697] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:31.923619 18384 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:31.917855 23693 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.925076 23713 raft_consensus.cc:697] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:31.926024 23693 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.925307 23500 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:19:31.927214 23713 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.926164 23657 raft_consensus.cc:3055] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:31.929421 23683 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:31.929699 23657 raft_consensus.cc:740] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:31.930847 23657 consensus_queue.cc:260] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.931911 23657 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.941659 23504 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:31.928318 23868 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:31.942389 23504 consensus_queue.cc:1243] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:19:31.943192 23853 raft_consensus.cc:3055] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:31.943928 23853 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:31.944332 23746 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.944887 23746 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.947773 23746 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.948750 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2452) took 1252 ms. Trace:
I20260709 13:19:31.951892 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:31.952459 18493 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.954082 23012 consensus_queue.cc:237] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.954255 23820 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.955545 23820 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:31.942957 23868 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:31.949262 18484 rpcz_store.cc:276] 0709 13:19:30.696651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.872276 (+175625us) service_pool.cc:224] Handling call
0709 13:19:31.186085 (+313809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:31.192681 (+  6596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.948464 (+755783us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400137250. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:31.948659 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691625856}
I20260709 13:19:31.964488 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:31.962049 23853 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.940155 23711 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:31.982730 18493 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:31.967033 23693 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.970068 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:31.918807 23796 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.984035 18410 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 18.
I20260709 13:19:31.958336 23878 consensus_queue.cc:237] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.973181 23776 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.990869 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:32.005939 18344 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:32.010543 18410 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:32.010612 18339 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:19:32.011251 18339 pending_rounds.cc:85] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 7
I20260709 13:19:32.011545 18339 pending_rounds.cc:107] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:19:32.011822 18339 raft_consensus.cc:2889] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:32.012509 18344 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
I20260709 13:19:31.975952 23683 raft_consensus.cc:697] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:32.013309 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:31.998124 18493 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:19:32.014467 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.985569 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:32.013784 18344 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:31.986346 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:32.017616 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:32.018662 18493 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:31.964432 23692 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:31.997152 23853 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:32.004297 23713 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:31.984064 23647 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:19:32.017002 23776 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:32.043859 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.018710 23500 consensus_queue.cc:1059] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:19:32.020538 23729 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:32.046490 18492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2867) took 1017 ms. Trace:
I20260709 13:19:32.048363 23500 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:32.048756 23776 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:31.997279 23768 consensus_queue.cc:1059] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:19:32.048784 23937 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:19:32.055737 18492 rpcz_store.cc:276] 0709 13:19:31.029418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.367756 (+338338us) service_pool.cc:224] Handling call
0709 13:19:31.368000 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.401125 (+ 33125us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:19:31.401460 (+   335us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.518982 (+117522us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.519154 (+   172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:31.519208 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:31.519266 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.889695 (+370429us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b180034e640. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:19:32.046190 (+156495us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b54002201d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:32.046281 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.046415 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23821,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":69833,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":147870208,"thread_start_us":116815,"threads_started":1,"wal-append.queue_time_us":147214}
I20260709 13:19:32.025120 23938 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:19:32.063804 18488 raft_consensus.cc:3060] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.065986 23796 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:32.067052 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:32.067816 18492 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 16: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:32.070566 23876 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:32.071102 23876 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.073107 23876 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:32.074911 23729 raft_consensus.cc:697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:32.075835 18492 raft_consensus.cc:1240] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:32.076169 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:32.076926 18484 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:31.984911 23711 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.078289 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:32.033406 23713 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.082967 19053 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:19:32.085593 19053 pending_rounds.cc:85] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 10
I20260709 13:19:32.085945 19053 pending_rounds.cc:107] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:19:32.086237 19053 raft_consensus.cc:2889] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:32.087958 23935 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:19:32.087918 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:32.020699 23823 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:19:32.059922 23012 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:32.059753 23500 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:32.101094 18488 raft_consensus.cc:1275] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:32.114032 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:32.092639 23713 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:32.114094 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1209) took 2679 ms. Trace:
I20260709 13:19:32.114850 18418 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 18.
I20260709 13:19:32.093554 23807 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:32.119323 18416 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:19:32.120062 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:32.121037 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.123560 19062 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:32.075855 23729 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:32.115406 23727 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:19:32.125316 18413 raft_consensus.cc:1240] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:32.083279 23796 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:19:32.093348 23876 consensus_queue.cc:1059] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:19:32.119195 18488 rpcz_store.cc:276] 0709 13:19:29.431147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.431658 (+   511us) service_pool.cc:224] Handling call
0709 13:19:29.432454 (+   796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.063516 (+2631062us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b58007ae1d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee380aa 00007f409eeba447 00007f409eed2fe7 00007f409eed47de 00007f409eedeb49 00007f409eedf416 00007f409eedbd8f 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4
0709 13:19:32.110099 (+ 46583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.110351 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3107197184}
I20260709 13:19:32.079310 23936 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:19:32.130060 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:32.116308 23012 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:32.122349 23807 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:32.125471 23858 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.165387 22894 raft_consensus.cc:3055] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:32.165783 22894 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:32.147140 19058 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1263) took 2057 ms. Trace:
I20260709 13:19:32.155701 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:32.145385 18487 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:19:32.166497 22894 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.159646 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:32.167392 19058 rpcz_store.cc:276] 0709 13:19:30.089696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.211281 (+121585us) service_pool.cc:224] Handling call
0709 13:19:30.241543 (+ 30262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.402035 (+160492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.402068 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.419791 (+ 17723us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.658257 (+238466us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:30.658646 (+   389us) log.cc:844] Serialized 14 byte log entry
0709 13:19:30.658897 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.146655 (+1487758us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b54001473d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:32.146726 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:32.146785 (+    59us) raft_consensus.cc:1685] finished
0709 13:19:32.146897 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.147065 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27551,"prepare.queue_time_us":208,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":112019,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":6279,"spinlock_wait_cycles":138058112,"thread_start_us":221912,"threads_started":1,"wal-append.queue_time_us":312941,"wal-append.run_cpu_time_us":8946,"wal-append.run_wall_time_us":1287766}
I20260709 13:19:32.169358 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:32.155510 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:32.162266 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:32.170409 18339 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:32.167649 22894 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:32.176760 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.164386 19027 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:32.178407 19027 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:32.137667 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.179912 19062 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:19:32.180958 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.182744 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:32.183861 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:32.184713 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:32.185034 18339 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:19:32.187769 18339 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:32.166060 23807 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.112864 23683 consensus_queue.cc:237] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:32.131567 23746 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:19:32.214763 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:32.220376 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:32.224704 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.226089 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 135860us
I20260709 13:19:32.133561 23500 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.201879 23938 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:19:32.182559 23858 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.214448 23823 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:32.216135 23692 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:32.220639 23796 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:32.244486 19058 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:32.237265 23796 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:32.245628 23500 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:32.270364 23940 log.cc:927] Time spent T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:19:32.281409 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.282042 19058 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:32.292448 19026 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:32.293318 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.294075 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.295974 23953 consensus_queue.cc:1059] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:32.360435 18340 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:32.362215 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.363920 23789 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:32.364547 23789 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:32.369773 23736 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:32.374939 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2524) took 2231 ms. Trace:
I20260709 13:19:32.375368 18411 rpcz_store.cc:276] 0709 13:19:30.143789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.143929 (+   140us) service_pool.cc:224] Handling call
0709 13:19:30.155039 (+ 11110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.431088 (+276049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.374666 (+1943578us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540003ff54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:32.374877 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474873728}
I20260709 13:19:32.297351 23853 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:32.276176 23796 raft_consensus.cc:3060] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:32.275657 23854 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:32.378304 23854 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:32.378746 18340 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:32.379487 23791 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:32.380388 23822 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:32.380861 23822 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:32.222543 23012 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.383291 18340 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:32.317160 18416 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:32.328079 23829 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:32.329624 23898 raft_consensus.cc:3055] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:32.385388 23898 raft_consensus.cc:740] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:32.386024 23854 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:32.336511 23711 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:32.338585 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.354812 19060 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
W20260709 13:19:32.355801 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.356297 23950 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:19:32.388481 18340 raft_consensus.cc:3055] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:32.388217 23822 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.388829 18340 raft_consensus.cc:740] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:32.337868 23954 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:19:32.390519 23822 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:32.386329 23898 consensus_queue.cc:260] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:32.392028 23898 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.392737 23858 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:32.393632 18343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2629) took 2240 ms. Trace:
I20260709 13:19:32.393697 23789 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.394112 18343 rpcz_store.cc:276] 0709 13:19:30.153461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.168271 (+ 14810us) service_pool.cc:224] Handling call
0709 13:19:30.168624 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.439879 (+271255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.393370 (+1953491us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54004187d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:32.393551 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622550400}
I20260709 13:19:32.395577 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53812 (request call id 1180) took 2216 ms. Trace:
I20260709 13:19:32.395948 18337 rpcz_store.cc:276] 0709 13:19:30.178811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.179110 (+   299us) service_pool.cc:224] Handling call
0709 13:19:32.395380 (+2216270us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54000582d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:32.395499 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453207424}
I20260709 13:19:32.389513 18340 consensus_queue.cc:260] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.397930 23691 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.398433 23691 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.400486 23691 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:32.400691 18340 raft_consensus.cc:3060] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.401831 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.402487 19058 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
W20260709 13:19:32.412112 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.412869 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.416057 18339 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:32.396489 23789 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:32.413218 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.435760 18340 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:19:32.436082 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 143715us
I20260709 13:19:32.440281 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:32.444075 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 218199us
I20260709 13:19:32.447052 18342 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:32.442440 23639 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:32.448550 23639 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.448910 23639 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:32.449584 19026 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:32.450850 23853 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:32.452520 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.452423 19027 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:32.454031 23787 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:32.454784 23787 raft_consensus.cc:3055] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:32.455155 23787 raft_consensus.cc:740] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:32.456123 23787 consensus_queue.cc:260] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.462419 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:32.463802 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.474051 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:32.514115 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 47374.1us
W20260709 13:19:32.514871 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.440567 23796 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:32.514773 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 47275.3us
I20260709 13:19:32.515372 18484 raft_consensus.cc:2393] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 17: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:32.457784 23787 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:32.520059 18488 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:32.520846 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:32.520977 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:32.523775 18414 raft_consensus.cc:2393] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:32.462270 23639 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.527199 23639 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:32.528538 18491 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:32.522450 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:32.524156 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:32.531230 18335 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 2314) took 1965 ms (client timeout 1869 ms). Trace:
W20260709 13:19:32.531662 18335 rpcz_store.cc:269] 0709 13:19:30.565870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.747646 (+181776us) service_pool.cc:224] Handling call
0709 13:19:32.530983 (+1783337us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b540007f3d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:32.531153 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":668373888}
I20260709 13:19:32.532750 18344 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:19:32.533102 18344 pending_rounds.cc:85] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 10
I20260709 13:19:32.533324 18344 pending_rounds.cc:107] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:19:32.533550 18344 raft_consensus.cc:2889] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:32.539490 23639 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:32.539917 23639 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:32.540282 23639 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:32.540727 23791 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:19:32.542779 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.543296 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.546262 23904 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.546836 23904 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:32.548264 23639 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.548950 23904 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:32.518666 23853 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:32.557457 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:32.561228 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:32.565877 18416 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:32.531454 23825 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.519668 23795 consensus_queue.cc:1059] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:19:32.567672 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.568387 19060 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 18: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:32.538853 19027 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:32.571350 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:32.572825 19026 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:32.520267 23712 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:19:32.578975 18493 raft_consensus.cc:1275] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:32.580749 19058 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:32.518496 23726 consensus_queue.cc:1048] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:19:32.553686 23953 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
W20260709 13:19:32.590540 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.584604 18384 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.013s	sys 0.030s
W20260709 13:19:32.594233 18384 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.014s	sys 0.031s
I20260709 13:19:32.573618 23820 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:32.594511 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 576899us
I20260709 13:19:32.613500 18340 pending_rounds.cc:85] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 12
I20260709 13:19:32.615603 18340 pending_rounds.cc:107] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:19:32.616019 18340 raft_consensus.cc:2889] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:32.601311 23822 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:19:32.600973 23954 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:32.622741 18343 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:32.622853 23876 consensus_queue.cc:1048] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:32.573830 23825 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:32.624540 18341 raft_consensus.cc:2468] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:32.625957 23711 raft_consensus.cc:3055] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:32.626381 23711 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:32.621197 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:32.618927 18418 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:32.629225 18335 raft_consensus.cc:2393] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 17: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:19:32.631383 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.631603 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.633658 18416 raft_consensus.cc:2468] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:19:32.641069 19026 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:32.618712 23958 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:32.654973 23854 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:32.655634 23854 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.658195 23854 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:32.659135 23639 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:32.614101 23796 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:32.661137 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:32.662276 18493 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 16: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:32.582541 23807 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.664649 23807 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:32.665876 23713 consensus_meta.cc:287] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.001s
I20260709 13:19:32.666368 23713 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.667968 23639 raft_consensus.cc:2804] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:32.668512 23713 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:32.668666 23639 raft_consensus.cc:697] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:32.621609 23954 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:32.670353 23823 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:32.669996 23639 consensus_queue.cc:237] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.670854 23823 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.614377 23791 consensus_queue.cc:1059] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:19:32.650815 23712 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:32.651141 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:32.651479 23822 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:32.651890 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:32.644896 23726 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:32.669982 23954 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.644456 23711 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.686520 18343 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:32.674769 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:32.705567 19062 raft_consensus.cc:1240] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:32.708109 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.708642 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.708776 19058 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:32.709419 23936 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:32.709790 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:32.714576 19058 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.708663 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:32.710346 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.710464 23941 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:32.711131 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.712178 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.713104 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:32.713434 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.718884 19027 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:32.766132 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.768198 19060 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:19:32.773294 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 54502us
W20260709 13:19:32.774559 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.775240 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 66674.1us
I20260709 13:19:32.704418 23853 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.778805 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:32.782356 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 359488us
I20260709 13:19:32.715029 23729 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:32.766862 23954 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:32.786873 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.769635 23941 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.780267 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:32.778172 23807 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:32.795210 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:32.804369 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:32.804643 18414 raft_consensus.cc:2393] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 14: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:19:32.800164 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.769412 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.806389 18309 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:32.802856 19058 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:32.809482 18411 raft_consensus.cc:2393] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 10: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:32.671888 23712 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.714298 23822 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.818122 18384 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:32.815295 18309 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:32.817607 19061 raft_consensus.cc:2410] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:19:32.709837 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:32.820600 19053 raft_consensus.cc:2410] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:19:32.821228 18335 raft_consensus.cc:2468] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:32.825439 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:32.838248 18343 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 18.
I20260709 13:19:32.843619 18384 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:32.804529 23711 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:32.792234 23941 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:32.791277 23959 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:32.853124 18338 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:32.812693 23148 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:19:32.785562 23853 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.817628 23504 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:32.855679 18338 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18. Ops: [15.13-17.14]
I20260709 13:19:32.817376 23691 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:32.791553 23729 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:32.868419 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.843863 23953 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:32.718551 23726 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.856698 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:32.860615 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 1.65694e+06us
I20260709 13:19:32.888571 18411 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:19:32.889659 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.890211 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.861334 18416 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:32.792666 23868 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:19:32.884049 19057 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:32.831038 23549 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:19:32.900295 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:32.901567 18413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2545) took 1032 ms. Trace:
I20260709 13:19:32.905020 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:32.902820 18414 raft_consensus.cc:1240] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:32.904958 18413 rpcz_store.cc:276] 0709 13:19:31.869461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.870238 (+   777us) service_pool.cc:224] Handling call
0709 13:19:31.878714 (+  8476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.125720 (+247006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.901331 (+775611us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540011cbd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:32.901516 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566510976}
I20260709 13:19:32.910027 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.910784 19059 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:32.912439 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.912952 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.913661 19061 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 15: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:32.914433 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:32.916849 19053 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:32.863829 23878 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:32.926517 19059 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 16: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:32.929812 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:32.869853 23653 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:19:32.897935 23504 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:32.897545 23473 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:32.875572 23829 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:19:32.938733 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:32.958434 19056 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:32.960076 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:32.917652 23823 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:32.962329 23964 log.cc:927] Time spent T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:19:32.885663 23953 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.964395 23712 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:32.965161 23504 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:19:32.966320 23962 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:19:32.941696 23500 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.966899 23500 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:32.967427 19056 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
W20260709 13:19:32.967566 23966 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:32.968997 23500 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:32.935799 23904 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:19:32.968379 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.939811 18338 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:32.932467 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:32.944137 19059 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:32.946866 19061 raft_consensus.cc:1275] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:19:32.973799 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 154113us
I20260709 13:19:32.951162 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.934167 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:32.970685 19056 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 15: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:19:32.950204 18458 leader_election.cc:336] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.556s (SENT)
I20260709 13:19:32.923666 23858 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:32.976459 19053 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
W20260709 13:19:32.970118 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 154901us
W20260709 13:19:32.970656 23967 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:32.980078 18309 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:32.984138 18309 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:32.978230 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:32.976970 18458 leader_election.cc:336] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.571s (SENT)
W20260709 13:19:32.998293 18458 connection.cc:256] RPC call timeout handler was delayed by -1.5237369659998876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 13:19:32.999243 18458 connection.cc:256] RPC call timeout handler was delayed by -1.4508369659999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
I20260709 13:19:32.936928 23796 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:32.977967 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.977667 18308 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:32.986215 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:32.993506 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:32.962361 23822 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:32.980243 23925 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:32.980624 23823 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:19:33.034168 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.064358 23691 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:33.065137 23691 consensus_queue.cc:1059] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:33.010151 23898 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.013664 23925 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:33.066941 23898 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.067911 23925 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:33.069094 23925 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:33.010594 23854 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.070004 23854 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.071946 23854 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:33.037405 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:33.049053 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 51864.6us
W20260709 13:19:33.074687 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 88555us
I20260709 13:19:33.005718 23473 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:33.082125 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:33.082551 23959 consensus_queue.cc:1059] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:33.083359 23959 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:33.083669 23959 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:33.084403 23959 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.085564 23959 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:33.019987 23796 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:33.087934 23973 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:19:33.089687 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:33.074391 23691 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:33.090549 23691 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.090752 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:33.091811 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:33.092790 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:33.094972 23853 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:33.090901 23691 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.101745 23500 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:33.102353 23500 raft_consensus.cc:697] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:33.103246 23500 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.106799 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:33.109483 23953 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:33.110695 23946 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.964s	user 0.000s	sys 0.005s
W20260709 13:19:33.075659 23951 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:33.087872 23796 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:32.986006 23858 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.008651 18308 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:33.093755 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:33.126106 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:33.130074 18336 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:33.133169 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 124565us
I20260709 13:19:33.114128 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:33.151167 18339 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:33.154383 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:33.154641 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:33.157414 18339 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:33.158720 18339 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:33.159701 18339 raft_consensus.cc:3055] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:33.161820 18339 raft_consensus.cc:740] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:33.152021 23473 raft_consensus.cc:3055] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:33.167176 18336 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:33.168483 18336 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:33.162585 18339 consensus_queue.cc:260] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:33.174468 18339 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.177618 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:33.178381 18414 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:33.166921 23473 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:33.166811 23729 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:33.177026 23981 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:33.191630 23473 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.197290 23473 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:33.205456 23825 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:33.210415 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 1083) took 1094 ms. Trace:
I20260709 13:19:33.219452 18339 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:19:33.230639 18339 pending_rounds.cc:85] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 7
I20260709 13:19:33.231313 18339 pending_rounds.cc:107] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:19:33.231928 18339 raft_consensus.cc:2889] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:33.230450 18418 rpcz_store.cc:276] 0709 13:19:32.115766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.120807 (+  5041us) service_pool.cc:224] Handling call
0709 13:19:32.121077 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.630319 (+509242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.210121 (+579802us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54003ec1d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:33.210343 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144500992}
I20260709 13:19:33.193569 23981 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:33.217907 23963 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
W20260709 13:19:33.241176 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.279649 23878 raft_consensus.cc:697] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:33.240439 23981 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:33.329154 23858 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:33.362231 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.337576 23978 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 13:19:33.379516 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.375921 23954 consensus_meta.cc:287] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 13:19:33.390851 19055 raft_consensus.cc:2410] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
W20260709 13:19:33.402853 23983 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:19:33.403460 23985 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:19:33.407284 18307 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.547s (SENT) [suppressed 29 similar messages]
I20260709 13:19:33.384660 23878 consensus_queue.cc:237] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:33.387416 23807 consensus_meta.cc:287] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.005s
I20260709 13:19:33.450320 23807 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:33.460000 23941 consensus_meta.cc:287] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.000s
I20260709 13:19:33.460644 23941 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:33.413661 18458 connection.cc:256] RPC call timeout handler was delayed by -1.3003327940000418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3068s for a response
W20260709 13:19:33.482012 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 479188us
I20260709 13:19:33.484985 18416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:33.487478 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:33.502293 18416 raft_consensus.cc:606] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:33.502615 18416 raft_consensus.cc:614] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:33.488703 18411 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:19:33.489657 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:33.503129 18309 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:33.491693 23986 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:19:33.499239 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.503911 18458 connection.cc:256] RPC call timeout handler was delayed by -1.0692369659998349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24080000000000001s for a response
I20260709 13:19:33.508306 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:33.512316 18309 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:33.513281 23986 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.523497 23825 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:33.528503 23825 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:33.527290 23986 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:33.519614 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:33.531905 23921 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:33.532434 23921 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:33.532896 23921 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.534638 23981 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.536768 23981 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:33.513422 23982 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:33.540196 23982 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:33.540593 23982 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:33.542228 23898 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:33.546128 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2640) took 3278 ms. Trace:
I20260709 13:19:33.511307 23979 raft_consensus.cc:2764] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:19:33.551167 18341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 2307) took 3112 ms (client timeout 1773 ms). Trace:
W20260709 13:19:33.551712 18341 rpcz_store.cc:269] 0709 13:19:30.439111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.586929 (+147818us) service_pool.cc:224] Handling call
0709 13:19:33.550992 (+2964063us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b5400267ad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:33.551102 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4585445248}
I20260709 13:19:33.554296 18339 raft_consensus.cc:3060] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:33.558456 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.559239 23904 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.559795 23904 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.546670 18342 rpcz_store.cc:276] 0709 13:19:30.267468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.373094 (+1105626us) service_pool.cc:224] Handling call
0709 13:19:31.380972 (+  7878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.447562 (+1066590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.545746 (+1098184us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540028e6d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:33.546030 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451030784}
I20260709 13:19:33.562918 18342 raft_consensus.cc:3055] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:33.563786 18342 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:33.565092 18338 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:33.564886 18342 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.566339 18342 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.569564 23904 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:33.570252 23904 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.570334 23955 raft_consensus.cc:3055] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:33.570917 23955 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:33.571758 23955 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.572943 23955 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:33.573598 23683 raft_consensus.cc:3055] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:33.573995 23683 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:33.574174 23904 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:33.562927 23975 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.601s	user 0.004s	sys 0.021s
I20260709 13:19:33.579991 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:33.580636 18340 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:33.581594 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:33.582816 18340 raft_consensus.cc:2393] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:33.583550 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:33.553777 18341 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:33.584936 18338 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:19:33.574833 23683 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:33.587280 23941 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:33.599538 23823 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:33.600777 23823 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.510408 23691 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.604809 19026 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:33.605540 23876 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.605664 23954 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.606048 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.606371 23639 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:33.606325 23954 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.606900 23639 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:33.607427 23639 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.608225 23691 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:33.608893 23807 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:33.609429 23807 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.606917 23712 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.619796 23795 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.620510 23795 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.627946 18488 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:33.630633 18489 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:33.632390 18485 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:19:33.619944 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.638576 19027 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:33.643442 23958 raft_consensus.cc:2804] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:33.644649 23958 raft_consensus.cc:697] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:33.645702 23958 consensus_queue.cc:237] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:33.650060 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 44573.3us
I20260709 13:19:33.652838 18414 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:33.584057 18340 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:33.654548 23638 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:33.660990 23500 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.661791 23500 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:33.693958 23976 log.cc:927] Time spent T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.683s	user 0.014s	sys 0.004s
I20260709 13:19:33.695477 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1244) took 1070 ms. Trace:
W20260709 13:19:33.697105 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 177597us
I20260709 13:19:33.695978 18490 rpcz_store.cc:276] 0709 13:19:32.625552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.625703 (+   151us) service_pool.cc:224] Handling call
0709 13:19:32.626040 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.626372 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.626407 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:32.626820 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:19:32.831942 (+205122us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:32.831981 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.832042 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.693244 (+861202us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:33.695080 (+  1836us) raft_consensus.cc:1685] finished
0709 13:19:33.695135 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.695407 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1043,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":12672,"spinlock_wait_cycles":16608000,"thread_start_us":204758,"threads_started":1,"wal-append.queue_time_us":309827}
W20260709 13:19:33.701001 23972 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.546s	user 0.003s	sys 0.007s
I20260709 13:19:33.702409 18337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2670) took 1100 ms. Trace:
I20260709 13:19:33.702888 18337 rpcz_store.cc:276] 0709 13:19:32.602289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.603499 (+  1210us) service_pool.cc:224] Handling call
0709 13:19:32.603776 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.604101 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.604152 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:32.614025 (+  9873us) log.cc:844] Serialized 26 byte log entry
0709 13:19:32.815619 (+201594us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:32.815657 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.815722 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.700414 (+884692us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:33.702092 (+  1678us) raft_consensus.cc:1685] finished
0709 13:19:33.702116 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.702343 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7009,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":13055,"spinlock_wait_cycles":3440640,"thread_start_us":201093,"threads_started":1,"wal-append.queue_time_us":443515}
I20260709 13:19:33.705225 23746 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:33.707527 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 1089) took 1194 ms. Trace:
I20260709 13:19:33.708781 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:33.709596 18411 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
W20260709 13:19:33.711055 18384 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.000s	sys 0.018s
I20260709 13:19:33.710971 19026 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:19:33.711473 18384 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.000s	sys 0.018s
W20260709 13:19:33.711784 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 591853us
I20260709 13:19:33.711936 23820 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:33.712507 23820 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:33.712963 23820 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:33.714674 23974 log.cc:927] Time spent T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.535s	user 0.010s	sys 0.000s
I20260709 13:19:33.715935 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1243) took 1093 ms. Trace:
I20260709 13:19:33.716249 18491 rpcz_store.cc:276] 0709 13:19:32.622398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.622515 (+   117us) service_pool.cc:224] Handling call
0709 13:19:32.622832 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:32.623199 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.623229 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:32.623821 (+   592us) log.cc:844] Serialized 52 byte log entry
0709 13:19:32.845277 (+221456us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:32.845321 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.845397 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.714114 (+868717us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:33.715630 (+  1516us) raft_consensus.cc:1685] finished
0709 13:19:33.715653 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.715880 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":470,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":86,"spinlock_wait_cycles":6033664,"thread_start_us":221018,"threads_started":1,"wal-append.queue_time_us":531456}
W20260709 13:19:33.708931 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 70461.6us
I20260709 13:19:33.721395 19027 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:33.724771 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:33.726593 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:33.726557 18458 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:33.727628 18484 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:33.728760 18458 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:33.732596 23957 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:33.733435 23957 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:33.708003 18419 rpcz_store.cc:276] 0709 13:19:32.513371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.513482 (+   111us) service_pool.cc:224] Handling call
0709 13:19:32.513834 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.518366 (+  4532us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:32.527870 (+  9504us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.098778 (+570908us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b18004c3540. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c23a 00007f409eee6a2a
0709 13:19:33.475126 (+376348us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.557824 (+ 82698us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b18004c3540. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:19:33.703701 (+145877us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b2c001026c8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:19:33.704069 (+   368us) log.cc:844] Serialized 26 byte log entry
0709 13:19:33.704249 (+   180us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:33.704492 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.705060 (+   568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.707221 (+  2161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.707267 (+    46us) raft_consensus.cc:1685] finished
0709 13:19:33.707283 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.707461 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23625,"prepare.queue_time_us":6006,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":55,"raft.queue_time_us":14290,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":5090,"spinlock_wait_cycles":48081280,"thread_start_us":370527,"threads_started":1,"wal-append.queue_time_us":859851}
I20260709 13:19:33.740228 18491 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:33.741245 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:33.740062 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.743628 18339 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:33.764545 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:33.765952 18458 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:33.769780 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:33.770819 18485 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:19:33.771497 18485 pending_rounds.cc:85] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 8
I20260709 13:19:33.771713 18485 pending_rounds.cc:107] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:19:33.771917 18485 raft_consensus.cc:2889] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:33.762161 18490 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:33.772993 18342 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:33.776647 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1206) took 1137 ms. Trace:
I20260709 13:19:33.777032 18335 rpcz_store.cc:276] 0709 13:19:32.639434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.828677 (+189243us) service_pool.cc:224] Handling call
0709 13:19:32.829077 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.222281 (+393204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:33.222327 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.236253 (+ 13926us) log.cc:844] Serialized 26 byte log entry
0709 13:19:33.730384 (+494131us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:33.776110 (+ 45726us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.776347 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.776433 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.776474 (+    41us) raft_consensus.cc:1685] finished
0709 13:19:33.776486 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.776593 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2553,"raft.queue_time_us":56202,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8662,"thread_start_us":840005,"threads_started":2,"wal-append.queue_time_us":341283}
I20260709 13:19:33.782159 23499 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:33.784991 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:33.705571 23982 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.786129 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:33.787559 19027 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:33.788584 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.722007 23455 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.740392 23762 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:33.793329 23455 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.793778 23762 consensus_queue.cc:1048] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:33.776103 23751 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:19:33.795679 23455 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:33.788702 23717 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:19:33.707564 23807 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:33.804316 23904 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:33.805888 23500 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:33.766304 23941 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:19:33.606010 23876 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.701033 23712 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.810221 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:33.764374 23915 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:33.809674 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1194) took 1648 ms. Trace:
I20260709 13:19:33.813540 18344 rpcz_store.cc:276] 0709 13:19:32.160813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.183652 (+ 22839us) service_pool.cc:224] Handling call
0709 13:19:32.532364 (+348712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.551967 (+ 19603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.809485 (+1257518us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b540007f3d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:33.809614 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801226112}
W20260709 13:19:33.814872 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.809805 23957 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.819741 18492 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:33.764134 23854 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:33.779177 23829 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:33.830286 23829 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.831892 19025 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:33.833079 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:33.833729 23711 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:33.835050 23711 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:33.835660 23711 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:33.836328 18489 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:33.817665 23988 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:19:33.836462 23921 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.764636 23012 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:19:33.784673 23858 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:33.787994 23853 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:19:33.823982 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:33.839975 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:33.840685 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:33.846771 19060 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 10.
I20260709 13:19:33.810953 23915 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:33.848453 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 330308us
I20260709 13:19:33.849119 18419 raft_consensus.cc:2410] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:19:33.850373 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:33.852445 19025 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:33.819515 23904 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.855321 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:33.856271 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:33.856863 19056 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:19:33.857134 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:33.861743 19053 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.857448 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:33.858971 19060 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:33.859045 18492 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:33.818558 23958 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:33.848376 23711 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:33.862625 19061 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:33.866093 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:33.851552 23822 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:33.859980 23789 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:33.881594 19053 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:33.848817 23787 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:19:33.860169 23807 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:19:33.889087 23789 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:33.905745 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:33.865000 23904 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:33.889034 23822 raft_consensus.cc:697] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:33.909682 18486 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:33.914108 23791 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:33.869974 23711 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.897089 23712 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:33.936172 18489 raft_consensus.cc:1275] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:33.930853 23915 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:33.916193 23647 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:19:33.943463 23959 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:33.948284 19054 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:19:33.929877 23683 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:33.952535 18382 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:33.922189 23938 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:19:33.954339 23941 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:19:33.955057 23820 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.980173 23820 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:33.977051 23822 consensus_queue.cc:237] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:33.975849 23717 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:19:33.970402 23751 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:33.985977 23751 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.993077 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:34.006367 18419 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:33.971210 19054 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 19.
I20260709 13:19:33.952782 23988 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 13:19:34.014132 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 241765us
I20260709 13:19:34.014945 18458 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:33.975132 23986 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.041595 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.041595 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:34.042665 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 262022us
I20260709 13:19:34.043673 18491 raft_consensus.cc:2410] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:33.974570 23921 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:34.051882 23904 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:34.062332 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:34.063658 18491 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:34.013373 23751 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:34.087452 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.088976 18493 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:34.013039 23820 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.019901 23854 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:34.091598 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.099956 23854 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:33.977770 23639 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.095912 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:34.103327 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 59603.2us
I20260709 13:19:34.100607 23854 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:34.116521 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.118562 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.114295 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:34.119448 18493 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:34.063845 23986 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.136190 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.136793 18489 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:34.137372 23986 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:34.116029 23854 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:34.137578 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:34.133400 23955 consensus_meta.cc:287] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.002s
I20260709 13:19:34.134799 23711 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:34.161374 18491 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:34.135324 18419 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:34.141460 19055 raft_consensus.cc:2393] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:34.155285 23639 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:34.159096 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:34.124624 24000 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.344s	user 0.003s	sys 0.000s
W20260709 13:19:34.165126 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 50974.1us
I20260709 13:19:34.166160 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.166368 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:34.166395 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:34.102974 23820 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.168902 18493 raft_consensus.cc:2393] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:34.169761 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:34.175280 19056 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:34.176604 19056 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:34.168483 19054 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:34.171061 19059 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:19:34.171576 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:34.167724 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 315344us
I20260709 13:19:34.173174 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.179559 19062 raft_consensus.cc:2410] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:19:34.179695 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:34.168500 24009 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.182171 23639 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:34.197468 23726 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:34.194962 23823 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.198580 23823 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.200640 23823 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:34.187103 19058 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:19:34.187160 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:34.201901 19058 pending_rounds.cc:85] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 10
I20260709 13:19:34.202211 19058 pending_rounds.cc:107] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:19:34.202433 19058 raft_consensus.cc:2889] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:34.202877 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:34.196417 23829 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:34.204192 24024 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.150s	user 0.001s	sys 0.003s
I20260709 13:19:34.204299 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:34.186255 23987 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:34.186919 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.181565 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.192286 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.213009 18491 raft_consensus.cc:2410] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:34.206071 18490 raft_consensus.cc:1217] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[9.9-9.9]   Dedup: 9.9->[]
I20260709 13:19:34.213622 18490 raft_consensus.cc:1240] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:19:34.214236 18484 raft_consensus.cc:1217] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Deduplicated request from leader. Original: 13.7->[15.8-15.8]   Dedup: 15.8->[]
I20260709 13:19:34.214900 18484 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:19:34.215816 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.212548 19026 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:34.163257 23957 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:19:34.217063 18493 raft_consensus.cc:2410] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:19:34.216101 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.218573 18490 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 8.
I20260709 13:19:34.218856 18458 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:34.219539 19025 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:34.267206 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.270550 23953 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:34.270994 23953 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.271340 23953 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:34.274585 23823 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.274756 23717 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:34.275104 23823 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.276072 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:34.277146 23823 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:34.277874 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:34.279057 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:34.254415 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.280220 18492 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
W20260709 13:19:34.280715 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 61907.3us
I20260709 13:19:34.281419 18492 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:34.282083 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:34.252703 23921 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:34.265280 23726 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:34.282476 24032 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.066s	user 0.002s	sys 0.001s
W20260709 13:19:34.317519 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.317836 23810 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.257520 23954 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:34.318460 23810 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:34.319937 23925 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:34.320467 23810 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:34.320636 23925 consensus_queue.cc:1243] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:34.321570 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:34.322283 18340 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:34.322628 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:34.323681 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:34.262298 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.318888 18309 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:34.324199 18342 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:34.282644 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:34.282604 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:34.284770 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 65301.8us
I20260709 13:19:34.295163 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:34.328737 18416 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:34.329350 19025 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:34.329947 19026 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:19:34.324221 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.331298 19025 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:34.283478 18492 raft_consensus.cc:1240] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:34.290760 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:34.295883 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:34.325124 18337 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:19:34.296219 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:34.335990 18411 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:34.338336 18343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2680) took 1292 ms. Trace:
I20260709 13:19:34.277186 18384 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:34.340960 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 45132us
I20260709 13:19:34.342046 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:34.342803 18415 raft_consensus.cc:2393] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 18: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:19:34.346850 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 69733.5us
I20260709 13:19:34.347837 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:34.348579 18416 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:19:34.348995 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.349388 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.349282 18458 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:34.347837 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:34.351186 18458 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:34.352181 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:34.352701 18412 raft_consensus.cc:606] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:34.353011 18412 raft_consensus.cc:614] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:34.216368 24009 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:34.355240 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:34.253202 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.373245 18491 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:34.357404 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:34.360872 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:34.363900 18413 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:34.361390 18384 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:34.375128 19025 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:34.369444 18336 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:34.338817 18343 rpcz_store.cc:276] 0709 13:19:33.045685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.430005 (+384320us) service_pool.cc:224] Handling call
0709 13:19:33.430533 (+   528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.430969 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:33.498355 (+ 67386us) log.cc:844] Serialized 14 byte log entry
0709 13:19:34.124339 (+625984us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b2400119a38. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bc759c4 00007f409bc73acb 00007f409be2edc9 00007f409be2ea55 00007f409be2e09d 00007f409ea6010e 00007f409ea7788c 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221
0709 13:19:34.314021 (+189682us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b18003aba00. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f409bdf1a40 00007f409bdec4e4 00007f409bdec455 00007f409eed4060 00007f409eee6716 00007f409eef7287 00007f409eef7208
0709 13:19:34.314476 (+   455us) log.cc:844] Serialized 14 byte log entry
0709 13:19:34.314647 (+   171us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.315085 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.315207 (+   122us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:34.315242 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.315311 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:34.338085 (+ 22774us) raft_consensus.cc:1685] finished
0709 13:19:34.338113 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.338268 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5809,"prepare.queue_time_us":109455,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":543396,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":302,"spinlock_wait_cycles":25042176,"thread_start_us":332573,"threads_started":2,"wal-append.queue_time_us":279139}
I20260709 13:19:34.378728 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:34.321040 23810 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:19:34.287957 23012 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:34.288295 24011 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:34.254531 23795 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:34.317587 23455 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.283232 23921 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:34.284312 24022 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:34.289005 23876 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:34.303642 23726 raft_consensus.cc:697] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:34.255560 23982 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:34.339759 23925 raft_consensus.cc:3055] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:34.387215 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:34.252461 24025 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:19:34.398769 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 79949us
I20260709 13:19:34.492274 18309 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:34.345327 24017 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:34.348100 23915 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.356894 24033 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:34.356194 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:34.454561 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 56108.2us
I20260709 13:19:34.420075 23984 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:34.432715 18418 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:34.357517 23639 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:34.420779 18335 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:19:34.500051 18335 pending_rounds.cc:85] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 7
I20260709 13:19:34.500540 18335 pending_rounds.cc:107] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:19:34.434989 18489 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:34.287127 23858 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:19:34.357230 23829 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.528240 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:34.529294 18344 raft_consensus.cc:2368] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 18. Current term is 19.
I20260709 13:19:34.354305 23954 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:34.475260 18413 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 19.
I20260709 13:19:34.310760 23854 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.290150 23953 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.477808 18412 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:34.478408 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:34.483206 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:34.399224 23823 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:34.358099 23987 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:34.357791 24027 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:34.398969 23955 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.379385 23791 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:34.492967 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2679) took 1480 ms. Trace:
I20260709 13:19:34.585530 18339 rpcz_store.cc:276] 0709 13:19:33.012753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.233647 (+220894us) service_pool.cc:224] Handling call
0709 13:19:33.554175 (+320528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.764592 (+210417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.492786 (+728194us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400267ad0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:34.492910 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736468864}
I20260709 13:19:34.379959 24020 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:34.500833 18335 raft_consensus.cc:2889] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:34.505511 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:34.587953 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 82540.4us
I20260709 13:19:34.588974 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:34.386835 23807 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 13:19:34.475731 24001 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:34.309319 23751 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:34.531411 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:34.480046 23746 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.533164 18418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:34.530544 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:34.602763 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:34.603442 18418 raft_consensus.cc:606] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:34.604015 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:34.605094 18344 raft_consensus.cc:2393] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:34.535346 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:34.472503 23683 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:19:34.471838 24011 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:34.536123 24025 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:34.573208 19060 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:34.608434 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:34.540886 19025 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:34.610481 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 69670.2us
I20260709 13:19:34.611335 19025 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:34.501670 23984 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.528581 23982 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.577867 23791 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:19:34.580621 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 176974us
I20260709 13:19:34.491014 23691 consensus_queue.cc:1059] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:19:34.525774 23825 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:34.422468 23878 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:19:34.491581 23925 raft_consensus.cc:740] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:34.481034 23455 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:34.478169 23012 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.532608 23954 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.517941 23639 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.596341 19053 raft_consensus.cc:1240] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:19:34.596552 18488 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:34.598474 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:34.611516 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:34.592326 23711 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.517735 23915 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.625541 18492 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:34.599717 24001 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.625398 19026 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:34.602458 24009 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:34.561841 23941 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:19:34.540254 23829 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:34.592577 23869 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:19:34.624107 23791 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:34.624689 23822 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:34.622051 23853 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:34.651933 18339 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:34.616477 23984 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:34.595315 23955 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.640329 23691 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.653601 23820 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:34.674281 24001 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:34.640249 23825 raft_consensus.cc:697] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:34.663728 23711 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.680518 23012 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:34.680752 23925 consensus_queue.cc:260] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.682366 23751 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:34.640259 23957 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:34.661487 24034 log.cc:927] Time spent T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.399s	user 0.001s	sys 0.000s
I20260709 13:19:34.616664 23746 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.649420 23954 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:34.649326 23823 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:34.653937 23639 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:34.624444 23982 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.669683 23988 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:34.680500 23455 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:34.767695 24036 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:19:34.688208 23854 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:34.690264 23876 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:34.769291 23876 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:34.770396 23876 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.691000 23941 consensus_queue.cc:1243] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:19:34.721004 23717 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:34.772715 24042 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:34.735356 23691 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.774044 18493 raft_consensus.cc:1240] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:34.623360 23726 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.775595 23691 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:34.776640 18344 raft_consensus.cc:2410] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:34.729231 23822 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:34.757369 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 262057us
W20260709 13:19:34.853830 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.854589 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.760540 23746 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:34.754312 23957 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.745754 24011 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:34.765267 23829 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:34.809206 18486 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:34.855124 23822 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:34.853680 23820 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:34.856913 23807 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.894207 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:34.897454 18486 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:34.910920 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 554735us
I20260709 13:19:34.912190 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:34.888545 23953 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:34.918443 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.924775 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 330530us
I20260709 13:19:34.849910 23823 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.935236 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:34.945044 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 442586us
I20260709 13:19:34.953269 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:34.960668 18309 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:34.961335 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:34.941658 18486 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 9.
I20260709 13:19:34.967612 19025 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:34.745371 24025 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:34.943456 24035 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
W20260709 13:19:34.933576 24038 log.cc:927] Time spent T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:19:34.960397 24009 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:34.959066 23854 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:34.906867 23820 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.982106 23953 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:34.998445 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:35.025599 18339 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:34.998989 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:35.026866 18417 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:34.909571 23807 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.998282 18411 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:34.894237 23825 consensus_queue.cc:237] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:34.985050 23829 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:35.026194 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:35.031953 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:34.983394 24039 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:35.032966 18343 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 15: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:34.971177 24047 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:34.990382 23858 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:19:35.042052 23829 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:35.043222 23807 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:35.043959 24056 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:35.044497 24056 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:35.042982 23829 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.001199 23915 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:35.050136 18339 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:34.983086 24041 consensus_queue.cc:1059] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:19:35.032308 23982 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:35.035065 24039 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:35.038483 23953 raft_consensus.cc:697] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:35.063534 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:35.064196 18487 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:35.040299 23955 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:35.074975 24043 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:19:35.066155 23711 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:35.091581 24051 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:35.094973 18309 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:35.068418 24039 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:35.111212 18487 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:35.112641 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.146417 24060 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:35.117331 23915 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.151505 23915 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.152557 23984 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.153688 18412 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:35.154407 19057 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1289) took 1310 ms. Trace:
I20260709 13:19:35.155543 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.154855 19057 rpcz_store.cc:276] 0709 13:19:33.843499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.846018 (+  2519us) service_pool.cc:224] Handling call
0709 13:19:33.853907 (+  7889us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:34.510824 (+656917us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b18003c96a0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409ea844bc 00007f409bdd248b 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdec455 00007f409eed4060 00007f409eed4bfb 00007f409eedf64b
0709 13:19:34.510983 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.511018 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:34.529899 (+ 18881us) log.cc:844] Serialized 52 byte log entry
0709 13:19:34.729985 (+200086us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:34.730039 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.730133 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.154110 (+423977us) raft_consensus.cc:1685] finished
0709 13:19:35.154130 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.154344 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13711,"raft.queue_time_us":30689,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4471,"spinlock_wait_cycles":2980224,"thread_start_us":226660,"threads_started":2,"wal-append.queue_time_us":409347}
I20260709 13:19:35.156369 24048 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.156878 24048 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:35.157105 23820 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.047736 24047 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.159049 24048 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.159497 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.160383 24047 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:35.148765 24060 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.165751 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.170907 23823 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.171818 23455 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:35.173444 24047 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:35.177068 18487 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
W20260709 13:19:35.184401 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 216885us
I20260709 13:19:35.099771 23982 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.103396 23957 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.214017 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.215688 18487 raft_consensus.cc:2410] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:19:35.153695 23915 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:35.183099 24048 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:35.165584 23954 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.101840 23499 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:19:35.202267 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 174503us
I20260709 13:19:35.196765 24056 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:35.219390 24065 log.cc:927] Time spent T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:19:35.175381 24060 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:35.207295 24053 log.cc:927] Time spent T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:19:35.229550 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:35.219622 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 462199us
W20260709 13:19:35.241519 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.247303 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:35.248533 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:35.195328 24047 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:35.261685 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:35.262379 18416 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:35.262560 18384 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:35.265537 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.265573 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:35.230405 23854 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:35.269764 19057 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:35.299526 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.299589 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:35.283778 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:35.230547 23499 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:35.304435 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:35.300653 18487 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:35.305807 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:35.309351 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.301616 19055 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:35.316458 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:35.321849 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:35.207549 23982 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.337749 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:35.338512 19057 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:35.339716 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:35.231176 24048 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.349198 18307 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:35.356280 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:35.200424 23953 consensus_queue.cc:237] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:35.307636 24001 consensus_meta.cc:287] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.003s
I20260709 13:19:35.358559 19055 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:35.302408 23751 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:35.364198 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:35.369838 19058 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:35.345822 19026 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:35.371037 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:35.364312 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1259) took 1175 ms. Trace:
W20260709 13:19:35.374020 18335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.006s	sys 0.015s
W20260709 13:19:35.374476 18335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.006s	sys 0.015s
I20260709 13:19:35.243643 24058 consensus_queue.cc:1048] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:19:35.371915 18485 rpcz_store.cc:276] 0709 13:19:34.188767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.387843 (+199076us) service_pool.cc:224] Handling call
0709 13:19:34.388131 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.388443 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.388468 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.475527 (+ 87059us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.731633 (+256106us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:34.731691 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.731784 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.364020 (+632236us) raft_consensus.cc:1685] finished
0709 13:19:35.364049 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.364234 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10108,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":55823,"thread_start_us":255820,"threads_started":1,"wal-append.queue_time_us":433127}
I20260709 13:19:35.443118 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.443941 18485 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:35.319802 23915 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:35.359207 23639 consensus_meta.cc:287] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.001s
I20260709 13:19:35.333581 24060 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:35.383742 23751 raft_consensus.cc:697] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:35.384802 23876 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:35.385283 24055 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:35.365550 24056 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:35.356896 24059 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:35.389575 23829 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:35.395469 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 49746.1us
W20260709 13:19:35.490484 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.495785 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.306056 24070 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:19:35.509545 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.312268 23854 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.368605 24063 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:35.521411 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38686 (request call id 1542) took 1198 ms. Trace:
I20260709 13:19:35.584203 19053 rpcz_store.cc:276] 0709 13:19:34.322949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.324491 (+  1542us) service_pool.cc:224] Handling call
0709 13:19:34.324757 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.651217 (+326460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.521027 (+869810us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400683b54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:35.521330 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623928192}
I20260709 13:19:35.477778 23820 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:35.618450 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 46771.8us
I20260709 13:19:35.619961 19026 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:35.576126 18487 raft_consensus.cc:2410] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:19:35.579066 18485 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:35.632282 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.382288 24001 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.509850 24049 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.648765 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.652773 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:35.650234 18485 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:35.656129 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.654700 18309 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:35.663599 18309 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:35.511353 23915 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:35.538826 24060 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:35.616914 23820 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.526140 23639 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.667959 18309 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:35.616889 23958 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:35.567931 23876 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:35.679351 24064 log.cc:927] Time spent T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:19:35.694523 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 323546us
W20260709 13:19:35.695585 24081 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:19:35.718681 19060 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 13:19:35.706516 24078 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:19:35.660475 23711 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:19:35.681268 24055 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:35.667858 24069 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:35.676080 23829 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:19:35.696961 24068 log.cc:927] Time spent T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:19:35.762326 23915 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.661027 24049 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.712550 23954 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.738571 24048 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:35.655524 23751 consensus_queue.cc:237] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:35.734347 24067 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.472s	user 0.000s	sys 0.001s
I20260709 13:19:35.668411 24063 consensus_queue.cc:1059] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:19:35.702267 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2931) took 1500 ms. Trace:
I20260709 13:19:35.803426 24055 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.698552 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2696) took 1375 ms. Trace:
I20260709 13:19:35.739995 23982 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:35.661401 23957 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:35.726519 23876 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:35.569159 23499 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.704121 23854 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:35.698581 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1228) took 1225 ms. Trace:
I20260709 13:19:35.836000 18342 rpcz_store.cc:276] 0709 13:19:34.472728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.065671 (+592943us) service_pool.cc:224] Handling call
0709 13:19:35.070295 (+  4624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:35.077504 (+  7209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.077555 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:35.078075 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:19:35.368543 (+290468us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:35.368583 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.368663 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.698374 (+329711us) raft_consensus.cc:1685] finished
0709 13:19:35.698397 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.698525 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6656,"raft.queue_time_us":135,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":13504,"thread_start_us":209711,"threads_started":1,"wal-append.queue_time_us":445537}
I20260709 13:19:35.839628 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1233) took 1364 ms. Trace:
I20260709 13:19:35.839980 18342 rpcz_store.cc:276] 0709 13:19:34.475278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.838498 (+1363220us) service_pool.cc:224] Handling call
0709 13:19:35.838917 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.839171 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.839215 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:35.839279 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:35.839328 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.839407 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.839552 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:35.764185 23791 consensus_meta.cc:287] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.032s	user 0.009s	sys 0.002s
I20260709 13:19:35.842455 23791 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.845402 18418 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:35.759670 24001 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:35.765528 24009 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.767s	user 0.005s	sys 0.005s
I20260709 13:19:35.778656 23984 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:35.695189 23958 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.702555 24060 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:35.687269 23820 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:35.782279 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.788214 18307 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:35.854125 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.695454 24025 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:35.806625 24073 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 13:19:35.805157 24069 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.780185 23683 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:35.741869 24059 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:35.813886 18487 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:35.812520 18488 rpcz_store.cc:276] 0709 13:19:34.201559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.652065 (+450506us) service_pool.cc:224] Handling call
0709 13:19:34.652468 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.685097 (+ 32629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.685128 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.727703 (+ 42575us) log.cc:844] Serialized 26 byte log entry
0709 13:19:35.092507 (+364804us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:35.217633 (+125126us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.220474 (+  2841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.220602 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.701990 (+481388us) raft_consensus.cc:1685] finished
0709 13:19:35.702014 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.702195 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":264910,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":14078,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":11984,"thread_start_us":439248,"threads_started":2,"wal-append.queue_time_us":590221}
I20260709 13:19:35.806663 23829 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.816054 18335 rpcz_store.cc:276] 0709 13:19:34.323166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.614284 (+291118us) service_pool.cc:224] Handling call
0709 13:19:34.628524 (+ 14240us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:34.645790 (+ 17266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.645833 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:34.658748 (+ 12915us) log.cc:844] Serialized 52 byte log entry
0709 13:19:35.374932 (+716184us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:35.374990 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.375086 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.698311 (+323225us) raft_consensus.cc:1685] finished
0709 13:19:35.698333 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.698491 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138981,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":64,"thread_start_us":639750,"threads_started":1,"wal-append.queue_time_us":961419}
I20260709 13:19:35.834040 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2938) took 1540 ms. Trace:
I20260709 13:19:35.862921 18485 rpcz_store.cc:276] 0709 13:19:34.293903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.665736 (+1371833us) service_pool.cc:224] Handling call
0709 13:19:35.666105 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.666347 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:35.669587 (+  3240us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.833653 (+164066us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:35.833706 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:35.833765 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.833830 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.833985 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2981,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":4916,"raft.queue_time_us":1233,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":12293,"thread_start_us":163659,"threads_started":1}
I20260709 13:19:35.830336 24055 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:35.863162 24025 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.870820 24025 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:35.871205 23958 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.850199 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2698) took 1526 ms. Trace:
I20260709 13:19:35.851085 24009 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:35.856504 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 68417.8us
I20260709 13:19:35.860765 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:35.875118 18419 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:35.875182 18307 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:35.875334 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 207460us
I20260709 13:19:35.876566 18487 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:35.872319 18340 rpcz_store.cc:276] 0709 13:19:34.323667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.679756 (+356089us) service_pool.cc:224] Handling call
0709 13:19:34.680127 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:34.906226 (+226099us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:34.916063 (+  9837us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.205556 (+289493us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:35.223109 (+ 17553us) log.cc:844] Serialized 52 byte log entry
0709 13:19:35.230688 (+  7579us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:35.230725 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.230817 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.849934 (+619117us) raft_consensus.cc:1685] finished
0709 13:19:35.849960 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.850128 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12072,"prepare.queue_time_us":9283,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":101536,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":13707,"thread_start_us":502300,"threads_started":2,"wal-append.queue_time_us":486650}
I20260709 13:19:35.850672 24063 consensus_queue.cc:1243] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:19:35.855265 24039 consensus_meta.cc:287] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.670s	user 0.005s	sys 0.007s
I20260709 13:19:35.865800 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2939) took 1571 ms. Trace:
I20260709 13:19:35.892521 18488 rpcz_store.cc:276] 0709 13:19:34.294160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.864848 (+1570688us) service_pool.cc:224] Handling call
0709 13:19:35.865196 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.865416 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.865452 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:35.865504 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:35.865548 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.865614 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.865736 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:35.859933 24069 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:35.868093 24049 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:35.780638 23822 consensus_meta.cc:287] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.875s	user 0.012s	sys 0.000s
I20260709 13:19:35.835145 23957 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.905434 23958 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:35.905499 23822 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.906266 23958 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.906992 23957 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.893360 23876 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.907569 23957 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.907876 23822 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.864601 23683 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.908105 23957 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.908727 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:35.909413 19058 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:35.885824 18419 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:35.910305 23683 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:35.859609 24059 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.860316 23982 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.911047 24059 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:35.901692 23915 consensus_queue.cc:1059] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:19:35.913126 23982 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:35.895345 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:35.914315 18416 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:35.915047 24047 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.915455 23915 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.915683 24047 raft_consensus.cc:3055] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:35.916121 24047 raft_consensus.cc:740] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:35.916040 23915 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.899552 19055 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:35.864434 23829 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:35.895720 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:35.902458 24063 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:35.904094 23791 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:35.904455 24001 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:35.907658 23876 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:35.902748 24018 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.840s	user 0.008s	sys 0.028s
I20260709 13:19:35.923354 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2941) took 1611 ms. Trace:
I20260709 13:19:35.924860 19026 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:35.927724 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2463) took 1867 ms. Trace:
I20260709 13:19:35.955444 18493 rpcz_store.cc:276] 0709 13:19:34.059888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.254542 (+194654us) service_pool.cc:224] Handling call
0709 13:19:34.773703 (+519161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.774541 (+   838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.927486 (+1152945us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b5400259250. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:35.927653 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193196800}
I20260709 13:19:35.956043 18414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 1104) took 2287 ms. Trace:
I20260709 13:19:35.956763 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:35.957885 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:35.959033 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:35.959483 18493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1269) took 1629 ms. Trace:
I20260709 13:19:35.959827 18493 rpcz_store.cc:276] 0709 13:19:34.330252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.958746 (+1628494us) service_pool.cc:224] Handling call
0709 13:19:35.959020 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.959193 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.959217 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:35.959257 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:35.959289 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.959339 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.959436 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:35.930564 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1266) took 1736 ms. Trace:
I20260709 13:19:35.960974 18489 rpcz_store.cc:276] 0709 13:19:34.193984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.518283 (+324299us) service_pool.cc:224] Handling call
0709 13:19:34.541846 (+ 23563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.621626 (+ 79780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.621656 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:34.621710 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:34.621743 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.930355 (+1308612us) spinlock_profiling.cc:243] Waited 79.6 ms on lock 0x7b54003543d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:35.930401 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.930514 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183025536}
I20260709 13:19:35.962603 18489 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:35.963116 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1271) took 1623 ms. Trace:
I20260709 13:19:35.963419 18489 rpcz_store.cc:276] 0709 13:19:34.339817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.962015 (+1622198us) service_pool.cc:224] Handling call
0709 13:19:35.962300 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.962891 (+   591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.963066 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:35.964445 18489 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:35.964740 18489 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:35.936216 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:35.937013 23639 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.966881 23876 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.942185 24047 consensus_queue.cc:260] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.944440 23957 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.967772 24001 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:35.968952 23957 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:35.969496 23957 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:35.969810 24001 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:35.970417 23957 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.946700 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:35.947269 24059 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.900996 24039 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:35.974192 19057 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:35.975541 24039 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:35.975544 24059 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:35.930428 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:35.956426 18414 rpcz_store.cc:276] 0709 13:19:33.668663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.669003 (+   340us) service_pool.cc:224] Handling call
0709 13:19:33.721258 (+ 52255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.721653 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:33.721683 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.770275 (+ 48592us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.035223 (+264948us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:34.035270 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.035350 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.835190 (+1799840us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:35.955743 (+120553us) raft_consensus.cc:1685] finished
0709 13:19:35.955764 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.955985 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11058,"raft.queue_time_us":92,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":18306,"spinlock_wait_cycles":64499584,"thread_start_us":232780,"threads_started":1,"wal-append.queue_time_us":260114}
I20260709 13:19:35.977779 18419 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:35.978458 23915 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:35.918452 23958 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:35.955161 18488 rpcz_store.cc:276] 0709 13:19:34.311535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.922396 (+1610861us) service_pool.cc:224] Handling call
0709 13:19:35.922755 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.922952 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.922984 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:35.923035 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:35.923077 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.923143 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.923283 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:35.980885 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2942) took 1354 ms. Trace:
I20260709 13:19:35.981268 18488 rpcz_store.cc:276] 0709 13:19:34.627008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.979972 (+1352964us) service_pool.cc:224] Handling call
0709 13:19:35.980329 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.980522 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.980545 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:35.980598 (+    53us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:35.980635 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.980695 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.980818 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:35.982164 19026 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:35.983227 23958 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:35.983687 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2699) took 1480 ms. Trace:
I20260709 13:19:35.983891 23958 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:35.984035 19026 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:35.984383 23958 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:35.984143 18344 rpcz_store.cc:276] 0709 13:19:34.502923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.605774 (+102851us) service_pool.cc:224] Handling call
0709 13:19:35.983476 (+1377702us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400416ed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:35.983626 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285921664}
I20260709 13:19:35.988435 18341 raft_consensus.cc:1275] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:35.990338 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1229) took 1517 ms. Trace:
I20260709 13:19:35.992277 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:35.992468 24012 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.820s	user 0.008s	sys 0.010s
I20260709 13:19:35.995223 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:35.989749 24089 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:35.997375 24089 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:35.997759 24089 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:36.000332 24055 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.995275 18344 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:36.002832 24055 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:36.002992 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2701) took 1499 ms. Trace:
I20260709 13:19:36.003234 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2488) took 1042 ms. Trace:
I20260709 13:19:36.003361 18344 rpcz_store.cc:276] 0709 13:19:34.503951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.985444 (+1481493us) service_pool.cc:224] Handling call
0709 13:19:35.985741 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.002598 (+ 16857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.002936 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:36.003739 18418 rpcz_store.cc:276] 0709 13:19:34.960568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.960714 (+   146us) service_pool.cc:224] Handling call
0709 13:19:34.984867 (+ 24153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.845968 (+861101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.002992 (+157024us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b5400177ad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:36.003176 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978425216}
I20260709 13:19:36.011768 18484 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 13: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:35.953204 24069 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.012277 23823 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:36.012889 23823 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.012920 24089 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:35.965384 18489 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.014276 24069 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:36.015885 23823 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:36.018249 24089 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:36.020476 23499 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:36.023108 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2943) took 1378 ms. Trace:
I20260709 13:19:36.023586 18484 rpcz_store.cc:276] 0709 13:19:34.645226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.013088 (+1367862us) service_pool.cc:224] Handling call
0709 13:19:36.013387 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.013573 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.013599 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:36.013645 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:36.013693 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.013751 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.023040 (+  9289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:36.026078 24048 raft_consensus.cc:3055] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:36.026485 24048 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:36.026672 23717 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:36.027264 24048 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.028330 24048 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:36.029323 18489 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:36.031817 23829 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.034329 23829 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:36.043653 19057 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 18.
I20260709 13:19:35.999356 23820 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.047515 23820 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:36.048964 24075 consensus_queue.cc:1059] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:36.052444 18382 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:36.056427 23717 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:36.057034 23683 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.057348 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.057716 23791 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:36.057596 23683 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:36.058575 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.059087 23984 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.059556 23984 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.060398 23683 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:36.062088 23941 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.072158 23941 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.072944 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.073745 18488 raft_consensus.cc:1240] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:36.074466 23941 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:36.062299 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:36.075306 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.075524 18488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1273) took 1434 ms. Trace:
I20260709 13:19:36.075975 19025 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:36.075906 18488 rpcz_store.cc:276] 0709 13:19:34.641670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.982523 (+1340853us) service_pool.cc:224] Handling call
0709 13:19:36.073537 (+ 91014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.074214 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.075362 (+  1148us) spinlock_profiling.cc:243] Waited 90.7 ms on lock 0x7b54000b72d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:36.075472 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208662912}
I20260709 13:19:36.076380 23795 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:36.076915 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.077239 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:36.078262 24089 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:36.078621 24089 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.078927 18419 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:36.077224 23795 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:36.067303 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:36.078928 24089 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.079993 18492 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:36.080389 23958 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.057585 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.081974 18418 raft_consensus.cc:2410] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:19:36.058364 23791 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.056993 23717 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.061651 23984 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:36.065856 23012 raft_consensus.cc:3055] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:36.087823 23012 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:36.088687 23012 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.089632 23012 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:36.091161 24062 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 1.000s	user 0.003s	sys 0.006s
I20260709 13:19:36.070909 23898 consensus_queue.cc:1059] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:36.071308 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.073303 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:36.092307 18417 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:36.092350 23898 raft_consensus.cc:3055] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:36.092628 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2928) took 1891 ms. Trace:
I20260709 13:19:36.092912 23898 raft_consensus.cc:740] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:36.092998 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:36.093866 18487 raft_consensus.cc:2393] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 16: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:36.094004 23898 consensus_queue.cc:260] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.094586 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:36.095127 18487 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:36.095377 23898 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.095789 18492 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:36.096717 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:36.097544 18492 raft_consensus.cc:2410] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:19:36.087352 23791 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:36.098636 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:36.099349 24076 log.cc:927] Time spent T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.380s	user 0.000s	sys 0.000s
I20260709 13:19:36.140071 18417 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:36.099705 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:36.100490 24046 log.cc:927] Time spent T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 1.010s	user 0.004s	sys 0.004s
I20260709 13:19:36.100826 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:36.087361 23717 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:36.102244 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2944) took 1450 ms. Trace:
I20260709 13:19:36.105157 23925 raft_consensus.cc:3060] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:36.142999 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:36.144856 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.142408 18484 rpcz_store.cc:276] 0709 13:19:34.651405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.024744 (+1373339us) service_pool.cc:224] Handling call
0709 13:19:36.025124 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.025338 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.025373 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:36.101947 (+ 76574us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:36.101998 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.102067 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.102187 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:36.141772 18418 raft_consensus.cc:2376] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 19. Re-sending same reply.
I20260709 13:19:36.077190 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:36.154812 18488 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:36.158273 18492 raft_consensus.cc:2410] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:36.107193 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 1115) took 1110 ms. Trace:
I20260709 13:19:36.109445 18487 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
W20260709 13:19:36.110170 23825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.063s	user 0.002s	sys 0.012s
I20260709 13:19:36.158442 24001 raft_consensus.cc:3055] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:36.110541 18489 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:19:36.159081 23825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.112s	user 0.002s	sys 0.012s
I20260709 13:19:36.158860 18412 rpcz_store.cc:276] 0709 13:19:34.996826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.996961 (+   135us) service_pool.cc:224] Handling call
0709 13:19:34.997277 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.154109 (+156832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.106889 (+952780us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54003ed0d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:36.107102 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359301888}
I20260709 13:19:36.159621 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1272) took 1623 ms. Trace:
I20260709 13:19:36.159991 18489 rpcz_store.cc:276] 0709 13:19:34.536053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.964058 (+1428005us) service_pool.cc:224] Handling call
0709 13:19:35.964320 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.159395 (+195075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.159573 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:36.112620 24072 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.506s	user 0.002s	sys 0.000s
I20260709 13:19:36.160741 23795 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:36.161299 23795 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.062763 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.113801 18490 rpcz_store.cc:276] 0709 13:19:34.200782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.539423 (+338641us) service_pool.cc:224] Handling call
0709 13:19:34.539808 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.692272 (+152464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.692317 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.692869 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.970219 (+277350us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:34.970270 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.970359 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.090436 (+1120077us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:36.092381 (+  1945us) raft_consensus.cc:1685] finished
0709 13:19:36.092399 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.092566 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49738,"raft.queue_time_us":62427,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":12623,"spinlock_wait_cycles":25550208,"thread_start_us":384816,"threads_started":2,"wal-append.queue_time_us":397738}
I20260709 13:19:36.116649 23958 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:36.117689 23959 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:36.125223 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2937) took 1831 ms. Trace:
I20260709 13:19:36.164179 18486 rpcz_store.cc:276] 0709 13:19:34.293661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.966917 (+673256us) service_pool.cc:224] Handling call
0709 13:19:34.967325 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.967784 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.967821 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.968364 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:19:35.918424 (+950060us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b180027e2c0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:19:36.124785 (+206361us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:36.124830 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.124899 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.124944 (+    45us) raft_consensus.cc:1685] finished
0709 13:19:36.124955 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.125154 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":8923,"spinlock_wait_cycles":4858624,"thread_start_us":206191,"threads_started":1,"wal-append.queue_time_us":1136710}
I20260709 13:19:36.165387 23959 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:36.165872 23959 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:36.166244 24001 raft_consensus.cc:740] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:36.167090 24001 consensus_queue.cc:260] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:36.168193 24001 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.131279 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:36.132467 23954 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:19:36.136165 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.136541 24027 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:36.170260 24027 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:36.172320 24027 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:36.063666 24052 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.976s	user 0.006s	sys 0.004s
I20260709 13:19:36.158257 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 1118) took 1155 ms. Trace:
I20260709 13:19:36.173857 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1267) took 1979 ms. Trace:
I20260709 13:19:36.174261 18491 rpcz_store.cc:276] 0709 13:19:34.194246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.530123 (+335877us) service_pool.cc:224] Handling call
0709 13:19:34.530451 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.559212 (+ 28761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.559257 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.580649 (+ 21392us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.888693 (+308044us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:34.888736 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.888813 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.063058 (+1174245us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:36.173606 (+110548us) raft_consensus.cc:1685] finished
0709 13:19:36.173626 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.173803 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28344,"raft.queue_time_us":28478,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":8328,"spinlock_wait_cycles":16919424,"thread_start_us":260872,"threads_started":1,"wal-append.queue_time_us":440866}
I20260709 13:19:36.175338 23959 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.173177 18415 rpcz_store.cc:276] 0709 13:19:35.002822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.002966 (+   144us) service_pool.cc:224] Handling call
0709 13:19:35.003383 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:35.022789 (+ 19406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.022826 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:35.995917 (+973091us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b2c001026c8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:19:35.996444 (+   527us) log.cc:844] Serialized 52 byte log entry
0709 13:19:36.135408 (+138964us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:36.135473 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.135543 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.157988 (+ 22445us) raft_consensus.cc:1685] finished
0709 13:19:36.158008 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.158204 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9496,"raft.queue_time_us":121,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":10125,"spinlock_wait_cycles":3071360,"thread_start_us":138294,"threads_started":1,"wal-append.queue_time_us":138854}
I20260709 13:19:36.130311 18485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 2940) took 1835 ms. Trace:
I20260709 13:19:36.177285 23959 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:36.177356 18485 rpcz_store.cc:276] 0709 13:19:34.294426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.867220 (+1572794us) service_pool.cc:224] Handling call
0709 13:19:35.867488 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.867674 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:35.867912 (+   238us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.125319 (+257407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:36.125381 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:36.125434 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.125508 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.130227 (+  4719us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":498,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":311,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":256548,"threads_started":1,"wal-append.queue_time_us":205346}
W20260709 13:19:36.181716 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 48214.4us
I20260709 13:19:36.186615 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.188848 19061 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:36.187178 24017 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:36.188294 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.189999 19057 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:36.190798 24017 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.194546 23795 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:36.200943 19053 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:36.204614 23954 consensus_queue.cc:1059] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:36.205509 23958 raft_consensus.cc:3055] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:36.205895 23958 raft_consensus.cc:740] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:36.206779 23958 consensus_queue.cc:260] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.208142 23958 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.217435 23795 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.218235 23795 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.266456 18338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2691) took 1944 ms. Trace:
I20260709 13:19:36.280000 18339 raft_consensus.cc:1275] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:19:36.280901 18339 pending_rounds.cc:85] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 10
I20260709 13:19:36.281108 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1234) took 1805 ms. Trace:
I20260709 13:19:35.990780 18341 rpcz_store.cc:276] 0709 13:19:34.472996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.152331 (+679335us) service_pool.cc:224] Handling call
0709 13:19:35.988019 (+835688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.988907 (+   888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.990080 (+  1173us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b5400416ed0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:35.990265 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919734528}
I20260709 13:19:36.281723 18342 rpcz_store.cc:276] 0709 13:19:34.475530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.841194 (+1365664us) service_pool.cc:224] Handling call
0709 13:19:35.841634 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:35.847035 (+  5401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.847085 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:35.848555 (+  1470us) log.cc:844] Serialized 26 byte log entry
0709 13:19:36.279322 (+430767us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:36.279991 (+   669us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.280352 (+   361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.280536 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.280630 (+    94us) raft_consensus.cc:1685] finished
0709 13:19:36.280644 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.280860 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1476,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":3149,"thread_start_us":384414,"threads_started":1,"wal-append.queue_time_us":186527}
I20260709 13:19:36.284703 18343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1224) took 1813 ms. Trace:
I20260709 13:19:36.285162 18343 rpcz_store.cc:276] 0709 13:19:34.471584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.036746 (+565162us) service_pool.cc:224] Handling call
0709 13:19:35.037153 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:35.048105 (+ 10952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.048135 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:35.048678 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:19:35.375325 (+326647us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:35.375379 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.375467 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.098803 (+723336us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:36.284082 (+185279us) raft_consensus.cc:1685] finished
0709 13:19:36.284133 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.284520 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10531,"raft.queue_time_us":19386,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":4383,"spinlock_wait_cycles":156408192,"thread_start_us":291794,"threads_started":1,"wal-append.queue_time_us":599890}
I20260709 13:19:36.281332 18339 pending_rounds.cc:107] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:19:36.287425 18339 raft_consensus.cc:2889] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:36.107007 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.289398 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 234692us
I20260709 13:19:36.289458 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2694) took 1966 ms. Trace:
I20260709 13:19:36.292030 18336 rpcz_store.cc:276] 0709 13:19:34.322716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.609558 (+286842us) service_pool.cc:224] Handling call
0709 13:19:34.609897 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.987875 (+377978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.987906 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.994795 (+  6889us) log.cc:844] Serialized 26 byte log entry
0709 13:19:35.189802 (+195007us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:35.223758 (+ 33956us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.228110 (+  4352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.050770 (+822660us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b18002f1ac0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:19:36.112069 (+ 61299us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:36.288708 (+176639us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b540028e6d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:36.288821 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.288934 (+   113us) raft_consensus.cc:1685] finished
0709 13:19:36.288953 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.289279 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33356,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":3917,"raft.queue_time_us":34316,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144,"spinlock_wait_cycles":306017920,"thread_start_us":396219,"threads_started":2,"wal-append.queue_time_us":432304}
I20260709 13:19:36.314808 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:36.316452 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.298802 18382 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:36.322846 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.323788 18382 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:36.332243 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 126027us
I20260709 13:19:36.333743 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:36.299547 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:36.307971 18415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:36.309990 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.311637 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1231) took 1838 ms. Trace:
I20260709 13:19:36.352052 23691 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.353097 23691 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.353825 24009 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:36.354278 19025 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:36.354785 24009 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.356364 19025 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:36.358314 24027 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:36.359305 24017 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:36.359256 24027 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.359772 24086 raft_consensus.cc:2804] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:36.340916 18339 rpcz_store.cc:276] 0709 13:19:34.473506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.242489 (+768983us) service_pool.cc:224] Handling call
0709 13:19:35.243342 (+   853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.288200 (+1044858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.311231 (+ 23031us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540007eed4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:36.311558 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2380645248}
I20260709 13:19:36.362816 18415 raft_consensus.cc:606] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:36.366019 23795 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:36.366382 24027 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:36.367399 24039 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:36.368101 24039 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:36.370498 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:36.358356 23820 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:36.371430 18344 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.267398 18338 rpcz_store.cc:276] 0709 13:19:34.321806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.324762 (+  2956us) service_pool.cc:224] Handling call
0709 13:19:34.324999 (+   237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.387896 (+ 62897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.387925 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.425380 (+ 37455us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.881568 (+456188us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:34.881612 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.881678 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.099932 (+1218254us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:36.265339 (+165407us) raft_consensus.cc:1685] finished
0709 13:19:36.265427 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.266102 (+   675us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62549,"raft.queue_time_us":63009,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":57987,"spinlock_wait_cycles":20596608,"thread_start_us":364707,"threads_started":1,"wal-append.queue_time_us":607425}
I20260709 13:19:36.401239 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:36.352157 23898 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:36.413295 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.399854 24086 raft_consensus.cc:697] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:36.421976 18242 catalog_manager.cc:5697] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 7 to 10, leader changed from <none> to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 10 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:36.425514 18242 catalog_manager.cc:5697] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 8 to 10, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 10 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:36.427650 18238 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54880 (request call id 259) took 35290 ms (client timeout 15000 ms). Trace:
I20260709 13:19:36.429157 23877 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.429453 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:36.430024 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.430994 19053 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:36.432955 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.432004 18242 catalog_manager.cc:5697] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 6, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 6 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:36.437804 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 88723.9us
I20260709 13:19:36.437883 23957 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
W20260709 13:19:36.440415 24114 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
I20260709 13:19:36.441980 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:36.441893 23898 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:36.442782 18418 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:36.443567 24071 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:36.444455 24009 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:36.445641 18337 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:36.446324 23954 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:36.448772 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 149483us
I20260709 13:19:36.450088 19025 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:36.450332 24050 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:36.442318 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:36.453308 18410 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:19:36.454196 23820 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.454933 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.455618 18415 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:36.434222 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:36.458375 18412 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:19:36.434423 18307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.003s	sys 0.013s
I20260709 13:19:36.429041 24042 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:36.466857 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.463318 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:36.463428 23691 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:36.464423 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.466845 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:36.467294 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:36.468448 18335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1235) took 1992 ms. Trace:
W20260709 13:19:36.461565 18307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.004s	sys 0.013s
I20260709 13:19:36.473261 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:36.480039 18339 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 16: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:36.481215 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.484755 18242 catalog_manager.cc:5697] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 8 to 9, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 9 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:36.486409 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:36.486749 18242 catalog_manager.cc:5697] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 7 to 9, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 9 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:36.489372 24086 consensus_queue.cc:237] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.490054 24039 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:36.472285 18335 rpcz_store.cc:276] 0709 13:19:34.475800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.868864 (+1393064us) service_pool.cc:224] Handling call
0709 13:19:35.869170 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.869352 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:36.270734 (+401382us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.467542 (+196808us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.467748 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:36.467832 (+    84us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:36.467901 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.468008 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.468192 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9124,"prepare.queue_time_us":262491,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":92,"raft.queue_time_us":2461,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":142,"thread_start_us":507679,"threads_started":2}
W20260709 13:19:36.490514 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.492213 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:36.498170 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.498512 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.499359 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.500438 18308 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:36.500572 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.434274 24056 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.502923 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.493891 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:36.506884 18242 catalog_manager.cc:5697] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 5 to 8, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 8 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:36.507352 18484 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:36.521947 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:36.522192 24009 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:36.523084 24009 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.523578 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.527532 18410 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:36.524225 18308 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:36.516773 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.530567 18344 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:36.535379 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:36.515981 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 623653us
I20260709 13:19:36.537676 24042 raft_consensus.cc:697] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:36.539273 24042 consensus_queue.cc:237] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:36.540033 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.541378 18242 catalog_manager.cc:5697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 5 to 9, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 9 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:36.542645 18337 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:36.544091 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.544899 18337 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:36.546634 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.547472 18339 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:36.548460 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.549140 18339 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:36.550506 24009 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:36.557193 24096 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:36.564330 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.565246 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:36.567013 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:36.567741 18337 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:36.569814 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.571082 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:36.572517 18339 raft_consensus.cc:3060] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:36.571702 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.574433 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2700) took 2071 ms. Trace:
I20260709 13:19:36.577957 23876 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:36.577356 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:36.578701 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:36.590749 18412 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:36.555868 18493 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:36.596284 18335 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 16: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:36.593793 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:36.596175 19062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:19:36.598960 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.600827 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.561630 23898 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:36.596100 23876 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.615940 19062 raft_consensus.cc:606] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:36.625059 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:36.428259 18238 rpcz_store.cc:269] 0709 13:19:01.198744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.299502 (+100758us) service_pool.cc:224] Handling call
0709 13:19:36.427330 (+35127828us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:28.314487 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:28.321035 (+  6548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:28.321082 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:19:28.321100 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:28.322167 (+  1067us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:28.322271 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:28.322309 (+    38us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:19:28.323207 (+   898us) tablet.cc:701] Row locks acquired
0709 13:19:28.323254 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:19:28.323445 (+   191us) write_op.cc:270] Start()
0709 13:19:28.323592 (+   147us) write_op.cc:276] Timestamp: P: 1783603168323360 usec, L: 0
0709 13:19:28.323635 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:19:28.324356 (+   721us) log.cc:844] Serialized 3954 byte log entry
0709 13:19:28.625669 (+301313us) op_driver.cc:464] REPLICATION: finished
0709 13:19:28.979584 (+353915us) write_op.cc:301] APPLY: starting
0709 13:19:28.979688 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:29.647508 (+667820us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:29.647625 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:29.813077 (+165452us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:29.813395 (+   318us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:19:29.813461 (+    66us) write_op.cc:312] APPLY: finished
0709 13:19:29.813833 (+   372us) log.cc:844] Serialized 97 byte log entry
0709 13:19:30.602779 (+788946us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409bdd20ac 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b
0709 13:19:30.820427 (+217648us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:30.828674 (+  8247us) write_op.cc:454] Released schema lock
0709 13:19:30.850836 (+ 22162us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:30.881597 (+ 30761us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:30.883316 (+  1719us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1625111,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":353560,"apply.run_cpu_time_us":68018,"apply.run_wall_time_us":1889787,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45787,"num_ops":10,"prepare.queue_time_us":261420,"prepare.run_cpu_time_us":18416,"prepare.run_wall_time_us":133967,"raft.queue_time_us":168986,"raft.run_cpu_time_us":20982,"raft.run_wall_time_us":263525,"replication_time_us":301846,"spinlock_wait_cycles":5754240,"thread_start_us":1554536,"threads_started":5,"wal-append.queue_time_us":1152422,"wal-append.run_cpu_time_us":38778,"wal-append.run_wall_time_us":2267236}]]}
I20260709 13:19:36.632198 18344 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 17: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:36.544670 24089 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.635872 19062 raft_consensus.cc:614] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:36.640380 19053 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
W20260709 13:19:36.638235 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 146842us
I20260709 13:19:36.587908 18340 rpcz_store.cc:276] 0709 13:19:34.503344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.906131 (+1402787us) service_pool.cc:224] Handling call
0709 13:19:35.906483 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.906697 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:36.347054 (+440357us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.533987 (+186933us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:36.556830 (+ 22843us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:36.574016 (+ 17186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.574134 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.574275 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95064,"prepare.queue_time_us":167981,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":131262,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":190,"thread_start_us":507400,"threads_started":2,"wal-append.queue_time_us":216991}
I20260709 13:19:36.650262 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.657512 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.658444 18344 raft_consensus.cc:2393] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 13: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:19:36.659027 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.659823 18344 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:36.660352 18488 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:36.661413 18344 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:36.667512 24089 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:36.670918 19057 raft_consensus.cc:2393] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:36.670670 23499 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:19:36.671782 24047 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:36.672698 18335 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 16: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:36.660048 18493 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:36.674511 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.675488 18491 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:36.644697 24017 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:36.692879 24017 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:36.693444 24017 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:36.699322 19054 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:36.700408 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.700471 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:36.703030 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.703830 19056 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:19:36.704723 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.705497 19056 raft_consensus.cc:2368] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16.
I20260709 13:19:36.709097 18343 raft_consensus.cc:2410] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:36.684494 19026 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:36.709667 23982 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:36.710273 19026 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:36.712414 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 188328us
I20260709 13:19:36.713371 23958 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:36.713816 23958 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:36.714214 23958 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:36.714323 24082 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:36.715485 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 57562.7us
I20260709 13:19:36.715606 24056 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:36.716886 18309 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:36.717593 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:36.717971 24056 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:36.718117 23957 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:36.655377 24112 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.061s	user 0.000s	sys 0.002s
I20260709 13:19:36.685196 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.690208 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:36.708827 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 130444us
I20260709 13:19:36.683525 23876 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:36.712446 19026 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:36.724391 19061 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:36.697808 18337 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
W20260709 13:19:36.734701 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.734848 19059 raft_consensus.cc:2410] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:19:36.737586 18339 raft_consensus.cc:2468] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:36.750399 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:36.750977 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.718650 24056 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:19:36.752349 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 205444us
I20260709 13:19:36.746058 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:36.761006 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:36.761760 19062 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 16: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:36.762624 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:36.763060 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.763279 19062 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:36.772161 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:36.774250 24059 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:36.775485 24123 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:19:36.776443 23820 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.777283 19055 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:36.777928 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.749782 23954 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:36.797785 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.799765 19025 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:36.822979 24047 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:36.823835 18308 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:36.824054 24047 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.782358 23957 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:36.737161 24082 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
W20260709 13:19:36.834052 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 92159.5us
I20260709 13:19:36.864059 18418 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:36.850072 23957 raft_consensus.cc:697] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:36.875922 18419 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:36.876395 23825 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:36.876873 23925 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:19:36.881125 19058 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:36.861990 24096 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:19:36.889813 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 115904us
I20260709 13:19:36.889958 18382 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:36.872001 23954 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:36.893741 18307 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:36.855785 23982 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:36.889839 24096 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:19:36.904301 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 53592.1us
I20260709 13:19:36.906016 23823 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:19:36.905833 23982 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.911931 18307 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:36.912755 18308 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:36.917151 18418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:36.917768 18418 raft_consensus.cc:606] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:36.921757 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:36.923132 23717 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:36.924190 23825 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:36.925617 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:36.901726 23877 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.921782 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:36.922744 23982 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:36.928448 18307 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:36.929325 23925 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.929700 23751 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:36.914487 23954 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:36.930894 23869 raft_consensus.cc:3055] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:36.930662 23986 raft_consensus.cc:993] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:19:36.945565 23869 raft_consensus.cc:740] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:36.947352 24095 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:36.916993 24059 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:36.947919 24095 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:36.948158 24059 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:36.948438 24095 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:36.949859 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.952545 23825 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:36.953694 23825 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.944782 23958 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.956753 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.956907 23958 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:36.959738 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:36.958432 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:36.960098 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:36.960163 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:36.962180 18339 raft_consensus.cc:2410] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:19:36.963321 24128 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:19:36.963464 24131 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:19:36.964202 24130 log.cc:927] Time spent T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:19:36.934628 23717 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.965363 23877 raft_consensus.cc:1081] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:19:36.948607 24059 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:36.972329 19027 leader_election.cc:400] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 18. Current term is 19.
I20260709 13:19:36.972679 19027 leader_election.cc:403] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:36.968386 24122 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.089s	user 0.001s	sys 0.001s
I20260709 13:19:36.947916 23869 consensus_queue.cc:260] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:36.975589 23869 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.975934 23957 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.972169 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:36.978322 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:36.980883 24054 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:36.981312 24054 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.981626 24054 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:36.982390 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:36.982553 24044 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:36.983034 24044 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.983366 24044 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:36.987217 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.988185 23959 raft_consensus.cc:993] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:19:36.988523 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.988698 23959 raft_consensus.cc:1081] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:19:36.990315 19055 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:36.992014 18416 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:36.992391 24138 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.917304 24056 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.992980 24138 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:36.995538 24138 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:36.996367 24096 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.989727 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:36.998891 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 56170us
I20260709 13:19:36.999162 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.998247 23717 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:37.000228 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:36.997505 24017 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:37.001327 24047 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:36.992880 24121 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:19:37.006229 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:37.007145 24068 log.cc:927] Time spent T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
I20260709 13:19:37.004328 23954 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:36.997961 24096 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:37.020761 19054 raft_consensus.cc:2393] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 17: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:36.930243 23982 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:37.023255 18418 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:37.016584 18309 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:37.026551 19026 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:37.027451 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:37.027715 19062 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:37.031958 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:37.033239 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 55676.2us
W20260709 13:19:37.049937 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 50413.2us
I20260709 13:19:37.050554 24047 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:37.051055 24047 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.051126 18486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:19:37.051796 18486 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:37.052253 18486 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:37.059954 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:37.051537 24047 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:37.069712 23820 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 18. Current term is 19.
I20260709 13:19:37.070454 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:37.075724 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:37.075639 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:37.076340 18336 raft_consensus.cc:2393] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 16: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:37.082808 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:37.084591 19026 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:37.061017 24089 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:37.110801 24017 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:37.088130 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:37.088857 18308 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:37.111657 19058 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:37.112504 18308 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:37.113607 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.090402 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:37.114194 23982 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:37.115350 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:37.116530 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:37.091198 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:37.118700 19061 raft_consensus.cc:2410] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:19:37.119037 24095 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:37.120983 19061 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:37.121510 24095 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:37.096724 18337 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:37.097218 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:37.098069 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:37.098774 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:37.099735 18338 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:19:37.149087 18343 raft_consensus.cc:2368] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 13. Current term is 14.
I20260709 13:19:37.148726 18486 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:37.100401 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:37.101115 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:37.101830 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:37.091686 18490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:19:37.150507 18490 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:37.150820 18490 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.122282 19061 raft_consensus.cc:1217] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Deduplicated request from leader. Original: 15.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:19:37.117795 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:37.122363 24059 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:37.150032 18340 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 9.
W20260709 13:19:37.118728 18458 leader_election.cc:336] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.773s (SENT)
I20260709 13:19:37.126767 19056 raft_consensus.cc:1240] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:19:37.128140 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 156192us
W20260709 13:19:37.134656 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.151350 19061 raft_consensus.cc:1240] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:19:37.151855 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:37.160020 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:37.159961 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:37.155864 18486 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:37.170600 19055 pending_rounds.cc:85] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 13
I20260709 13:19:37.171011 19055 pending_rounds.cc:107] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:19:37.171255 19055 raft_consensus.cc:2889] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:37.173976 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:37.176457 18344 raft_consensus.cc:2368] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 14. Current term is 15.
I20260709 13:19:37.177377 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:37.182292 19053 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:37.182922 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:37.193210 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 140300us
I20260709 13:19:37.225628 19060 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:37.227032 18337 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:37.230446 19058 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:37.229276 19062 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:37.193311 24039 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.241433 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:19:37.241822 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 157322us
I20260709 13:19:37.236215 18340 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:37.219581 23876 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:19:37.229809 24102 log.cc:927] Time spent T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:37.258915 18338 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 17. Current term is 18. Ops: []
W20260709 13:19:37.266742 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 148102us
W20260709 13:19:37.267946 18458 leader_election.cc:336] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 2.032s (SENT)
I20260709 13:19:37.266765 24139 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:37.269227 18458 leader_election.cc:336] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 2.066s (SENT)
I20260709 13:19:37.265691 19026 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:37.273483 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 202559us
I20260709 13:19:37.269780 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:37.283551 24089 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:37.246197 23691 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.279891 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:19:37.285988 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.273406 23876 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:37.325608 24138 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:37.283824 24047 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:37.344461 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 95977.1us
I20260709 13:19:37.264004 24039 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:37.366982 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:37.274518 24054 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:37.379020 18488 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:37.382355 18341 raft_consensus.cc:1240] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16. Ops: [13.12-15.13]
I20260709 13:19:37.327370 23691 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:37.423568 18419 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
W20260709 13:19:37.425086 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:37.424635 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 272560us
I20260709 13:19:37.403275 24096 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:37.426666 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 157516us
W20260709 13:19:37.512639 18458 leader_election.cc:336] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 2.075s (SENT)
I20260709 13:19:37.513162 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:37.437755 24082 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:37.518687 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:37.523718 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.526532 18492 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:37.530592 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:37.531157 18412 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:37.531456 18412 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:37.529994 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:37.535233 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 269708us
W20260709 13:19:37.527882 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 114812us
I20260709 13:19:37.505635 23959 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.509222 23825 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:37.427178 23717 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:37.537766 19026 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:37.541589 18339 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:37.546226 18338 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:37.538213 24027 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:37.426191 23876 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:37.641047 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 97050.5us
W20260709 13:19:37.624208 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 73378.5us
I20260709 13:19:37.548357 18412 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:37.632504 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.522693 24096 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:37.644491 18412 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:37.643786 19026 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:37.652951 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:37.690095 23647 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:37.690555 18493 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:37.690781 23647 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:37.625806 24144 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:19:37.552309 24089 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:37.720767 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 208143us
I20260709 13:19:37.542316 23823 consensus_queue.cc:1059] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.144s
W20260709 13:19:37.719790 24044 consensus_meta.cc:287] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.002s
I20260709 13:19:37.696250 23958 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:37.550462 23959 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:37.621748 23954 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.117s
I20260709 13:19:37.748258 24044 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:37.745298 24047 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:37.751775 24155 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:19:37.752352 24096 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:37.744468 24056 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.758863 24056 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:37.760810 24056 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:37.752889 24027 consensus_queue.cc:1059] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:37.758286 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 111573us
I20260709 13:19:37.740876 23825 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:37.762326 24141 log.cc:927] Time spent T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260709 13:19:37.764300 23825 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:37.766168 24149 log.cc:927] Time spent T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
W20260709 13:19:37.767532 24148 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.351s	user 0.000s	sys 0.000s
W20260709 13:19:37.770404 24154 log.cc:927] Time spent T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.002s
W20260709 13:19:37.774246 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.774641 24054 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:37.774286 24039 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:37.775632 24039 raft_consensus.cc:3055] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:37.776065 24039 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:37.782766 18490 consensus_meta.cc:287] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
I20260709 13:19:37.787897 18412 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:37.783391 18490 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:37.777046 24039 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:37.628320 24082 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:37.799935 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.774225 23959 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:37.788884 23958 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:37.821744 18490 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:37.820014 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:37.826658 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:37.828934 18336 raft_consensus.cc:2368] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 14. Current term is 15.
I20260709 13:19:37.822853 18342 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:37.858202 23958 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:37.861323 24142 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.598s	user 0.003s	sys 0.009s
I20260709 13:19:37.863045 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1306) took 1162 ms. Trace:
I20260709 13:19:37.863456 19056 rpcz_store.cc:276] 0709 13:19:36.700919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.773952 (+ 73033us) service_pool.cc:224] Handling call
0709 13:19:37.126512 (+352560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.171200 (+ 44688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.862813 (+691613us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54004551d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:37.862970 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809910016}
I20260709 13:19:37.868182 23954 consensus_queue.cc:1048] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:37.868268 24147 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:37.872170 24017 consensus_queue.cc:1048] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:19:37.872764 23691 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:37.875198 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 263553us
I20260709 13:19:37.866663 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1309) took 1164 ms. Trace:
I20260709 13:19:37.869597 19027 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:37.878654 19054 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.017s	sys 0.045s
W20260709 13:19:37.879343 19054 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.017s	sys 0.045s
I20260709 13:19:37.876324 19053 rpcz_store.cc:276] 0709 13:19:36.701794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.115580 (+413786us) service_pool.cc:224] Handling call
0709 13:19:37.176731 (+ 61151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.194684 (+ 17953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.866462 (+671778us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b54006f90d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:37.866599 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128772480}
I20260709 13:19:37.833279 24039 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:38.026014 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:38.050175 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.112001 23953 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:38.114034 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 72019us
W20260709 13:19:38.114553 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.115239 18309 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:38.115492 23959 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:38.116132 23691 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:38.116040 23959 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.116909 23691 raft_consensus.cc:697] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:38.118073 23691 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.122076 24164 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.122769 24164 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.125190 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2580) took 1057 ms. Trace:
I20260709 13:19:38.125312 24164 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.063707 24082 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.125584 18418 rpcz_store.cc:276] 0709 13:19:37.067317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.067854 (+   537us) service_pool.cc:224] Handling call
0709 13:19:37.079609 (+ 11755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.110202 (+ 30593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.110233 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:37.147732 (+ 37499us) log.cc:844] Serialized 26 byte log entry
0709 13:19:37.425130 (+277398us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:37.425163 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.425225 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.124939 (+699714us) raft_consensus.cc:1685] finished
0709 13:19:38.124960 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.125103 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":197129,"threads_started":1,"wal-append.queue_time_us":966552}
I20260709 13:19:38.116181 18309 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:38.143332 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 314436us
W20260709 13:19:38.144023 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:38.144446 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:38.165813 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 49715.4us
I20260709 13:19:38.166950 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.167949 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:38.134919 24164 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.168016 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.171969 19056 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:19:38.169684 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 300165us
I20260709 13:19:38.172550 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.195369 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.200958 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:38.207695 19062 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:19:38.208818 24160 log.cc:927] Time spent T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.358s	user 0.000s	sys 0.002s
I20260709 13:19:38.210078 24082 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:38.171641 24139 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:38.212327 19053 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:19:38.217378 24156 log.cc:927] Time spent T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:19:38.217649 23717 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:38.218449 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2581) took 1146 ms. Trace:
I20260709 13:19:38.218832 18415 rpcz_store.cc:276] 0709 13:19:37.072000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.072171 (+   171us) service_pool.cc:224] Handling call
0709 13:19:37.083974 (+ 11803us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:37.219873 (+135899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.219919 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:37.232345 (+ 12426us) log.cc:844] Serialized 52 byte log entry
0709 13:19:37.532396 (+300051us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:37.647190 (+114794us) log.cc:844] Serialized 14 byte log entry
0709 13:19:37.647826 (+   636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.647966 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.208110 (+560144us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:38.212474 (+  4364us) raft_consensus.cc:1685] finished
0709 13:19:38.218268 (+  5794us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.218398 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103433,"prepare.queue_time_us":114440,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":98833,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":10645,"spinlock_wait_cycles":8909696,"thread_start_us":247391,"threads_started":1,"wal-append.queue_time_us":564436}
I20260709 13:19:38.221068 24139 raft_consensus.cc:697] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:38.222059 24139 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.226890 24164 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.244683 19027 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:38.242702 23825 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.250815 23959 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.242904 24167 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.250964 24082 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:38.256587 23954 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:38.242916 24164 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.279551 24017 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:38.237851 24039 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.289947 19061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1321) took 1318 ms. Trace:
I20260709 13:19:38.289049 19059 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1303) took 1589 ms. Trace:
I20260709 13:19:38.290778 18341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2723) took 1081 ms. Trace:
I20260709 13:19:38.293296 18341 rpcz_store.cc:276] 0709 13:19:37.208929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.224815 (+ 15886us) service_pool.cc:224] Handling call
0709 13:19:37.253693 (+ 28878us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:37.401204 (+147511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.289969 (+888765us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b540028d2d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:38.290718 (+   749us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284572416}
W20260709 13:19:38.291424 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 46834.9us
I20260709 13:19:38.293238 19059 rpcz_store.cc:276] 0709 13:19:36.700052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.754082 (+ 54030us) service_pool.cc:224] Handling call
0709 13:19:37.117494 (+363412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.117745 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.117773 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:37.117838 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:37.117899 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.128934 (+ 11035us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.288804 (+1159870us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400494150. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:38.288972 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809085696}
I20260709 13:19:38.293120 19061 rpcz_store.cc:276] 0709 13:19:36.971663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.172621 (+200958us) service_pool.cc:224] Handling call
0709 13:19:37.216547 (+ 43926us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:37.251942 (+ 35395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.251971 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:37.263260 (+ 11289us) log.cc:844] Serialized 52 byte log entry
0709 13:19:37.536271 (+273011us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:37.536369 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.537219 (+   850us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.289656 (+752437us) raft_consensus.cc:1685] finished
0709 13:19:38.289684 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.289864 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2314,"raft.queue_time_us":22818,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":11107,"thread_start_us":268849,"threads_started":1,"wal-append.queue_time_us":539654}
W20260709 13:19:38.298857 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.290378 24164 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:38.284442 23825 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.308876 19027 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:38.292426 24082 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:38.316483 18457 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:38.289602 23954 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.297101 24167 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.310727 24176 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.315658 24017 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:38.304224 24164 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.336287 24176 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.339895 24176 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.340090 24059 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.340678 24176 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:38.341326 24176 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:38.312713 24039 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.343532 24167 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.356623 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.362520 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:38.362900 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:38.362771 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:38.364748 18342 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:38.364795 18339 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:38.368064 18343 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:38.348073 24059 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:38.378314 24173 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:19:38.382256 24145 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.033s	user 0.000s	sys 0.017s
I20260709 13:19:38.386042 24180 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:38.386616 24180 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.388584 23825 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:38.389632 24177 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:38.392170 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1315) took 1422 ms. Trace:
I20260709 13:19:38.392490 23647 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.392720 19054 rpcz_store.cc:276] 0709 13:19:36.969763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.172054 (+202291us) service_pool.cc:224] Handling call
0709 13:19:37.181289 (+  9235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.263797 (+ 82508us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:37.370668 (+106871us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b480021d2d8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a3e05aa1 00007f40a3dfcb37 00007f40a3dfc9ca 00007f40a3ef426f 00007f40a3ef3f37 00007f40a3f0855c 00007f40a3f08508 00007f40a3f08488 00007f40a3f08443 00007f40a3f076ec 00007f40a2e31a96
0709 13:19:38.023111 (+652443us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.245010 (+221899us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.245639 (+   629us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.245785 (+   146us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:38.246335 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.246450 (+   115us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:38.246609 (+   159us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.246824 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.246897 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.391881 (+144984us) raft_consensus.cc:1685] finished
0709 13:19:38.391912 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.392087 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16236,"prepare.queue_time_us":30781,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":8157,"raft.queue_time_us":25895,"raft.run_cpu_time_us":1125,"raft.run_wall_time_us":114196,"spinlock_wait_cycles":13499648,"thread_start_us":665555,"threads_started":2,"wal-append.queue_time_us":224158}
I20260709 13:19:38.405272 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:38.406124 18341 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:38.408612 18342 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:38.397800 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:38.362043 23691 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:38.417399 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:38.419221 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:38.418932 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 66389.6us
I20260709 13:19:38.413800 24176 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:38.423640 24179 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:38.424316 24138 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:38.424889 24138 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.426977 24138 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.426684 23691 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:38.427527 24138 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:38.429740 18458 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:38.431586 24180 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.431936 24138 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:19:38.432487 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 77139.4us
I20260709 13:19:38.432210 23691 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:38.433862 18458 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:38.434954 24138 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:38.435175 24089 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:38.434969 19027 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:38.437160 23711 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:38.438441 23711 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:38.438876 24082 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:38.443186 24164 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.406718 24059 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.446327 24059 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.447436 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.444923 18458 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:38.452317 24164 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:38.453222 18343 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:19:38.453742 18343 pending_rounds.cc:85] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 8
I20260709 13:19:38.453442 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:38.454103 18343 pending_rounds.cc:107] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:19:38.454490 18343 raft_consensus.cc:2889] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.454571 18344 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 17: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:38.416618 23954 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:38.456799 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:38.413859 24178 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:38.458089 24164 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:38.458484 24178 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.459573 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:38.461176 24164 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:38.461653 24164 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:38.462177 24164 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:38.411103 24139 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:38.465863 24139 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.468665 24139 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.469828 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.471575 18458 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:38.474387 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:38.411669 23795 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:38.484753 24138 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:38.485767 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1308) took 1155 ms. Trace:
I20260709 13:19:38.490249 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:38.490800 18458 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:38.491214 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:38.491560 24138 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:38.492699 18458 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:38.493400 24138 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:38.493628 24178 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.487836 18491 rpcz_store.cc:276] 0709 13:19:37.324859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.344180 (+ 19321us) service_pool.cc:224] Handling call
0709 13:19:37.370584 (+ 26404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.370861 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:19:37.377116 (+  6255us) log.cc:844] Serialized 14 byte log entry
0709 13:19:37.377537 (+   421us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.343036 (+965499us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b180049ba60. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f409bdf1a40 00007f409bdec4e4 00007f409bdec455 00007f40a28d43c7 00007f409eee69a7 00007f409eef60bf 00007f409eef6038
0709 13:19:38.343240 (+   204us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.391626 (+ 48386us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b180049ba60. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdbd2a6 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1
0709 13:19:38.392926 (+  1300us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b180049ba60. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:19:38.423720 (+ 30794us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b180049ba60. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef522 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:19:38.479520 (+ 55800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:38.479584 (+    64us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:38.479659 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.479811 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.479953 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7593,"prepare.queue_time_us":1046302,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":113,"raft.queue_time_us":34843,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":25483,"spinlock_wait_cycles":104974208,"thread_start_us":135980,"threads_started":1}
I20260709 13:19:38.494992 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:38.496002 24138 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:38.496659 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.497112 23711 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.497275 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:38.497583 23711 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.498010 24138 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:38.498417 24138 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:38.498809 24138 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:38.500052 23711 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:38.501520 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.501763 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:38.502261 19057 raft_consensus.cc:2393] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 11: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:38.502351 19054 raft_consensus.cc:2376] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16. Re-sending same reply.
I20260709 13:19:38.503610 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:38.504280 19054 raft_consensus.cc:2368] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 14. Current term is 15.
I20260709 13:19:38.506425 24138 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:38.506793 24164 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.508154 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:38.508849 19054 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:38.510426 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.514926 18458 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:38.515854 24027 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:38.516261 24027 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.516568 24027 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:38.516988 19054 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:38.520159 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.521029 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:38.521469 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:38.521337 24175 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.309s	user 0.001s	sys 0.002s
I20260709 13:19:38.525763 24164 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.522281 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:38.526592 19053 raft_consensus.cc:2376] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13. Re-sending same reply.
I20260709 13:19:38.522428 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.527675 23711 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:38.522545 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.522691 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:38.530328 24027 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:38.531641 24138 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:38.532095 24164 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:38.532349 19027 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:38.533630 24164 consensus_queue.cc:1243] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer d03b672b2ff044b8bc2a0dfd8180ee19 log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:19:38.523566 18338 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:19:38.534160 23711 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:38.534265 24138 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:38.522106 19060 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:38.534866 24138 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:38.535092 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:38.521899 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.535841 24138 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.536491 18338 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:19:38.524125 24044 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.532902 18458 leader_election.cc:400] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 14. Current term is 15.
I20260709 13:19:38.538743 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:38.539001 18458 leader_election.cc:403] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:19:38.539834 23898 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:38.539738 18458 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:38.540858 24138 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:38.540647 23711 consensus_queue.cc:1059] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:38.541498 23711 raft_consensus.cc:3055] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:38.540683 24027 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:38.542410 23954 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:38.541813 23711 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:38.543999 23711 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.539671 24044 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.544948 23711 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:38.544975 24044 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.549878 24044 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.551493 18485 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:38.552894 18489 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:38.478765 23795 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:38.556640 24164 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:38.557126 24164 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.556784 23795 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.557497 24164 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:38.558137 23795 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:38.563066 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.564689 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.564845 24164 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:38.565421 18489 raft_consensus.cc:2410] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:38.566542 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.567273 24164 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:38.567909 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:38.568362 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2729) took 1035 ms. Trace:
I20260709 13:19:38.568831 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.569085 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.569406 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.569573 18485 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:38.570173 18484 raft_consensus.cc:2368] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13.
I20260709 13:19:38.570554 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:38.571168 18485 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:38.572863 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.571193 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:38.524515 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.574352 19059 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:38.579066 18485 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:38.583194 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.583858 18485 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:38.585434 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:38.585798 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.585934 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:38.586009 18491 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:38.586233 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.586546 18490 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:38.586997 19061 raft_consensus.cc:2368] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16.
I20260709 13:19:38.534286 19058 raft_consensus.cc:1275] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:19:38.588181 19058 pending_rounds.cc:85] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 10
I20260709 13:19:38.588436 19058 pending_rounds.cc:107] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:19:38.588649 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.589257 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.589586 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.590092 18487 raft_consensus.cc:2393] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 17: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:38.590266 18488 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:38.590840 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.591183 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.591527 18487 raft_consensus.cc:2393] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:38.591717 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.588656 19058 raft_consensus.cc:2889] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.592293 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.592717 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.591940 18488 raft_consensus.cc:2393] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:38.589288 18490 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 9.
I20260709 13:19:38.568713 18340 rpcz_store.cc:276] 0709 13:19:37.533081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.536670 (+  3589us) service_pool.cc:224] Handling call
0709 13:19:37.549099 (+ 12429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.828295 (+279196us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:37.834894 (+  6599us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.151758 (+316864us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:38.151827 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:38.151892 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.568147 (+416255us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54000ea6d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:38.568193 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.568298 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":231,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":1048,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8289,"spinlock_wait_cycles":606015488,"thread_start_us":313965,"threads_started":1,"wal-append.queue_time_us":388260}
I20260709 13:19:38.596454 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:38.596951 18340 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:38.603827 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.602267 18489 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:19:38.604569 18488 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:38.600467 18491 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
W20260709 13:19:38.572948 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.605474 18339 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:38.610800 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:38.611519 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.612354 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:38.622921 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:38.623101 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 67637.4us
I20260709 13:19:38.623922 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:38.623757 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 109012us
I20260709 13:19:38.629106 18415 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:38.629185 24095 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:19:38.630730 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 89501.1us
I20260709 13:19:38.633540 18487 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:19:38.634047 18487 pending_rounds.cc:85] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 14
I20260709 13:19:38.634090 18491 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:38.634507 18487 pending_rounds.cc:107] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:19:38.634900 18487 raft_consensus.cc:2889] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.636523 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:38.641983 18490 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:38.643589 18484 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:19:38.644492 18340 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:38.646209 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.646886 19058 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:38.647279 18341 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:38.648056 18342 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:19:38.652745 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:38.655146 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:38.656356 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:38.656672 19061 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:38.661761 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:38.662246 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:38.662515 24042 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:38.662925 18418 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:38.663796 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:38.664090 18308 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:38.664594 18417 raft_consensus.cc:2410] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:19:38.662256 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.664844 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.665680 24039 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.666445 23713 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:38.667963 24017 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:38.668459 23954 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:38.670279 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:38.663754 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:38.672683 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 46648.5us
W20260709 13:19:38.672818 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.665457 19062 raft_consensus.cc:2393] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 16: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:38.674424 18488 raft_consensus.cc:1240] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:38.674654 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:38.675523 18415 raft_consensus.cc:2393] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 16: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:38.637553 23711 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:38.676158 24059 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:38.676720 23711 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:38.697178 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.679082 19059 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:38.712641 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:38.713356 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.713500 18340 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:38.714006 18488 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:38.712935 18339 raft_consensus.cc:1275] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:19:38.713544 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:38.720052 18489 raft_consensus.cc:3060] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:38.719574 18339 pending_rounds.cc:85] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 12
I20260709 13:19:38.720850 18339 pending_rounds.cc:107] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:19:38.721251 18339 raft_consensus.cc:2889] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.727727 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.728627 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:38.729094 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:38.756577 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 67097us
I20260709 13:19:38.755462 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.758097 18308 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:38.766280 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.768707 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.769506 19054 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:38.774243 18485 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:38.785260 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:38.765379 24165 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.007s	sys 0.019s
W20260709 13:19:38.791488 24165 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.007s	sys 0.020s
W20260709 13:19:38.784477 18458 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.4:45611 timed out after 1.813s (SENT) [suppressed 24 similar messages]
I20260709 13:19:38.792524 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:38.793082 18384 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:38.729960 23691 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:38.787278 24059 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:19:38.798146 23647 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:38.799335 24059 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:38.800359 18308 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:38.801157 23986 consensus_queue.cc:1059] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:38.802052 23986 consensus_queue.cc:1059] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:38.805610 18410 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:38.806011 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:38.773829 24167 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.814708 18308 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:38.817359 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.804180 18384 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:38.718370 24017 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:19:38.712643 23954 consensus_queue.cc:1059] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:19:38.834020 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:38.717928 24095 consensus_queue.cc:1059] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.079s
I20260709 13:19:38.717443 23876 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 13:19:38.837414 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:38.795092 23713 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.840759 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.847674 18415 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:38.855589 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:38.808506 24050 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:38.852522 18382 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:38.865012 18485 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:38.874775 24191 log.cc:927] Time spent T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:19:38.878105 23711 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:38.878572 23984 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.852061 23713 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:38.879273 23984 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.881029 23713 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:38.838413 24039 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:38.846463 24056 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:38.899252 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 95277.6us
I20260709 13:19:38.850683 23647 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:38.883186 23691 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:38.883077 23954 raft_consensus.cc:3055] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:38.915297 18493 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:19:38.921397 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:38.839077 24167 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.883517 24176 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:38.924688 18384 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:38.881865 23984 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.898749 24056 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:38.859575 23959 consensus_queue.cc:1059] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:19:38.912027 23713 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:38.919293 24164 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.870536 24050 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.927723 23954 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:38.971066 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 46460.9us
I20260709 13:19:38.949975 24056 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.946092 24176 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:38.927138 23647 raft_consensus.cc:697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:38.970961 24164 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:38.974273 23938 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:38.974594 24167 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:38.905311 24039 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:38.996248 18384 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:38.951613 23713 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:39.016091 18489 raft_consensus.cc:2468] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:39.022769 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:39.028019 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 116419us
W20260709 13:19:39.029470 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.033696 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:39.033936 18307 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:39.035830 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 183383us
W20260709 13:19:39.053617 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 49800.4us
I20260709 13:19:39.027554 23713 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:39.010705 23898 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 14. Current term is 15.
I20260709 13:19:39.031070 23984 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:39.031293 24167 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:39.035035 24059 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:39.106856 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 73038us
I20260709 13:19:39.036161 23717 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:39.130550 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:39.144836 23986 raft_consensus.cc:3055] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:39.145327 23986 raft_consensus.cc:740] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:39.146229 23986 consensus_queue.cc:260] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:39.147495 23986 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:39.148816 23988 raft_consensus.cc:3055] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:39.149232 23988 raft_consensus.cc:740] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:19:39.150903 24201 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:19:39.151326 24039 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:39.153874 24197 log.cc:927] Time spent T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:39.154325 23647 consensus_queue.cc:237] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.155666 23988 consensus_queue.cc:260] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:39.158562 24198 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.182s	user 0.004s	sys 0.000s
I20260709 13:19:39.158716 24176 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:39.096534 23691 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:39.163033 18486 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:39.159585 23691 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:39.166373 23938 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:39.166755 23938 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:39.167112 23938 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:39.168006 23691 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:39.135118 24059 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.170387 24059 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:39.171743 23954 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.172773 23954 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:39.173998 24192 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:19:39.175648 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 361060us
I20260709 13:19:39.179936 18308 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:39.103404 23984 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.190903 18458 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:19:39.201759 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 71318.1us
I20260709 13:19:39.202309 24206 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:39.202687 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:39.203291 24206 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:39.204000 18307 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:39.204053 24206 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:39.205574 18307 leader_election.cc:400] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 12. Current term is 13.
I20260709 13:19:39.207131 24059 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:39.207590 18307 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:39.207728 24059 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:39.208752 24059 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:39.209806 18307 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:39.211156 23691 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:39.211946 23691 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:39.212390 23691 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:39.212841 23691 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:39.234155 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 54287.6us
I20260709 13:19:39.236428 18308 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:39.238071 24206 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:39.244385 18458 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:39.239880 24192 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:19:39.132525 24207 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:39.261797 18458 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:39.198697 23984 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:39.136080 24167 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:39.254482 23898 raft_consensus.cc:2764] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:19:39.278538 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 435056us
I20260709 13:19:39.261262 24185 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:39.268898 24187 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:39.288530 18458 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:39.211858 18307 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:39.309019 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 97314.2us
I20260709 13:19:39.313454 18307 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:39.315982 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 282366us
W20260709 13:19:39.319320 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 194917us
I20260709 13:19:39.303359 23795 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:39.322263 18384 leader_election.cc:400] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16.
I20260709 13:19:39.323879 18384 leader_election.cc:403] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:39.312119 24217 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:39.326736 24188 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.380s	user 0.000s	sys 0.001s
W20260709 13:19:39.336237 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 47809.3us
I20260709 13:19:39.337136 18458 leader_election.cc:400] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 14. Current term is 15.
I20260709 13:19:39.337991 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:39.344046 24229 consensus_queue.cc:1048] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:39.345160 24059 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:39.347368 24056 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:39.347667 24059 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:39.348472 23746 raft_consensus.cc:3055] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:39.348958 23746 raft_consensus.cc:740] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:39.349530 24056 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:39.383762 23795 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:39.350853 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.398434 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:39.313927 23898 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:39.401533 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:39.448884 18491 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 14: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:39.350644 24039 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:39.295269 23713 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.374306 24167 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:39.314781 24164 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:39.408792 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 83588.9us
W20260709 13:19:39.371443 24209 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:19:39.370465 24200 log.cc:927] Time spent T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 13:19:39.378525 24205 log.cc:927] Time spent T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:19:39.421672 18458 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:39.349931 23746 consensus_queue.cc:260] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.363734 23691 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.355850 24176 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:39.438962 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 125623us
I20260709 13:19:39.445451 18418 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:39.438298 24042 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.468742 24042 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.470095 24050 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:39.470867 24042 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:39.471525 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:39.447546 23795 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:39.455384 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:39.457510 24227 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:39.457653 24221 consensus_queue.cc:1059] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:19:39.474535 19057 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:39.460800 18458 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:39.448148 23825 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:39.464978 18488 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:39.459695 24095 raft_consensus.cc:3055] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:39.467069 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:39.478514 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:39.479878 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:39.467954 18382 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:39.475970 23825 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:39.483776 24233 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.483930 23938 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.484375 24233 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.485513 24138 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:39.488924 18307 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:39.483965 23825 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:39.486502 19026 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:39.471500 23691 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:39.473515 23898 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:39.475879 24164 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:39.495992 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:39.482203 24095 raft_consensus.cc:740] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:39.492650 24165 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:39.490957 24167 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:39.494148 24229 consensus_queue.cc:1059] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:19:39.499905 24164 raft_consensus.cc:697] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:39.499774 24095 consensus_queue.cc:260] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.500847 24095 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:39.502032 24146 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:39.502378 24187 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:39.474167 24223 consensus_queue.cc:1059] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:19:39.503093 23959 raft_consensus.cc:2804] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:39.503139 23938 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:39.504055 24223 raft_consensus.cc:3055] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:39.504460 24223 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:39.504585 23713 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:39.506368 24050 raft_consensus.cc:3055] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:39.506400 23959 raft_consensus.cc:697] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:39.506814 24050 raft_consensus.cc:740] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:39.507498 23959 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:39.507593 24050 consensus_queue.cc:260] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.508723 24050 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:39.500849 24164 consensus_queue.cc:237] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:39.514183 24233 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:39.514267 24220 raft_consensus.cc:3055] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:39.514921 24220 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:39.505326 24223 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:39.518836 24223 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.482463 23984 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.523777 23984 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:39.474036 24176 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.482086 24056 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:39.529407 18307 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:39.497203 19026 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:39.542443 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 44163.9us
I20260709 13:19:39.544023 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:39.515965 24220 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.558444 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:39.560213 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 63074.8us
I20260709 13:19:39.561268 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:39.568375 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:39.540203 24165 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:39.569875 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:39.526203 23499 consensus_queue.cc:1059] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:19:39.539937 24213 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:39.541618 23986 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16.
I20260709 13:19:39.580009 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:39.580356 24042 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:39.580655 18418 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:39.538996 24225 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:39.576763 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:39.581331 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:39.585347 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:39.585816 18344 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 17: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:39.569816 24208 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:39.578176 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:39.566793 23982 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:39.595610 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:39.555740 23691 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:39.587463 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.599574 18342 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:39.587975 19057 raft_consensus.cc:1240] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:39.591097 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:39.590449 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:39.559087 24221 consensus_queue.cc:1059] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:19:39.598503 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:39.601099 18419 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.602300 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:39.603958 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:39.603910 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:39.605861 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:39.606066 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:39.606570 18342 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.607507 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:39.608127 18335 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:39.608040 18419 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:39.572510 24146 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:39.609472 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:39.611788 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:39.613381 18417 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:39.587554 24230 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:39.587462 24229 raft_consensus.cc:3055] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:39.580981 24217 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:39.616747 18340 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:19:39.617427 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:39.616842 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:39.617672 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:39.631917 24229 raft_consensus.cc:740] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:39.632934 24229 consensus_queue.cc:260] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:39.634663 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:39.593348 24042 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:39.635385 24221 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.635936 24221 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.636029 24042 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.638209 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:39.638473 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:39.638321 23898 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.639138 19061 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:39.612897 23691 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.587210 24213 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.644063 23691 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:39.638218 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:39.645381 19060 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:39.645550 24213 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:39.645730 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:39.649801 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:39.654636 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:39.650580 18343 raft_consensus.cc:1275] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:39.620281 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:39.652145 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:39.652304 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:39.578339 24059 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:19:39.595414 23982 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:39.654166 24237 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:39.660900 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:39.662393 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:39.611860 23876 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.664389 18412 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:19:39.612185 24208 raft_consensus.cc:697] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:39.667519 18417 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 17: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:39.667966 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:39.672616 18337 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:39.668728 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:19:39.668875 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 208135us
I20260709 13:19:39.660660 24232 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:39.671095 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:39.629834 24017 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.675367 19054 raft_consensus.cc:2410] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:19:39.675108 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 207234us
I20260709 13:19:39.677062 18487 raft_consensus.cc:1240] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:39.679836 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:39.609714 24206 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:19:39.663657 23982 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:39.690130 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.689587 18382 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:39.698510 18418 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:39.699942 18342 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:39.686993 24017 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.689029 23795 consensus_queue.cc:1048] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:19:39.710318 19059 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
W20260709 13:19:39.720315 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 45256.2us
I20260709 13:19:39.710997 23959 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:39.731462 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:39.730134 24241 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:39.734431 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:39.738050 24042 consensus_queue.cc:1059] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:39.739251 23959 raft_consensus.cc:3055] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:39.739593 23959 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:39.740417 23825 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.722494 24056 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:39.742276 24056 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:39.744020 24238 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:19:39.744724 24056 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:39.723685 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:39.726316 18418 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:19:39.727171 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:39.729592 24017 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:39.730118 23746 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:39.730369 24232 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:39.748243 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:39.748296 18308 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:39.748472 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:39.656237 24217 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:39.757187 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:39.675822 23876 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.751847 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:39.753165 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:39.740419 23959 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:39.716306 24185 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:39.761188 18457 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:39.763561 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:39.765517 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:39.774501 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:39.746592 24176 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:39.777640 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:39.779138 19026 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:39.767876 24225 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:39.796854 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:39.771718 24243 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:39.781142 24164 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:39.791715 24176 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:39.810940 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 45561.4us
I20260709 13:19:39.812892 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:39.814798 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 107679us
I20260709 13:19:39.778224 24216 consensus_queue.cc:1059] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:19:39.784361 23711 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:19:39.819630 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:39.805060 24213 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:39.821178 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:39.822795 19062 raft_consensus.cc:1240] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:39.829077 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:39.843624 18341 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 16: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:39.829844 24086 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:39.832895 18416 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:39.810287 24176 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.837055 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:39.820300 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:39.801373 24225 raft_consensus.cc:697] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:39.841660 19060 raft_consensus.cc:2410] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:19:39.779167 24208 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:39.815846 24164 raft_consensus.cc:697] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:39.854527 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:39.855145 19057 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:39.855688 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 75210.2us
I20260709 13:19:39.840286 24243 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:39.867779 24164 consensus_queue.cc:237] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:39.860687 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:39.862316 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:39.863082 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:39.863703 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:39.865964 24059 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:39.850749 24176 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:39.848469 24236 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:19:39.872151 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:39.876014 18485 raft_consensus.cc:2376] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16. Re-sending same reply.
I20260709 13:19:39.875090 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:39.877105 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:39.844327 23825 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:39.873191 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:39.851779 24167 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:39.880182 18458 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:19:39.881549 24247 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:19:39.892247 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:39.893327 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:39.897672 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:39.903316 18492 raft_consensus.cc:2393] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 11: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:39.872581 24255 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:39.917726 24255 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:39.918293 24255 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:39.921669 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:39.871920 24225 consensus_queue.cc:237] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:39.934659 24249 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:39.934880 23876 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:39.876459 24059 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:39.937031 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:39.937932 24059 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:39.938169 18417 raft_consensus.cc:2410] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:19:39.943565 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.943523 19057 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:39.924572 24138 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:39.955871 24256 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:39.985088 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.891410 24243 consensus_queue.cc:1059] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:19:39.989993 18338 raft_consensus.cc:2468] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
W20260709 13:19:40.008340 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 111893us
I20260709 13:19:40.012535 18414 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:40.012312 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:40.007336 24217 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:40.011507 24164 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:19:40.054313 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.029759 24266 log.cc:927] Time spent T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:19:40.027949 24164 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:40.080344 24267 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.081091 24267 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.083405 24267 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:40.090745 24264 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:19:40.091521 24164 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:40.016260 24256 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:19:40.094761 24237 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:40.099861 18335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47610
I20260709 13:19:40.100455 18335 raft_consensus.cc:606] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Received request to transfer leadership
I20260709 13:19:40.100840 18335 raft_consensus.cc:614] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:40.112399 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 232301us
I20260709 13:19:40.113469 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:40.114310 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 87022.5us
I20260709 13:19:40.118543 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:40.120900 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:40.122685 18458 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:40.129297 24269 raft_consensus.cc:3055] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:40.129813 24269 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:40.132954 24217 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:40.133564 24217 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:40.135859 24217 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:40.136412 24273 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:40.137243 18486 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:40.145438 24229 raft_consensus.cc:3060] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:40.120493 24256 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:40.152949 23982 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.116462 24176 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.155115 23982 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.155510 24220 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:40.156858 24176 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.157528 18341 raft_consensus.cc:1240] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:40.139504 24138 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:40.142107 24255 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:40.162112 24255 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:40.163496 23959 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.164908 24164 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:40.168264 24050 consensus_meta.cc:287] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.659s	user 0.007s	sys 0.008s
I20260709 13:19:40.136448 24217 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:40.130805 24269 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:40.169765 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 47185.9us
I20260709 13:19:40.170372 18411 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:40.173897 18458 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:40.169659 24278 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:40.176131 24269 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.190086 18490 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:40.177845 24255 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:40.191928 24083 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:40.175357 24217 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.201045 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:40.203001 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.204672 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.206681 18458 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:40.207742 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.210525 24138 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.214373 24265 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:40.215129 24265 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.212975 24225 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.220106 24253 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:40.220798 24253 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:40.198753 24255 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:40.220872 24164 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.209877 24278 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:40.209714 23982 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:40.209544 24207 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:40.225442 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.225956 18458 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:40.228299 24138 raft_consensus.cc:2804] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:40.228325 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:40.228998 24138 raft_consensus.cc:697] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:40.229607 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:40.231089 18307 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.217816 24265 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:40.208834 24083 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.234257 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:40.235117 18307 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.223965 24255 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:40.224529 24221 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.237404 18493 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:19:40.235519 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 46353.9us
I20260709 13:19:40.236133 19056 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:40.241124 18307 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.248208 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:40.248991 18487 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:40.249641 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:40.250003 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:40.251610 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:40.233595 24225 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.252149 18338 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:40.255185 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:40.241334 24167 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:40.253280 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:40.253459 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:40.261030 18337 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:40.239118 24165 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:40.267408 24284 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:19:40.229856 24138 consensus_queue.cc:237] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:40.266243 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.270367 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:40.259855 24253 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.266732 24280 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:40.248236 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:40.271450 18335 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.279980 24280 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.281992 18307 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.283905 24225 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.287603 18335 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:40.252628 23982 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:40.279361 24083 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.278117 19056 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:40.287258 24225 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:40.290175 24269 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:40.290757 24269 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.293048 24176 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:40.293905 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:40.295116 24176 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:40.295663 24176 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:40.296626 24176 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:40.301833 19061 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:40.302269 24217 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.303169 19061 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:19:40.304289 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:40.304824 18488 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
W20260709 13:19:40.309180 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.310357 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.258697 24279 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.315342 18410 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:40.316954 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.318372 18342 raft_consensus.cc:1240] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:40.318040 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:40.319273 18419 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:40.269937 18338 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:40.317788 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:40.330839 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:40.334977 18337 raft_consensus.cc:1240] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:40.315935 24253 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:40.340416 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:40.340417 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:40.343847 19056 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:19:40.343727 18308 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.345335 19026 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.352134 18308 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.359505 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:40.349004 24167 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:40.318012 24279 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.349888 24256 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:40.359501 24281 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.371407 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:40.371866 24280 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:40.354210 24225 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:40.334764 24164 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:19:40.379703 18492 raft_consensus.cc:1240] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:40.381834 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:40.383502 24280 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.386775 19056 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:40.392817 24279 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:40.407485 18491 raft_consensus.cc:1240] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:40.416728 24255 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.380512 24256 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:40.420959 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.434319 23988 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:40.370087 24167 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:40.436177 24165 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.440171 18344 raft_consensus.cc:1275] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:40.425417 19056 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:40.440254 24167 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:40.475992 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 116894us
I20260709 13:19:40.448930 24269 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.449064 24243 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:19:40.481629 19025 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:40.485431 24279 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:40.485926 24279 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.486268 24279 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:40.488201 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.492116 24234 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.452394 24228 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:19:40.495404 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 150113us
I20260709 13:19:40.444169 24165 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.474589 24083 consensus_queue.cc:1059] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:19:40.477113 24223 consensus_queue.cc:1059] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:19:40.506918 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:40.507622 18411 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:40.509676 18491 raft_consensus.cc:1240] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:40.510838 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:40.512662 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 191191us
I20260709 13:19:40.525245 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:40.517409 24232 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.527264 18458 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:40.524263 24176 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:40.530810 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:40.531586 18338 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 18.
I20260709 13:19:40.533563 19056 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:40.524276 24285 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.543735 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:40.550019 18458 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:40.551342 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:40.526628 24138 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:40.551944 19062 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:40.553522 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:40.541095 24243 raft_consensus.cc:2764] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:40.546233 24255 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.530526 24274 consensus_queue.cc:1059] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:19:40.555526 24185 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:40.534219 24232 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.540491 24176 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:40.574479 24289 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:19:40.574589 24165 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.573954 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:40.551905 24285 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:40.583940 24290 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:40.557032 24164 consensus_queue.cc:1059] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:19:40.586424 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:40.585002 23746 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.589715 23746 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.591205 24176 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:40.591801 24293 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.592264 24293 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.592720 19058 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:40.594537 24293 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:40.595162 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:40.595592 18458 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:40.607026 18337 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 16: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:40.627835 24056 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:40.628672 24297 log.cc:927] Time spent T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:40.628576 24056 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.630581 24208 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:40.631134 24208 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:40.631349 24056 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.633481 18309 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.585269 24185 raft_consensus.cc:697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:40.634034 24165 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.635802 24165 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:40.636238 24185 consensus_queue.cc:237] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:40.638490 24299 log.cc:927] Time spent T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:40.638916 24056 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:40.638417 24165 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:40.639454 23877 raft_consensus.cc:3055] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:40.639983 23877 raft_consensus.cc:740] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:40.644501 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:40.641126 23877 consensus_queue.cc:260] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.647298 23877 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:40.651472 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37920 (request call id 2745) took 1003 ms. Trace:
I20260709 13:19:40.651891 18336 rpcz_store.cc:276] 0709 13:19:39.648092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.648371 (+   279us) service_pool.cc:224] Handling call
0709 13:19:39.648632 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.782758 (+134126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.782794 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.782836 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:39.782871 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.651236 (+868365us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400267ad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:40.651286 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.651415 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308001536}
I20260709 13:19:40.632264 24208 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:40.660449 19026 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:40.577178 24256 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.661808 19026 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:19:40.672067 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 76525.7us
I20260709 13:19:40.674160 24039 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:40.674532 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:40.670076 24281 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.671172 24233 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:40.682037 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:40.683225 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:40.677757 24086 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:40.693302 24086 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.693847 18343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1277) took 1101 ms. Trace:
I20260709 13:19:40.684561 24164 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.694537 24285 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:40.694480 24164 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:40.696022 24232 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:40.696640 24164 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:40.698107 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.693688 24086 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:40.690651 18486 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:40.707131 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:40.681681 24233 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:40.691820 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:40.708329 18414 raft_consensus.cc:2410] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:19:40.681526 24281 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.692483 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:40.681129 24039 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:40.711578 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:40.694307 18343 rpcz_store.cc:276] 0709 13:19:39.592128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.592787 (+   659us) service_pool.cc:224] Handling call
0709 13:19:39.593028 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.657678 (+ 64650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.693636 (+1035958us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b54002d19d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:40.693790 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130233088}
I20260709 13:19:40.689520 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:40.712805 18489 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:40.699476 24165 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:40.712186 18415 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:40.715443 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:40.715869 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:40.716885 18337 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:40.716938 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:40.712375 24039 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.720482 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:40.727595 18419 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:40.710129 24233 raft_consensus.cc:3060] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:40.734541 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:40.735409 18484 raft_consensus.cc:2410] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 17 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:19:40.737028 18290 auto_rebalancer.cc:893] Removing replace marker failed: Replica d03b672b2ff044b8bc2a0dfd8180ee19 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:19:40.737510 18290 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:19:40.737540 24281 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:40.737859 18290 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:19:40.740834 24260 raft_consensus.cc:3055] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:40.741256 24260 raft_consensus.cc:740] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:40.741581 24017 consensus_queue.cc:1059] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:40.742666 19027 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:40.742830 24234 raft_consensus.cc:3055] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:40.743395 24234 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:40.743731 24295 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:40.744153 24234 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.684165 24167 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:40.767056 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 76809.7us
I20260709 13:19:40.777499 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:40.778980 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:40.783991 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:40.786986 18309 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.786266 19027 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:40.765619 24165 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:40.820333 24165 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.821092 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:40.821899 18486 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:40.823194 24165 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.782256 24207 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.823876 24207 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.825937 24207 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.816411 24140 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.817589 24167 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:40.818670 24281 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:40.828504 24281 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.828876 24281 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:40.811442 24282 consensus_queue.cc:1048] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:19:40.833443 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:40.740746 24086 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.776681 24260 consensus_queue.cc:260] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.727888 24089 consensus_queue.cc:1059] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
W20260709 13:19:40.888162 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 99746.4us
I20260709 13:19:40.868512 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:40.889096 18343 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:40.785661 24056 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:19:40.871290 24281 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.872525 24279 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.894435 19060 raft_consensus.cc:1240] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:40.895718 24279 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:40.791455 24285 consensus_queue.cc:1059] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:19:40.862866 18419 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:40.896950 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:40.897349 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:40.897683 24281 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:40.900061 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:40.867012 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:40.907212 24307 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:19:40.907646 19056 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:19:40.903419 19026 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:40.920882 23898 raft_consensus.cc:3055] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:40.921350 23898 raft_consensus.cc:740] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:40.921802 24285 raft_consensus.cc:3055] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:40.922475 24086 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:40.922262 23898 consensus_queue.cc:260] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.923429 23898 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:40.882105 24234 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:40.922258 24285 raft_consensus.cc:740] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:40.927742 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.928289 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.927944 24285 consensus_queue.cc:260] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.929185 24285 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:40.931905 24089 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:40.932322 24089 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:40.932678 24089 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:40.933053 18309 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:40.933802 24217 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:40.934804 18338 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:19:40.936352 18344 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:40.935673 18342 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:40.937539 18340 raft_consensus.cc:1240] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:19:40.935017 18343 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:40.935648 18336 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:40.938381 24260 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:40.935957 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:40.939237 18339 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
W20260709 13:19:40.904333 24293 consensus_queue.cc:1175] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" responder_term: 9 status { last_received { term: 9 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 9 index: 10 } }
I20260709 13:19:40.911976 24233 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.944754 24233 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:40.945778 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:19:40.945720 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.948365 18411 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:19:40.953213 23746 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.955423 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:40.956053 18489 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:40.957479 24235 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.958698 24235 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:40.960112 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:40.960907 24235 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:40.961350 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:40.963467 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:40.963524 18382 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:40.964550 24221 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:40.964890 24221 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.965242 24221 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:40.972816 24208 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.975785 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:40.979020 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:40.982170 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:40.985764 18413 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
W20260709 13:19:40.991602 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 108454us
I20260709 13:19:40.992103 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:40.997423 18411 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:19:40.999334 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:41.000172 18489 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:41.000754 19061 raft_consensus.cc:2410] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
W20260709 13:19:41.003388 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.003561 18412 raft_consensus.cc:2468] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:40.566619 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:41.021065 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:41.028918 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.008136 19026 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:41.033624 18486 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:41.033033 24230 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.990267 23746 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:40.988040 23898 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:41.035415 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.037623 19026 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:41.036898 23746 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:41.043093 23746 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:41.045895 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:41.038129 24233 raft_consensus.cc:2804] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:41.051908 19057 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:41.058594 19027 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:41.059212 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:41.037995 24230 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:41.060412 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:41.065004 18336 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:41.057888 19025 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:41.061167 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:41.068080 24294 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:41.068837 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:41.040776 23988 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:19:41.070030 19059 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:41.070688 18339 raft_consensus.cc:2393] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 16: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:41.050763 24292 raft_consensus.cc:2804] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:41.065093 24233 raft_consensus.cc:697] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:41.079253 24312 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:19:41.079600 24233 consensus_queue.cc:237] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.088816 24221 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.090353 24280 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:41.049649 24223 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:19:41.095422 24230 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:41.098766 24089 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.068563 24294 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.102289 24294 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:41.097792 24221 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:41.107306 18336 raft_consensus.cc:2468] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:41.108594 19025 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:41.109365 24253 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:41.114115 24292 raft_consensus.cc:697] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:41.115155 24292 consensus_queue.cc:237] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.038975 23898 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:41.071400 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:41.119779 18340 raft_consensus.cc:3060] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:41.113720 18242 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42292 (request call id 343) took 45741 ms (client timeout 15000 ms). Trace:
W20260709 13:19:41.125278 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 305010us
I20260709 13:19:41.127121 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:41.129127 18486 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:41.115079 24242 raft_consensus.cc:3055] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:41.137532 18335 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:41.138504 18307 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.139103 18336 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:19:41.118899 24208 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:41.145021 24208 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.147251 23898 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:41.148259 23746 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.136945 23825 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:41.150318 18308 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:41.152001 18340 raft_consensus.cc:2468] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
W20260709 13:19:41.152805 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.172870 18308 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.174165 18308 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:41.176782 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 139453us
I20260709 13:19:41.131633 24230 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.137734 24242 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:41.178457 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:41.164764 23877 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:41.120882 18242 rpcz_store.cc:269] 0709 13:18:55.372885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.374041 (+  1156us) service_pool.cc:224] Handling call
0709 13:19:41.113635 (+45739594us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:37.008530 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:37.094579 (+ 86049us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:37.094656 (+    77us) write_op.cc:435] Acquired schema lock
0709 13:19:37.094683 (+    27us) tablet.cc:662] Decoding operations
0709 13:19:37.095887 (+  1204us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:37.096009 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:37.096050 (+    41us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:19:37.096901 (+   851us) tablet.cc:701] Row locks acquired
0709 13:19:37.096964 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:19:37.097180 (+   216us) write_op.cc:270] Start()
0709 13:19:37.097383 (+   203us) write_op.cc:276] Timestamp: P: 1783603177097101 usec, L: 0
0709 13:19:37.097441 (+    58us) op_driver.cc:348] REPLICATION: starting
0709 13:19:37.228349 (+130908us) log.cc:844] Serialized 2891 byte log entry
0709 13:19:38.239526 (+1011177us) op_driver.cc:464] REPLICATION: finished
0709 13:19:38.447136 (+207610us) write_op.cc:301] APPLY: starting
0709 13:19:38.447237 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:38.653754 (+206517us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:38.653877 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:38.661962 (+  8085us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:38.662240 (+   278us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:19:38.662308 (+    68us) write_op.cc:312] APPLY: finished
0709 13:19:38.662618 (+   310us) log.cc:844] Serialized 73 byte log entry
0709 13:19:38.788138 (+125520us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:38.797178 (+  9040us) write_op.cc:454] Released schema lock
0709 13:19:38.828003 (+ 30825us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:38.837386 (+  9383us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:38.837441 (+    55us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6246,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":177252,"apply.run_cpu_time_us":11694,"apply.run_wall_time_us":390232,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33289,"num_ops":7,"prepare.queue_time_us":391678,"prepare.run_cpu_time_us":28232,"prepare.run_wall_time_us":528063,"raft.queue_time_us":467410,"raft.run_cpu_time_us":35791,"raft.run_wall_time_us":123994,"replication_time_us":1141910,"thread_start_us":1028260,"threads_started":4,"wal-append.queue_time_us":316388,"wal-append.run_cpu_time_us":163412,"wal-append.run_wall_time_us":2115764}]]}
I20260709 13:19:41.150343 23825 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.179864 23982 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:41.185184 24050 raft_consensus.cc:2764] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:19:41.187626 24059 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:41.182233 24228 consensus_queue.cc:1059] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:19:41.182328 24221 consensus_queue.cc:1059] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:19:41.144447 18237 catalog_manager.cc:5697] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 10 to 17, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 17 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:41.218524 18237 catalog_manager.cc:5697] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 10 to 13, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 13 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:41.221228 18237 catalog_manager.cc:5697] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:41.228703 18237 catalog_manager.cc:5697] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 10 to 14, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 14 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:41.229431 24208 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:41.231068 24242 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.232613 24242 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:41.187907 24140 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:41.187837 24320 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:19:41.234498 18384 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.236371 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:41.187955 23746 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:41.230786 18237 catalog_manager.cc:5697] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 11 to 15, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 15 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:41.184115 24230 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:41.213565 23982 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:41.237063 18493 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:41.187593 23877 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.258219 18414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:41.259040 18414 raft_consensus.cc:606] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.259479 18414 raft_consensus.cc:614] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:41.263123 18384 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.263423 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:41.264096 18493 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:41.258361 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 84264us
I20260709 13:19:41.267658 18308 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:41.270277 18382 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:41.270643 18384 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:41.271546 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 94758.5us
I20260709 13:19:41.277462 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:41.278945 18384 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.279368 24220 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:41.252847 24217 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:19:41.280138 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:41.279721 24228 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:41.269212 23988 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:41.281976 18308 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:41.283089 24220 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:41.271397 24281 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.284534 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:41.286634 18308 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.287341 24227 consensus_queue.cc:1059] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:41.288503 24056 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:41.288554 18414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:41.295535 18414 raft_consensus.cc:606] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:41.295769 18414 raft_consensus.cc:614] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:41.289134 23825 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:41.296535 24059 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:41.297068 24059 raft_consensus.cc:697] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:41.297935 24059 consensus_queue.cc:237] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:41.289208 23746 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:41.301945 24227 consensus_queue.cc:1243] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:41.289731 24220 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.302935 24220 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.303081 18493 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
I20260709 13:19:41.289875 18382 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:41.308738 24220 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.289985 18384 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.291797 18340 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 14: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:41.277335 24323 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:41.282634 23982 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:41.293871 24228 raft_consensus.cc:697] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:41.276026 24256 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:19:41.327057 24228 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.328652 23988 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:41.329157 23988 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:41.329830 19060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:19:41.330418 19060 raft_consensus.cc:606] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:41.330437 18237 catalog_manager.cc:5697] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 5 to 9, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 9 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:41.290782 24294 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.334023 18237 catalog_manager.cc:5697] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:41.316563 19053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1342) took 1494 ms. Trace:
I20260709 13:19:41.315867 23982 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.338109 19053 rpcz_store.cc:276] 0709 13:19:39.822526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.822646 (+   120us) service_pool.cc:224] Handling call
0709 13:19:40.623140 (+800494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.623365 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:40.623670 (+   305us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.679655 (+ 55985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.679701 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:40.679744 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.679817 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.737787 (+ 57970us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b1800215440. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:19:41.316353 (+578566us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b54007521d0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:41.316491 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20961,"prepare.queue_time_us":2828,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":96,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":2186,"spinlock_wait_cycles":1843521152,"thread_start_us":55655,"threads_started":1,"wal-append.queue_time_us":101805}
I20260709 13:19:41.280601 24269 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:19:41.342643 23877 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:41.309674 24227 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:41.343523 18414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:41.344029 24227 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.344383 18414 raft_consensus.cc:606] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.344528 24227 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:41.344964 18414 raft_consensus.cc:614] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:41.346637 18237 catalog_manager.cc:5697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 13 to 16, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 16 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:41.348739 18237 catalog_manager.cc:5697] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 9 to 17, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 17 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:41.295006 24281 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.351889 24281 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:41.326920 24230 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:41.339073 23982 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:41.358363 24294 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:41.398911 18414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:41.399760 18414 raft_consensus.cc:606] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.400184 18414 raft_consensus.cc:614] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:41.389133 23898 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.389736 23988 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:41.416421 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 106634us
W20260709 13:19:41.423269 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 100678us
I20260709 13:19:41.438959 18384 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.441887 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:41.442836 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:41.443605 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:41.444135 18416 raft_consensus.cc:2376] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12. Re-sending same reply.
I20260709 13:19:41.445240 18413 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:41.445307 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:41.446125 18416 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:41.425525 18382 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:41.458148 18411 raft_consensus.cc:2468] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:41.459546 18412 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:41.353869 18237 catalog_manager.cc:5697] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:41.414250 23898 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.460911 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:41.462683 18419 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:41.464344 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:41.465272 18416 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 17: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:41.468046 24220 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:41.467959 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:41.469024 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:41.470193 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:41.471576 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:41.472262 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:41.473326 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:41.475567 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:41.476162 18411 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:41.476646 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:41.479511 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:41.460423 24223 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:41.482162 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:41.482427 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:41.482708 18412 raft_consensus.cc:606] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:41.484325 24326 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:41.488364 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:41.488626 23898 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:41.494095 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:41.472913 24269 raft_consensus.cc:476] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Not starting pre-election -- already a leader
I20260709 13:19:41.494762 18493 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.496085 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:41.498339 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:41.448035 23986 consensus_queue.cc:1059] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:19:41.496881 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1343) took 1674 ms. Trace:
I20260709 13:19:41.504580 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:41.502383 18412 raft_consensus.cc:1275] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:41.508806 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:41.509620 18339 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:41.509876 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:41.515770 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:41.516741 18344 raft_consensus.cc:1240] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: [12.8-13.9]
I20260709 13:19:41.518416 18413 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:41.521121 18342 raft_consensus.cc:1240] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:19:41.495024 24223 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:41.503316 19055 rpcz_store.cc:276] 0709 13:19:39.823041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.823253 (+   212us) service_pool.cc:224] Handling call
0709 13:19:40.368938 (+545685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:40.384018 (+ 15080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.384053 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:40.384517 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.503695 (+119178us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:40.503749 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.007601 (+503852us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b54006f8454. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:41.007645 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.007689 (+    44us) raft_consensus.cc:1685] finished
0709 13:19:41.007706 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.496666 (+488960us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54006f8450. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedb8ad 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:41.496808 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9377,"raft.queue_time_us":11753,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":1266302464,"thread_start_us":118842,"threads_started":1,"wal-append.queue_time_us":158689}
I20260709 13:19:41.522406 18493 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:41.527789 18382 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:41.542263 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:41.542925 18341 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:41.515782 23986 consensus_queue.cc:1243] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:19:41.516435 24225 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:41.552219 24050 raft_consensus.cc:3055] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:41.552655 24050 raft_consensus.cc:740] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:41.554250 23499 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:41.554741 23499 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:41.555537 23499 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:41.556809 23499 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:41.562119 24294 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:41.562724 24294 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.564921 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:41.565155 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:41.565552 19060 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
I20260709 13:19:41.565881 19053 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:41.567389 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:41.567701 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:41.569434 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:41.569576 19056 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:41.570307 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:41.570896 19054 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:41.572748 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:41.573246 19054 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.596731 19056 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:41.598187 19060 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:19:41.603885 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 76154.1us
I20260709 13:19:41.604471 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:41.602722 19027 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:41.605108 19056 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:41.602926 18341 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:41.611936 19054 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:41.613734 19055 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:41.595366 24228 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:41.549544 24165 consensus_queue.cc:1059] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:19:41.595163 24230 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:41.549360 24227 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:41.553516 24050 consensus_queue.cc:260] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.640467 19053 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
W20260709 13:19:41.641793 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:41.641772 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 114022us
I20260709 13:19:41.644701 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:41.637483 24050 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:41.594470 24225 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:41.620311 24285 raft_consensus.cc:2804] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:41.664701 18384 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:41.668277 18411 raft_consensus.cc:2368] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 14. Current term is 15.
I20260709 13:19:41.623968 24228 raft_consensus.cc:697] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:41.637641 24089 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:41.677554 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 53997.8us
I20260709 13:19:41.682158 24340 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:41.682917 24340 consensus_queue.cc:1059] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:41.685361 24332 raft_consensus.cc:993] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
W20260709 13:19:41.675870 24335 log.cc:927] Time spent T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:19:41.687268 24228 consensus_queue.cc:237] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.693114 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:41.690728 19027 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:41.696235 18413 raft_consensus.cc:1275] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:19:41.696632 18413 pending_rounds.cc:85] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 8
I20260709 13:19:41.696861 18413 pending_rounds.cc:107] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:19:41.697091 18413 raft_consensus.cc:2889] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:41.697956 18458 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:41.698729 24039 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:41.699095 24039 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.699436 24039 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:41.703811 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:41.711763 24039 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.715886 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:41.617672 24223 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.570458 18237 catalog_manager.cc:5697] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 9 to 14, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 14 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:41.717029 18384 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.685811 24332 raft_consensus.cc:1081] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:19:41.715647 24234 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:41.717458 24294 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:41.764835 18417 raft_consensus.cc:1240] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:41.721112 24340 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:41.747305 18337 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:41.764484 24220 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:41.747545 24225 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:41.748479 24338 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:41.672573 24293 consensus_queue.cc:1059] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:19:41.716760 24269 consensus_queue.cc:1059] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:19:41.750595 18384 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.751499 24227 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:41.795184 24220 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:41.754496 23898 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:41.715281 24185 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:19:41.799500 24216 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:41.804639 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 274738us
I20260709 13:19:41.809437 24216 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.811712 24216 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:41.796324 18237 catalog_manager.cc:5697] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:41.795645 24220 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.793675 24234 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:41.782995 23982 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.839164 24216 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:41.840108 24220 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:41.802886 24340 consensus_queue.cc:1059] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:19:41.868443 24167 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:41.837426 24285 raft_consensus.cc:697] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:41.881845 24323 raft_consensus.cc:3055] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:41.886096 24323 raft_consensus.cc:740] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:41.889238 24340 consensus_queue.cc:1243] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer 31ab487dc52e4f608b39df0fae2fdfa5 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:41.889796 24050 raft_consensus.cc:3055] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:41.890210 24050 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:41.889986 24323 consensus_queue.cc:260] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.890960 24050 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.891454 24323 raft_consensus.cc:3060] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:41.884179 24185 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.882805 24167 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.897447 24050 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:41.920408 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 222296us
W20260709 13:19:41.910737 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 235855us
I20260709 13:19:41.925580 18309 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:41.927139 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:41.930047 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:41.932600 18418 raft_consensus.cc:2393] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 17: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:41.883255 24216 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.902122 24185 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:41.875698 18237 catalog_manager.cc:5697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 6 to 10, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 10 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:41.934551 24217 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:41.966751 24185 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:41.921787 24285 consensus_queue.cc:237] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.902209 24234 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.970691 24216 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:41.934685 24243 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:41.971837 24243 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:41.970192 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:41.980664 24216 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:41.985872 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:41.993079 19055 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:41.993366 19054 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:41.996438 24167 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:41.997339 24228 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:41.998414 24333 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:42.001708 24327 raft_consensus.cc:3055] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:42.002198 24327 raft_consensus.cc:740] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:42.003088 23982 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:42.002969 24327 consensus_queue.cc:260] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.004142 24327 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:42.005503 24277 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.006244 24277 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.002218 18237 catalog_manager.cc:5697] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 4 to 11, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 11 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:42.008327 24277 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:42.008229 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:42.008899 19055 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:19:42.008778 18237 catalog_manager.cc:5697] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 9 to 16, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 16 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.011054 18237 catalog_manager.cc:5697] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 5 to 7, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 7 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:42.012328 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:42.017817 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:42.018548 18340 raft_consensus.cc:2368] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18.
I20260709 13:19:42.021186 19027 leader_election.cc:400] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18.
I20260709 13:19:42.021472 19027 leader_election.cc:403] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:42.021804 18342 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:42.021804 18340 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:19:42.022384 24243 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:42.025523 24345 raft_consensus.cc:3055] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:42.025940 24345 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:42.026710 24345 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.027196 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:42.027803 18340 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:42.030313 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:42.030843 18415 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:42.031292 24039 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:42.035887 19055 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 18.
I20260709 13:19:42.038188 24265 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18.
I20260709 13:19:42.038942 18340 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:42.040800 18417 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:42.042876 18384 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:42.055086 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:42.057626 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:42.057991 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:42.059657 18493 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:19:42.061162 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 361935us
I20260709 13:19:42.066160 18485 raft_consensus.cc:1275] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:19:42.066586 18485 pending_rounds.cc:85] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 12
I20260709 13:19:42.066845 18485 pending_rounds.cc:107] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:19:42.067106 18485 raft_consensus.cc:2889] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:42.069327 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:42.073150 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:42.078533 18457 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:42.046236 24039 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:42.091392 18493 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:42.092875 18492 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:42.058413 23986 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.058413 24243 raft_consensus.cc:476] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 13:19:42.098646 18489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:19:42.122526 24243 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:42.122579 18489 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.123880 18489 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:42.124684 24243 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:42.125217 24243 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.127879 24243 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:42.130343 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:42.119670 24362 raft_consensus.cc:2764] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:19:42.132097 18490 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:42.134567 18484 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:42.012639 18237 catalog_manager.cc:5697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.137178 18237 catalog_manager.cc:5697] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:42.100567 18457 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:42.144038 24362 raft_consensus.cc:2804] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:42.144559 24362 raft_consensus.cc:697] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:42.145463 24216 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.145694 24362 consensus_queue.cc:237] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.059856 24293 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.087s
I20260709 13:19:42.088975 18415 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 18.
I20260709 13:19:42.105243 18411 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:42.108353 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:42.113610 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:42.114962 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:42.048601 24324 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:42.152307 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.160029 18490 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 18.
I20260709 13:19:42.150950 19056 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:42.154203 18457 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:42.169456 18457 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:42.183188 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 79833.2us
I20260709 13:19:42.153314 18489 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:42.184824 18487 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:42.186470 24269 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:42.187136 24269 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:42.138923 18237 catalog_manager.cc:5697] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.189327 18237 catalog_manager.cc:5697] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 6 to 12, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 12 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:42.194594 18237 catalog_manager.cc:5697] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:42.196017 18237 catalog_manager.cc:5697] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:42.204267 18457 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:42.205163 24269 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:42.211032 18489 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:42.045109 24329 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:19:42.058593 24280 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 13:19:42.220832 24220 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.226091 24269 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:42.197535 18237 catalog_manager.cc:5697] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:42.160108 24039 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.228308 18237 catalog_manager.cc:5697] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 5 to 9, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 9 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:42.229439 24039 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:42.234088 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 50388.1us
I20260709 13:19:42.234575 18457 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:42.236608 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 84930.9us
I20260709 13:19:42.264063 18308 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:42.271771 24329 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:42.272431 24329 raft_consensus.cc:697] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:42.275048 24225 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:42.275772 24225 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.283262 18457 leader_election.cc:400] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 14. Current term is 15.
I20260709 13:19:42.283595 18457 leader_election.cc:403] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:42.258993 23898 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:19:42.295259 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:42.258620 24039 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:42.160526 23986 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:42.300105 18491 raft_consensus.cc:2393] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 18: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:42.312987 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:42.313673 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 76036.3us
I20260709 13:19:42.317353 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:42.262948 24327 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.320685 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:42.183329 24216 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.261982 24208 consensus_queue.cc:1048] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:19:42.290902 24324 raft_consensus.cc:697] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:42.312763 24039 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:42.290040 24227 consensus_queue.cc:1059] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:19:42.330628 24185 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 14. Current term is 15.
I20260709 13:19:42.348169 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:42.353894 18487 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:42.350250 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:42.298556 24357 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:19:42.329433 24327 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:42.356354 18415 raft_consensus.cc:1275] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:19:42.359153 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 241696us
I20260709 13:19:42.273593 24329 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.322212 24359 consensus_queue.cc:1048] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:19:42.344074 24039 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:42.414005 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:42.346045 24269 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:42.347674 24294 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.411947 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:42.412292 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:42.412994 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:42.343757 24352 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.415045 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:42.423213 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:42.423056 18458 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:42.420976 18418 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 16: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:42.424799 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:42.430156 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:42.435724 18415 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:19:42.436105 18415 pending_rounds.cc:85] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 8
I20260709 13:19:42.436321 18415 pending_rounds.cc:107] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:19:42.436703 18415 raft_consensus.cc:2889] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:42.440570 18414 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:42.444348 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:42.445207 18340 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:42.356178 24323 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:19:42.409198 24321 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:42.422837 24341 raft_consensus.cc:3055] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:42.455819 18337 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:42.460990 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:42.466585 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:42.467585 18336 raft_consensus.cc:2393] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 10: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:42.444782 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:42.468355 18344 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:42.428368 24225 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:42.434038 24220 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:42.436368 24056 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:42.436717 24320 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:42.434180 23825 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:19:42.464730 24341 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:42.427723 24269 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.471468 24362 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:42.467489 24321 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.499346 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:42.508395 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:42.506557 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:42.518582 18337 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:42.517382 24233 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:42.427521 24294 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.520267 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:42.523221 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:42.489599 24280 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:42.527607 19027 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:42.503093 18344 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:42.527004 19062 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:42.431981 24352 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.433861 24324 consensus_queue.cc:237] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:42.530465 24357 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:19:42.530884 24359 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:42.528029 24280 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.548887 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:42.510471 24362 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:42.573894 24294 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:42.577944 24321 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:42.565663 24359 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:42.578935 24359 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:42.582445 24358 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.583043 24358 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:42.583530 24358 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.527912 24233 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.589871 24233 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:42.589996 23986 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:42.590653 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:42.591360 18336 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:42.591414 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:42.592046 18414 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:42.592285 24269 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:42.593240 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:42.594030 19027 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:42.513031 24349 consensus_queue.cc:1048] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:19:42.593593 24371 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:42.568979 24280 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:42.642011 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 48864.8us
I20260709 13:19:42.565011 24216 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:42.595551 24362 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:42.636569 24371 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:42.658820 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 250298us
I20260709 13:19:42.646186 24344 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:42.666236 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:42.661650 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 241314us
I20260709 13:19:42.669459 18486 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:42.672837 18457 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:42.678402 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:42.699056 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:42.657724 24269 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.666592 24371 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.708891 19025 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:42.657645 24374 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:42.727836 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:42.715157 18457 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:42.722379 24377 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:19:42.724119 24352 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:42.731808 24352 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:42.727732 24374 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.732666 24374 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:42.595856 24341 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.733424 24341 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.725597 24357 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:42.669143 24344 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.731078 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:42.676261 24327 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:42.672279 24383 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:42.740944 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 285865us
W20260709 13:19:42.743455 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 95442.8us
I20260709 13:19:42.745937 18457 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:42.759419 18341 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:42.728847 24269 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.769152 24269 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:42.746089 24344 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:42.794894 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 49100.6us
I20260709 13:19:42.744445 24352 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:42.803260 24396 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:42.804893 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:42.804984 24395 consensus_queue.cc:1059] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:42.805760 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:42.806200 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:42.806450 19057 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:42.807798 19053 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:42.808179 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:42.809285 19058 raft_consensus.cc:3060] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:42.802155 24269 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:42.970371 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:43.001773 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 239719us
I20260709 13:19:42.746965 24357 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:43.016539 19058 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:19:42.972364 24227 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:42.762131 24383 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:42.974611 24392 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:43.010885 24225 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:43.068995 24393 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:19:43.067967 24379 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:19:43.018998 24391 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:43.070755 24050 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:43.426803 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 423944us
I20260709 13:19:43.427582 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:43.436486 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 468477us
I20260709 13:19:43.068414 24227 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:43.194177 24384 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:43.485334 19026 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.042s	sys 0.033s
W20260709 13:19:43.485517 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 48290.6us
W20260709 13:19:43.484690 19028 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.016s	sys 0.059s
W20260709 13:19:43.536384 19026 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.043s	sys 0.033s
W20260709 13:19:43.536635 19028 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.017s	sys 0.059s
W20260709 13:19:43.537055 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.480576 24386 log.cc:927] Time spent T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.752s	user 0.000s	sys 0.001s
I20260709 13:19:43.175626 24223 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:43.534031 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 62296.8us
I20260709 13:19:43.120482 24225 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:43.538311 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:43.487999 18459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.015s	sys 0.073s
W20260709 13:19:43.558727 18459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.016s	sys 0.074s
I20260709 13:19:43.541374 18343 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:43.439033 24405 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:43.425386 24329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.061s	user 0.005s	sys 0.010s
I20260709 13:19:43.550124 18490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55660 (request call id 2549) took 1428 ms. Trace:
I20260709 13:19:43.562049 18490 rpcz_store.cc:276] 0709 13:19:42.114910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.116302 (+  1392us) service_pool.cc:224] Handling call
0709 13:19:43.542896 (+1426594us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b54003746d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:43.543186 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2579200}
I20260709 13:19:43.424341 24050 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:43.575073 24367 log.cc:927] Time spent T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 1.144s	user 0.006s	sys 0.017s
I20260709 13:19:43.584280 24225 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:43.565562 24329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.006s	sys 0.010s
I20260709 13:19:43.594399 24227 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:43.561741 24223 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:43.598316 24223 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:43.598651 24400 log.cc:927] Time spent T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:19:43.540421 24281 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:19:43.731637 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:43.634429 24039 consensus_meta.cc:287] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 1.206s	user 0.010s	sys 0.002s
W20260709 13:19:43.729573 24358 consensus_meta.cc:287] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 1.145s	user 0.007s	sys 0.004s
I20260709 13:19:43.548362 24384 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:43.790536 24384 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:43.801100 24360 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:43.820763 24360 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:43.829986 24413 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:43.786120 24039 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:43.809657 24050 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:43.810770 24357 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:43.798730 24358 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:43.846072 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 287703us
W20260709 13:19:43.846264 24374 consensus_meta.cc:287] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.113s	user 0.013s	sys 0.000s
W20260709 13:19:43.847879 18457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.003s	sys 0.010s
I20260709 13:19:43.832937 24233 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:43.849589 18457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.003s	sys 0.010s
I20260709 13:19:43.856629 18490 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:43.839305 24383 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:43.860520 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:43.860976 18489 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:43.861321 19058 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:43.856666 18487 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:43.862516 18488 raft_consensus.cc:1240] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:19:43.837265 24407 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:19:43.850186 24281 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:43.869709 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:43.877058 24359 consensus_meta.cc:287] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 1.298s	user 0.007s	sys 0.003s
I20260709 13:19:43.877058 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:43.878062 24416 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:43.878540 24416 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.878899 24416 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.879144 18411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2548) took 1174 ms. Trace:
I20260709 13:19:43.882079 18411 rpcz_store.cc:276] 0709 13:19:42.705175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.705312 (+   137us) service_pool.cc:224] Handling call
0709 13:19:42.705595 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.705944 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.705973 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.714896 (+  8923us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.815917 (+101021us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:43.535846 (+719929us) log.cc:844] Serialized 14 byte log entry
0709 13:19:43.878583 (+342737us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b1800332980. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bd69c0a 00007f40a54a9219 00007f409bdf1a40 00007f409bdec4e4 00007f409bdec455 00007f409eed4060 00007f409eee6716 00007f409eef7287 00007f409eef7208
0709 13:19:43.878772 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.878843 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.878885 (+    42us) raft_consensus.cc:1685] finished
0709 13:19:43.878973 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.879091 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":215707,"prepare.queue_time_us":665075,"prepare.run_cpu_time_us":8265,"prepare.run_wall_time_us":46914,"raft.queue_time_us":349136,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":3902,"spinlock_wait_cycles":23671168,"thread_start_us":539752,"threads_started":2,"wal-append.queue_time_us":387376}
W20260709 13:19:43.884012 24390 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 1.219s	user 0.005s	sys 0.003s
I20260709 13:19:43.886086 24423 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:43.886310 19056 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1326) took 1382 ms. Trace:
I20260709 13:19:43.886739 19056 rpcz_store.cc:276] 0709 13:19:42.503981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.504134 (+   153us) service_pool.cc:224] Handling call
0709 13:19:42.504555 (+   421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:42.507159 (+  2604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.507187 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:42.509305 (+  2118us) log.cc:844] Serialized 52 byte log entry
0709 13:19:42.643010 (+133705us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:42.643068 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.643170 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.883388 (+1240218us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:43.885993 (+  2605us) raft_consensus.cc:1685] finished
0709 13:19:43.886030 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.886253 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2133,"raft.queue_time_us":47270,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3422,"spinlock_wait_cycles":5771136,"thread_start_us":108302,"threads_started":1,"wal-append.queue_time_us":134111}
I20260709 13:19:43.892869 24039 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:43.857306 24360 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:43.860165 24089 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.898658 24357 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:43.899255 24089 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:43.899443 24357 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:43.859062 24233 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:43.904594 24233 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:43.906667 24358 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:43.907568 24358 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:43.908221 24358 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:43.840348 24413 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:43.886757 24423 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:43.915928 24413 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:43.916771 24423 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:43.873055 24402 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 13:19:43.919283 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2550) took 1213 ms. Trace:
I20260709 13:19:43.920214 24281 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:43.921902 24344 consensus_meta.cc:287] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 1.106s	user 0.009s	sys 0.000s
I20260709 13:19:43.919647 18415 rpcz_store.cc:276] 0709 13:19:42.705746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.706334 (+   588us) service_pool.cc:224] Handling call
0709 13:19:42.721551 (+ 15217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.728015 (+  6464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.728044 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.728438 (+   394us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.797280 (+ 68842us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:43.075378 (+278098us) log.cc:844] Serialized 14 byte log entry
0709 13:19:43.076355 (+   977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.076444 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.919047 (+842603us) raft_consensus.cc:1685] finished
0709 13:19:43.919069 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.919213 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13308,"prepare.queue_time_us":640664,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":8235,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":9268,"thread_start_us":150885,"threads_started":2,"wal-append.queue_time_us":388078}
I20260709 13:19:43.922343 24344 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:43.923166 24281 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:43.881851 24050 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:43.925035 24050 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:43.848640 24374 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:43.931097 24374 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:43.901850 24089 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:43.933040 24345 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:43.934154 24341 consensus_meta.cc:287] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 1.200s	user 0.006s	sys 0.005s
W20260709 13:19:43.935986 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 51194.1us
I20260709 13:19:43.893689 24039 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:43.927817 24050 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:43.962450 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:43.964668 18411 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:43.962844 18384 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:43.877761 24359 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:43.980012 18414 raft_consensus.cc:1275] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:19:43.947924 24089 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.958228 24341 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:44.003028 18457 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:43.960685 24223 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:43.963936 24050 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.959265 24384 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.009853 24424 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.011106 24343 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.001461 24423 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:44.003875 24413 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:44.012830 24419 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:19:44.014601 24358 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:43.975493 24371 consensus_meta.cc:287] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.238s	user 0.009s	sys 0.006s
W20260709 13:19:44.017418 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 47516us
W20260709 13:19:43.974231 24362 consensus_meta.cc:287] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 1.300s	user 0.009s	sys 0.003s
W20260709 13:19:43.974231 24280 consensus_meta.cc:287] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 1.319s	user 0.012s	sys 0.000s
I20260709 13:19:43.960635 24281 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:43.978240 24227 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:44.036528 24050 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.038981 24285 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:44.039772 24420 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:44.042026 19056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:19:43.985181 24407 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:43.982287 24394 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:44.034446 24208 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:19:44.001626 24357 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:43.981001 24411 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:43.960949 24039 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.103017 24411 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.104348 24039 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.057283 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:44.105271 18335 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:44.058638 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.059521 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.047281 24424 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.108446 18344 raft_consensus.cc:2410] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:19:44.111099 24424 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.111934 24429 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:44.112689 24429 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.114796 18335 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:44.115404 24429 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.123862 24404 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.124599 24404 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.082279 24394 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.128682 24394 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:44.132463 24366 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.777s	user 0.009s	sys 0.014s
I20260709 13:19:44.134264 18412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2626) took 2149 ms. Trace:
I20260709 13:19:44.134593 18412 rpcz_store.cc:276] 0709 13:19:41.985236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.985984 (+   748us) service_pool.cc:224] Handling call
0709 13:19:41.986326 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:41.986647 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:41.986669 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:41.987101 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.291981 (+304880us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:42.292016 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.292078 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.131561 (+1839483us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:44.133960 (+  2399us) raft_consensus.cc:1685] finished
0709 13:19:44.133979 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.134192 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4149,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":307556864,"thread_start_us":304530,"threads_started":1,"wal-append.queue_time_us":335526}
I20260709 13:19:44.070650 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.072343 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.073944 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.081995 24407 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.148707 24407 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:43.981839 24344 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.034271 24341 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.075534 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.015424 24089 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.077749 24425 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:44.047875 24343 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.079857 24050 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.034904 24223 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.186213 24343 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.044724 24384 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.062769 24362 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.187752 24089 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.049762 24413 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.188285 24384 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.075977 24420 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.056391 24371 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.062582 24280 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.047185 24423 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.191377 24280 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.192469 24420 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.088356 24416 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.193346 24423 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.067042 24281 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.095083 24359 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.196027 24281 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.156111 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.199735 24416 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.188288 24362 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.105896 24411 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.172912 24341 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.179787 24185 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.202407 24185 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:44.203405 24378 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 1.724s	user 0.008s	sys 0.011s
I20260709 13:19:44.189739 24413 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.205243 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1371) took 2185 ms. Trace:
I20260709 13:19:44.205474 24185 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:44.186261 24223 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.069696 24285 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.205605 19060 rpcz_store.cc:276] 0709 13:19:42.019808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.020053 (+   245us) service_pool.cc:224] Handling call
0709 13:19:42.020328 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.020679 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:42.263380 (+242701us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.441388 (+178008us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.472604 (+ 31216us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.493123 (+ 20519us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:42.498664 (+  5541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.498866 (+   202us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.202673 (+1703807us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:44.204927 (+  2254us) raft_consensus.cc:1685] finished
0709 13:19:44.205024 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.205158 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39805,"prepare.queue_time_us":19881,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":52651,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":13301,"spinlock_wait_cycles":61972864,"thread_start_us":306319,"threads_started":2,"wal-append.queue_time_us":151528}
I20260709 13:19:44.207675 24285 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:44.209415 19057 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:44.163552 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.211141 19053 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
I20260709 13:19:44.191516 24371 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.225504 19027 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:44.225622 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.227151 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:44.232091 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 188499us
I20260709 13:19:44.233146 18457 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:44.234297 24243 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:19:44.234625 18384 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.1:37809 timed out after 1.560s (SENT) [suppressed 9 similar messages]
I20260709 13:19:44.235894 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.237376 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.249305 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:44.250470 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.250231 19060 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:44.255833 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:44.256956 18486 raft_consensus.cc:2410] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:19:44.258183 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:44.259894 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:44.260268 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:44.260648 18486 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:19:44.260897 18344 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.264511 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:44.265228 18493 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:44.266393 18484 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:44.266693 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:44.267925 18493 raft_consensus.cc:2410] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:44.269363 18416 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:44.269810 18416 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:44.252120 24280 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:44.279815 18344 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:44.248533 24243 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:44.249166 23499 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:44.282810 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.305022 18339 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:44.283700 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:44.308130 18493 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:44.270682 18416 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:44.298415 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.258534 24089 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:44.300364 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:44.295202 24260 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:44.310768 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.314534 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:44.296501 24387 log.cc:927] Time spent T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 1.630s	user 0.000s	sys 0.022s
I20260709 13:19:44.333730 18490 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
W20260709 13:19:44.389935 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 155313us
I20260709 13:19:44.388697 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34458 (request call id 2544) took 1975 ms. Trace:
W20260709 13:19:44.402244 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.434372 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:44.435001 19025 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:44.343034 18493 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:44.299345 24349 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:19:44.392980 24370 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 1.898s	user 0.000s	sys 0.011s
W20260709 13:19:44.435302 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.434072 18419 rpcz_store.cc:276] 0709 13:19:42.412824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.412937 (+   113us) service_pool.cc:224] Handling call
0709 13:19:42.413243 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.427525 (+ 14282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.427556 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.427990 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.660548 (+232558us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:42.782688 (+122140us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.802676 (+ 19988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.802753 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.291771 (+1489018us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:44.388417 (+ 96646us) raft_consensus.cc:1685] finished
0709 13:19:44.388524 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.388641 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101958,"prepare.queue_time_us":343296,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":76697,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":152167,"spinlock_wait_cycles":6518912,"thread_start_us":296947,"threads_started":2,"wal-append.queue_time_us":209269}
I20260709 13:19:44.360116 18486 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:44.312901 24269 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:44.333547 18339 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:44.335657 24235 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:19:44.427150 24217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.103s	user 0.042s	sys 0.087s
I20260709 13:19:44.426858 24223 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:44.395160 19027 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:44.438112 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:44.442811 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:44.335856 23499 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.381762 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.350925 24256 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.450156 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:44.311600 24281 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:19:44.451459 18489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35114 (request call id 1378) took 1786 ms (client timeout 1978 ms). Trace:
I20260709 13:19:44.453583 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.364343 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:44.304358 24243 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:44.458511 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.496572 19058 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:44.496956 19060 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 10.
I20260709 13:19:44.459429 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.432303 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:44.497989 18490 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:44.499128 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:44.500257 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:44.500980 18490 raft_consensus.cc:2368] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
W20260709 13:19:44.458395 24217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.143s	user 0.042s	sys 0.087s
I20260709 13:19:44.451555 24405 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.450184 24435 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.469031 24358 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:44.343530 24089 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.463799 24235 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:44.470947 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 75863.7us
I20260709 13:19:44.471284 24216 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:44.471388 19055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1323) took 2399 ms. Trace:
I20260709 13:19:44.520279 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:44.446059 24349 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.472324 18458 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:44.474620 24343 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:44.519904 24360 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:44.476042 24436 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:44.478124 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:44.530326 18493 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:44.479920 24221 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.529528 24343 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.515168 24435 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:44.439051 24434 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:44.465632 18485 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
I20260709 13:19:44.360476 24376 consensus_queue.cc:1048] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.198s
I20260709 13:19:44.340054 24280 raft_consensus.cc:697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:44.350927 24260 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:44.496289 18489 rpcz_store.cc:269] 0709 13:19:42.664966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.665815 (+   849us) service_pool.cc:224] Handling call
0709 13:19:44.451287 (+1785472us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400258854. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:44.451401 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2666864512}
I20260709 13:19:44.501704 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:44.447804 24269 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:44.515926 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:44.599311 18491 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:44.518230 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.501032 24256 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.521107 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.520697 19055 rpcz_store.cc:276] 0709 13:19:42.071650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.071770 (+   120us) service_pool.cc:224] Handling call
0709 13:19:42.072096 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.080442 (+  8346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.080471 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.080957 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.338960 (+258003us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:42.338999 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.339066 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.392384 (+2053318us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:44.471131 (+ 78747us) raft_consensus.cc:1685] finished
0709 13:19:44.471152 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.471332 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":706,"raft.queue_time_us":5892,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":28575,"spinlock_wait_cycles":34034432,"thread_start_us":257749,"threads_started":1,"wal-append.queue_time_us":399300}
I20260709 13:19:44.604149 19060 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:44.604435 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.605613 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.606557 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.485767 24228 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:44.524040 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 51785.8us
I20260709 13:19:44.475080 24341 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.499130 24086 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:44.487581 24223 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:44.509276 24281 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.513326 24358 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:44.499176 24350 consensus_queue.cc:1059] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:19:44.493081 24050 consensus_queue.cc:1048] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:19:44.601218 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:44.618333 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 165538us
I20260709 13:19:44.618937 19061 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
I20260709 13:19:44.510150 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:44.531567 24216 raft_consensus.cc:697] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:44.610045 24234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.341s	user 0.023s	sys 0.059s
W20260709 13:19:44.600754 24365 log.cc:927] Time spent T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 2.106s	user 0.003s	sys 0.014s
I20260709 13:19:44.613903 19055 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:44.609248 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:44.612335 24227 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.572459 24221 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.610227 24086 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:44.679562 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 56547.9us
I20260709 13:19:44.687222 18491 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
W20260709 13:19:44.688619 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 240042us
W20260709 13:19:44.689440 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 69526.9us
I20260709 13:19:44.561831 24436 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.610898 24344 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:44.610460 24423 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:44.692589 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.693799 19027 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:44.680465 24234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.356s	user 0.023s	sys 0.059s
I20260709 13:19:44.708667 23959 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:44.709231 23959 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.709868 24436 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.709954 24281 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.710625 24344 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:44.711309 24443 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:19:44.707098 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:44.716889 19060 raft_consensus.cc:2368] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 16. Current term is 17.
I20260709 13:19:44.621235 24358 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.712644 19055 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
I20260709 13:19:44.713109 18492 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:44.601217 24434 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:44.613021 24228 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.737162 19056 raft_consensus.cc:606] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:44.732496 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.706550 24086 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.613294 24341 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:44.740058 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 46501.6us
W20260709 13:19:44.754391 24439 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:19:44.754091 24216 consensus_queue.cc:237] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.755563 24341 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.706265 24227 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.710543 23499 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.711330 23959 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.743201 24454 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.743702 24235 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.745180 24089 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:44.746994 24260 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:44.748379 24256 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.705324 24269 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.779844 24269 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:44.694280 23898 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.750651 24221 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.753000 24350 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:44.753686 24217 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:44.756166 24441 log.cc:927] Time spent T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:19:44.740623 19060 raft_consensus.cc:2393] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 16: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:44.760330 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.759419 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:44.792455 19055 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.761003 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:44.762125 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 55112.7us
I20260709 13:19:44.762499 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:44.765045 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 156813us
W20260709 13:19:44.795888 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.779568 24454 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.795928 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.714740 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:19:44.757030 24438 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:44.733104 24423 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:44.802601 24423 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:44.803046 24435 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:44.773118 24452 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:44.805928 24452 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:44.807221 24086 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.808090 24452 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.773962 24434 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.767493 24349 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.809299 24086 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.760041 24341 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.791680 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:44.799089 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:44.799564 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.799894 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.808173 24374 raft_consensus.cc:993] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:19:44.823695 24374 raft_consensus.cc:1081] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:19:44.796445 24256 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.796723 24217 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.778613 24227 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.813529 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:44.853276 18417 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:44.718541 24280 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:44.815557 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 100900us
W20260709 13:19:44.784782 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 166039us
I20260709 13:19:44.795318 24221 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:44.788462 24350 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:44.841406 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 47430.9us
I20260709 13:19:44.863049 18419 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:19:44.824136 24435 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:44.828581 24452 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:44.848340 19055 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:44.906704 24452 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.858868 18458 leader_election.cc:400] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 16. Current term is 17.
I20260709 13:19:44.907079 24452 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:44.873716 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.873827 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:44.886256 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:44.886796 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.908425 24167 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:44.908942 24167 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:44.909447 18340 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:44.864148 24451 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:44.910112 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:44.910368 24451 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:44.910744 18410 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
I20260709 13:19:44.872781 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.911775 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:44.912111 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:44.912371 24451 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.912853 24451 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.913398 24324 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:44.913259 24451 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:44.913801 24324 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:44.914223 24324 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:44.914978 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:44.891296 18382 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:44.874394 24243 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.916496 18382 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:44.916877 18490 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 17: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:44.917830 24243 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:44.900238 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.919129 24434 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:44.919550 24434 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.919775 18419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:44.903652 18487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2552) took 2442 ms. Trace:
I20260709 13:19:44.920346 18419 raft_consensus.cc:606] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:44.920822 18419 raft_consensus.cc:614] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:44.920442 18487 rpcz_store.cc:276] 0709 13:19:42.461673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.461774 (+   101us) service_pool.cc:224] Handling call
0709 13:19:42.463276 (+  1502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.862543 (+1399267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.903402 (+1040859us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002927d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:44.903559 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3204100480}
I20260709 13:19:44.907171 18458 leader_election.cc:403] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:19:44.911041 24167 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:44.922083 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 78492us
I20260709 13:19:44.922731 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:44.923627 24167 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:44.925072 24383 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 16. Current term is 17.
I20260709 13:19:44.918103 24463 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:44.925959 24383 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:44.926357 24383 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:44.919924 24434 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:44.926584 18417 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:44.926815 24383 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:44.928288 24369 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 2.518s	user 0.011s	sys 0.019s
I20260709 13:19:44.929488 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38692 (request call id 1370) took 2910 ms. Trace:
I20260709 13:19:44.895282 24217 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.906004 24462 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:44.930274 24462 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:44.932510 24462 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:44.932806 24440 log.cc:927] Time spent T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.334s	user 0.000s	sys 0.003s
I20260709 13:19:44.787923 23898 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:44.917591 18382 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:44.942533 18382 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:44.926452 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:44.943807 18411 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 17: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:44.934531 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.929833 19054 rpcz_store.cc:276] 0709 13:19:42.019511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.024106 (+  4595us) service_pool.cc:224] Handling call
0709 13:19:42.024402 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.024783 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.024826 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.041459 (+ 16633us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b2c0004d028. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:19:42.041980 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.263535 (+221555us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:42.263568 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.263632 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.838035 (+2574403us) spinlock_profiling.cc:243] Waited 60.3 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:44.929289 (+ 91254us) raft_consensus.cc:1685] finished
0709 13:19:44.929312 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.929434 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4383,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4628,"spinlock_wait_cycles":172329600,"thread_start_us":220379,"threads_started":1,"wal-append.queue_time_us":285821}
I20260709 13:19:44.945515 18458 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:44.946684 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:44.948159 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:44.948379 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.949435 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.949461 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.952183 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.954784 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.956413 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:44.956795 19059 raft_consensus.cc:2393] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 17: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:44.950497 19056 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:44.958354 19058 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:44.962414 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.969333 18413 raft_consensus.cc:1275] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:44.873653 24350 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:44.969990 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:44.970956 18412 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:19:44.862807 24448 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:44.967784 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:44.978416 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.936185 24435 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:44.980911 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.841984 24256 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.977811 23499 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:44.987311 23499 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:44.987793 23499 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:44.989159 24404 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:44.987334 18412 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:19:44.990881 18412 pending_rounds.cc:85] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 10
I20260709 13:19:44.991096 18412 pending_rounds.cc:107] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:19:44.991315 18412 raft_consensus.cc:2889] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:44.841301 24341 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:44.994285 18419 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 16: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:44.994323 24451 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.965530 24243 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:44.985178 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:44.977950 24448 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:44.984172 24050 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 13:19:44.996866 24461 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:19:44.966145 24332 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:44.997496 24332 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:44.963418 24463 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:44.964154 24223 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.985930 24435 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:44.997889 24332 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:44.996802 24228 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.998975 24463 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.022614 24463 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:44.934031 24221 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.000557 24343 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:45.032313 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.033002 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.033974 18339 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:45.034236 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.003237 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:45.035209 18412 raft_consensus.cc:606] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:45.035512 18412 raft_consensus.cc:614] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:45.003369 18416 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.004463 23898 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:45.008797 23499 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.040964 18493 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:45.003049 24454 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:45.013484 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:45.003015 24341 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:45.032377 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.043972 18341 raft_consensus.cc:2410] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:19:45.011895 24256 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:44.996888 24448 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:44.995196 24243 raft_consensus.cc:697] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:45.046056 23499 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:45.045975 24243 consensus_queue.cc:237] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.047660 24358 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.012583 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:45.049904 18343 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:45.054399 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:45.054813 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:45.055188 18485 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:45.055649 18493 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 10.
I20260709 13:19:45.059233 24344 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:45.059453 18491 raft_consensus.cc:1240] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:45.032387 24285 raft_consensus.cc:3055] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:45.059975 24285 raft_consensus.cc:740] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:45.060985 24285 consensus_queue.cc:260] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.062317 24285 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:45.064150 18419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:45.064697 18419 raft_consensus.cc:606] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:45.065176 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.064584 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.066905 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.068006 24221 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:45.068871 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:45.075734 18411 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.069406 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.077397 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.069522 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.070086 18413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:45.087692 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.087872 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:45.079859 19025 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:45.064095 24383 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.059593 18412 raft_consensus.cc:1275] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:45.073387 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.074049 18416 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:45.092299 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:45.092849 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 375552us
I20260709 13:19:45.097409 19025 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.043649 24350 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.101644 18410 raft_consensus.cc:2393] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 15: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:45.104773 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.106007 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.095105 18309 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:45.102689 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:45.103210 18416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34458 (request call id 2546) took 2680 ms (client timeout 2211 ms). Trace:
I20260709 13:19:45.110934 18486 raft_consensus.cc:2393] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 19: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:19:45.103945 24230 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:19:45.144068 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:45.111200 18416 rpcz_store.cc:269] 0709 13:19:42.413343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.413763 (+   420us) service_pool.cc:224] Handling call
0709 13:19:44.269216 (+1855453us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b540043b5a0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee53dc0 00007f409eedfe18 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6
0709 13:19:45.003200 (+733984us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b540043b5a0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409ee51a1d 00007f409ee381a4 00007f409eeba447 00007f409eed2fe7 00007f409eed47de 00007f409eee027c 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591
0709 13:19:45.093412 (+ 90212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183317248}
I20260709 13:19:45.146155 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.146823 24358 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:45.150048 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.151630 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.152379 18338 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:45.152551 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:45.154616 19055 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:45.155303 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.098861 24086 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:45.101068 24391 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:45.119346 18485 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:45.146860 18416 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:45.170338 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.179725 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:45.181023 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:45.156081 18342 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
W20260709 13:19:45.206890 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.207633 18411 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:45.208966 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:45.209825 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 114761us
I20260709 13:19:45.211617 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:45.214425 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.214534 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.215322 18488 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:45.216842 18457 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:45.218106 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:45.223670 19056 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.218453 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.219058 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:45.226560 19061 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:19:45.260540 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.266227 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:45.267223 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:45.112385 24344 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:45.274829 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 58108.5us
I20260709 13:19:45.276108 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:45.276875 19061 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:45.109323 24234 consensus_queue.cc:1059] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.110s
I20260709 13:19:45.111720 24466 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.269680 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.181420 24260 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:45.284760 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.285367 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.291136 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:45.292464 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:45.295339 24434 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.267863 19060 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:45.267802 24448 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:45.333220 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.321503 24464 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:45.338377 24464 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:45.340517 24464 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:45.342295 24434 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:45.358831 24350 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:45.359959 24452 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.361263 18414 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 18. Ops: []
I20260709 13:19:45.364344 24452 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:45.368731 24332 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.318289 23898 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:45.216892 24086 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:45.302323 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:45.386639 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.325066 18339 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:45.215895 24449 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:45.392304 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.275647 24293 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.329039 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:45.374682 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 77410.8us
I20260709 13:19:45.397464 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:45.304319 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:45.379189 18309 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:45.309659 18457 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:45.389168 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:45.389427 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:45.401072 18308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.016s	sys 0.022s
I20260709 13:19:45.390122 18486 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:45.406756 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.407294 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:45.390858 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:45.389972 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.405025 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.405841 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:45.409217 18338 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:19:45.406492 18336 raft_consensus.cc:2368] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11.
I20260709 13:19:45.409758 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.334841 24448 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:45.408129 18485 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:45.410030 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:45.405741 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:45.410667 18308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.017s	sys 0.022s
I20260709 13:19:45.413393 18488 raft_consensus.cc:1275] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:45.415490 19054 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:45.416388 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 522542us
I20260709 13:19:45.417093 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.418358 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:45.420986 18412 raft_consensus.cc:2393] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 17: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:45.421064 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:45.286929 24344 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:45.386425 23898 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.320940 24451 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:19:45.424743 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.425796 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:45.436730 19054 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
I20260709 13:19:45.437264 18485 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:45.394671 19056 raft_consensus.cc:2468] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:45.439414 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.430539 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:45.414606 18382 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:45.449440 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.454865 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.455832 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.456346 18338 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
I20260709 13:19:45.385469 24256 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:45.391885 24421 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:45.468076 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 53593.6us
I20260709 13:19:45.334275 24260 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.471293 24343 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:45.471763 24452 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.469305 18384 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.412731 24208 consensus_queue.cc:1059] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:19:45.474278 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:45.475042 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.466651 23499 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:45.414836 24384 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:45.486142 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.455281 23898 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:45.420992 24448 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:45.492664 24443 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:45.415409 24352 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:45.543906 18344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.032s	sys 0.055s
W20260709 13:19:45.544487 18344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.033s	sys 0.055s
I20260709 13:19:45.414641 24293 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.426890 24468 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:45.425565 24395 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:45.496513 18340 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:19:45.326440 24466 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.404726 24407 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:45.435811 24056 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:45.510217 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.509163 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:45.509081 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:45.413523 24409 consensus_queue.cc:1048] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 13:19:45.488758 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:45.535130 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 65919.7us
W20260709 13:19:45.501884 24280 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.009s	sys 0.017s
I20260709 13:19:45.490950 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:45.546933 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53812 (request call id 1362) took 1168 ms. Trace:
I20260709 13:19:45.413017 24398 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.096s
W20260709 13:19:45.401161 24394 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.009s	sys 0.029s
I20260709 13:19:45.404590 24449 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:45.678514 18339 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
W20260709 13:19:45.579066 18417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.014s	sys 0.031s
I20260709 13:19:45.507663 24384 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:45.597654 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.604960 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:45.683964 18486 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.683876 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.608013 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:45.637377 24324 consensus_meta.cc:287] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.000s
I20260709 13:19:45.579692 24383 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:45.579347 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 173785us
I20260709 13:19:45.619644 18340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:53812
I20260709 13:19:45.553536 24050 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:45.692730 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.694259 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.694422 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.694913 18486 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:45.695041 18341 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:45.629751 18382 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:45.628640 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.493088 24256 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.492889 24421 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:45.638293 18493 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 17: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:19:45.615736 24269 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.060s	sys 0.122s
I20260709 13:19:45.699929 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.578792 24374 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:45.588578 24468 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.636921 18344 rpcz_store.cc:276] 0709 13:19:44.378400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.428814 (+ 50414us) service_pool.cc:224] Handling call
0709 13:19:44.429211 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.429460 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:19:44.447007 (+ 17547us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.682229 (+235222us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.924444 (+242215us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b1800235240. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdec455 00007f409eed4060 00007f409eee6716 00007f409eef7287 00007f409eef7208
0709 13:19:45.546529 (+622085us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.546593 (+    64us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:45.546668 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.546745 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.546870 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26628,"prepare.queue_time_us":44130,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":89,"raft.queue_time_us":112437,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":160,"spinlock_wait_cycles":24447744,"thread_start_us":829879,"threads_started":2}
I20260709 13:19:45.533774 24086 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.579650 24352 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:45.636575 24280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.010s	sys 0.017s
I20260709 13:19:45.691646 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:45.691947 18416 raft_consensus.cc:1240] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:45.696292 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 67761.3us
W20260709 13:19:45.677009 24394 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.009s	sys 0.032s
I20260709 13:19:45.697811 19026 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:45.702744 18307 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:45.639472 24223 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:19:45.706756 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:45.682914 18417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.015s	sys 0.032s
I20260709 13:19:45.700322 24292 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:45.749084 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 51371.4us
I20260709 13:19:45.749539 18413 raft_consensus.cc:606] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.749967 18413 raft_consensus.cc:614] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:45.749816 19026 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:45.700454 24269 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.060s	sys 0.123s
I20260709 13:19:45.708259 24468 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.709668 24256 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:45.722795 24471 log.cc:927] Time spent T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:19:45.724704 24421 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:45.699987 24343 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:45.726706 24293 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:45.696962 24281 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:45.687548 24384 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:45.779062 24463 consensus_meta.cc:287] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.756s	user 0.010s	sys 0.002s
I20260709 13:19:45.778781 24474 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:45.739970 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.741089 18384 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.700695 18341 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
I20260709 13:19:45.634968 24407 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:45.751881 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.699103 24324 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.755458 24350 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:45.759021 24382 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:45.802884 24281 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:45.806485 24467 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:45.800647 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 59669us
I20260709 13:19:45.808650 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:45.801865 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 50067.2us
I20260709 13:19:45.811858 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.813107 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:45.813740 18341 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:19:45.814095 19026 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:45.816586 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.818475 18384 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:45.819598 18384 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:45.820706 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.799784 24344 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:45.822409 24454 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:45.802970 24343 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:45.822803 24350 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:45.825395 23986 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:45.858961 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 44978.9us
I20260709 13:19:45.860829 19026 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:45.855175 24223 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:45.800423 24463 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.859627 24382 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:45.853585 24294 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:45.837029 24050 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:45.823141 24208 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:45.817682 24281 consensus_queue.cc:1048] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:19:45.833328 24454 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:45.804242 24474 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:45.830135 24395 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.858310 24468 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.874696 24476 consensus_queue.cc:1059] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:19:45.866633 24472 log.cc:927] Time spent T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:19:45.885721 18410 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:45.888031 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:45.922704 19056 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
W20260709 13:19:45.893455 24285 consensus_meta.cc:287] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.831s	user 0.007s	sys 0.001s
I20260709 13:19:45.869823 24223 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:45.923502 18415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34462 (request call id 2645) took 1082 ms. Trace:
I20260709 13:19:45.872615 24293 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:45.871464 24230 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:45.873256 24466 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:45.883327 24281 consensus_queue.cc:1243] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer 20e06cff39b649c48d342b7431135303 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:19:45.894289 24454 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:45.918277 24435 consensus_meta.cc:287] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.905s	user 0.008s	sys 0.003s
I20260709 13:19:45.923893 18309 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:45.996676 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 72855.2us
I20260709 13:19:45.925323 18415 rpcz_store.cc:276] 0709 13:19:44.841113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.841254 (+   141us) service_pool.cc:224] Handling call
0709 13:19:45.047153 (+205899us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b580004da98. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3ef40ab 00007f40a3ef4131 00007f40a3eb5fc0 00007f40a3ea0929 00007f40a3ea03d2 00007f409d417bd4
0709 13:19:45.047330 (+   177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.047529 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:45.484895 (+437366us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.922657 (+437762us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.923246 (+   589us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:45.923287 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.923348 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.923454 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":686708,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":94,"spinlock_wait_cycles":4843776,"thread_start_us":868168,"threads_started":2}
I20260709 13:19:45.939921 24468 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:45.924041 24223 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.942797 24391 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:46.006062 24391 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:46.006986 24391 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.007337 24448 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.007997 24391 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.009526 24448 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:45.945552 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:46.010072 18342 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 10.
I20260709 13:19:45.947260 18344 raft_consensus.cc:2368] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:45.949174 24260 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:45.950805 24487 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:45.952216 24341 raft_consensus.cc:3055] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:45.963135 24344 raft_consensus.cc:3055] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:45.975589 24407 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:45.980269 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.000908 24466 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:45.919510 24395 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.917877 24449 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:45.994256 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:45.877811 24294 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:45.999641 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:46.046130 19056 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.002274 24352 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:46.019733 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:46.050827 19057 raft_consensus.cc:2368] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
I20260709 13:19:46.022675 18343 raft_consensus.cc:2393] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 18: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:46.026620 18335 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:19:46.029696 18457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.022s	sys 0.066s
W20260709 13:19:46.051944 18457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.022s	sys 0.066s
W20260709 13:19:46.052520 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 743548us
I20260709 13:19:45.913738 24463 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:46.027809 24341 raft_consensus.cc:740] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:46.001408 24435 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:46.060689 23898 consensus_meta.cc:287] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
I20260709 13:19:46.061112 24294 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:46.054881 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 352223us
I20260709 13:19:46.053767 18457 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:46.032368 24344 raft_consensus.cc:740] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:46.035995 24466 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.058351 18309 leader_election.cc:400] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
I20260709 13:19:46.066205 18309 leader_election.cc:403] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:46.059500 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:46.068195 19056 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:46.036083 24324 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:46.064100 18457 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:46.069540 18309 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:46.069947 18307 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:46.073060 18457 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:46.072957 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 443287us
I20260709 13:19:46.030079 24487 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.061298 23898 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.080067 24421 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:46.082357 23898 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:46.066766 24435 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:46.084192 24487 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:46.085465 24344 consensus_queue.cc:260] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.087248 24344 raft_consensus.cc:3060] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:46.077505 24448 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:46.093871 24448 raft_consensus.cc:697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:46.068885 24466 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.094439 19027 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.095489 19027 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.097271 24223 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:46.098913 24395 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:46.099646 24352 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:46.099874 24223 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:46.100103 24352 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:46.110508 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:46.079804 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:46.101380 18491 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.121942 18485 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.078071 18307 leader_election.cc:400] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
W20260709 13:19:46.129276 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 51416.9us
I20260709 13:19:46.130234 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:46.131816 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:46.132665 18486 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 19: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:46.133420 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:46.133903 18486 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 18.
I20260709 13:19:46.135552 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:46.137368 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:46.075096 24451 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.069613 24056 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:46.140959 18492 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:46.146268 18489 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:46.076608 24449 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:46.151378 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 71782.9us
I20260709 13:19:46.151908 18485 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:46.152316 18491 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:46.152474 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.133977 24260 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:46.156177 18487 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:46.165508 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:46.165797 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:46.166100 19061 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:46.166579 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:46.138571 24293 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:46.148375 24452 consensus_meta.cc:287] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.640s	user 0.012s	sys 0.000s
I20260709 13:19:46.168020 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:46.167876 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:46.169682 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:46.181847 19059 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:46.182468 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:46.183044 18410 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 16.
I20260709 13:19:46.170058 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:46.184618 19053 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.104949 24384 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.105266 24341 consensus_queue.cc:260] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.175833 19057 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:46.162680 24398 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:46.179936 18487 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:46.180315 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:46.161684 24352 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:46.190887 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:46.191052 18458 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:46.201713 19055 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 14: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:46.200953 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:46.210707 18486 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:46.211304 18417 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 18: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:46.217681 18414 pending_rounds.cc:85] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 11
I20260709 13:19:46.218092 18414 pending_rounds.cc:107] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:19:46.218379 18414 raft_consensus.cc:2889] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:46.192967 19025 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.221903 18382 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.149365 24464 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:19:46.231505 19061 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 19.
I20260709 13:19:46.177229 24409 consensus_queue.cc:1059] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:19:46.164829 24285 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:19:46.238435 24341 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.238866 24332 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:46.240185 18344 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:19:46.241281 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:46.242077 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 51345.2us
I20260709 13:19:46.243820 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.245973 24243 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:46.246361 24243 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.246694 24243 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:46.184551 24452 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:46.249904 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:46.250463 24185 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:46.250010 24056 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:46.251071 24492 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:46.253511 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:46.254217 24382 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:46.103452 24448 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.255067 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:46.255295 24489 log.cc:927] Time spent T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:46.256872 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:46.257170 24384 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:46.198267 24466 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.258598 24398 raft_consensus.cc:697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:46.259966 24466 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:46.260465 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 67604.8us
I20260709 13:19:46.261116 19025 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:46.262588 24292 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:46.262775 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:46.263109 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:46.259629 24398 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.259975 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:46.265419 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:46.266786 18458 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:46.268587 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 46802.1us
W20260709 13:19:46.310132 18488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.032s	sys 0.034s
I20260709 13:19:46.268610 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:46.312481 18412 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:46.312932 18488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.032s	sys 0.035s
I20260709 13:19:46.268873 19053 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
W20260709 13:19:46.316249 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 49535.9us
I20260709 13:19:46.317028 18458 leader_election.cc:400] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11.
I20260709 13:19:46.317322 18458 leader_election.cc:403] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:19:46.319205 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 498567us
I20260709 13:19:46.319342 18458 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.319342 18382 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:46.263062 24292 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:46.322371 18382 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:46.227985 24474 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:46.309861 24352 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:46.328819 18484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.012s	sys 0.060s
I20260709 13:19:46.320071 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.327572 18458 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.312554 24223 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:46.330113 18484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.012s	sys 0.060s
I20260709 13:19:46.318303 24376 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:46.324548 24281 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:46.326009 24230 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:46.332955 24362 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:46.321087 24464 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:19:46.320912 24358 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 10. Current term is 11.
I20260709 13:19:46.331547 18458 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.328068 24384 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:46.324119 24452 consensus_queue.cc:1059] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:19:46.321816 24292 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:46.327911 24324 consensus_queue.cc:1048] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:19:46.344846 24281 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.328545 24423 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:46.335018 24463 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:19:46.337369 24332 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:46.337203 24396 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:46.346024 18382 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:46.357095 18458 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.344062 24230 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:46.351112 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:46.377499 24167 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:46.378155 24167 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:46.378998 24167 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.380312 24167 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:46.422189 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 56297.7us
I20260709 13:19:46.423246 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:46.423442 18340 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:46.428371 18340 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:46.428543 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 77509.9us
I20260709 13:19:46.360199 24281 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:46.355119 24499 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:46.427870 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 81934.3us
I20260709 13:19:46.359472 24376 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:46.429806 24185 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:46.433739 24499 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.434324 18484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 3100) took 1032 ms. Trace:
I20260709 13:19:46.434343 24185 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:46.435168 24185 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:46.436180 24499 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:46.370940 24230 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.428122 24352 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:46.434739 18484 rpcz_store.cc:276] 0709 13:19:45.401581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.401719 (+   138us) service_pool.cc:224] Handling call
0709 13:19:45.402064 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.788289 (+386225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.788333 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.788860 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.331454 (+542594us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:46.331496 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.332718 (+  1222us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.434128 (+101410us) raft_consensus.cc:1685] finished
0709 13:19:46.434147 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.434272 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18472,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":29301,"thread_start_us":912451,"threads_started":2,"wal-append.queue_time_us":633404}
I20260709 13:19:46.440395 19062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38692 (request call id 1404) took 1260 ms. Trace:
I20260709 13:19:46.440856 19062 rpcz_store.cc:276] 0709 13:19:45.179556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.180652 (+  1096us) service_pool.cc:224] Handling call
0709 13:19:46.440151 (+1259499us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400484254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:46.440312 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2797860736}
I20260709 13:19:46.431032 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:46.443497 24500 log.cc:927] Time spent T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:19:46.444198 24391 raft_consensus.cc:3055] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:46.444742 24391 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:46.444079 24185 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.445655 24391 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.447085 24391 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.447104 24185 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:46.448506 24468 raft_consensus.cc:3055] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:46.448920 24468 raft_consensus.cc:740] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:46.432963 23986 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:46.458065 18457 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:46.459206 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:46.460522 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:46.461122 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:46.462275 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:46.465062 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:46.474404 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:46.475098 18412 raft_consensus.cc:2376] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17. Re-sending same reply.
I20260709 13:19:46.486119 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:46.486274 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:46.490517 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 59559.4us
I20260709 13:19:46.491237 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:46.491833 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:46.492484 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:46.494525 18458 leader_election.cc:400] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:46.494774 18458 leader_election.cc:403] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:46.494827 24352 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.495874 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:46.496654 18412 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:46.499596 18412 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:46.494892 18410 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:19:46.505281 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:46.508116 18384 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.512982 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:46.513785 18413 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
I20260709 13:19:46.450747 24343 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:46.502883 24396 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:46.527717 24396 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:46.528175 24396 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:46.530193 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:46.532018 18418 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 19: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:46.522691 18457 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:46.525056 24332 raft_consensus.cc:2804] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:46.525235 24223 raft_consensus.cc:3055] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:46.525789 24395 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.511160 23986 raft_consensus.cc:697] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:46.515233 24269 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:46.449757 24468 consensus_queue.cc:260] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:46.533160 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:46.532564 24454 consensus_meta.cc:287] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 13:19:46.520498 24362 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:46.548609 24468 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:46.548650 24332 raft_consensus.cc:697] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:46.550478 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.537807 24223 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:46.557657 18458 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.561600 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:46.543069 24269 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.567828 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:46.542932 24488 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:46.570010 19058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.038s	sys 0.043s
I20260709 13:19:46.537230 24358 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:19:46.544560 24343 raft_consensus.cc:697] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:46.573628 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:46.575974 19058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.038s	sys 0.043s
I20260709 13:19:46.546484 24362 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:46.556649 24435 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:46.576543 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:46.580446 19026 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.587697 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:46.568475 24423 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:46.566612 24487 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:46.551115 24454 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:46.573038 24269 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:46.572803 24376 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:46.575031 24294 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:46.588328 24362 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:46.655679 24343 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:46.656352 24506 log.cc:927] Time spent T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:19:46.661695 24451 consensus_meta.cc:287] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.514s	user 0.003s	sys 0.007s
I20260709 13:19:46.662175 24451 raft_consensus.cc:2749] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 10. Current term is 11.
I20260709 13:19:46.663612 24362 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.666368 24454 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:46.668736 24395 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:46.702911 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:46.704191 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.720304 18344 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:46.725167 18417 raft_consensus.cc:1240] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:46.725871 18419 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:46.623584 24332 consensus_queue.cc:237] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.738186 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:46.619982 23986 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.745694 24223 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.748662 24223 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:46.758230 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 494988us
I20260709 13:19:46.760447 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 2420) took 1252 ms. Trace:
I20260709 13:19:46.747754 24292 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.733086 24230 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.769825 24260 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.810670 24260 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.769747 18336 rpcz_store.cc:276] 0709 13:19:45.507550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.509519 (+  1969us) service_pool.cc:224] Handling call
0709 13:19:46.759930 (+1250411us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001d0e54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:46.760181 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485205888}
I20260709 13:19:46.776435 24230 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:46.780711 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 53869.5us
I20260709 13:19:46.818949 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:46.787468 19027 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.014s	sys 0.010s
W20260709 13:19:46.822152 18383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.010s	sys 0.006s
W20260709 13:19:46.822484 19027 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.015s	sys 0.010s
W20260709 13:19:46.822827 18383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.010s	sys 0.006s
I20260709 13:19:46.826370 24324 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:46.807798 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:46.773258 24292 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:46.828985 24344 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:46.830047 24344 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.878896 24056 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:46.879838 24056 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:46.915777 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 155544us
I20260709 13:19:46.916271 24396 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:46.943353 24056 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:46.949564 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:46.952031 24503 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.954419 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:46.955343 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.958953 24260 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:46.943849 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:46.990355 24503 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:46.992905 24503 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:46.995879 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:46.996906 24434 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:46.997714 18411 raft_consensus.cc:1240] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:46.998682 18417 raft_consensus.cc:1240] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:46.999408 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.000042 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.000222 18418 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:47.000993 18419 raft_consensus.cc:2393] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 15: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:19:46.998677 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 458720us
I20260709 13:19:47.003679 18415 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:19:47.004642 18457 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:47.007507 24358 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:47.007931 24358 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:47.008292 24358 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.997614 24434 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:47.021282 24352 consensus_meta.cc:287] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.018s
I20260709 13:19:47.046941 18484 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:47.023118 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:47.062320 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 113166us
W20260709 13:19:47.062970 18384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.030310 24344 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.021907 24352 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:47.067611 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:47.073398 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.078218 24376 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:47.087913 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:47.079823 24243 consensus_meta.cc:287] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.833s	user 0.007s	sys 0.017s
W20260709 13:19:47.110548 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 182758us
I20260709 13:19:47.116459 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.101516 18489 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
W20260709 13:19:47.114320 18414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.006s	sys 0.028s
W20260709 13:19:47.124369 18414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.007s	sys 0.028s
W20260709 13:19:47.107234 18340 consensus_meta.cc:287] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.012s
I20260709 13:19:47.107645 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:47.124490 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:47.135710 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 46503.7us
I20260709 13:19:47.106886 24362 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:47.101758 24513 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:19:47.106997 24487 consensus_queue.cc:1059] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:19:47.146116 18413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:47.147068 18413 raft_consensus.cc:606] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:47.147276 24487 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:47.147504 18413 raft_consensus.cc:614] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:47.147818 24487 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:47.154038 24468 raft_consensus.cc:493] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:47.137066 18340 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.167651 24468 raft_consensus.cc:515] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.168354 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:47.169121 19054 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 18.
W20260709 13:19:47.169267 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 48658.2us
I20260709 13:19:47.107156 24395 consensus_queue.cc:1059] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:19:47.171579 24395 raft_consensus.cc:3055] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:47.171475 24448 consensus_queue.cc:1059] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:47.172099 24395 raft_consensus.cc:740] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:47.174248 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:47.174642 24396 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.175017 19058 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:47.175935 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:47.179003 18308 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:47.179261 24423 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.179672 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:47.179960 24423 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.180511 18489 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:47.154551 24056 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:47.183132 24056 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.185519 24056 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.155746 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:47.174755 19062 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:47.170631 19053 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:47.181865 18489 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:19:47.192251 18493 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:47.193303 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:47.195211 18340 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.196188 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:47.215366 18492 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:47.196581 24358 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:47.217131 18490 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:47.218132 24358 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:47.219235 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:47.197145 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:47.199232 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:47.220677 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:47.221400 18486 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 18.
I20260709 13:19:47.222550 18486 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:47.200223 24451 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:47.201386 18491 raft_consensus.cc:1240] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:47.148981 24487 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:47.203564 24391 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:47.204643 24434 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:47.207180 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:47.207652 18382 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:47.209048 24468 leader_election.cc:290] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.211182 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:47.173451 24395 consensus_queue.cc:260] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:47.213361 24056 consensus_queue.cc:1059] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:47.224598 18492 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:47.238154 18485 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:47.232887 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:47.225071 18340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53812 (request call id 1380) took 1606 ms. Trace:
I20260709 13:19:47.098661 24243 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.245572 18340 rpcz_store.cc:276] 0709 13:19:45.619314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.619523 (+   209us) service_pool.cc:224] Handling call
0709 13:19:47.192307 (+1572784us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b540007f654. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eed3a3d 00007f40a3ea3cd0 00007f409d428254 00007f409d4281e2 00007f409d428111 00007f409d42808c 00007f409d427342 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:47.224942 (+ 32635us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680626560}
I20260709 13:19:47.252601 18484 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:47.254117 19058 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:47.236112 24434 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:19:47.254472 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 66434.3us
I20260709 13:19:47.225170 24451 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.226940 24487 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.255792 24358 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.259833 18490 raft_consensus.cc:2368] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 18. Current term is 19.
W20260709 13:19:47.259522 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 78982.8us
I20260709 13:19:47.261547 18382 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:47.264919 24434 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:47.267584 24243 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.268630 24434 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.268776 24358 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.272179 24358 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.256551 24260 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:47.261574 24451 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:47.283375 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:47.287199 18413 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 18: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:47.288180 24293 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:47.288725 24293 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:47.290112 24281 consensus_meta.cc:287] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.784s	user 0.013s	sys 0.015s
I20260709 13:19:47.290970 24293 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:47.290654 24281 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.292317 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:47.286312 24394 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:47.293423 24454 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:47.293836 19053 raft_consensus.cc:1240] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:47.293527 24394 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.279753 24056 consensus_queue.cc:1059] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:19:47.262940 24423 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.295743 24394 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:47.299156 18384 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:47.294986 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:47.299058 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:47.292958 24281 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:47.310900 24260 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.315829 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:47.316901 18490 raft_consensus.cc:2393] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:47.317713 24260 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:47.298652 24358 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:19:47.321012 24452 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:47.321255 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 43647.1us
I20260709 13:19:47.308600 19025 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:47.328887 18384 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:47.293884 24454 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.302984 24056 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:47.346335 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:47.347081 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:47.348085 24341 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:47.349789 19060 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:47.346457 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:47.350633 19061 raft_consensus.cc:2368] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 17. Current term is 18.
I20260709 13:19:47.350656 24086 consensus_queue.cc:1059] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:19:47.352846 24086 raft_consensus.cc:3055] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:47.353195 24086 raft_consensus.cc:740] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:47.356837 19025 leader_election.cc:400] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 18. Current term is 19.
I20260709 13:19:47.357141 18490 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:47.368856 19025 leader_election.cc:403] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:19:47.356988 24086 consensus_queue.cc:260] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.360028 24281 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:47.362283 19061 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:47.362674 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:47.362895 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:47.365679 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:47.367686 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.376833 18419 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:47.338222 24454 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:47.378844 24358 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:47.380873 24269 consensus_meta.cc:287] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.744s	user 0.019s	sys 0.004s
I20260709 13:19:47.382117 24468 raft_consensus.cc:3055] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:47.382367 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.382493 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:47.387648 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 55845.9us
I20260709 13:19:47.335057 24344 raft_consensus.cc:3055] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:47.392874 18419 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 19.
I20260709 13:19:47.393808 24344 raft_consensus.cc:740] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:47.397323 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:47.398005 24056 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:47.398607 24344 consensus_queue.cc:260] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.400640 24344 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:47.401150 24056 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:47.401755 24504 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:47.393823 24230 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:19:47.397333 18384 leader_election.cc:400] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 17. Current term is 18.
I20260709 13:19:47.404604 18415 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:47.405491 18411 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:47.406831 18457 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:47.407878 18457 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:47.408694 18457 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:47.391872 24468 raft_consensus.cc:740] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:47.414062 24086 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.415752 24423 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:47.384966 24281 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.416272 24396 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:47.417830 24362 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:47.428224 24391 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:47.427892 24292 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:47.447929 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 142237us
I20260709 13:19:47.395485 24269 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:47.441751 24396 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:47.443643 24362 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.461486 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:47.465720 19057 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:47.448139 24514 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:47.450665 24423 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:47.457561 24537 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:47.445585 24448 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:47.476056 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 177220us
I20260709 13:19:47.482030 24292 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.484529 24292 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:47.486332 18488 raft_consensus.cc:1240] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:19:47.467903 24396 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:47.468544 24362 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:47.488427 24281 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:47.493402 24468 consensus_queue.cc:260] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.497509 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.500314 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:47.501166 18411 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:47.510241 24448 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.512982 24448 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.513581 24536 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:47.514232 24536 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.516412 24536 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.474810 24514 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.517683 24514 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:47.523326 18336 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
W20260709 13:19:47.550051 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 132125us
I20260709 13:19:47.549319 24537 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.568974 18411 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:47.570034 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.562238 24448 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:47.571990 24448 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.562196 24451 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:47.575874 24451 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:47.578956 18309 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:47.580448 24056 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:47.581118 24056 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.582031 24395 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.582226 24539 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:47.582749 24539 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:47.583153 24539 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:47.584827 24536 raft_consensus.cc:493] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:47.585464 24536 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.587036 24423 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.588479 24448 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.569818 24537 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.589957 24167 raft_consensus.cc:3055] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:47.590358 24167 raft_consensus.cc:740] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:47.591178 24167 consensus_queue.cc:260] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.594399 24468 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:47.601220 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:47.602581 24435 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:47.603107 24435 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:47.604140 24435 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.608254 18344 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:47.609475 18336 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:47.658066 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:47.659791 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:47.656441 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:47.660836 18486 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:47.661720 18485 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:47.663141 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:47.664229 18490 raft_consensus.cc:2368] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15.
I20260709 13:19:47.664273 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:47.667882 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 121163us
I20260709 13:19:47.670753 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:47.671181 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:47.671873 19054 raft_consensus.cc:3055] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:47.672223 19054 raft_consensus.cc:740] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:47.678789 18414 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:47.683637 18384 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:47.690275 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:47.690937 19062 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 18.
I20260709 13:19:47.691206 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:47.692055 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:47.692564 18384 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:47.693270 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:47.696127 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.697340 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:47.689198 24434 raft_consensus.cc:493] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:47.698700 24536 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.698817 24434 raft_consensus.cc:515] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.699564 24260 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:47.700013 18418 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:47.700184 24260 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.701099 24434 leader_election.cc:290] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.702023 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.674322 24230 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:19:47.714147 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.714200 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:47.716902 19054 consensus_queue.cc:260] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.684682 24269 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:47.736613 18487 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:47.754156 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:47.756232 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:47.715075 24503 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:47.759748 19054 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:47.762681 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 73365.5us
I20260709 13:19:47.733368 24292 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.763048 24539 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.763921 24269 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:47.763695 24292 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.764428 24269 raft_consensus.cc:697] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:47.765435 24269 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.768038 24514 raft_consensus.cc:515] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.770046 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.745368 24434 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:47.775588 24434 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:47.776585 24434 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.779302 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:47.779963 18337 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:47.786494 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:47.782197 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.789723 18337 raft_consensus.cc:1240] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:47.790359 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 210279us
I20260709 13:19:47.783056 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:47.742576 24223 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:47.800411 19060 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.805778 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:47.740831 24504 consensus_queue.cc:1059] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:19:47.782397 24537 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:47.789587 24292 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:47.785653 24536 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:47.841807 19057 raft_consensus.cc:1275] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:47.843931 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:47.839721 18309 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:47.845710 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:47.846596 18340 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:47.850800 18308 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:47.851773 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 88364.1us
I20260709 13:19:47.853299 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.855762 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.859025 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:47.863672 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:47.833525 24514 leader_election.cc:290] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:47.874047 24549 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:19:47.876827 24550 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:47.877491 24550 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:47.882118 24519 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:47.882866 24519 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:47.890753 24542 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:19:47.898370 24056 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.899122 24056 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:47.899725 24260 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:47.849056 24539 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.907325 24551 raft_consensus.cc:493] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:47.908151 24551 raft_consensus.cc:515] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.916404 24551 leader_election.cc:290] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.924474 19054 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:47.941839 18486 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 18.
I20260709 13:19:47.871176 24293 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 13:19:47.862793 24537 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:47.968364 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 225020us
I20260709 13:19:47.978226 24537 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:47.982563 18490 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:47.992605 24452 raft_consensus.cc:3055] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:48.003472 24452 raft_consensus.cc:740] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:48.002868 24398 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:48.014350 24398 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:48.015228 24391 consensus_meta.cc:287] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.004s
I20260709 13:19:48.015795 24391 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 18. Current term is 19.
I20260709 13:19:48.015372 24398 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:47.918465 24536 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.018893 24536 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:48.013324 24344 consensus_meta.cc:287] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.005s
I20260709 13:19:47.967912 24504 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.994839 24167 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:47.948335 24519 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:47.929895 24362 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.024164 18384 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:48.029167 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 247006us
W20260709 13:19:48.020192 24543 log.cc:927] Time spent T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.149s	user 0.000s	sys 0.003s
I20260709 13:19:48.009336 24396 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.031527 24504 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.071346 24504 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:48.062309 24223 consensus_queue.cc:1059] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:19:48.077093 18491 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:19:48.078197 19060 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:19:48.086899 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 297305us
I20260709 13:19:48.089212 19025 leader_election.cc:400] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15.
I20260709 13:19:48.090327 19025 leader_election.cc:403] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:48.076361 24324 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:48.105355 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:48.106024 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 313379us
I20260709 13:19:48.106256 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:48.073326 24550 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.107370 18493 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 11.
W20260709 13:19:48.111747 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 198069us
I20260709 13:19:48.113636 19026 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:48.114374 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 307660us
I20260709 13:19:48.115410 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88b963fb1b740418ee335cb0fe83049" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:48.118059 23499 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:19:48.120622 24519 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:48.111585 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:48.107776 24454 consensus_meta.cc:287] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.691s	user 0.016s	sys 0.000s
I20260709 13:19:48.105623 24324 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:48.149796 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:48.105868 24086 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 14. Current term is 15.
I20260709 13:19:48.162276 18309 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:48.108944 24503 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:48.157600 18493 raft_consensus.cc:2393] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 18: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:19:48.164736 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 52262.4us
W20260709 13:19:48.165609 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 54186.8us
I20260709 13:19:48.160135 19026 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:48.161026 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.156554 24324 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.125964 18382 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:48.168077 18340 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:48.162262 24230 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:19:48.176074 24332 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:48.176678 24332 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:48.178038 24566 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:48.178879 24332 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:48.158149 24391 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:19:48.184230 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:48.184816 18487 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:48.185495 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:48.195519 18484 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 19: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:19:48.197510 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 71664.4us
I20260709 13:19:48.208460 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:48.111042 24344 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.217435 24230 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:48.217940 24223 raft_consensus.cc:493] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:48.218549 24223 raft_consensus.cc:515] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.163007 24519 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:48.124513 24452 consensus_queue.cc:260] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:48.164420 24167 consensus_queue.cc:1059] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:19:48.224901 24452 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:48.225397 24362 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:48.225561 24167 raft_consensus.cc:3055] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:48.226174 24167 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:19:48.229614 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 69549.3us
I20260709 13:19:48.230479 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:48.229488 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:48.165305 24503 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:48.195226 24396 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:48.250356 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:48.250944 18410 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:48.165907 24292 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:19:48.157559 24454 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:48.254940 18414 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:48.217950 24230 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.228217 24536 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:48.249848 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:48.278076 18416 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:48.279456 24503 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.280869 24503 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:48.227212 24167 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.282310 24167 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:48.247121 24519 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:48.242342 24362 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.286384 24362 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.263407 24562 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:48.294008 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:48.295100 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:48.228173 24341 consensus_queue.cc:1175] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" responder_term: 15 status { last_received { term: 15 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 15 index: 10 } }
I20260709 13:19:48.264904 24561 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:19:48.274329 24487 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.274675 18410 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
I20260709 13:19:48.275745 24566 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:48.286245 24519 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.258306 18309 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:48.246706 24374 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:48.310814 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 47716us
I20260709 13:19:48.299716 18419 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 19: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:48.303058 18415 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:48.303635 19025 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:48.306555 18457 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:48.291445 24230 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:48.329315 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 86627.7us
I20260709 13:19:48.330693 18309 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:48.257193 24344 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.306200 24223 leader_election.cc:290] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:48.332176 24374 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.311600 24292 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.346231 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:48.374684 18419 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 19.
I20260709 13:19:48.335270 24423 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:48.342407 24409 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:19:48.394805 24292 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.397085 24292 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:48.401417 24398 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:48.404739 18487 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:19:48.397656 24292 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:48.410279 24292 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:48.353019 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:48.411435 24292 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.412607 24292 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:48.327031 24571 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.422017 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:48.422611 24571 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.351679 18307 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:48.326254 24562 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.335795 24487 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:48.311591 23499 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:48.342514 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:48.355587 23986 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:19:48.370990 18309 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:48.507424 24269 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.277053 24324 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:48.508119 24269 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:48.510118 24167 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:48.510576 24167 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:48.384305 18416 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
I20260709 13:19:48.511050 24167 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:48.451692 18310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.507385 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 136521us
I20260709 13:19:48.372300 24536 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:48.522706 18309 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:48.531906 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 233774us
I20260709 13:19:48.424800 24086 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:48.530421 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 216299us
I20260709 13:19:48.379047 24448 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:48.504927 24423 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:48.545060 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.389637 24230 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.524111 24362 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:48.342949 24555 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 10, Time since last communication: 0.227s
W20260709 13:19:48.558902 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 258601us
I20260709 13:19:48.549791 18384 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:48.513887 24468 consensus_queue.cc:1059] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:19:48.561585 24468 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:48.562129 24468 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:48.563374 24468 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:48.564168 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:48.565013 18486 raft_consensus.cc:2393] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:48.565140 24468 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:48.567008 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.570808 18415 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:19:48.539322 24324 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:48.559710 19027 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:48.546849 18458 connection.cc:256] RPC call timeout handler was delayed by -1.2661820360001457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.261s for a response
I20260709 13:19:48.543723 24561 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:48.543081 24550 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:48.578100 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:48.584975 18418 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:19:48.513777 24562 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:48.597589 24576 log.cc:927] Time spent T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:19:48.543620 23499 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.601061 24589 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:48.601771 24589 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.602234 24573 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:48.559029 24086 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:48.578356 24536 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:48.579144 24448 raft_consensus.cc:697] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:19:48.620739 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 54304.6us
I20260709 13:19:48.621444 18458 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:48.623824 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 64197.3us
W20260709 13:19:48.624132 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 74455us
I20260709 13:19:48.604964 24167 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.611975 24514 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.646898 18457 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:48.651795 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 73315.8us
I20260709 13:19:48.652546 18493 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:19:48.657562 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:48.661420 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:48.662115 18414 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:48.664511 24448 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.671504 24562 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:48.672394 24571 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:48.672905 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:48.673671 18339 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:48.674671 24435 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:48.675247 24435 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:48.675872 24344 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:48.669551 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 58684.5us
I20260709 13:19:48.614418 24086 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.637703 24454 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:48.657855 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:48.680480 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:48.680801 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:48.681499 19054 raft_consensus.cc:2368] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19.
I20260709 13:19:48.644234 24260 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.644060 24566 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:48.641584 24588 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:48.713893 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:48.690614 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.713001 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:48.714809 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:48.713136 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:48.718272 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:48.719156 18336 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:19:48.721627 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:48.732008 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:48.736469 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:48.736819 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:48.737143 18340 raft_consensus.cc:3060] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:19:48.676239 24435 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.751005 24167 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:48.753062 24374 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:48.754161 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:48.755016 19055 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 19.
I20260709 13:19:48.689756 24423 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.758595 24230 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:48.761354 24487 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:48.762195 24487 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:48.764262 24086 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:48.715479 24566 raft_consensus.cc:493] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.765745 24566 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.712669 24260 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.768857 24260 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:48.769534 19053 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 19.
I20260709 13:19:48.770741 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:48.773439 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 58351.7us
W20260709 13:19:48.774350 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 90402.6us
W20260709 13:19:48.774573 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 47938.3us
I20260709 13:19:48.775071 19025 leader_election.cc:304] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:48.775763 18384 leader_election.cc:304] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:48.783458 19027 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.643494 24514 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:48.791435 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 57271.8us
W20260709 13:19:48.792781 18308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.798251 19026 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:48.818523 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 466918us
W20260709 13:19:48.821939 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 47804.5us
I20260709 13:19:48.643574 24536 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:48.824131 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:48.800227 24230 raft_consensus.cc:2749] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:48.796919 24409 raft_consensus.cc:2804] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:19:48.836990 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 124121us
I20260709 13:19:48.797294 24374 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.870407 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:48.869933 18335 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:19:48.875999 18340 raft_consensus.cc:2468] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:19:48.877851 18340 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:48.874907 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:48.883710 18340 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 18. Current term is 19. Ops: []
W20260709 13:19:48.887809 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 89652.9us
I20260709 13:19:48.888512 19026 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:48.821619 24548 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:19:48.951483 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:48.822788 24571 consensus_queue.cc:1048] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:19:48.869341 24281 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:48.957659 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:48.958231 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:48.872995 24344 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.836519 24573 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:19:48.886232 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:48.970305 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:19:48.972010 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 91877.6us
I20260709 13:19:48.975380 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:48.952775 24395 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.845175 24374 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:48.978432 24292 consensus_meta.cc:287] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.000s
I20260709 13:19:48.976799 18491 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:49.057615 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:49.059410 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:48.966609 24394 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:49.058903 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:49.063884 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c860bd12a6124270ba17146fea662e3b" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:48.987443 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 98972.6us
I20260709 13:19:49.073726 19058 raft_consensus.cc:2368] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 16. Current term is 17.
I20260709 13:19:49.068693 24599 consensus_queue.cc:1059] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.233s
I20260709 13:19:49.076855 24599 raft_consensus.cc:3055] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:49.077183 24599 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:49.078107 24599 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:49.079228 24599 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.080479 19059 raft_consensus.cc:2410] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260709 13:19:49.081854 24596 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 13:19:49.071705 24167 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:19:49.082993 24595 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:49.071435 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.088752 18488 raft_consensus.cc:2368] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19.
I20260709 13:19:49.091866 18341 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 12.
I20260709 13:19:49.087829 24519 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:49.095127 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.095922 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.100946 24536 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:48.973106 24281 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.110229 24281 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:49.110304 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:48.973805 24344 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.111814 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:49.112867 24344 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.117157 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.118331 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:49.118988 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.119771 18342 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:19:49.120775 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.121285 18309 leader_election.cc:400] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19.
I20260709 13:19:49.121565 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.123129 18309 leader_election.cc:403] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:49.068421 24409 raft_consensus.cc:697] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:49.125358 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ca5739563d4349a7b7a6c70d81e653" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:49.080529 24452 consensus_meta.cc:287] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.855s	user 0.008s	sys 0.000s
I20260709 13:19:49.133235 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.112946 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b55a3ba07d4097b2da619afcf80e3f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.134042 18486 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 19: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:49.135138 19056 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 19.
I20260709 13:19:49.130940 18309 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:49.131125 19055 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 19.
I20260709 13:19:49.136993 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.137113 18309 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:49.135954 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:49.133970 19060 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:49.143066 19027 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:49.130057 24547 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.141144 18309 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:49.145112 18343 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:19:49.183028 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.183818 19059 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:49.151976 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.184885 18410 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:49.137737 24086 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:49.140717 24167 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:49.186494 24448 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:49.186367 24086 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.186944 24448 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:49.187345 24448 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:49.188666 24566 raft_consensus.cc:515] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.189807 19062 raft_consensus.cc:1240] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:49.190554 24374 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:49.191476 24409 consensus_queue.cc:237] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.195648 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.196271 18414 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:49.070333 24395 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:49.198241 24514 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:49.198710 24395 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:49.141566 24293 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:49.199842 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.199970 24293 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.200735 19059 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:49.145040 24550 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:49.202950 24332 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:19:49.203469 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 60466.2us
I20260709 13:19:49.204444 19027 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:49.205734 18308 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:49.206334 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.206777 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:49.206101 24167 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.213083 19059 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:49.214990 18384 leader_election.cc:304] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:49.206458 24468 consensus_meta.cc:287] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.641s	user 0.014s	sys 0.000s
I20260709 13:19:49.203413 24332 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:49.211988 24167 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.221357 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4139afe4ea2b4938821aa26d4c12e6ab" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.133425 24344 raft_consensus.cc:2749] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19.
I20260709 13:19:49.243432 18338 raft_consensus.cc:2410] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:19:49.227375 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.259990 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:49.261525 19059 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:19:49.266075 18384 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:49.222970 24573 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:49.287832 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:49.223158 24545 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:49.217257 24514 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:49.259647 24503 consensus_meta.cc:287] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.978s	user 0.011s	sys 0.003s
I20260709 13:19:49.133795 24519 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.221067 24293 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:49.244318 24452 raft_consensus.cc:2749] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:49.260658 24468 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:49.326016 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:49.334256 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 128599us
I20260709 13:19:49.327050 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.289523 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:49.333866 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 192793us
I20260709 13:19:49.311313 24571 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:49.344676 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:49.310400 24600 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:49.316525 24545 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.346781 19055 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:49.220809 24547 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.335165 18491 raft_consensus.cc:2376] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13. Re-sending same reply.
I20260709 13:19:49.291548 24548 consensus_queue.cc:1059] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:19:49.353219 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.356338 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:49.335852 24468 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.307924 24591 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:19:49.399667 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.400476 18486 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:49.363708 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.365764 24566 leader_election.cc:290] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:49.367012 24167 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.370889 24514 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.374882 24269 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:49.377080 24595 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:49.354460 24571 raft_consensus.cc:697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:49.337690 24293 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:49.382241 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.413096 18491 raft_consensus.cc:2376] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17. Re-sending same reply.
I20260709 13:19:49.351385 24394 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:49.354755 24600 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.383677 24547 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.351943 24545 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:49.389561 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:49.391088 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.391765 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.393035 24504 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:19:49.393694 18307 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.211.3:43125 timed out after 1.910s (SENT) [suppressed 18 similar messages]
I20260709 13:19:49.394269 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:49.394335 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.401531 18336 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:49.409376 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.327797 24573 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.399106 24468 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:49.417900 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.420857 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.421509 18490 raft_consensus.cc:2376] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17. Re-sending same reply.
I20260709 13:19:49.423607 19061 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
I20260709 13:19:49.421655 18489 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:49.426138 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.436744 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:49.437489 18336 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.439554 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.441709 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.410341 24555 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.442827 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.443624 18491 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 14: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:49.440202 18490 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:49.445439 18457 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:49.447136 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.413484 24167 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:49.416882 24243 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:49.414192 24448 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.423447 24571 consensus_queue.cc:237] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:49.423853 24293 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.455686 24573 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.456439 24600 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:49.410066 24514 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.458283 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.477735 19058 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:49.447872 18412 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
W20260709 13:19:49.478281 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 84607.9us
I20260709 13:19:49.426270 24269 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:49.474248 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.475395 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.490511 18342 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 19: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:49.485373 18343 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:49.493227 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.491436 18309 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:49.472851 24435 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:49.493796 18343 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:49.507421 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:49.508612 19058 raft_consensus.cc:2410] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:19:49.510697 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.496555 24269 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.519040 24269 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.523182 24293 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:49.471599 24167 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.525125 18339 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:49.525362 24167 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.528911 24514 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:49.530679 24589 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.534286 24519 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:49.537139 24332 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.460361 24555 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.501754 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:49.542217 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.553033 18335 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:19:49.539865 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:49.551765 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 44660.4us
W20260709 13:19:49.553033 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 51399.6us
I20260709 13:19:49.544895 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.554459 18343 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:49.555737 18307 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:49.557814 18307 leader_election.cc:400] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19.
I20260709 13:19:49.558894 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:49.473765 24243 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.561637 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.562107 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:49.563441 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.486626 23499 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.503624 24599 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:49.497174 24435 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.565292 18307 leader_election.cc:304] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:49.566524 24167 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.560309 24573 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:49.567057 24504 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:49.564579 24589 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:49.573132 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.574433 18307 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:49.560722 18338 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:49.582096 24611 raft_consensus.cc:2749] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.583823 18343 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:19:49.586510 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.587699 19057 raft_consensus.cc:2410] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:19:49.583354 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.588176 19055 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:49.588249 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:49.571931 24621 log.cc:927] Time spent T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:19:49.589879 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:49.567982 24591 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.590826 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.578538 18457 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:49.591522 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:49.572345 24599 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.573058 24435 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.597236 18335 raft_consensus.cc:2410] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:19:49.597626 19057 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:19:49.599220 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 129187us
I20260709 13:19:49.577267 24504 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.601821 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:49.603582 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.605546 18493 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:49.606678 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.607757 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.608502 18338 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:49.609532 24623 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:49.609965 24623 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.610306 24623 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:49.591332 24167 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:49.611136 24589 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:49.611872 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.613015 24448 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.575366 24573 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:49.613842 24573 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:49.598316 24599 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:49.620949 18335 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:19:49.572134 24545 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.621871 19025 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:49.626569 24394 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:49.627108 24555 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.627638 18335 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:49.623432 24566 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:49.628685 24566 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:49.629046 24566 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:49.637905 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 49327.1us
I20260709 13:19:49.638893 18307 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:49.640024 18492 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:19:49.644122 24545 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:49.646591 18338 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:19:49.626134 24571 consensus_queue.cc:1059] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:19:49.648625 24332 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:49.600402 24591 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.651708 24591 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.652212 24573 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.654219 24243 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.655179 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.655258 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.656015 18487 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:49.624600 18458 leader_election.cc:400] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 16. Current term is 17.
I20260709 13:19:49.658658 18484 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:49.662184 19054 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 19. Current term is 20. Ops: []
W20260709 13:19:49.663285 24610 log.cc:927] Time spent T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.335s	user 0.000s	sys 0.003s
I20260709 13:19:49.657980 24623 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:49.666458 24623 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:49.668583 24612 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:19:49.670748 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97efddba551a406f8d4427488fc22c5c" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:49.658707 18458 leader_election.cc:403] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:19:49.669313 24573 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.616890 24504 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.677263 18484 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
W20260709 13:19:49.692648 24619 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:19:49.693698 18418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 1255) took 1431 ms. Trace:
I20260709 13:19:49.694128 18418 rpcz_store.cc:276] 0709 13:19:48.262789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.262924 (+   135us) service_pool.cc:224] Handling call
0709 13:19:48.273776 (+ 10852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.592121 (+318345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.693415 (+1101294us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54002a5b54. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:49.693617 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702720768}
I20260709 13:19:49.699293 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:49.705253 24086 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:49.708480 24566 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.710125 24435 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:49.712266 24448 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:49.712549 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 73846.1us
I20260709 13:19:49.734119 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:49.716115 24468 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.716835 18336 raft_consensus.cc:2468] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:49.720530 24504 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.726272 18238 catalog_manager.cc:5697] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 9 to 16, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 16 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:49.727260 24554 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.729581 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.743263 18419 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:19:49.731127 18309 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:49.732167 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:49.733058 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:49.735530 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:49.743525 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.735740 19025 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:19:49.742326 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 123592us
I20260709 13:19:49.747430 24344 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:49.747807 24344 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.748004 24396 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:49.748169 24344 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:49.748653 24396 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.748947 24565 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:19:49.751140 24396 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.751305 24566 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:49.753324 18382 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:49.754873 19054 raft_consensus.cc:1240] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:49.755214 18382 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:49.756102 24468 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.756470 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:49.757009 19054 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:19:49.759836 24554 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.760993 18418 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:49.761840 24554 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.762157 24573 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.762521 24566 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.762902 24573 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:49.762997 24566 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.763595 24573 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:49.764179 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.764868 18336 raft_consensus.cc:2368] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18.
I20260709 13:19:49.764505 24573 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:49.765100 24566 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:49.769641 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:49.769731 19027 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:49.770880 19027 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:49.773095 19057 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 19: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:19:49.773789 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.775992 18410 raft_consensus.cc:1240] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:49.775491 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.775482 19054 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 18.
I20260709 13:19:49.772541 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:49.781149 19059 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:49.781466 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:49.757400 24599 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:49.787822 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 52167.1us
I20260709 13:19:49.788198 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.785301 19027 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:49.782368 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.788337 18309 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:49.789835 18411 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 16. (term mismatch)
I20260709 13:19:49.784859 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:49.790251 18411 pending_rounds.cc:85] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Aborting all ops after (but not including) 15
I20260709 13:19:49.789860 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:49.791262 18412 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:49.792459 18415 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 15: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:49.745002 24352 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 16. Current term is 17.
I20260709 13:19:49.796828 24579 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:49.779541 24448 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:49.797230 24579 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.795178 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.797571 24536 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:49.797854 24597 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:49.798333 24585 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:49.798767 24585 raft_consensus.cc:493] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.794130 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:49.802767 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.790511 18411 pending_rounds.cc:107] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: Aborting uncommitted NO_OP operation due to leader change: 17.16
I20260709 13:19:49.803963 18411 raft_consensus.cc:2889] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:49.811721 24504 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.813567 18458 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:49.814724 24243 consensus_queue.cc:1059] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:49.815939 24243 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:49.816699 24555 raft_consensus.cc:3055] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:49.817159 24555 raft_consensus.cc:740] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:49.817288 24581 consensus_queue.cc:1059] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:19:49.818092 24614 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:49.818655 24625 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:49.818349 24555 consensus_queue.cc:260] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.790014 24423 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.797657 24579 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:49.823944 19027 leader_election.cc:304] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:49.799099 24585 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.792608 24374 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:49.794674 24260 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:49.850066 24260 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:49.849900 24344 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.850526 24260 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:49.786883 24611 consensus_queue.cc:1059] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:19:49.795379 24550 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:49.823202 18342 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 18: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:49.839365 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:49.801499 24623 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:49.842614 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:49.844296 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.845042 19027 leader_election.cc:400] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18.
I20260709 13:19:49.845727 24582 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:49.845861 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.846334 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.846684 24555 raft_consensus.cc:3060] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.846999 24352 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:19:49.821434 24243 raft_consensus.cc:697] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:49.851861 18337 raft_consensus.cc:2393] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 20: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
W20260709 13:19:49.852025 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 117975us
I20260709 13:19:49.879930 18307 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:49.858084 19027 leader_election.cc:403] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:49.840209 24614 raft_consensus.cc:697] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:49.884425 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.884548 18411 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:19:49.885066 18416 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:19:49.875687 18413 raft_consensus.cc:2393] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 12: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:49.843632 24374 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.859901 24611 raft_consensus.cc:3055] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:49.886858 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:49.889760 18338 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:19:49.889947 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 45018.8us
I20260709 13:19:49.893010 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.887281 24601 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:49.888935 24374 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:49.896638 24563 raft_consensus.cc:2804] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:49.897027 23986 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.897478 24594 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:49.897531 23986 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.898406 24564 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:49.898949 24564 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.899865 23986 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.901005 24564 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:49.901522 24566 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18.
I20260709 13:19:49.868017 24582 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.840055 24396 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:19:49.905481 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:49.907545 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.908080 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.844089 24423 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.912683 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:49.913245 19061 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.914242 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.914848 19058 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
I20260709 13:19:49.915633 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.916834 24614 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.889403 24487 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:49.886770 24554 raft_consensus.cc:493] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:49.921016 18412 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:49.902777 24565 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:49.922411 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:49.907754 24582 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:49.924782 19061 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:49.924227 18384 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:49.906733 24563 raft_consensus.cc:697] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:49.889591 24611 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:49.908228 24623 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:49.934624 18485 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
I20260709 13:19:49.937052 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.852329 24625 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.939786 24504 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:49.942128 24435 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:49.942541 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.942701 24435 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:49.943281 18412 raft_consensus.cc:2393] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 17: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:49.946660 24599 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.947105 24423 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.947387 24243 consensus_queue.cc:237] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.948800 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:49.950270 24344 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.937884 24554 raft_consensus.cc:515] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.952920 24554 leader_election.cc:290] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:49.958489 24623 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:49.962388 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:49.963160 19055 raft_consensus.cc:2393] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 20: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:19:49.964361 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 84498.2us
I20260709 13:19:49.965097 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:49.940697 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:49.923030 24487 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:49.929121 24396 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:49.970870 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:49.962457 24630 log.cc:927] Time spent T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:49.981559 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.968900 18384 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:49.964789 18457 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:49.988909 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:49.992480 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:49.970453 24344 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:50.000728 19054 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:49.971704 24324 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:49.987460 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:49.978624 24396 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:50.007467 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:50.021704 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:49.993697 24423 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:50.029285 18458 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:50.029661 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:50.030870 19060 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:19:50.031569 19060 pending_rounds.cc:85] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 11
I20260709 13:19:50.031895 19060 pending_rounds.cc:107] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:19:50.032241 19060 raft_consensus.cc:2889] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:50.022848 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 57819.8us
I20260709 13:19:50.023777 19058 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:19:49.990554 24583 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:50.037617 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:50.040365 18418 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:50.042444 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:50.047709 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:50.058503 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:50.059464 18412 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
I20260709 13:19:50.034724 24230 raft_consensus.cc:2749] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:50.039489 24583 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.035667 24344 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.043345 24423 raft_consensus.cc:697] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:50.069334 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1734a6c318d4e6ba6b65fd828d4fe66" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:50.074627 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:50.078097 18415 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 18.
I20260709 13:19:50.083674 18413 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:19:50.090058 18338 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:50.071592 24583 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:50.105414 24374 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.079984 24269 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:50.035107 24563 consensus_queue.cc:237] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:50.095356 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 66185.3us
I20260709 13:19:50.042891 24487 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:50.108619 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:50.038787 24611 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.123070 19061 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:50.076224 24344 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:50.081779 24585 raft_consensus.cc:515] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.131632 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:50.130204 18415 raft_consensus.cc:1240] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:19:50.143729 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 49711.2us
I20260709 13:19:50.144572 18307 leader_election.cc:304] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:50.080492 24396 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.136652 24611 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.137822 24292 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:50.200664 24637 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:19:50.201606 24638 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:19:50.201963 24374 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:50.202845 24636 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:19:50.203629 24633 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:19:50.205020 24639 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:19:50.131453 24423 consensus_queue.cc:237] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:50.166695 24625 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:50.198776 24550 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:50.211814 24550 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:50.213150 18418 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:19:50.214114 24396 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:50.218140 23986 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:50.218719 23986 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:50.220721 23986 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:50.222388 24260 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.223198 24585 leader_election.cc:290] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:50.224790 24344 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:50.142464 24594 consensus_queue.cc:1059] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.088s
I20260709 13:19:50.226648 24594 raft_consensus.cc:3055] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:50.226981 24594 raft_consensus.cc:740] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:50.227764 19056 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:50.205511 24582 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.228863 19053 raft_consensus.cc:1240] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:19:50.230314 24260 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:50.238054 18309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.196730 24589 raft_consensus.cc:2804] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:50.230126 24579 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.312558 18419 raft_consensus.cc:2368] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18.
I20260709 13:19:50.287837 24550 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:50.277619 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 219046us
W20260709 13:19:50.275934 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 76339.2us
I20260709 13:19:50.282430 24589 raft_consensus.cc:493] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:50.326416 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:50.332261 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 187757us
I20260709 13:19:50.334041 18457 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:50.339489 19056 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 18.
I20260709 13:19:50.342909 24269 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:50.343379 24269 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:50.343851 24269 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:50.344776 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:50.354007 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:50.323361 24589 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:50.227803 24594 consensus_queue.cc:260] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:50.454838 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 121683us
I20260709 13:19:50.466744 18307 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:50.469118 24582 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:50.521584 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:50.523036 18307 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:50.524875 18307 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:50.527959 24594 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:50.529940 18342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2861) took 1142 ms. Trace:
I20260709 13:19:50.521768 24579 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:50.530386 18342 rpcz_store.cc:276] 0709 13:19:49.387509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.510358 (+122849us) service_pool.cc:224] Handling call
0709 13:19:50.529739 (+1019381us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400057dd4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:50.529866 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716600576}
I20260709 13:19:50.518162 24614 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:50.536494 18307 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:50.537891 18307 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:50.543542 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.532406 24344 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:50.531183 24550 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:50.533015 24611 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:50.534220 24589 raft_consensus.cc:515] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:50.560391 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 427004us
I20260709 13:19:50.561025 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:50.561410 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:50.561558 19026 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:50.559551 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:50.561725 18341 raft_consensus.cc:2368] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18.
I20260709 13:19:50.543841 24468 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:50.542145 24599 raft_consensus.cc:2749] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:50.559199 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:50.545760 18342 raft_consensus.cc:1240] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:50.568179 18415 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:50.563542 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:50.566497 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bc6fb6380b4ad7b0907976d075d20e" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:50.567047 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:19:50.569429 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.571228 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:50.571866 18335 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:50.548318 24344 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:50.562224 24584 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.576136 18340 raft_consensus.cc:3060] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:50.571163 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:50.577100 18337 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:50.565979 24260 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:50.577950 24344 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.590930 24582 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:50.611696 18335 raft_consensus.cc:2468] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 18.
I20260709 13:19:50.613298 18415 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 18.
I20260709 13:19:50.588912 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:50.562491 24614 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:19:50.566263 24563 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:19:50.627574 18340 raft_consensus.cc:2468] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:19:50.583545 24584 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:50.630350 24269 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.620577 24582 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:50.633455 24545 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:50.637430 24583 consensus_meta.cc:287] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 13:19:50.637841 24583 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.639789 24583 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:50.640431 18416 raft_consensus.cc:1240] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:19:50.642755 24589 leader_election.cc:290] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:50.647243 24584 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:50.654237 19027 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:50.655843 19027 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:50.661362 18337 raft_consensus.cc:2468] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:50.660447 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:50.654531 24582 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:50.657755 24292 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:50.666178 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 113100us
I20260709 13:19:50.672955 19027 leader_election.cc:400] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18.
I20260709 13:19:50.673642 19027 leader_election.cc:403] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:19:50.661234 24281 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:50.682943 24269 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:50.683599 24281 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18.
I20260709 13:19:50.671918 23986 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:50.684571 23986 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:50.681470 24563 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:50.685858 24324 consensus_queue.cc:1059] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:19:50.709205 24324 raft_consensus.cc:3055] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:50.709672 24324 raft_consensus.cc:740] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:50.709982 24590 raft_consensus.cc:3055] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:50.710444 24590 raft_consensus.cc:740] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:50.710496 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:50.710774 24324 consensus_queue.cc:260] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.711344 24590 consensus_queue.cc:260] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.792847 24590 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:50.792985 24324 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:50.798038 24584 consensus_queue.cc:1175] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" responder_term: 17 status { last_received { term: 17 index: 15 } last_committed_idx: 14 last_received_current_leader { term: 17 index: 15 } }
I20260709 13:19:50.742204 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:50.754649 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:50.802984 18337 raft_consensus.cc:1240] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:50.756755 24487 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:50.686699 23986 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:50.696514 24645 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:19:50.698503 24652 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:19:50.698616 24651 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:19:50.698942 24654 log.cc:927] Time spent T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:19:50.705598 24588 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.706512 24563 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.820290 24563 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:50.820829 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:50.800806 18457 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:50.822825 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:50.823509 18413 raft_consensus.cc:2368] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 15. Current term is 16.
I20260709 13:19:50.703912 18382 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:50.769609 18341 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:50.774922 24293 raft_consensus.cc:3055] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:50.824486 24590 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:50.824713 24293 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:50.824909 24590 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:50.824507 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 120718us
I20260709 13:19:50.825563 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:50.825713 24590 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:50.826774 18340 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 18: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:50.820304 24588 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.829825 18492 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:50.829766 24648 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:50.830772 24648 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:50.783578 18491 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:50.784879 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:50.831983 24648 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:50.833154 24293 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.786027 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:50.834184 18485 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:50.834348 24293 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.786667 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:50.789885 18384 leader_election.cc:304] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:50.835212 18484 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 14: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:19:50.835834 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 46064.8us
I20260709 13:19:50.837026 18384 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:50.837358 23986 raft_consensus.cc:2749] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:50.831748 24588 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:50.838131 23986 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:50.838657 18382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.838689 23986 raft_consensus.cc:697] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:50.839630 18492 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:50.839906 23986 consensus_queue.cc:237] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:50.842067 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 162708us
I20260709 13:19:50.842965 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:19:50.814601 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 52331us
W20260709 13:19:50.844027 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.843770 24563 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.844707 18458 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:50.847651 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:50.848296 18336 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:50.849251 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:50.850229 18338 raft_consensus.cc:2393] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 14: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:50.851141 18335 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:19:50.851629 18335 pending_rounds.cc:85] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 8
I20260709 13:19:50.851881 18335 pending_rounds.cc:107] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:19:50.852138 18335 raft_consensus.cc:2889] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.852591 24269 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:50.816718 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.853554 18487 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:19:50.853802 18340 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:50.819676 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:50.854709 18416 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:50.854820 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:50.829186 18308 leader_election.cc:400] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 15. Current term is 16.
I20260709 13:19:50.855598 18308 leader_election.cc:403] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:19:50.855847 24352 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:50.856374 24614 raft_consensus.cc:2749] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 15. Current term is 16.
I20260709 13:19:50.851063 24395 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:50.858413 18308 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:50.859405 24614 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:50.859828 24614 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:50.860234 24614 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:50.860505 18493 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
I20260709 13:19:50.861819 18419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44916 (request call id 1266) took 1076 ms. Trace:
I20260709 13:19:50.862273 18419 rpcz_store.cc:276] 0709 13:19:49.785202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.785347 (+   145us) service_pool.cc:224] Handling call
0709 13:19:50.861587 (+1076240us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54000a78d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:50.861726 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1183083904}
I20260709 13:19:50.779815 24582 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.843046 19027 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:50.859843 24269 consensus_queue.cc:1059] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:19:50.867174 24395 raft_consensus.cc:3055] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:50.867519 24409 raft_consensus.cc:2804] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:50.851881 18458 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:50.868149 24409 raft_consensus.cc:697] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:50.867568 24395 raft_consensus.cc:740] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:50.855602 18337 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 18: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:50.873155 24269 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.873647 24573 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:50.875931 18382 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:50.876746 24573 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:50.877170 24573 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.877576 24573 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:50.869434 24409 consensus_queue.cc:237] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.879494 18238 catalog_manager.cc:5697] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 12 to 14, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 14 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:50.880342 24352 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:50.870640 19027 leader_election.cc:304] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:50.883373 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:50.817746 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 157361us
I20260709 13:19:50.881003 18238 catalog_manager.cc:5697] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 9 to 13, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 13 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:50.883965 18337 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:50.884456 19026 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:50.888844 19056 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:19:50.890547 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:50.892164 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:50.897979 18341 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:50.898371 18238 catalog_manager.cc:5697] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 4 to 15, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 15 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:50.907846 19026 leader_election.cc:400] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18.
I20260709 13:19:50.908898 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:50.909809 18340 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 15: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:50.911281 18309 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:50.805588 24344 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:50.902601 24514 raft_consensus.cc:2804] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:50.914701 19059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:50.915103 24344 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:50.915560 19059 raft_consensus.cc:2393] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 18: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:50.907531 18238 catalog_manager.cc:5697] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:50.916497 18238 catalog_manager.cc:5697] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 9 to 14, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 14 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:50.917939 18339 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:50.918596 18487 raft_consensus.cc:1275] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:19:50.919000 18487 pending_rounds.cc:85] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 10
I20260709 13:19:50.919222 18487 pending_rounds.cc:107] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:19:50.919456 18487 raft_consensus.cc:2889] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.923585 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:50.924556 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:50.925168 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:50.931501 18384 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:50.933182 18382 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:50.925202 18489 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 18.
I20260709 13:19:50.935366 24611 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:50.936106 24611 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:50.939180 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:50.939797 19056 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:50.926929 18340 raft_consensus.cc:1275] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:50.927301 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9264b0a434b79b6292c2ed23bbae0" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:50.927842 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:50.942130 18339 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:19:50.942296 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132f50d25c404b83b0bafe5445c572e9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:50.942823 18491 raft_consensus.cc:2410] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:19:50.925542 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:50.930253 18488 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:50.931098 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:50.902910 24086 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:50.869472 24395 consensus_queue.cc:260] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.902834 24589 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.903820 24600 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:50.951370 24655 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:19:50.952941 24514 raft_consensus.cc:697] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:50.956949 24514 consensus_queue.cc:237] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.959822 24487 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:19:50.960263 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 83838.3us
I20260709 13:19:50.960376 24487 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.948412 18487 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:19:50.969049 24352 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
W20260709 13:19:50.978022 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 52905.5us
I20260709 13:19:50.946004 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:50.988925 18458 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:50.991863 24230 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:50.993412 24358 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:50.962555 24657 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:51.000072 18486 raft_consensus.cc:2393] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 16: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:50.937271 24611 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:50.904369 24590 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:51.009661 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 76521.1us
I20260709 13:19:51.010371 18412 raft_consensus.cc:2393] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 19: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:51.012981 24590 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:51.009166 19056 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 19.
I20260709 13:19:50.959873 24582 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:50.993824 24230 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:19:50.993862 24358 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.031183 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:50.999923 24625 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:50.962854 24614 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:50.979765 24600 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.043550 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:51.015129 24269 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:51.008596 24563 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:50.994213 24260 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:19:50.970161 24589 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.023658 24583 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:51.032442 24358 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:51.027822 24597 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:51.048538 24487 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:51.031855 24395 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:51.066787 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:51.067595 18336 raft_consensus.cc:2393] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 19: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:51.068190 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:51.068976 18418 raft_consensus.cc:2410] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:19:51.069674 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:51.073169 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:51.073874 18419 raft_consensus.cc:2368] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18.
I20260709 13:19:51.076612 18418 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:19:51.097031 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 105972us
I20260709 13:19:51.058132 24583 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:51.100425 19026 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:51.101799 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:51.105309 18416 raft_consensus.cc:2368] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15.
I20260709 13:19:51.106240 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:51.107440 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:51.109016 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:51.102350 24344 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.110478 18308 leader_election.cc:400] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15.
I20260709 13:19:51.110874 18308 leader_election.cc:403] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:19:51.090342 24653 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.111997 24653 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.112565 24573 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:51.070779 24597 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.103092 24583 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:51.119529 24597 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:51.119602 24600 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:51.091884 24565 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:19:51.121881 24653 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:51.123560 24589 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:51.125424 24260 consensus_queue.cc:1048] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:51.101560 24269 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:19:51.129565 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:51.132417 18414 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 19.
I20260709 13:19:51.139106 19026 leader_election.cc:400] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 17. Current term is 18.
I20260709 13:19:51.131125 24599 raft_consensus.cc:493] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:51.141448 24599 raft_consensus.cc:515] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.140866 24669 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:51.152858 24670 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:51.121760 24565 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 14. Current term is 15.
I20260709 13:19:51.154929 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:51.109877 24344 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.158581 24573 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:51.159456 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:51.160039 18488 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:51.161165 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:51.161764 18341 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:19:51.133019 24563 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:51.134424 24590 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:51.131353 24657 raft_consensus.cc:2749] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:51.165234 19027 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:51.171411 24581 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:51.171880 24581 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.172235 24581 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:51.172982 18384 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:51.178529 24584 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:51.149398 18419 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:19:51.179673 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:51.181699 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:51.175614 24269 consensus_queue.cc:1059] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:51.192123 24269 raft_consensus.cc:3055] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:51.192556 24269 raft_consensus.cc:740] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:51.193343 24269 consensus_queue.cc:260] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.194446 24269 raft_consensus.cc:3060] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:51.194907 24614 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:51.196599 24599 leader_election.cc:290] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:51.176637 24487 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:51.182433 24615 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:51.198658 24615 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:51.183847 24625 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:51.184993 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:51.201079 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:51.201375 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:51.182449 24584 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 19 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:51.202920 24584 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.201097 18307 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:51.188289 18411 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:19:51.190289 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:51.204978 18337 raft_consensus.cc:3060] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:51.190948 24468 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:51.187269 24663 log.cc:927] Time spent T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:19:51.203397 24599 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:51.176193 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:51.206128 18307 leader_election.cc:304] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:51.227584 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:51.174860 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:51.164369 24260 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.208540 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:51.207140 19054 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 15: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
W20260709 13:19:51.234203 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 226381us
I20260709 13:19:51.237591 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e75d2ac4114e428bf95ddfa6245037" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:51.233574 18337 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:51.242251 18458 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:51.243682 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:51.244457 18412 raft_consensus.cc:2368] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 16. Current term is 17.
I20260709 13:19:51.202252 24615 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.245507 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:51.246299 18487 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 19.
I20260709 13:19:51.222168 24614 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:51.247493 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:51.250917 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:51.254685 18309 leader_election.cc:304] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:51.256088 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:51.256623 19057 raft_consensus.cc:1240] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:19:51.267082 18308 leader_election.cc:400] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 16. Current term is 17.
I20260709 13:19:51.267590 18308 leader_election.cc:403] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:19:51.269366 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:51.269681 18457 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:51.270109 18419 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 19.
I20260709 13:19:51.271992 19057 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:51.242689 24669 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:51.244544 24550 raft_consensus.cc:2749] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:51.282856 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:51.248355 24487 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:51.225162 24468 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.250746 24614 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:51.270328 24565 raft_consensus.cc:2749] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:51.247354 24395 consensus_queue.cc:1059] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:19:51.292348 24423 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:51.280716 24599 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 16. Current term is 17.
I20260709 13:19:51.242516 24260 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.256325 24583 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:51.304984 18457 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:51.297874 24550 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:19:51.303611 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:51.306656 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 100284us
I20260709 13:19:51.295010 24614 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:51.308168 18488 raft_consensus.cc:2468] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:51.309154 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:51.310606 18337 raft_consensus.cc:2376] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14. Re-sending same reply.
I20260709 13:19:51.309433 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:51.312758 18336 raft_consensus.cc:1240] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:19:51.311553 18340 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:51.304358 24625 raft_consensus.cc:3055] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:51.335635 19061 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 19.
I20260709 13:19:51.302002 24344 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:51.336721 19025 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:51.295502 24669 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.354292 19025 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:51.351878 18384 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:51.323951 24423 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:51.358433 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:51.332959 24625 raft_consensus.cc:740] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:51.335115 24674 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:51.372321 18413 raft_consensus.cc:1275] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:51.369307 18307 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:51.357849 24564 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:51.360366 24594 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:51.380154 24563 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:51.368148 24681 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:19:51.443586 24668 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
W20260709 13:19:51.443930 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.445228 24675 log.cc:927] Time spent T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:19:51.445518 24669 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:51.449375 24223 raft_consensus.cc:2804] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:19:51.427313 24645 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:19:51.485833 24468 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:51.487118 24678 log.cc:927] Time spent T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:19:51.378007 24674 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:51.498525 24674 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:51.479272 18308 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:51.426498 24599 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:51.479132 19060 raft_consensus.cc:1240] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:51.446249 24677 log.cc:927] Time spent T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:19:51.493300 24260 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:51.496047 24583 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:51.501319 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:51.424329 24565 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:19:51.510958 18488 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
W20260709 13:19:51.512609 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 143385us
I20260709 13:19:51.518060 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:51.515861 18307 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:51.511744 24468 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.512732 24589 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:51.536434 18488 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
W20260709 13:19:51.564440 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 188851us
I20260709 13:19:51.569132 18337 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:51.546566 24589 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.576684 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:51.569823 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:51.550439 24599 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:51.580961 18339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37928 (request call id 2456) took 1018 ms. Trace:
I20260709 13:19:51.582294 18343 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:51.587852 24599 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.588400 24599 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:51.602237 18342 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 18: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:51.581388 18339 rpcz_store.cc:276] 0709 13:19:50.563189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.563306 (+   117us) service_pool.cc:224] Handling call
0709 13:19:51.580759 (+1017453us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b540003cad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:51.580904 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802445056}
I20260709 13:19:50.951052 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:51.615586 24686 log.cc:927] Time spent T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.003s
I20260709 13:19:51.618289 18238 catalog_manager.cc:5697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:51.620180 18238 catalog_manager.cc:5697] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 11 to 16, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 16 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.551584 24468 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:51.625448 24468 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:51.626446 24519 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:51.627007 24519 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.628927 24582 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:51.630441 18416 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:51.629504 24582 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.629621 24519 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:51.639837 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:51.643937 18384 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:51.639948 18491 raft_consensus.cc:1240] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:51.681118 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:51.553509 24223 raft_consensus.cc:697] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
W20260709 13:19:51.693807 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 56756.5us
I20260709 13:19:51.517491 24625 consensus_queue.cc:260] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.701602 18341 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:51.695741 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:51.707118 18338 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:51.722236 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:51.640532 24589 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:51.700412 24358 consensus_meta.cc:287] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Time spent flushing consensus metadata: real 0.611s	user 0.010s	sys 0.000s
I20260709 13:19:51.670644 24582 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:51.695149 24606 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:51.579326 24588 consensus_queue.cc:1048] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.150s
I20260709 13:19:51.770467 18484 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:51.728350 24653 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.756554 24625 raft_consensus.cc:3060] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:51.700994 24554 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:19:51.756539 24701 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.779102 24681 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:51.768023 24269 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:19:51.758541 24358 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:51.770901 24582 consensus_queue.cc:1059] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.024s
W20260709 13:19:51.869333 24694 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
W20260709 13:19:51.871443 24697 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:19:51.877691 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 116539us
I20260709 13:19:51.882375 18486 raft_consensus.cc:1240] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:19:51.788558 24653 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.894865 24566 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:51.849061 24681 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:51.897552 24086 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:51.913704 24614 consensus_meta.cc:287] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.581s	user 0.005s	sys 0.004s
W20260709 13:19:51.898106 24698 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:19:51.899807 24358 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:51.901638 18415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:51.921689 18415 raft_consensus.cc:606] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:51.901692 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:51.922138 18415 raft_consensus.cc:614] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:51.903016 24693 log.cc:927] Time spent T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:19:51.903862 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:51.907224 24653 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:51.788830 24223 consensus_queue.cc:237] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:51.907635 24581 consensus_meta.cc:287] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent flushing consensus metadata: real 0.735s	user 0.010s	sys 0.003s
I20260709 13:19:51.908377 24660 raft_consensus.cc:3055] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:51.929018 24660 raft_consensus.cc:740] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:51.928836 18238 catalog_manager.cc:5697] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:51.929809 24660 consensus_queue.cc:260] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.930827 24660 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:51.931464 18237 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42278 (request call id 372) took 19694 ms (client timeout 15000 ms). Trace:
I20260709 13:19:51.909377 24230 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.923249 24589 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.934207 24230 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.934736 24683 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.935253 24683 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:51.936422 24230 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:51.937410 24683 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:51.938366 18416 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 18: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:51.796231 24701 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:51.941867 24701 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:51.913415 24681 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:51.888695 24691 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:51.942742 19055 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:51.942932 24691 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:51.924516 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:51.921430 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 160621us
I20260709 13:19:51.909996 18487 raft_consensus.cc:1275] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:19:51.942664 18238 catalog_manager.cc:5697] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:51.945353 18487 pending_rounds.cc:85] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 13
I20260709 13:19:51.945595 18487 pending_rounds.cc:107] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:19:51.944905 18419 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:51.945824 18487 raft_consensus.cc:2889] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:51.926987 24695 log.cc:927] Time spent T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.202s	user 0.000s	sys 0.002s
I20260709 13:19:51.947499 19025 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:51.961671 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:51.962687 18338 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:51.963941 18238 catalog_manager.cc:5697] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 9 to 16, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 16 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:51.977383 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:51.978588 19056 raft_consensus.cc:2410] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:19:51.979370 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:51.979943 19058 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
I20260709 13:19:51.917798 24614 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:51.986236 18238 catalog_manager.cc:5697] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 6 to 11, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 11 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:51.936453 24589 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:51.990814 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:51.992340 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:51.991595 18344 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 15.
I20260709 13:19:51.993291 19055 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 14: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:51.993870 18238 catalog_manager.cc:5697] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 7 to 14, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 14 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.974021 24358 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.980965 24086 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:52.018785 18238 catalog_manager.cc:5697] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 9 to 10, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 10 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:52.020475 18238 catalog_manager.cc:5697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 10 to 11, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 11 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:51.928864 24581 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.037284 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:52.039599 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 46581.1us
I20260709 13:19:52.039748 18335 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:19:52.041776 18238 catalog_manager.cc:5697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 15 to 18, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 18 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:19:52.051331 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.054410 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.057404 18238 catalog_manager.cc:5697] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 9 to 15, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 15 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:52.067592 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:52.095323 19053 raft_consensus.cc:1240] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:52.097342 19027 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:52.041091 24691 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:52.052232 24686 log.cc:927] Time spent T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:52.117592 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:52.122632 18415 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:52.117727 18238 catalog_manager.cc:5697] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:52.119812 18384 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:52.125018 19028 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.128024 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:52.097282 24668 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:52.018808 24358 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.114419 24688 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:52.133759 18238 catalog_manager.cc:5697] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 14 to 15, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 15 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:52.131037 18308 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:52.096383 24681 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.179461 18238 catalog_manager.cc:5697] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 13 to 14, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 14 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:52.113030 24709 raft_consensus.cc:493] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:52.147305 18335 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:52.121286 24086 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:52.122196 24699 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.186412 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 55465.6us
I20260709 13:19:52.095449 24230 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:19:52.146960 24688 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:52.186383 24599 consensus_meta.cc:287] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.597s	user 0.006s	sys 0.006s
I20260709 13:19:52.181898 24712 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.182271 24687 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:52.198788 24691 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:52.186087 24681 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.238718 24599 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.203883 24699 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.213614 24688 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:52.236057 18415 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 20.
I20260709 13:19:52.198922 24709 raft_consensus.cc:515] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.260214 24614 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:52.303032 19060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1395) took 1409 ms. Trace:
I20260709 13:19:52.307240 18486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55650 (request call id 3198) took 1277 ms. Trace:
I20260709 13:19:52.383249 19062 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:19:52.319175 19061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38686 (request call id 1685) took 1187 ms (client timeout 1532 ms). Trace:
I20260709 13:19:52.204646 24701 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:19:51.931874 18237 rpcz_store.cc:269] 0709 13:19:32.241625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.262033 (+ 20408us) service_pool.cc:224] Handling call
0709 13:19:51.931258 (+19669225us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:44.043645 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:44.080527 (+ 36882us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:44.080563 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:19:44.080580 (+    17us) tablet.cc:662] Decoding operations
0709 13:19:44.084230 (+  3650us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:44.084304 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:44.084337 (+    33us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:19:44.197291 (+112954us) tablet.cc:701] Row locks acquired
0709 13:19:44.197321 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:19:44.197515 (+   194us) write_op.cc:270] Start()
0709 13:19:44.197654 (+   139us) write_op.cc:276] Timestamp: P: 1783603184197455 usec, L: 0
0709 13:19:44.197684 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:19:44.209970 (+ 12286us) log.cc:844] Serialized 9376 byte log entry
0709 13:19:44.900037 (+690067us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b54000497d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eed7e28 00007f40a2912581 00007f40a2911d58 00007f40a29169f1 00007f40a29169a9 00007f40a2916939 00007f40a2916901 00007f40a2915b2d 000000000038f354 000000000038f199
0709 13:19:45.839662 (+939625us) op_driver.cc:464] REPLICATION: finished
0709 13:19:46.576129 (+736467us) write_op.cc:301] APPLY: starting
0709 13:19:46.587975 (+ 11846us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:47.193665 (+605690us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:47.193725 (+    60us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:47.592398 (+398673us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:47.592832 (+   434us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 13:19:47.592902 (+    70us) write_op.cc:312] APPLY: finished
0709 13:19:47.593591 (+   689us) log.cc:844] Serialized 212 byte log entry
0709 13:19:47.843650 (+250059us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:47.844294 (+   644us) write_op.cc:454] Released schema lock
0709 13:19:47.844396 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:47.974453 (+130057us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:47.999857 (+ 25404us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":176357,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":698923,"apply.run_cpu_time_us":80824,"apply.run_wall_time_us":1397937,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104111,"num_ops":24,"prepare.queue_time_us":178210,"prepare.run_cpu_time_us":27795,"prepare.run_wall_time_us":893883,"raft.queue_time_us":846320,"raft.run_cpu_time_us":40392,"raft.run_wall_time_us":538285,"replication_time_us":1628149,"spinlock_wait_cycles":26346368,"thread_start_us":1541337,"threads_started":5,"wal-append.queue_time_us":622220,"wal-append.run_cpu_time_us":38197,"wal-append.run_wall_time_us":3147618}]]}
I20260709 13:19:52.383498 18486 rpcz_store.cc:276] 0709 13:19:51.029874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.030015 (+   141us) service_pool.cc:224] Handling call
0709 13:19:51.032048 (+  2033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.882980 (+850932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.306893 (+423913us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54002927d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:52.307128 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1954828672}
I20260709 13:19:52.249965 24700 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:52.383968 19061 rpcz_store.cc:269] 0709 13:19:51.131884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.174644 (+ 42760us) service_pool.cc:224] Handling call
0709 13:19:52.318910 (+1144266us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54004ed254. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:52.319050 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246081792}
I20260709 13:19:52.339294 18343 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:52.385625 18339 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 20: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:52.343207 24581 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:52.270871 24358 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:52.209815 18238 catalog_manager.cc:5697] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 4 to 16, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 16 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:52.348084 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36dd573a999e4211a80fa3aeb1b2dbd2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:52.350108 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:52.350939 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:52.272990 18382 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:52.238510 24653 consensus_queue.cc:1059] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:19:52.184696 24086 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.250488 19055 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:52.365236 19054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38700 (request call id 1397) took 1221 ms. Trace:
I20260709 13:19:52.374838 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:52.375541 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.395025 18415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:52.395618 18415 raft_consensus.cc:606] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:52.375514 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:52.376775 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:52.261734 24713 log.cc:927] Time spent T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:19:52.382601 19060 rpcz_store.cc:276] 0709 13:19:50.893292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.893710 (+   418us) service_pool.cc:224] Handling call
0709 13:19:50.917558 (+ 23848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.501648 (+584090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.302720 (+801072us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b540026e8d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eedce01 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2 00007f409d21748c 00007f409d2168c6
0709 13:19:52.302931 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290856320}
I20260709 13:19:52.373153 24582 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.373162 24691 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.401535 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:52.392648 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 119768us
I20260709 13:19:52.389972 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:52.376427 24352 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:52.405261 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:52.395990 18415 raft_consensus.cc:614] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:52.397269 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:52.397691 18308 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:52.406486 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:52.405973 18486 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:19:52.394716 19054 rpcz_store.cc:276] 0709 13:19:51.143750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.264150 (+120400us) service_pool.cc:224] Handling call
0709 13:19:51.264584 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.265075 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:19:51.339685 (+ 74610us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.503460 (+163775us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.335013 (+831553us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b2c0004d028. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:19:52.335494 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.335687 (+   193us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:52.335942 (+   255us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.336130 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.336219 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.365005 (+ 28786us) raft_consensus.cc:1685] finished
0709 13:19:52.365030 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.365175 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12042,"prepare.queue_time_us":40317,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":13921,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":21373,"spinlock_wait_cycles":3262848,"thread_start_us":161912,"threads_started":2,"wal-append.queue_time_us":192675}
I20260709 13:19:52.373579 24615 consensus_queue.cc:1048] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:19:52.410097 18238 catalog_manager.cc:5697] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 9 to 12, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 12 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.407155 24691 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:52.425640 24468 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:52.392304 24588 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:52.398870 24086 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:52.415421 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:52.415966 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:52.417816 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:52.433561 18238 catalog_manager.cc:5697] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 15 to 16, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 16 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:52.400490 24711 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:52.408224 24423 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.388510 24554 consensus_queue.cc:1059] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:19:52.443369 24395 consensus_queue.cc:1059] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:52.445236 24684 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:52.440634 18238 catalog_manager.cc:5697] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 9 to 13, leader changed from <none> to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 13 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:52.411931 24352 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.449258 24699 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:52.450523 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:52.481029 19054 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
I20260709 13:19:52.482698 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:52.451395 24709 leader_election.cc:290] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:52.485538 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:52.452337 24653 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.408705 24625 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.412266 24614 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:52.376086 24712 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.408461 24648 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:52.389211 24701 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.502877 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9986bcf770bb42549bfb7d77ec66768b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.502591 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.500779 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.471760 24711 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:52.472790 24579 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:52.515030 18417 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:52.476082 24707 consensus_queue.cc:1059] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:52.483497 18492 raft_consensus.cc:2410] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:19:52.481134 24435 raft_consensus.cc:3055] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:52.534271 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.412848 24582 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.467602 24423 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.466892 24588 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:52.492609 18238 catalog_manager.cc:5697] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 11 to 12, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 12 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:52.497975 18384 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:52.474254 24554 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:52.512789 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.533557 24435 raft_consensus.cc:740] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:52.544313 24435 consensus_queue.cc:260] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.499806 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:52.504576 24700 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:52.507225 18416 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:19:52.489744 24352 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:52.537000 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:52.564749 18412 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:52.538250 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:52.498929 24653 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.547331 24435 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:52.515403 24648 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:52.548605 24711 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:52.575609 24648 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:52.503970 24625 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.550061 24423 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:52.551179 24701 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:52.551633 24588 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:52.513381 24660 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:52.587002 24344 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:52.587563 24344 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.546026 24554 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:52.555284 24581 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:52.590490 24554 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:52.590965 24581 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:52.591699 24554 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:52.591820 24581 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.592885 24581 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:52.555655 18238 catalog_manager.cc:5697] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 9 to 10, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 10 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:19:52.556499 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.556758 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 58893.5us
I20260709 13:19:52.557682 18490 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
W20260709 13:19:52.560273 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 120358us
I20260709 13:19:52.596050 18238 catalog_manager.cc:5697] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 10 to 15, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 15 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:52.596662 24344 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:52.600255 24625 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:52.577049 24332 raft_consensus.cc:3055] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:52.503948 24656 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.561024 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:52.566005 18491 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:52.586501 24660 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.513804 24614 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:52.602065 24653 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:52.618642 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.619362 24699 raft_consensus.cc:493] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:52.619886 24699 raft_consensus.cc:515] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:52.568717 24700 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.635610 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:52.637154 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:52.641672 18339 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 20.
W20260709 13:19:52.475131 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 65743.5us
I20260709 13:19:52.597438 18238 catalog_manager.cc:5697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 9 to 14, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 14 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:52.602569 24332 raft_consensus.cc:740] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:52.562588 24584 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:52.610184 18382 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:52.612959 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:52.613530 24358 consensus_queue.cc:1059] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:52.607909 24656 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.614619 24614 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:52.646795 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 85839.4us
I20260709 13:19:52.656538 18412 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 20.
I20260709 13:19:52.657968 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:52.666679 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:52.659943 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 47074.3us
I20260709 13:19:52.667579 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:52.655671 19027 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:52.668596 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:52.671275 18492 raft_consensus.cc:1275] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:19:52.671686 18492 pending_rounds.cc:85] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 9
I20260709 13:19:52.671942 18492 pending_rounds.cc:107] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:19:52.672170 18492 raft_consensus.cc:2889] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.621868 24699 leader_election.cc:290] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:52.676748 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 66644.6us
I20260709 13:19:52.678603 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:52.680950 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:52.651603 24519 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:52.684455 18415 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 19.
I20260709 13:19:52.651296 24584 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.686647 18309 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:52.693706 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04eef32e6eb14221811a03f4940ae121" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:52.697340 19026 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:52.701124 24564 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:52.701558 24564 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.701931 24564 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:52.675518 24625 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:52.711510 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:52.676586 24566 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:52.681321 24701 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:52.714676 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.713053 18493 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:52.660229 24688 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.713042 24648 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:52.696229 24584 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:52.687840 24724 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:52.735581 18336 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:52.711329 24699 raft_consensus.cc:493] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:52.737542 19025 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:52.738667 18419 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:19:52.736090 24648 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:52.706198 24588 raft_consensus.cc:3055] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:52.717463 24566 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.753472 18418 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 19: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:52.723181 24565 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:52.713460 24332 consensus_queue.cc:260] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:52.711072 24468 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:52.717274 24655 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:52.731546 24625 raft_consensus.cc:697] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:52.762828 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.756443 24566 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:52.753811 24648 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.770105 18490 raft_consensus.cc:1275] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:19:52.771070 18490 pending_rounds.cc:85] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 14
I20260709 13:19:52.771299 18490 pending_rounds.cc:107] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:19:52.757198 24519 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:52.771513 18490 raft_consensus.cc:2889] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.772686 24332 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:52.753523 24588 raft_consensus.cc:740] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:52.762977 24468 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:52.749286 24595 consensus_queue.cc:1048] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:19:52.783056 24660 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:52.765669 24655 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.750682 24724 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:52.790480 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.778429 24625 consensus_queue.cc:237] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:52.802706 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.808616 18487 raft_consensus.cc:1275] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:52.755837 24699 raft_consensus.cc:515] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.818171 24588 consensus_queue.cc:260] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.819536 24588 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:52.823243 24344 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:52.823899 24468 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:52.823835 24344 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:52.796303 24554 consensus_queue.cc:1048] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:19:52.827333 24582 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:52.830132 24712 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:52.837069 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:52.829428 24086 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.838797 24565 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:52.839198 24565 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.839790 19056 raft_consensus.cc:2368] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19.
I20260709 13:19:52.840054 24565 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:52.842171 18309 leader_election.cc:400] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19.
I20260709 13:19:52.842489 18309 leader_election.cc:403] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:52.843284 24709 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:52.843734 24709 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.825228 24688 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:52.854687 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:52.857589 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.858798 19056 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 20: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:52.859947 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.864409 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:52.866441 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 114620us
I20260709 13:19:52.873518 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:52.888805 24599 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:52.845870 24709 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:52.897723 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:52.859458 24468 raft_consensus.cc:3060] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:19:52.919685 18486 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:19:52.837666 24648 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:52.923259 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 254716us
I20260709 13:19:52.929425 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.875353 24712 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:52.928380 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:52.896294 24564 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.953898 24730 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:52.955832 24564 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:52.892722 24582 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:52.961163 19060 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 20: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:52.961069 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:52.957188 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:19:52.957679 18383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.848181 24566 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.968420 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:52.969238 18490 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:52.970500 18416 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 20: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:52.973573 18458 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:52.977074 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:52.935499 24656 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:52.957077 24281 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.965795 24582 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.981268 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:52.983002 18458 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:52.957633 24597 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:52.979174 18344 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 LEADER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:19:52.989295 18307 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:52.929713 23986 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:19:52.994129 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:52.923197 24565 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:52.999107 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6419a332888d490f92e43b717ff1edd4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:52.994660 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:52.995977 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:52.998108 18336 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 20.
I20260709 13:19:52.994405 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:52.978669 24352 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:52.982252 24730 raft_consensus.cc:2749] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:53.001392 19056 raft_consensus.cc:2393] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 21: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:52.986303 24739 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:53.006832 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:53.009013 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:53.007822 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:53.008076 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:52.995441 18307 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:52.996460 24728 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:53.014315 24699 leader_election.cc:290] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:53.006726 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:52.986569 24344 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:52.993754 24582 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:53.017943 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:53.030205 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:53.031139 24086 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:53.033675 24691 consensus_meta.cc:287] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.002s
I20260709 13:19:53.001345 24597 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.034507 24724 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:53.039178 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:53.050957 18416 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 19: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:53.042933 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:53.019044 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:53.045935 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:53.046747 18490 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 20.
I20260709 13:19:52.990084 24281 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:53.062057 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 210457us
I20260709 13:19:53.063206 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:53.063910 18339 raft_consensus.cc:2368] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 19. Current term is 20.
I20260709 13:19:53.070153 18384 leader_election.cc:304] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:53.066164 24332 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:53.050925 24344 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:53.077973 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:53.027058 24655 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:53.051682 24691 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:53.101270 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:53.102380 19053 raft_consensus.cc:2393] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 19: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:53.108726 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:53.117259 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:53.118072 18338 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:19:53.109804 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:53.116518 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:53.119216 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:53.120019 19062 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
I20260709 13:19:53.080854 24504 raft_consensus.cc:2749] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:53.122535 18336 raft_consensus.cc:2393] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 20: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:53.119582 18342 raft_consensus.cc:2393] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 20: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:53.112227 24352 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.136380 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4511f72b2b34e4d82124396a41054ca" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:53.138265 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:53.139446 18418 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:53.137176 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:53.140022 19025 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.111796 24681 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:53.101024 24688 consensus_queue.cc:1048] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:19:53.141935 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c3d9691e854ee98b2b7d81f868c727" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:53.143607 24753 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:53.141745 24757 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:19:53.144726 24747 log.cc:927] Time spent T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:19:53.149700 24648 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:53.150087 18484 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 20.
I20260709 13:19:53.150684 18418 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 20.
I20260709 13:19:53.155792 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:53.152726 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 157361us
I20260709 13:19:53.157235 19027 leader_election.cc:400] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 19. Current term is 20.
I20260709 13:19:53.157176 19056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:53.161423 19027 leader_election.cc:403] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:53.161952 19056 raft_consensus.cc:2393] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 14: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:53.162434 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:53.159838 18308 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:53.163563 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:53.163757 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:53.164369 18486 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:53.154093 24753 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.166118 24588 raft_consensus.cc:2749] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:53.167302 24086 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:19:53.171589 24700 consensus_meta.cc:287] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.001s
I20260709 13:19:53.172072 24700 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:53.172986 24756 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:53.173573 24756 raft_consensus.cc:697] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:53.174420 24756 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.176450 18417 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:53.151768 24565 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:53.179757 24281 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:53.180655 24597 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:53.183776 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:53.184489 18418 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.185436 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:53.185524 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:53.186347 18491 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:19:53.188458 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:53.191362 18458 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:53.192653 24588 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:53.199146 18486 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:19:53.200695 24757 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.151950 24352 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:53.201195 24757 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:53.205312 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:53.206602 18418 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:19:53.211057 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:53.208627 18308 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:53.216158 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:53.213310 24757 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:53.219791 24281 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:53.220206 24281 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.220561 24281 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.224828 19027 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:53.189684 24584 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.182828 24566 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:53.231012 19027 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:53.213773 24741 raft_consensus.cc:2764] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:19:53.233886 24584 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:53.234786 24352 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:53.224884 24691 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:53.236196 24281 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.243357 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:53.243990 18487 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:19:53.248260 24744 log.cc:927] Time spent T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.267s	user 0.002s	sys 0.000s
I20260709 13:19:53.248417 24086 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 19. Current term is 20.
I20260709 13:19:53.251245 24700 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:53.254594 24759 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:53.255205 24759 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:53.255457 24395 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.255690 24759 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.256054 24395 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.238252 24754 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:53.258266 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 130389us
I20260709 13:19:53.259608 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:53.260177 18343 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:53.259644 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:53.262898 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:53.263687 18487 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 19.
I20260709 13:19:53.265162 18382 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:53.254377 24582 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.270195 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:53.274545 19053 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:53.272706 18458 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:53.268280 18335 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:19:53.289394 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:53.237890 24751 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:53.257999 24260 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:53.295579 18458 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:53.275559 24352 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.292618 24584 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:53.307394 18384 leader_election.cc:304] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:53.298125 24588 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:53.315902 24352 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:53.316694 18343 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 21.
I20260709 13:19:53.318194 24352 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:53.319988 19027 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:53.320511 18384 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:53.320984 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 90497.7us
I20260709 13:19:53.321745 18307 leader_election.cc:304] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:53.323271 19053 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 19.
I20260709 13:19:53.325145 18307 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:53.391165 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 59437.9us
W20260709 13:19:53.391299 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 59765.8us
W20260709 13:19:53.391717 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 59869.8us
I20260709 13:19:53.304082 24656 raft_consensus.cc:2764] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:19:53.393635 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:53.393831 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 56434.9us
I20260709 13:19:53.392678 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:53.398047 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:53.398564 19053 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 19.
I20260709 13:19:53.332067 24332 raft_consensus.cc:2749] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:53.323380 24395 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:53.323582 24584 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 19 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:53.449458 24584 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.332708 24707 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:53.405685 24582 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:53.410163 24753 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:53.410640 24550 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.454748 24550 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:53.455312 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:53.458334 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:53.459209 18417 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 19.
I20260709 13:19:53.411221 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:53.417855 24281 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:53.421257 24614 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:53.332763 24709 raft_consensus.cc:2749] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:53.461506 24550 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:53.429347 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:53.462653 18335 raft_consensus.cc:2410] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:19:53.430362 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:53.426764 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
W20260709 13:19:53.463734 24468 consensus_meta.cc:287] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 13:19:53.464172 24468 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19.
I20260709 13:19:53.463773 18343 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.463593 18341 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
I20260709 13:19:53.390758 24648 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:53.491523 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:53.492058 18487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:53.503626 18487 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.500093 18343 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:53.500643 18414 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:19:53.507653 18490 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:53.512370 18384 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:53.518407 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:53.523656 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:53.524875 18485 raft_consensus.cc:2410] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:19:53.524793 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:53.396754 24594 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:53.526856 18337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:43634
I20260709 13:19:53.535423 18337 raft_consensus.cc:606] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:53.535847 18337 raft_consensus.cc:614] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:53.527697 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:53.537156 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ec555240a9486fad41ffb02e94fd9c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:53.528112 18487 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:53.529985 18339 raft_consensus.cc:2468] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 19.
I20260709 13:19:53.532917 18484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:53.547108 18417 raft_consensus.cc:1240] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:53.547623 18484 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:53.391898 24691 raft_consensus.cc:2749] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:53.533211 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:53.522778 19027 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:53.504801 24754 raft_consensus.cc:697] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:53.550122 18344 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:53.529515 18457 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:53.576334 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:53.531278 24550 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:19:53.594321 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 82082.4us
I20260709 13:19:53.596139 24324 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.598131 24324 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:19:53.565047 24086 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:53.529246 24599 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:19:53.563170 24594 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:53.592042 24352 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:53.604918 18484 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:53.589237 24550 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:53.622002 24550 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:53.622561 24745 consensus_queue.cc:1059] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:19:53.623587 24625 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:53.600183 24395 raft_consensus.cc:2764] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:19:53.647550 18342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b972754511104f898e9cbc171aa6c170"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:43634
I20260709 13:19:53.648411 18342 raft_consensus.cc:606] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 LEADER]: Received request to transfer leadership to TS 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:53.657791 24754 consensus_queue.cc:237] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:53.615634 24352 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.662237 24352 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:53.623975 24625 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:53.687480 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 43877.8us
I20260709 13:19:53.627709 24086 raft_consensus.cc:697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:53.683529 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 154113us
I20260709 13:19:53.665630 24223 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:19:53.703115 18417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:19:53.709662 18417 raft_consensus.cc:606] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:53.710147 18417 raft_consensus.cc:614] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:53.716361 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 140096us
I20260709 13:19:53.717244 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:53.722265 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:53.724494 24745 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:53.724417 18458 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:53.727365 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:53.725097 24395 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:53.759763 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:53.701946 24759 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:53.762521 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:53.736088 24745 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:53.719553 24728 consensus_queue.cc:1059] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:19:53.814282 18335 raft_consensus.cc:1240] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:53.763724 24581 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:53.811254 24745 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.763172 24395 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:53.730851 24594 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.840112 24759 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:53.825945 24581 raft_consensus.cc:697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:53.840422 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 131087us
I20260709 13:19:53.841097 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:53.840962 18309 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:53.772837 24625 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:53.829396 24745 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:53.874329 18384 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:53.877283 24223 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:53.806401 24086 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.845777 24776 raft_consensus.cc:3055] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:53.882372 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:53.883270 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:53.884769 19055 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 20.
W20260709 13:19:53.886795 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 176068us
I20260709 13:19:53.846668 24785 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:53.877460 18384 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:53.881013 24756 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:53.885892 24615 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.884295 24776 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:53.908135 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:53.907629 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:53.913206 18418 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:53.914228 24777 log.cc:927] Time spent T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:19:53.905757 24770 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:19:53.916266 24615 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.919224 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:53.919806 24395 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:53.919840 19062 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:19:53.920624 19062 pending_rounds.cc:85] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting all ops after (but not including) 15
I20260709 13:19:53.920846 19062 pending_rounds.cc:107] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:19:53.921085 19062 raft_consensus.cc:2889] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:53.899295 24625 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:53.922358 24771 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:19:53.923372 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:53.924180 24774 log.cc:927] Time spent T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:19:53.920240 24615 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:53.926465 24776 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:53.927825 24776 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.896413 24582 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:53.932876 24582 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.933705 24755 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:53.934942 24582 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:53.925722 24550 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.937408 24550 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:53.924223 18493 raft_consensus.cc:2410] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:19:53.941332 19062 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:53.927480 24581 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.904532 24230 raft_consensus.cc:2804] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:53.958159 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:53.960855 19054 raft_consensus.cc:2393] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 20: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
W20260709 13:19:53.905544 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 170536us
I20260709 13:19:53.911731 24260 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:53.962792 18307 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:53.952912 24773 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
W20260709 13:19:53.966966 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 58266.8us
I20260709 13:19:53.967396 18418 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:19:53.967939 18307 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:53.965397 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 61329.5us
I20260709 13:19:53.917668 24352 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.972348 18307 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:53.900735 24785 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.977456 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:53.981609 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:53.992115 24755 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:53.992792 24755 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.961472 24756 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:19:53.966078 24230 raft_consensus.cc:697] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 19 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:53.976245 24599 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:53.995155 24230 consensus_queue.cc:237] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:53.995647 24755 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:53.996876 24785 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:53.997406 18341 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 19: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:53.998268 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:53.970880 24260 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.001999 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:54.001574 18416 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:19:54.005664 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:53.970323 24550 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:54.007977 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:54.010321 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:54.010464 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:54.010978 18419 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 19.
I20260709 13:19:53.973757 24757 raft_consensus.cc:2749] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:54.016014 24352 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:54.018988 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:54.019081 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:54.020166 19054 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:54.020855 24708 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:54.022223 24260 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:54.022909 19053 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
W20260709 13:19:54.027369 24779 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.094s	user 0.000s	sys 0.003s
I20260709 13:19:54.027957 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:54.029628 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:54.031152 24778 log.cc:927] Time spent T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.116s	user 0.001s	sys 0.004s
I20260709 13:19:54.035014 19053 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:19:54.035175 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:54.040634 18457 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:54.042089 24588 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:54.042503 24588 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:54.042847 24588 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:54.045645 24745 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:54.053722 18490 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 20.
I20260709 13:19:54.063987 19054 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 20.
I20260709 13:19:54.074654 18492 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:19:54.076108 18307 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:54.153569 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 64064.9us
W20260709 13:19:54.088058 24783 log.cc:927] Time spent T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.174s	user 0.002s	sys 0.000s
I20260709 13:19:54.081326 24550 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:54.171259 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d50aacd9894a6ca1895dbf30df38dc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:54.176178 18417 raft_consensus.cc:3060] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:54.153292 24776 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.158509 24708 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:54.180019 24550 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:54.173187 24784 consensus_queue.cc:1059] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:19:54.185808 24757 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:54.203608 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:54.212531 24550 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.217847 24745 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:54.191087 24708 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.187038 24776 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.224434 24776 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:54.226361 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:54.230193 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:54.249222 19062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:54.250065 19062 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 19.
I20260709 13:19:54.253528 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:54.248159 18458 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:54.221794 24708 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:54.261611 24625 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:54.262982 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:54.228649 24588 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:54.264151 24741 raft_consensus.cc:2804] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:54.264724 24741 raft_consensus.cc:697] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:54.265889 24588 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:54.259262 24724 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:54.265821 24741 consensus_queue.cc:237] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.266858 24724 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.271474 18410 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:54.207034 24757 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:54.274329 24757 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:54.276611 18340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:54.277406 18340 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 19: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:54.277472 24724 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:54.280777 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:54.281236 18484 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:19:54.281471 18491 raft_consensus.cc:2393] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:54.281599 18484 pending_rounds.cc:85] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 10
I20260709 13:19:54.281841 18484 pending_rounds.cc:107] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:19:54.282080 18484 raft_consensus.cc:2889] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:54.262763 24625 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.285436 24625 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:54.288311 18309 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:54.290952 24599 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:54.293416 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:54.294064 18493 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 19.
I20260709 13:19:54.295863 19027 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:54.301931 24743 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:54.304617 24780 log.cc:927] Time spent T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.383s	user 0.007s	sys 0.002s
I20260709 13:19:54.310374 24755 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:54.312419 18417 raft_consensus.cc:2468] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 20.
W20260709 13:19:54.313145 24793 log.cc:927] Time spent T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:19:54.331928 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:54.333233 24332 raft_consensus.cc:3055] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:54.333642 24332 raft_consensus.cc:740] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:54.334393 24332 consensus_queue.cc:260] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:54.335538 24332 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.342273 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:54.349015 24795 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.086s	user 0.000s	sys 0.002s
I20260709 13:19:54.350914 18491 raft_consensus.cc:1275] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:19:54.352792 18308 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:54.353600 24755 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:54.353889 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:54.354548 18418 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:54.355953 18415 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:54.358541 19026 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:54.359964 24755 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:54.364858 18308 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:54.365278 24708 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:54.365710 24765 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:54.366271 24765 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:54.366704 24765 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.365731 24708 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:54.367969 24708 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:54.377707 18493 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:54.385952 24660 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:54.398484 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 90364.7us
W20260709 13:19:54.400441 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 61855.2us
I20260709 13:19:54.402395 24755 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:54.405076 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:54.405777 18414 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
I20260709 13:19:54.405766 19027 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:54.401192 18382 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:54.415345 18458 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:54.426692 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:54.436498 18384 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:54.449476 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:54.417649 24409 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:54.417896 24655 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:54.421319 24787 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:54.457818 24655 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:54.457942 24787 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.462059 24655 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:54.462172 24787 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:54.458703 24582 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:54.440446 24707 consensus_queue.cc:1059] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:19:54.465049 24708 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.478060 19055 raft_consensus.cc:1240] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:54.456835 24701 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:19:54.489153 24332 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:54.515621 18457 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:54.517621 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:54.518551 19058 raft_consensus.cc:2393] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 19: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:54.523082 18335 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:54.532038 24594 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:54.541694 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:54.527426 24648 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:54.546615 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:54.516182 24657 consensus_queue.cc:1048] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:19:54.570061 18418 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 19.
W20260709 13:19:54.587044 24799 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:19:54.599889 24708 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:54.607204 18457 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:54.604812 24792 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:19:54.617800 18419 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:54.622159 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:54.614478 18457 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:54.631750 24787 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.603749 24655 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.635761 24765 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:54.639359 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:54.639565 24787 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:54.688210 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 73796.1us
I20260709 13:19:54.694387 24741 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:54.613405 24625 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:54.725518 18416 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:54.733103 24563 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.735419 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:54.736172 18491 raft_consensus.cc:2393] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 13: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:19:54.737572 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 96063.8us
I20260709 13:19:54.741758 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:54.742522 19055 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:54.745291 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:54.746306 18416 raft_consensus.cc:3060] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:54.735406 24765 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:54.745978 24352 consensus_queue.cc:1059] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:19:54.753756 24776 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:54.754187 24776 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:54.754953 24776 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.733718 24563 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.759968 24563 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:54.761720 24805 log.cc:927] Time spent T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:54.736917 24741 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:54.766844 24741 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:54.767845 18416 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 20.
I20260709 13:19:54.775593 24688 raft_consensus.cc:3055] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:54.776064 24688 raft_consensus.cc:740] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:54.753120 19055 raft_consensus.cc:2468] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 20.
I20260709 13:19:54.777328 24688 consensus_queue.cc:260] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:54.792065 24688 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:54.791013 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 46302.3us
I20260709 13:19:54.799924 18484 raft_consensus.cc:1240] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:19:54.801175 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:54.802085 18490 raft_consensus.cc:2368] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 19. Current term is 20.
I20260709 13:19:54.808318 24594 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:54.810042 18308 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:54.810912 24599 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:54.811455 24599 raft_consensus.cc:697] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:54.812367 24599 consensus_queue.cc:237] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:54.801265 19055 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:54.823256 19058 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:19:54.823732 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:54.824733 18493 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:19:54.825001 18486 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:54.825691 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:54.825117 18493 pending_rounds.cc:85] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting all ops after (but not including) 15
I20260709 13:19:54.825896 18457 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:54.827596 18489 raft_consensus.cc:2410] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:19:54.829535 18493 pending_rounds.cc:107] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:19:54.838478 18493 raft_consensus.cc:2889] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:54.839164 18419 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:19:54.841225 18340 raft_consensus.cc:1275] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:19:54.858145 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 123105us
I20260709 13:19:54.865861 18382 leader_election.cc:400] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 19. Current term is 20.
I20260709 13:19:54.866317 18382 leader_election.cc:403] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:19:54.833132 24769 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:54.874298 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:54.880159 18341 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:54.835352 24655 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:54.885718 19056 raft_consensus.cc:1275] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:19:54.858711 24787 raft_consensus.cc:2804] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:54.892657 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59be45893c741da9dfbf367c31f3851" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:54.894426 19060 raft_consensus.cc:2368] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 19. Current term is 20.
I20260709 13:19:54.832945 24757 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:19:54.899317 18493 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:54.864430 24751 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:19:54.879753 24745 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 13:19:54.895128 24588 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.894779 24658 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) with higher term. Message: Invalid argument: T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 19. Current term is 20.
I20260709 13:19:54.886699 24581 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 13:19:54.881364 24769 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:54.905179 24324 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.915207 24755 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:19:54.923759 24588 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.937397 24588 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:54.938308 24769 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:54.912453 24758 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
W20260709 13:19:54.961460 19026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 59792us
W20260709 13:19:54.972731 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 77333.5us
I20260709 13:19:54.974222 19027 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:54.941282 24759 raft_consensus.cc:993] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
W20260709 13:19:54.975361 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 61529.2us
I20260709 13:19:54.977376 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:54.978143 18417 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 16: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:54.979635 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:54.980436 18493 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:54.982275 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:54.983075 18338 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 21.
I20260709 13:19:54.952250 24659 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.984987 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:54.986141 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:54.976970 24751 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:55.001228 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 96503.8us
I20260709 13:19:54.985158 24769 raft_consensus.cc:1081] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:19:54.951149 24324 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:54.995664 24599 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:54.994176 24787 raft_consensus.cc:697] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:55.114010 24776 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:55.120132 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 116522us
I20260709 13:19:55.023697 24809 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:54.994946 24659 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:55.086683 24599 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:55.023355 24758 consensus_queue.cc:1048] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.101s
W20260709 13:19:55.231565 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 113676us
W20260709 13:19:55.234439 24812 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.243s	user 0.000s	sys 0.000s
W20260709 13:19:55.236892 24813 log.cc:927] Time spent T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:19:55.236994 24818 consensus_queue.cc:1048] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:55.242558 18384 leader_election.cc:400] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Vote denied by peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) with higher term. Message: Invalid argument: T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for earlier term 19. Current term is 20.
I20260709 13:19:55.125465 24809 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.263077 19057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:55.224987 19056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b972754511104f898e9cbc171aa6c170"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38686
I20260709 13:19:55.276602 19056 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:55.277535 19056 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:55.261650 24324 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:55.222347 24599 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:55.290515 24811 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:19:54.848287 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:55.222483 24581 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 13:19:55.310699 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:55.271991 24809 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:55.313771 18485 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 20.
I20260709 13:19:55.281518 24588 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.317704 24588 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:55.274617 24769 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.322636 24769 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:55.324798 24769 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:55.319885 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:55.331017 19055 raft_consensus.cc:2410] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 21 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:19:55.322060 24588 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:55.336484 19056 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:55.348901 19054 raft_consensus.cc:1240] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:55.387005 19056 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:55.389979 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:55.396773 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 85345.8us
W20260709 13:19:55.398137 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 86377.2us
I20260709 13:19:55.298100 24787 consensus_queue.cc:237] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:55.402987 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:55.403524 18335 raft_consensus.cc:3055] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:55.403805 18335 raft_consensus.cc:740] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:55.413442 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:55.414311 18414 raft_consensus.cc:2410] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:19:55.416074 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:55.417068 18341 raft_consensus.cc:2410] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 for term 21 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:19:55.404455 18335 consensus_queue.cc:260] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:55.419761 18335 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:55.447467 18307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.450686 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:55.479974 18335 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 21.
I20260709 13:19:55.547685 18384 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:55.567301 24809 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:55.567725 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:55.599336 18414 raft_consensus.cc:3060] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:55.599498 18488 raft_consensus.cc:1240] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Rejecting Update request from peer 31ab487dc52e4f608b39df0fae2fdfa5 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:19:55.601083 24599 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:55.552199 24656 raft_consensus.cc:2749] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:55.603204 24599 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:55.572799 24688 consensus_meta.cc:287] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Time spent flushing consensus metadata: real 0.780s	user 0.009s	sys 0.000s
I20260709 13:19:55.574378 24659 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:55.572644 18418 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:19:55.613337 18492 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 20.
I20260709 13:19:55.624152 18414 raft_consensus.cc:2468] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 21.
I20260709 13:19:55.614578 24776 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:19:55.632177 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:55.636157 18336 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:19:55.624848 24809 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 22 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:55.639882 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:55.644485 24588 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:19:55.641835 24820 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.684536 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:55.685233 18414 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 19.
I20260709 13:19:55.708815 18493 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:19:55.730523 24845 log.cc:927] Time spent T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:19:55.784912 24834 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.289s	user 0.002s	sys 0.000s
I20260709 13:19:55.804701 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:55.799538 24765 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:55.807178 24765 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:55.824440 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:55.825464 18490 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 19: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:55.842958 24816 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:55.843789 24816 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:55.846705 24816 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:55.863327 19026 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:19:55.876802 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:55.891489 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:55.892136 18419 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 20.
I20260709 13:19:55.892421 18489 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 16.
I20260709 13:19:55.830440 24765 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:55.893776 18307 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:55.901235 18336 raft_consensus.cc:2393] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 12: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:55.901626 18308 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:55.910606 18414 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:55.913268 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:55.913931 18344 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 20.
I20260709 13:19:55.887395 24615 raft_consensus.cc:2804] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:55.927469 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:55.904520 24332 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.935691 18415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:55.936640 18415 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 19.
I20260709 13:19:55.920130 24759 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:55.942430 24550 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:55.945470 18308 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:55.918138 24086 consensus_queue.cc:1059] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:19:55.940446 24615 raft_consensus.cc:697] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:55.967412 24765 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.967471 24769 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:55.968102 24765 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:55.968508 24086 raft_consensus.cc:3055] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:55.970291 24086 raft_consensus.cc:740] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:55.947822 24826 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:19:55.971220 24086 consensus_queue.cc:260] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:55.972539 24086 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:55.972549 24615 consensus_queue.cc:237] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:55.968192 24769 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:55.978349 24769 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:55.983371 24765 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:55.984071 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:19:55.984884 24840 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.336s	user 0.004s	sys 0.000s
I20260709 13:19:55.984902 18489 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 11.
I20260709 13:19:55.986619 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:55.987663 24765 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:55.988179 24765 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.988649 24765 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.989091 18416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44916 (request call id 1329) took 1091 ms. Trace:
I20260709 13:19:55.944208 24332 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:55.989547 18416 rpcz_store.cc:276] 0709 13:19:54.897696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.898994 (+  1298us) service_pool.cc:224] Handling call
0709 13:19:54.908599 (+  9605us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:54.918015 (+  9416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.918048 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:54.918655 (+   607us) log.cc:844] Serialized 52 byte log entry
0709 13:19:55.261771 (+343116us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b1800464200. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdeec02 00007f409ea7620b 00007f409ea7bd23 00007f409ea7c0d1 00007f409ee97a0f
0709 13:19:55.630170 (+368399us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:55.713347 (+ 83177us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.713730 (+   383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.713832 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.984268 (+270436us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:55.988859 (+  4591us) raft_consensus.cc:1685] finished
0709 13:19:55.988884 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.989033 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11313,"prepare.queue_time_us":94491,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":9156,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":18773,"spinlock_wait_cycles":76335744,"thread_start_us":438221,"threads_started":2,"wal-append.queue_time_us":720603}
I20260709 13:19:55.992550 24332 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:56.007195 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 43523.2us
I20260709 13:19:56.011039 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:56.011763 18489 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:19:56.017797 18414 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 16: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:19:56.019793 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:56.020840 18410 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:56.024566 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:56.028069 18489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:56.028682 18489 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 20.
I20260709 13:19:56.023576 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:56.032510 19025 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:56.038285 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:56.038535 19027 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:56.039055 18417 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:56.022778 24759 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:56.037071 24797 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:56.044076 24409 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:56.042683 24581 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:56.079839 18457 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:56.070209 24797 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.074965 24581 raft_consensus.cc:493] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.077333 24409 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:56.088330 24588 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:56.134181 24797 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:56.137547 24581 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:56.129678 24858 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:19:56.157473 24588 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:19:56.208256 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 135787us
I20260709 13:19:56.201886 24769 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:56.203634 24588 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:56.214970 18457 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.16.211.62:40381, user_credentials={real_user=slave}} blocked reactor thread for 44756.1us
I20260709 13:19:56.230441 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:56.238041 19060 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:56.263592 18415 raft_consensus.cc:1275] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:19:56.280272 24859 log.cc:927] Time spent T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:19:56.281002 24850 log.cc:927] Time spent T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.247s	user 0.001s	sys 0.001s
I20260709 13:19:56.282666 19058 raft_consensus.cc:2410] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:19:56.209308 24765 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:56.254879 24856 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
W20260709 13:19:56.293673 24853 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:19:56.294976 18491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35114 (request call id 1560) took 1168 ms. Trace:
I20260709 13:19:56.295332 18491 rpcz_store.cc:276] 0709 13:19:55.126382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.126503 (+   121us) service_pool.cc:224] Handling call
0709 13:19:55.126802 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:55.233489 (+106687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:55.233524 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:55.809265 (+575741us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b2c001042f8. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409d7d5a11 00007f409d7e5372 00007f409ef17a01 00007f409eedc43a 00007f409eedb83e 00007f40a3ea0419 00007f409d417bd4 00007f409d417b62 00007f409d417a91 00007f409d417a0c 00007f409d416cc2
0709 13:19:55.809607 (+   342us) log.cc:844] Serialized 26 byte log entry
0709 13:19:56.057146 (+247539us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:56.057190 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.057270 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:56.294681 (+237411us) raft_consensus.cc:1685] finished
0709 13:19:56.294699 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.294921 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106324,"raft.queue_time_us":119561,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":95,"spinlock_wait_cycles":15951744,"thread_start_us":247225,"threads_started":1,"wal-append.queue_time_us":232144}
I20260709 13:19:56.162500 24759 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:56.321280 24860 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:19:56.323311 24765 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:56.324780 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:56.327005 24550 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:56.327522 24550 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:56.328503 24769 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:56.331969 24588 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:56.219288 24409 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:56.345356 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:56.355027 24797 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:56.357293 24797 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:56.360713 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:56.366511 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:56.367339 18486 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:56.368577 18491 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.351611 24816 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.379534 24816 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:56.381639 24816 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:56.373135 24797 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:56.378166 24588 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:56.384928 18491 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:56.386818 18493 raft_consensus.cc:2393] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 19: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:56.394004 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:56.395047 18338 raft_consensus.cc:2410] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:19:56.395692 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:56.401062 18336 raft_consensus.cc:2368] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:56.351722 24776 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:19:56.402498 18458 leader_election.cc:400] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:56.403002 18458 leader_election.cc:403] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:56.396292 24751 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:56.412336 24751 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:56.406456 24588 raft_consensus.cc:2749] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) with higher term. Message: Invalid argument: T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13.
I20260709 13:19:56.393771 24797 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:56.417181 24797 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:56.420358 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:56.424772 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:56.425498 18492 raft_consensus.cc:2393] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 20: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:19:56.435511 24581 raft_consensus.cc:515] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:56.449753 24751 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:19:56.469399 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 220957us
I20260709 13:19:56.471581 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:56.473623 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:56.478201 18419 raft_consensus.cc:2410] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:19:56.486537 18410 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:19:56.486573 18486 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:19:56.489053 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:56.493009 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:56.500941 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:56.503486 18341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:56.504027 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:56.512121 19027 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:56.513141 24563 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:56.520943 24819 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:19:56.533325 24854 log.cc:927] Time spent T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.327s	user 0.004s	sys 0.000s
I20260709 13:19:56.538003 24868 consensus_queue.cc:1048] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:19:56.541683 18307 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:56.552799 18336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:56.553587 18336 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:56.543860 24797 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:56.549170 24755 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:56.561324 18457 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:56.573849 18336 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 21.
W20260709 13:19:56.650427 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 137498us
W20260709 13:19:56.659159 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 60954.5us
I20260709 13:19:56.587909 24797 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:56.648476 24581 leader_election.cc:290] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:56.595162 24755 raft_consensus.cc:697] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:19:56.665136 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 66193.8us
I20260709 13:19:56.669416 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:56.670064 18491 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:56.670241 18336 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:19:56.619158 24869 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:56.677237 18410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:56.677793 18410 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:56.678750 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 96139.8us
I20260709 13:19:56.680117 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:56.682746 18384 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:56.686805 18491 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 21.
I20260709 13:19:56.688215 18410 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:56.689606 24332 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:56.693936 24870 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:19:56.695544 24808 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:56.698329 24755 consensus_queue.cc:237] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:56.700202 24550 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:56.703284 18341 raft_consensus.cc:1240] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:56.707129 24550 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:56.700150 24332 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:56.725313 18417 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 19.
I20260709 13:19:56.711685 19025 leader_election.cc:304] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:56.774422 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 93522.3us
W20260709 13:19:56.778220 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 55576.3us
W20260709 13:19:56.780630 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 91329.1us
I20260709 13:19:56.782544 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:56.855005 24615 raft_consensus.cc:2804] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:56.856499 24878 consensus_queue.cc:1059] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:19:56.857854 24865 log.cc:927] Time spent T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
W20260709 13:19:56.858407 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 79534.2us
I20260709 13:19:56.858673 24879 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:56.859202 24879 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:56.866119 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:56.684247 24797 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:56.933583 24881 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:56.995275 24879 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:56.997998 24830 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
W20260709 13:19:57.024485 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 168948us
W20260709 13:19:57.072010 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 293825us
I20260709 13:19:57.073463 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
W20260709 13:19:57.082166 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 56639.9us
W20260709 13:19:57.063174 24872 log.cc:927] Time spent T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.272s	user 0.001s	sys 0.001s
I20260709 13:19:57.084584 24615 raft_consensus.cc:697] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:19:57.127422 24819 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:57.148288 24819 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:19:57.135677 24882 log.cc:927] Time spent T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:19:57.136402 24884 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:19:57.002738 24881 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:57.156947 24881 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:57.040400 24830 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:57.162945 24830 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:57.142297 24615 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:57.172040 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:57.088640 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 174339us
I20260709 13:19:57.172873 19058 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 22.
W20260709 13:19:57.189857 18382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.007s	sys 0.006s
W20260709 13:19:57.191275 18382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.008s	sys 0.006s
W20260709 13:19:57.192067 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 703036us
I20260709 13:19:57.195389 18309 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:57.202912 24889 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:57.149255 24819 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:57.192068 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 108865us
I20260709 13:19:57.203343 24889 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:57.222088 18308 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:57.235001 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 406389us
I20260709 13:19:57.236289 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:57.236896 18418 raft_consensus.cc:3060] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:57.239738 18416 raft_consensus.cc:1275] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:19:57.240648 18490 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:19:57.258565 18416 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:19:57.255779 18418 raft_consensus.cc:2468] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 21.
I20260709 13:19:57.267500 24765 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:57.268062 24765 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:57.268337 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:57.268879 24765 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:57.269820 24564 consensus_queue.cc:1048] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:57.271193 24821 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:19:57.275701 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 53710.5us
I20260709 13:19:57.248170 24819 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:57.231276 24889 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:57.343602 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:19:57.358695 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 112104us
I20260709 13:19:57.349829 18458 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:57.368268 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:57.367245 24836 raft_consensus.cc:493] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.369685 24836 raft_consensus.cc:515] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:57.371740 24836 leader_election.cc:290] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:57.371807 24564 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:57.378003 24816 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:57.380961 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:57.381800 18485 raft_consensus.cc:2393] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 22: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:57.382440 18491 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:57.350139 24858 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:57.383185 24858 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:57.383853 18492 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:57.384353 18344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37920 (request call id 2979) took 1360 ms. Trace:
I20260709 13:19:57.384711 18344 rpcz_store.cc:276] 0709 13:19:56.024162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.024321 (+   159us) service_pool.cc:224] Handling call
0709 13:19:57.384181 (+1359860us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b540003cad4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eee02fa 00007f40a3ea1b17 00007f409d41c6d4 00007f409d41c662 00007f409d41c591 00007f409d41c50c 00007f409d41b7c2 00007f409d21748c 00007f409d2168c6 00007f409d21626f
0709 13:19:57.384301 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2065062784}
I20260709 13:19:57.385161 24858 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:19:57.388777 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 51768.4us
I20260709 13:19:57.387501 18489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55660 (request call id 2660) took 1101 ms. Trace:
I20260709 13:19:57.390666 18457 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:57.389470 18489 rpcz_store.cc:276] 0709 13:19:56.286285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.286438 (+   153us) service_pool.cc:224] Handling call
0709 13:19:56.286753 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:56.289939 (+  3186us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:56.313125 (+ 23186us) log.cc:844] Serialized 14 byte log entry
0709 13:19:56.555940 (+242815us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:56.560685 (+  4745us) log.cc:844] Serialized 52 byte log entry
0709 13:19:56.560822 (+   137us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:56.561091 (+   269us) log.cc:844] Serialized 14 byte log entry
0709 13:19:57.270478 (+709387us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b18004960c0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdd1e07 00007f40a4c2cab9 00007f409bdee69b 00007f409bdec93f 00007f409bdec455 00007f409eed4060 00007f409eee6716 00007f409eef7287 00007f409eef7208
0709 13:19:57.360544 (+ 90066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.360658 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:57.349381 (+-11277us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b18004960c0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdbd2a6 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1
0709 13:19:57.375122 (+ 25741us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b18004960c0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef522 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:19:57.376452 (+  1330us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b4400022b4c. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bd15c85 00007f409bd166a2 00007f409ea881db 00007f409ea83aaf 00007f409ea7786e 00007f409ea76bb6 00007f409ea767d8 00007f409ea80221 00007f409ea801d9 00007f409ea80169
0709 13:19:57.387304 (+ 10852us) raft_consensus.cc:1685] finished
0709 13:19:57.387325 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:57.387451 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34551,"prepare.queue_time_us":13014,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":30450,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":18120,"spinlock_wait_cycles":96786944,"thread_start_us":301376,"threads_started":2,"wal-append.queue_time_us":225588}
I20260709 13:19:57.413125 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:57.365885 24888 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:57.424674 24897 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:57.424811 24888 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:57.425232 24897 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:57.426949 24888 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:57.427284 24897 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:57.450492 24878 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:57.394656 24659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.336s	user 0.000s	sys 0.016s
W20260709 13:19:57.454840 24659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.396s	user 0.000s	sys 0.017s
I20260709 13:19:57.461089 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:57.463371 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:57.463866 24816 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.464479 24816 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:57.466338 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 73097us
I20260709 13:19:57.466759 24816 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:57.469097 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:57.489595 24889 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:57.497439 24889 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 22 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:57.535712 18307 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:57.547988 18338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b972754511104f898e9cbc171aa6c170" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
W20260709 13:19:57.562345 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 151164us
I20260709 13:19:57.562408 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:19:57.609726 19058 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 22.
I20260709 13:19:57.612241 24819 raft_consensus.cc:493] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 31ab487dc52e4f608b39df0fae2fdfa5)
I20260709 13:19:57.615990 24824 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:57.620949 18416 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Rejecting Update request from peer d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:57.622087 24550 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:57.634294 24332 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:57.635386 24332 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:57.637368 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fc3d36b088480ab5fb6ac2a5600252" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:19:57.644703 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 46577.4us
I20260709 13:19:57.652043 24599 consensus_queue.cc:1059] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:57.653496 24889 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:57.655642 24824 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:57.661712 24824 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:57.667665 24332 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:57.672681 24599 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:57.673223 24599 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:57.675462 24819 raft_consensus.cc:515] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:57.676810 24599 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:57.682456 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:57.697623 24819 leader_election.cc:290] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:57.698357 18309 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:19:57.699559 24550 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:57.700174 24550 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 22 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:57.693818 24599 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:57.701618 24550 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:19:57.719100 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 88944.8us
W20260709 13:19:57.722522 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 123565us
I20260709 13:19:57.733187 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:57.758478 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:57.757838 18414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:57.799942 18484 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:57.808657 18414 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 12.
I20260709 13:19:57.822388 18411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:57.823741 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:57.835821 18417 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:57.821408 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f9a8403ec74b85bc4a3ff12e5f686a" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:57.849284 18490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:57.850267 18490 raft_consensus.cc:2393] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 22: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:19:57.810388 24819 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:19:57.854182 24260 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:57.854640 24819 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:57.854926 24260 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:57.854194 24615 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:19:57.857265 24260 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:57.900467 18412 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:19:57.903798 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 142527us
I20260709 13:19:57.904770 18308 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:57.905858 24827 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:57.914278 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:57.937470 18487 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:57.939072 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:57.939220 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:57.937901 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:57.953838 24599 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:57.972572 24564 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:57.969755 18308 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:57.987216 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 56242us
I20260709 13:19:57.989109 24550 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:57.994191 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:57.991770 24550 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:19:58.016865 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 54102.3us
I20260709 13:19:58.021450 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:58.008246 24550 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.036375 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:58.040114 24819 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:19:58.084108 24911 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:19:58.086655 18335 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:58.066583 18240 catalog_manager.cc:5697] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.093164 18308 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:19:58.101804 24917 log.cc:927] Time spent T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:58.105654 24582 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:58.106618 24916 log.cc:927] Time spent T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:19:58.110441 24889 raft_consensus.cc:2749] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:58.112335 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102530a9a2f94c3492b2af9e95b376f6" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:58.116863 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:58.137419 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 98719.7us
I20260709 13:19:58.139966 18337 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:19:58.140442 18337 pending_rounds.cc:85] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting all ops after (but not including) 11
I20260709 13:19:58.140749 18337 pending_rounds.cc:107] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:19:58.141021 18337 raft_consensus.cc:2889] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:58.142550 24615 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:58.148416 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 106857us
I20260709 13:19:58.172783 18410 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:58.211715 24769 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:19:58.220067 18384 leader_election.cc:304] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:58.223351 24573 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:58.224006 24573 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:58.227859 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 62382.6us
I20260709 13:19:58.209759 18240 catalog_manager.cc:5697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 6 to 8, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 8 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:58.229652 18458 leader_election.cc:304] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:58.237432 18240 catalog_manager.cc:5697] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:58.234426 24923 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.258698 24824 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:58.266294 18240 catalog_manager.cc:5697] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:58.276701 24875 raft_consensus.cc:2749] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:58.278102 24816 raft_consensus.cc:2749] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:58.278825 24550 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:58.281648 18344 raft_consensus.cc:1240] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Rejecting Update request from peer 9d6cd7c600ec4ab2b5cac479f05d4c0f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:58.277797 18240 catalog_manager.cc:5697] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 8 to 11, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 11 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.289147 18240 catalog_manager.cc:5697] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 5 to 6, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 6 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:58.294857 24573 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:58.302821 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:58.303611 18492 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 20.
W20260709 13:19:58.295899 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 85731.7us
I20260709 13:19:58.305107 18382 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:19:58.315048 18457 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:58.314172 24875 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:58.318676 24875 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:19:58.319083 24875 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:58.321535 23986 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:58.322110 24819 consensus_queue.cc:1059] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:58.324198 19060 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 22 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:58.326274 24769 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:58.305233 24923 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:58.345331 18238 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42292 (request call id 345) took 17206 ms (client timeout 15000 ms). Trace:
I20260709 13:19:58.346264 24819 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:58.344058 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:58.347265 24819 raft_consensus.cc:3055] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:58.347730 24819 raft_consensus.cc:740] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:58.347975 18335 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 20: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:58.348013 18491 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:58.348843 24819 consensus_queue.cc:260] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:58.351784 24923 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:58.361639 18384 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:19:58.365594 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.365322 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:58.369254 18335 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:19:58.370070 23986 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:58.371857 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:58.366927 24926 log.cc:927] Time spent T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:58.361665 24819 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:58.380123 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 112572us
I20260709 13:19:58.381623 24876 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:19:58.382010 24894 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:58.382500 24894 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.382885 24894 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:58.386631 24927 log.cc:927] Time spent T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:19:58.387712 18457 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:19:58.389402 24816 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:58.391728 18457 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:58.398382 24925 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:58.418808 24550 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:58.421437 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
W20260709 13:19:58.424103 24931 log.cc:927] Time spent T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:58.428722 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:58.429343 18491 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:58.430751 24875 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:19:58.345830 18238 rpcz_store.cc:269] 0709 13:19:41.109863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.110087 (+   224us) service_pool.cc:224] Handling call
0709 13:19:58.310686 (+17200599us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:53.021775 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:53.022504 (+   729us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:53.022560 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:19:53.022581 (+    21us) tablet.cc:662] Decoding operations
0709 13:19:53.024894 (+  2313us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:53.024999 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:53.025032 (+    33us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:19:53.223501 (+198469us) tablet.cc:701] Row locks acquired
0709 13:19:53.223552 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:19:53.223705 (+   153us) write_op.cc:270] Start()
0709 13:19:53.223858 (+   153us) write_op.cc:276] Timestamp: P: 1783603193223646 usec, L: 0
0709 13:19:53.223880 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:53.229421 (+  5541us) log.cc:844] Serialized 10892 byte log entry
0709 13:19:54.041255 (+811834us) op_driver.cc:464] REPLICATION: finished
0709 13:19:54.210221 (+168966us) write_op.cc:301] APPLY: starting
0709 13:19:54.210328 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:54.380545 (+170217us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b54000497d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee45571 00007f409eed932a 00007f409ee5ef14 00007f409ee5eec3 00007f409ee5ee38 00007f409ee5edf3 00007f409ee5e0dc 00007f409ee87e16 00007f409ee6fcbb 00007f409ee5a39d 00007f409ee5dd75
0709 13:19:54.555526 (+174981us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:54.555555 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:54.695955 (+140400us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:54.696447 (+   492us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 13:19:54.696506 (+    59us) write_op.cc:312] APPLY: finished
0709 13:19:54.697044 (+   538us) log.cc:844] Serialized 244 byte log entry
0709 13:19:54.707000 (+  9956us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:54.707266 (+   266us) write_op.cc:454] Released schema lock
0709 13:19:54.707402 (+   136us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:54.714439 (+  7037us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:54.714483 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2199691,"reported_tablets":46,"spinlock_wait_cycles":1028992,"child_traces":[["op",{"apply.queue_time_us":168698,"apply.run_cpu_time_us":37001,"apply.run_wall_time_us":497605,"cfile_cache_hit":114,"cfile_cache_hit_bytes":120775,"num_ops":28,"prepare.queue_time_us":118393,"prepare.run_cpu_time_us":33060,"prepare.run_wall_time_us":381483,"raft.queue_time_us":392967,"raft.run_cpu_time_us":39646,"raft.run_wall_time_us":360286,"replication_time_us":817203,"spinlock_wait_cycles":47193856,"thread_start_us":501486,"threads_started":4,"wal-append.queue_time_us":319222,"wal-append.run_cpu_time_us":74643,"wal-append.run_wall_time_us":2212709}]]}
W20260709 13:19:58.439049 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 57844.2us
I20260709 13:19:58.454945 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:58.455753 18342 raft_consensus.cc:2393] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 20e06cff39b649c48d342b7431135303 in current term 20: Already voted for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in this term.
I20260709 13:19:58.459811 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:58.474196 24875 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:58.476385 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:58.505453 24825 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:19:58.497690 24923 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.536648 24923 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:58.547435 24923 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:19:58.574576 24894 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:58.578953 18492 raft_consensus.cc:1240] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Rejecting Update request from peer 20e06cff39b649c48d342b7431135303 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:19:58.583515 23986 consensus_queue.cc:1059] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:58.584396 23986 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:58.584800 23986 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:58.590329 24894 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:19:58.598748 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:19:58.561627 18493 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 20.
I20260709 13:19:58.610880 18335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:58.585796 23986 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:58.613722 23986 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:58.625995 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:58.601457 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:19:58.642725 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:58.656648 18485 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 13.
I20260709 13:19:58.669385 24922 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:58.666709 18382 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:58.677495 24875 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:58.678316 24875 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 20 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:19:58.679638 24875 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:58.695483 18307 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:19:58.703866 24550 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:58.704421 24550 raft_consensus.cc:697] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:19:58.705332 24550 consensus_queue.cc:237] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:58.791894 18412 raft_consensus.cc:2410] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:19:58.794639 18457 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:19:58.796139 24894 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:58.972754 18235 catalog_manager.cc:5697] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 17 to 19, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 19 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:58.975275 18235 catalog_manager.cc:5697] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 10 to 16, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 16 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:58.981473 18235 catalog_manager.cc:5697] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:58.988965 18235 catalog_manager.cc:5697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 10 to 14, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 14 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:19:58.971776 18240 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42292 (request call id 344) took 36555 ms (client timeout 15000 ms). Trace:
I20260709 13:19:58.991317 18235 catalog_manager.cc:5697] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 7 to 12, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 12 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:58.993350 18235 catalog_manager.cc:5697] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 18 to 19, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 19 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:59.003965 18235 catalog_manager.cc:5697] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:59.010988 18235 catalog_manager.cc:5697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 10 to 17, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 17 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:58.990865 18240 rpcz_store.cc:269] 0709 13:19:22.416411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.416834 (+   423us) service_pool.cc:224] Handling call
0709 13:19:58.971660 (+36554826us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:58.522558 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:58.523481 (+   923us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:58.523546 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:19:58.523563 (+    17us) tablet.cc:662] Decoding operations
0709 13:19:58.524384 (+   821us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:58.524468 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:58.524499 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:19:58.525244 (+   745us) tablet.cc:701] Row locks acquired
0709 13:19:58.525291 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:19:58.525443 (+   152us) write_op.cc:270] Start()
0709 13:19:58.525588 (+   145us) write_op.cc:276] Timestamp: P: 1783603198525382 usec, L: 0
0709 13:19:58.525625 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:19:58.576363 (+ 50738us) log.cc:844] Serialized 2506 byte log entry
0709 13:19:58.766207 (+189844us) op_driver.cc:464] REPLICATION: finished
0709 13:19:58.826360 (+ 60153us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b1800335680. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409bdef3f3 00007f409bdf17c1 00007f409bdf1779 00007f409bdf1709 00007f409bdf16d1 00007f409bdf09cd 000000000038f354 000000000038f199 00007f409bdd283a
0709 13:19:58.826553 (+   193us) write_op.cc:301] APPLY: starting
0709 13:19:58.826657 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:58.831990 (+  5333us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:58.832029 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:58.858915 (+ 26886us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:58.859244 (+   329us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:19:58.859319 (+    75us) write_op.cc:312] APPLY: finished
0709 13:19:58.859671 (+   352us) log.cc:844] Serialized 65 byte log entry
0709 13:19:58.859865 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:58.859979 (+   114us) write_op.cc:454] Released schema lock
0709 13:19:58.860041 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:58.860493 (+   452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:58.860524 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2408067,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":50527,"apply.run_cpu_time_us":9973,"apply.run_wall_time_us":33935,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29123,"num_ops":6,"prepare.queue_time_us":205914,"prepare.run_cpu_time_us":11426,"prepare.run_wall_time_us":150401,"raft.queue_time_us":35412,"raft.run_cpu_time_us":11368,"raft.run_wall_time_us":40113,"replication_time_us":240373,"spinlock_wait_cycles":19702784,"thread_start_us":222477,"threads_started":4,"wal-append.queue_time_us":67368}]]}
I20260709 13:19:59.020479 18235 catalog_manager.cc:5697] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:59.025983 18235 catalog_manager.cc:5697] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:59.028223 18235 catalog_manager.cc:5697] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:59.029681 18235 catalog_manager.cc:5697] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:59.032519 18235 catalog_manager.cc:5697] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.038162 18235 catalog_manager.cc:5697] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:59.040028 18235 catalog_manager.cc:5697] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:59.075032 18235 catalog_manager.cc:5697] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 12 to 15, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 15 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:59.083722 18235 catalog_manager.cc:5697] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 14 to 17, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 17 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:59.085548 18235 catalog_manager.cc:5697] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 12 to 14, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 14 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:59.095955 18235 catalog_manager.cc:5697] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:19:59.097836 18235 catalog_manager.cc:5697] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 14 to 17, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 17 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:19:59.266199 18492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:19:59.266798 18412 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.267050 18492 raft_consensus.cc:606] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Received request to transfer leadership
I20260709 13:19:59.286298 18486 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:59.298497 23986 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:59.302623 18486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:19:59.303606 18486 raft_consensus.cc:606] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Received request to transfer leadership
W20260709 13:19:59.305177 18226 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 2b12e68055d54f32b4b3e7d0d0c76af4 already in progress [suppressed 3 similar messages]
W20260709 13:19:59.321573 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 66456.5us
I20260709 13:19:59.322872 18412 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:59.324316 24894 raft_consensus.cc:993] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: : Instructing follower 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:19:59.327476 24816 raft_consensus.cc:1081] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Signalling peer 31ab487dc52e4f608b39df0fae2fdfa5 to start an election
I20260709 13:19:59.327920 24550 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.328609 24550 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:19:59.328974 24599 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:59.330744 19057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
 from {username='slave'} at 127.0.0.1:38700
I20260709 13:19:59.331372 19057 raft_consensus.cc:493] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:59.331717 19057 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.335940 18493 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:19:59.336419 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 48962.3us
I20260709 13:19:59.339453 18342 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:59.339193 24599 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:59.343703 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:19:59.352458 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:19:59.354357 18307 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:19:59.352661 24550 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:59.355206 24946 raft_consensus.cc:2749] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:59.356592 24590 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:19:59.363431 18226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 58386us
I20260709 13:19:59.387943 19057 raft_consensus.cc:515] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:59.395702 19057 leader_election.cc:290] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:19:59.396163 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:19:59.396744 18416 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.397035 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:19:59.401180 18486 raft_consensus.cc:3055] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:59.401515 18486 raft_consensus.cc:740] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:19:59.395192 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:19:59.402716 18337 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.402634 18486 consensus_queue.cc:260] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:59.464040 18486 raft_consensus.cc:3060] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.473629 18416 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:59.502703 18492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b12e68055d54f32b4b3e7d0d0c76af4"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:19:59.513226 18337 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:59.532462 18486 raft_consensus.cc:2468] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:19:59.533059 18492 raft_consensus.cc:606] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Received request to transfer leadership
I20260709 13:19:59.533421 18492 raft_consensus.cc:614] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:59.590245 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 87598.6us
I20260709 13:19:59.501392 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:59.608580 18236 catalog_manager.cc:5697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.614969 18235 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42278 (request call id 373) took 8311 ms. Trace:
I20260709 13:19:59.618562 18236 catalog_manager.cc:5697] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 14 to 16, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 16 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:59.615391 18235 rpcz_store.cc:276] 0709 13:19:51.303657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.303964 (+   307us) service_pool.cc:224] Handling call
0709 13:19:59.614904 (+8310940us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:59.124866 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:59.125450 (+   584us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:59.125486 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:19:59.125505 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:59.127126 (+  1621us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:59.127200 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:59.127231 (+    31us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:19:59.128753 (+  1522us) tablet.cc:701] Row locks acquired
0709 13:19:59.128772 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:19:59.128921 (+   149us) write_op.cc:270] Start()
0709 13:19:59.129043 (+   122us) write_op.cc:276] Timestamp: P: 1783603199128873 usec, L: 0
0709 13:19:59.129073 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:19:59.129755 (+   682us) log.cc:844] Serialized 7841 byte log entry
0709 13:19:59.132765 (+  3010us) op_driver.cc:464] REPLICATION: finished
0709 13:19:59.133102 (+   337us) write_op.cc:301] APPLY: starting
0709 13:19:59.133187 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:59.143334 (+ 10147us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:59.143436 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:59.199057 (+ 55621us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:59.199380 (+   323us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:19:59.199433 (+    53us) write_op.cc:312] APPLY: finished
0709 13:19:59.199882 (+   449us) log.cc:844] Serialized 180 byte log entry
0709 13:19:59.202081 (+  2199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:59.202290 (+   209us) write_op.cc:454] Released schema lock
0709 13:19:59.202354 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:59.202751 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:59.202780 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15911,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":23568,"apply.run_wall_time_us":69599,"cfile_cache_hit":80,"cfile_cache_hit_bytes":83320,"num_ops":20,"prepare.queue_time_us":17458,"prepare.run_cpu_time_us":5208,"prepare.run_wall_time_us":7718,"replication_time_us":3545}]]}
W20260709 13:19:59.699522 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 184027us
W20260709 13:19:59.705271 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 185786us
W20260709 13:19:59.853857 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 139534us
I20260709 13:19:59.861622 19027 leader_election.cc:304] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
W20260709 13:19:59.862843 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 152439us
I20260709 13:19:59.903857 18236 catalog_manager.cc:5697] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:19:59.910856 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 205854us
I20260709 13:19:59.934335 18236 catalog_manager.cc:5697] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 12 to 18, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 18 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.942183 24086 raft_consensus.cc:2804] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:59.951695 24086 raft_consensus.cc:697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:19:59.966796 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 44030.6us
W20260709 13:19:59.963577 24968 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:19:59.963378 24550 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:19:59.988044 24086 consensus_queue.cc:237] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:19:59.995360 24550 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:00.030151 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:00.028970 24550 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:00.031296 18492 raft_consensus.cc:2393] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 in current term 18: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:20:00.104943 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 150341us
W20260709 13:20:00.096066 24968 log.cc:927] Time spent T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:20:00.144476 18236 catalog_manager.cc:5697] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 11 to 12, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 12 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:00.194034 18236 catalog_manager.cc:5697] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:00.199848 24961 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.200536 24961 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:20:00.287784 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 366612us
I20260709 13:20:00.328634 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:00.329320 18493 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 18.
I20260709 13:20:00.330147 24961 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:00.350507 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:20:00.351205 18342 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
I20260709 13:20:00.439540 18416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:20:00.440308 18416 raft_consensus.cc:606] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:00.431296 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:20:00.479856 18290 auto_rebalancer.cc:893] Removing replace marker failed: Replica 9d6cd7c600ec4ab2b5cac479f05d4c0f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:20:00.480424 18290 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:20:00.480775 18290 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:20:00.487164 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 55957.6us
I20260709 13:20:00.488674 24992 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:00.489137 24992 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.489466 24992 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:00.489466 24996 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:00.494896 24996 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:00.497042 24996 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:00.523840 24992 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:00.525081 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:20:00.525833 18418 raft_consensus.cc:2368] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19.
I20260709 13:20:00.529062 24992 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:00.531978 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:20:00.532227 18308 leader_election.cc:400] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19.
I20260709 13:20:00.532588 18308 leader_election.cc:403] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:00.532615 18412 raft_consensus.cc:606] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:00.533085 18412 raft_consensus.cc:614] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:00.533442 24970 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:20:00.535804 18488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:00.536401 18488 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:00.544303 24970 raft_consensus.cc:2749] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) with higher term. Message: Invalid argument: T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03b672b2ff044b8bc2a0dfd8180ee19 for earlier term 18. Current term is 19.
I20260709 13:20:00.545087 18488 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 19.
I20260709 13:20:00.554137 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:20:00.554786 18412 raft_consensus.cc:606] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:00.557560 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:20:00.558147 18412 raft_consensus.cc:606] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:00.563125 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb654ec8beb54a539b5b6b44aa5181c3"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:20:00.563752 18412 raft_consensus.cc:606] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:00.564096 18412 raft_consensus.cc:614] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:00.566898 24998 raft_consensus.cc:993] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:20:00.567423 24998 raft_consensus.cc:1081] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:20:00.570263 19057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:20:00.570814 19057 raft_consensus.cc:606] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Received request to transfer leadership to TS d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:00.572530 18344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:20:00.572952 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" is_pre_election: true
I20260709 13:20:00.575706 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:00.577564 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:00.578598 19053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:00.588410 18344 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 19.
I20260709 13:20:00.604669 18344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37920
I20260709 13:20:00.605333 18344 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:00.605690 18344 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:00.613003 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 48964.9us
I20260709 13:20:00.620543 18488 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:00.613689 18382 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:00.622334 24978 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:00.629558 24996 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:00.630470 24996 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 19 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:00.631546 24996 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:00.632972 18344 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:00.639125 18344 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:00.640218 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:00.642271 18412 raft_consensus.cc:3055] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:00.642642 18412 raft_consensus.cc:740] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:00.640218 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:00.645679 18492 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:00.643414 18412 consensus_queue.cc:260] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:00.650424 18412 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:00.652240 24086 raft_consensus.cc:993] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:20:00.652640 24994 raft_consensus.cc:993] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:00.652674 24086 raft_consensus.cc:1081] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:20:00.651634 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:00.655068 24995 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:00.657729 18344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:53812
I20260709 13:20:00.654204 24875 raft_consensus.cc:1081] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:00.657644 24994 raft_consensus.cc:993] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: : Instructing follower d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:20:00.660145 18344 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:00.661628 18344 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:00.662696 18410 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:00.668607 18486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:20:00.669193 18486 raft_consensus.cc:493] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:00.669595 18486 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.662659 24995 raft_consensus.cc:1081] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Signalling peer d03b672b2ff044b8bc2a0dfd8180ee19 to start an election
I20260709 13:20:00.669368 24978 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:20:00.685503 18337 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:00.694916 18492 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:20:00.696123 18307 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:20:00.696928 24950 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:00.697441 24950 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:20:00.698325 24950 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:00.699448 24965 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:00.717643 18412 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 15.
I20260709 13:20:00.742848 18342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
 from {username='slave'} at 127.0.0.1:37920
I20260709 13:20:00.750800 18342 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:00.751287 18342 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.752203 18344 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:00.753563 18486 raft_consensus.cc:515] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:00.763366 18486 leader_election.cc:290] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:00.764498 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:00.765193 18417 raft_consensus.cc:3055] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:00.765558 18344 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:00.766126 18492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:00.766664 18492 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:00.765477 18417 raft_consensus.cc:740] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:00.768824 18417 consensus_queue.cc:260] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:00.770892 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:00.771575 19060 raft_consensus.cc:3055] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:00.771631 18343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d70af6941f4d469682dabf08926fc9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:20:00.772024 19060 raft_consensus.cc:740] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:00.772351 18343 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.772907 19060 consensus_queue.cc:260] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:00.774120 19060 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:00.775784 18417 raft_consensus.cc:3060] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.794866 18417 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:20:00.796044 18457 leader_election.cc:304] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:00.797402 18343 raft_consensus.cc:2468] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:20:00.818162 24979 raft_consensus.cc:2804] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:00.819135 24979 raft_consensus.cc:697] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:00.796168 18342 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:00.823112 24979 consensus_queue.cc:237] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:00.834692 18492 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:20:00.829391 19060 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 17.
I20260709 13:20:00.840495 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:00.841053 18342 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:00.841135 18417 raft_consensus.cc:3055] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:00.842023 18417 raft_consensus.cc:740] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:00.843066 18417 consensus_queue.cc:260] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:00.844696 18417 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.846249 18493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:00.846815 18493 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.839601 18309 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:20:00.855316 18493 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:20:00.859400 24988 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:00.859692 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:00.860662 19060 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.860042 24988 raft_consensus.cc:697] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:20:00.876664 19060 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:20:00.895948 18417 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03b672b2ff044b8bc2a0dfd8180ee19 in term 14.
I20260709 13:20:00.891971 18309 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:20:00.919001 24985 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:00.953898 24988 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:01.014581 24985 raft_consensus.cc:697] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Becoming Leader. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
W20260709 13:20:01.040309 25011 log.cc:927] Time spent T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:20:01.047504 24985 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:01.050643 18342 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:01.064615 24996 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:01.084187 18493 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:01.085901 24996 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 13:20:01.118450 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 57642us
W20260709 13:20:01.119542 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 58483.6us
I20260709 13:20:01.218638 18235 catalog_manager.cc:5697] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 12 to 13, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 13 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.220496 18235 catalog_manager.cc:5697] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 14 to 18, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 18 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:01.226033 18235 catalog_manager.cc:5697] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:01.310225 18235 catalog_manager.cc:5697] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 16 to 19, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 19 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.311344 18410 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:01.312286 18235 catalog_manager.cc:5697] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:20:01.313016 24985 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:01.313737 18235 catalog_manager.cc:5697] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 17 to 19, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 19 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:01.315145 18235 catalog_manager.cc:5697] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 10 to 13, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 13 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:01.316907 18236 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42284 (request call id 337) took 24605 ms (client timeout 15000 ms). Trace:
I20260709 13:20:01.316560 18235 catalog_manager.cc:5697] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:01.319866 18235 catalog_manager.cc:5697] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 16 to 21, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 21 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } attrs { replace: true } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:01.335821 18492 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:20:01.317415 18236 rpcz_store.cc:269] 0709 13:19:36.711581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.711895 (+   314us) service_pool.cc:224] Handling call
0709 13:20:01.316832 (+24604937us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:00.558608 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:00.564291 (+  5683us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:00.564388 (+    97us) write_op.cc:435] Acquired schema lock
0709 13:20:00.564405 (+    17us) tablet.cc:662] Decoding operations
0709 13:20:00.565209 (+   804us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:00.565267 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:00.565304 (+    37us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:20:00.565815 (+   511us) tablet.cc:701] Row locks acquired
0709 13:20:00.565833 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:20:00.566002 (+   169us) write_op.cc:270] Start()
0709 13:20:00.566117 (+   115us) write_op.cc:276] Timestamp: P: 1783603200565948 usec, L: 0
0709 13:20:00.566139 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:20:00.566743 (+   604us) log.cc:844] Serialized 2506 byte log entry
0709 13:20:00.770313 (+203570us) op_driver.cc:464] REPLICATION: finished
0709 13:20:00.842153 (+ 71840us) write_op.cc:301] APPLY: starting
0709 13:20:00.842235 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:00.845771 (+  3536us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:00.845867 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:00.908820 (+ 62953us) spinlock_profiling.cc:243] Waited 9.13 ms on lock 0x7b180033d9c0. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f40a4cb7de1 00007f40a4cc45b1 00007f409ec1b0ec 00007f409ec67c0a 00007f409ec674f7 00007f409ec67490 00007f409ec1ef48 00007f40a29331bb 00007f40a297a5d4 00007f40a28268da 00007f40a28293cb
0709 13:20:00.944388 (+ 35568us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:00.944607 (+   219us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:20:00.949491 (+  4884us) write_op.cc:312] APPLY: finished
0709 13:20:00.963776 (+ 14285us) log.cc:844] Serialized 65 byte log entry
0709 13:20:00.988065 (+ 24289us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:00.998473 (+ 10408us) write_op.cc:454] Released schema lock
0709 13:20:01.000569 (+  2096us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:01.013548 (+ 12979us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:01.014914 (+  1366us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53275,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":71565,"apply.run_cpu_time_us":13066,"apply.run_wall_time_us":165608,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29123,"num_ops":6,"prepare.queue_time_us":142049,"prepare.run_cpu_time_us":13835,"prepare.run_wall_time_us":82648,"raft.queue_time_us":78977,"raft.run_cpu_time_us":9907,"raft.run_wall_time_us":101522,"replication_time_us":203976,"spinlock_wait_cycles":21000448,"thread_start_us":372178,"threads_started":4,"wal-append.queue_time_us":94673}]]}
I20260709 13:20:01.343281 24985 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:01.327401 18235 catalog_manager.cc:5697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 18 to 20, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 20 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.354176 18235 catalog_manager.cc:5697] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 14 to 20, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 20 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.355870 18235 catalog_manager.cc:5697] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.357368 18235 catalog_manager.cc:5697] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 18 to 21, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 21 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:01.358767 18235 catalog_manager.cc:5697] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
W20260709 13:20:01.359786 18227 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 02f16ac6b95a48868f83cdf22debb207 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 20e06cff39b649c48d342b7431135303 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:01.369794 18337 raft_consensus.cc:1275] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:01.371922 18235 catalog_manager.cc:5697] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 11 to 13, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 13 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.374676 18235 catalog_manager.cc:5697] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:20:01.376200 18235 catalog_manager.cc:5697] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 12 to 15, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 15 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.378119 18235 catalog_manager.cc:5697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:01.381762 18235 catalog_manager.cc:5697] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:20:01.383280 18235 catalog_manager.cc:5697] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 14 to 18, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 18 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.385465 19057 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:01.385448 18235 catalog_manager.cc:5697] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:01.388163 24988 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:01.377481 24962 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:20:01.449355 18410 raft_consensus.cc:1275] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:01.451282 24962 consensus_queue.cc:1048] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:01.496858 18492 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:01.506424 24985 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:01.522215 18493 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:01.524036 24980 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:01.561645 18410 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:01.564182 24985 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:01.603643 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:01.630904 19057 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Refusing update from remote peer d03b672b2ff044b8bc2a0dfd8180ee19: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:01.633149 24980 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:01.756119 18235 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42278 (request call id 374) took 1302 ms. Trace:
I20260709 13:20:01.757329 18235 rpcz_store.cc:276] 0709 13:20:00.454006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.455431 (+  1425us) service_pool.cc:224] Handling call
0709 13:20:01.756028 (+1300597us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:01.454261 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:01.456489 (+  2228us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:01.456522 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:20:01.456541 (+    19us) tablet.cc:662] Decoding operations
0709 13:20:01.473317 (+ 16776us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:01.473406 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:01.473434 (+    28us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:20:01.475233 (+  1799us) tablet.cc:701] Row locks acquired
0709 13:20:01.475257 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:20:01.475460 (+   203us) write_op.cc:270] Start()
0709 13:20:01.475628 (+   168us) write_op.cc:276] Timestamp: P: 1783603201475394 usec, L: 0
0709 13:20:01.475669 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:20:01.476694 (+  1025us) log.cc:844] Serialized 8299 byte log entry
0709 13:20:01.552253 (+ 75559us) op_driver.cc:464] REPLICATION: finished
0709 13:20:01.553693 (+  1440us) write_op.cc:301] APPLY: starting
0709 13:20:01.553793 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:01.663778 (+109985us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:01.663887 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:01.734079 (+ 70192us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:01.734431 (+   352us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:20:01.734486 (+    55us) write_op.cc:312] APPLY: finished
0709 13:20:01.734960 (+   474us) log.cc:844] Serialized 188 byte log entry
0709 13:20:01.735810 (+   850us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:01.736012 (+   202us) write_op.cc:454] Released schema lock
0709 13:20:01.736074 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:01.748983 (+ 12909us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:01.749019 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":897,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":1178,"apply.run_cpu_time_us":26623,"apply.run_wall_time_us":195262,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91613,"num_ops":21,"prepare.queue_time_us":27121,"prepare.run_cpu_time_us":6768,"prepare.run_wall_time_us":22926,"replication_time_us":76420,"thread_start_us":69238,"threads_started":2}]]}
I20260709 13:20:01.843170 18239 catalog_manager.cc:5697] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 8 to 11, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 11 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:02.081570 18239 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42284 (request call id 336) took 46411 ms (client timeout 15000 ms). Trace:
W20260709 13:20:02.082031 18239 rpcz_store.cc:269] 0709 13:19:15.670414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.670764 (+   350us) service_pool.cc:224] Handling call
0709 13:20:02.081494 (+46410730us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:01.957117 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:01.957742 (+   625us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:01.957782 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:20:01.957795 (+    13us) tablet.cc:662] Decoding operations
0709 13:20:01.958176 (+   381us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:01.958237 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:01.958277 (+    40us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:20:01.958472 (+   195us) tablet.cc:701] Row locks acquired
0709 13:20:01.958491 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:20:01.958641 (+   150us) write_op.cc:270] Start()
0709 13:20:01.958762 (+   121us) write_op.cc:276] Timestamp: P: 1783603201958593 usec, L: 0
0709 13:20:01.958795 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:20:01.959461 (+   666us) log.cc:844] Serialized 529 byte log entry
0709 13:20:01.961229 (+  1768us) op_driver.cc:464] REPLICATION: finished
0709 13:20:01.961846 (+   617us) write_op.cc:301] APPLY: starting
0709 13:20:01.961973 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:01.962702 (+   729us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:01.962777 (+    75us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:01.963367 (+   590us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:01.963553 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:20:01.963593 (+    40us) write_op.cc:312] APPLY: finished
0709 13:20:01.963742 (+   149us) log.cc:844] Serialized 25 byte log entry
0709 13:20:01.963908 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:01.963982 (+    74us) write_op.cc:454] Released schema lock
0709 13:20:01.964033 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:01.964407 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:01.964434 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":47876,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":265,"apply.run_cpu_time_us":2588,"apply.run_wall_time_us":2600,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4166,"num_ops":1,"prepare.queue_time_us":7849,"prepare.run_cpu_time_us":2660,"prepare.run_wall_time_us":2661,"replication_time_us":2319,"spinlock_wait_cycles":10112}]]}
I20260709 13:20:02.162563 18242 catalog_manager.cc:5697] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 16 to 17, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 17 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:02.168020 18242 catalog_manager.cc:5697] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:02.223177 18242 catalog_manager.cc:5697] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:02.225625 18242 catalog_manager.cc:5697] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:20:02.237528 18241 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54880 (request call id 260) took 34994 ms (client timeout 15000 ms). Trace:
I20260709 13:20:02.238585 18242 catalog_manager.cc:5697] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:02.263266 18242 catalog_manager.cc:5697] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 12 to 13, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 13 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:20:02.256783 18241 rpcz_store.cc:269] 0709 13:19:27.242853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.242994 (+   141us) service_pool.cc:224] Handling call
0709 13:19:27.355105 (+112111us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b54000497d4. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409ee46090 00007f409eee4f3a 00007f40a4c9b1cc 00007f40a4d9937e 00007f40a325a2a4 00007f40a325a232 00007f40a325a161 00007f40a325a0dc 00007f40a3259392 00007f409d21748c 00007f409d2168c6
0709 13:20:02.237323 (+34882218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30372,"reported_tablets":44,"spinlock_wait_cycles":13708544}
I20260709 13:20:02.282511 18242 catalog_manager.cc:5697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 10 to 11, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 11 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.299583 18242 catalog_manager.cc:5697] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.439132 18237 catalog_manager.cc:5697] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 16 to 19, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 19 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:02.443234 18226 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2b12e68055d54f32b4b3e7d0d0c76af4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d6cd7c600ec4ab2b5cac479f05d4c0f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:02.442386 18237 catalog_manager.cc:5697] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 5 to 19, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 19 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:20:02.448411 18242 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54880 (request call id 261) took 13870 ms (client timeout 15000 ms). Trace:
I20260709 13:20:02.452725 18237 catalog_manager.cc:5697] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 16 to 19, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 19 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:02.453853 18242 rpcz_store.cc:269] 0709 13:19:48.597005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.611815 (+ 14810us) service_pool.cc:224] Handling call
0709 13:20:02.448333 (+13836518us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:02.336039 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:02.336537 (+   498us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:02.336568 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:20:02.336584 (+    16us) tablet.cc:662] Decoding operations
0709 13:20:02.337373 (+   789us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:02.337433 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:02.337462 (+    29us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:20:02.338213 (+   751us) tablet.cc:701] Row locks acquired
0709 13:20:02.338229 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:20:02.338376 (+   147us) write_op.cc:270] Start()
0709 13:20:02.338487 (+   111us) write_op.cc:276] Timestamp: P: 1783603202338329 usec, L: 0
0709 13:20:02.338504 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:20:02.339186 (+   682us) log.cc:844] Serialized 3190 byte log entry
0709 13:20:02.341622 (+  2436us) op_driver.cc:464] REPLICATION: finished
0709 13:20:02.342066 (+   444us) write_op.cc:301] APPLY: starting
0709 13:20:02.342146 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:02.346645 (+  4499us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:02.346751 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:02.358495 (+ 11744us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:02.358721 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:20:02.358772 (+    51us) write_op.cc:312] APPLY: finished
0709 13:20:02.359067 (+   295us) log.cc:844] Serialized 81 byte log entry
0709 13:20:02.370123 (+ 11056us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:02.370251 (+   128us) write_op.cc:454] Released schema lock
0709 13:20:02.370310 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:02.370694 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:02.370893 (+   199us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":833510,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":265,"apply.run_cpu_time_us":11196,"apply.run_wall_time_us":28569,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33328,"num_ops":8,"prepare.queue_time_us":132,"prepare.run_cpu_time_us":3448,"prepare.run_wall_time_us":9808,"replication_time_us":2987}]]}
I20260709 13:20:02.492436 18237 catalog_manager.cc:5697] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.579300 18234 catalog_manager.cc:5697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:02.581570 18234 catalog_manager.cc:5697] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.595888 18234 catalog_manager.cc:5697] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 17 to 20, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 20 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.587268 18237 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42284 (request call id 338) took 6837 ms. Trace:
I20260709 13:20:02.606238 18237 rpcz_store.cc:276] 0709 13:19:55.750057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.750214 (+   157us) service_pool.cc:224] Handling call
0709 13:20:02.587201 (+6836987us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:02.507220 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:02.507784 (+   564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:02.507825 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:20:02.507843 (+    18us) tablet.cc:662] Decoding operations
0709 13:20:02.508399 (+   556us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:02.508456 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:02.508495 (+    39us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:20:02.508921 (+   426us) tablet.cc:701] Row locks acquired
0709 13:20:02.508937 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:20:02.509096 (+   159us) write_op.cc:270] Start()
0709 13:20:02.509227 (+   131us) write_op.cc:276] Timestamp: P: 1783603202509038 usec, L: 0
0709 13:20:02.509246 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:20:02.509898 (+   652us) log.cc:844] Serialized 1674 byte log entry
0709 13:20:02.512839 (+  2941us) op_driver.cc:464] REPLICATION: finished
0709 13:20:02.513370 (+   531us) write_op.cc:301] APPLY: starting
0709 13:20:02.513470 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:02.515825 (+  2355us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:02.515925 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:02.518449 (+  2524us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:02.518650 (+   201us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:20:02.518703 (+    53us) write_op.cc:312] APPLY: finished
0709 13:20:02.518955 (+   252us) log.cc:844] Serialized 49 byte log entry
0709 13:20:02.519816 (+   861us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:02.519920 (+   104us) write_op.cc:454] Released schema lock
0709 13:20:02.519977 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:02.530105 (+ 10128us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:02.530140 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":104648,"reported_tablets":45,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":254,"apply.run_cpu_time_us":6353,"apply.run_wall_time_us":7020,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16664,"num_ops":4,"prepare.queue_time_us":126,"prepare.run_cpu_time_us":2992,"prepare.run_wall_time_us":5415,"replication_time_us":3466}]]}
I20260709 13:20:02.762113 18236 catalog_manager.cc:5697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 14 to 15, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 15 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:02.764232 18236 catalog_manager.cc:5697] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:20:02.765856 18236 catalog_manager.cc:5697] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 13 to 14, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 14 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } }
I20260709 13:20:02.770740 18412 consensus_queue.cc:237] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:02.794221 18236 catalog_manager.cc:5697] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 14 to 15, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 15 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.796698 18236 catalog_manager.cc:5697] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 16 to 17, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 17 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.864355 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:02.898671 18236 catalog_manager.cc:5697] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: term changed from 13 to 14, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1). New cstate: current_term: 14 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:02.933429 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 67339.6us
W20260709 13:20:02.993857 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 59459.3us
W20260709 13:20:02.991420 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 131604us
I20260709 13:20:02.999305 18486 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:20:03.018039 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 87205.2us
I20260709 13:20:03.049954 25062 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:03.082186 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 49417us
W20260709 13:20:03.118055 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 105859us
I20260709 13:20:03.221060 19053 raft_consensus.cc:1275] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:20:03.221101 18385 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.278469 25049 raft_consensus.cc:2955] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 6 to 12, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:20:03.286130 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 286410us
W20260709 13:20:03.322278 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 152481us
I20260709 13:20:03.344954 18491 raft_consensus.cc:2955] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 6 to 12, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:03.385712 18236 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42278 (request call id 375) took 1580 ms. Trace:
I20260709 13:20:03.386271 18236 rpcz_store.cc:276] 0709 13:20:01.787026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.790027 (+  3001us) service_pool.cc:224] Handling call
0709 13:20:03.367157 (+1577130us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:03.067539 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:03.068102 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:03.068139 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:20:03.068153 (+    14us) tablet.cc:662] Decoding operations
0709 13:20:03.068951 (+   798us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:03.069009 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:03.069040 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:20:03.069595 (+   555us) tablet.cc:701] Row locks acquired
0709 13:20:03.069608 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:20:03.069772 (+   164us) write_op.cc:270] Start()
0709 13:20:03.069887 (+   115us) write_op.cc:276] Timestamp: P: 1783603203069725 usec, L: 0
0709 13:20:03.069902 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:20:03.217970 (+148068us) log.cc:844] Serialized 2573 byte log entry
0709 13:20:03.230904 (+ 12934us) op_driver.cc:464] REPLICATION: finished
0709 13:20:03.231385 (+   481us) write_op.cc:301] APPLY: starting
0709 13:20:03.231468 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:03.243322 (+ 11854us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:03.243425 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:03.298317 (+ 54892us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:03.298522 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:20:03.298564 (+    42us) write_op.cc:312] APPLY: finished
0709 13:20:03.298802 (+   238us) log.cc:844] Serialized 65 byte log entry
0709 13:20:03.303848 (+  5046us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:03.327093 (+ 23245us) write_op.cc:454] Released schema lock
0709 13:20:03.327725 (+   632us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:03.355854 (+ 28129us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:03.355890 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":184455,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":266,"apply.run_cpu_time_us":10040,"apply.run_wall_time_us":118757,"cfile_cache_hit":24,"cfile_cache_hit_bytes":24996,"num_ops":6,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":9677,"prepare.run_wall_time_us":162866,"replication_time_us":160850}]]}
I20260709 13:20:03.403415 24992 consensus_queue.cc:1048] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:03.407708 18227 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b345033a56994fff90990b7d03324074 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:20:03.410033 18234 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42292 (request call id 346) took 5489 ms. Trace:
I20260709 13:20:03.410501 18234 rpcz_store.cc:276] 0709 13:19:57.921172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.921872 (+   700us) service_pool.cc:224] Handling call
0709 13:20:03.409967 (+5488095us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:02.713207 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:02.734645 (+ 21438us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:02.734697 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:20:02.734725 (+    28us) tablet.cc:662] Decoding operations
0709 13:20:02.735411 (+   686us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:02.735485 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:02.735529 (+    44us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:20:02.736066 (+   537us) tablet.cc:701] Row locks acquired
0709 13:20:02.736096 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:20:02.736289 (+   193us) write_op.cc:270] Start()
0709 13:20:02.736457 (+   168us) write_op.cc:276] Timestamp: P: 1783603202736232 usec, L: 0
0709 13:20:02.736497 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:20:02.737294 (+   797us) log.cc:844] Serialized 1293 byte log entry
0709 13:20:02.745633 (+  8339us) op_driver.cc:464] REPLICATION: finished
0709 13:20:02.746130 (+   497us) write_op.cc:301] APPLY: starting
0709 13:20:02.746209 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:02.748033 (+  1824us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:02.748121 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:02.752037 (+  3916us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:02.752232 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:20:02.752282 (+    50us) write_op.cc:312] APPLY: finished
0709 13:20:02.752511 (+   229us) log.cc:844] Serialized 41 byte log entry
0709 13:20:02.752673 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:02.752782 (+   109us) write_op.cc:454] Released schema lock
0709 13:20:02.752826 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:02.753141 (+   315us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:02.753175 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":44638,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":284,"apply.run_cpu_time_us":4912,"apply.run_wall_time_us":6996,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12498,"num_ops":3,"prepare.queue_time_us":712,"prepare.run_cpu_time_us":3832,"prepare.run_wall_time_us":30721,"replication_time_us":8969}]]}
I20260709 13:20:03.445952 18242 catalog_manager.cc:5697] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 19 to 20, leader changed from 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 20 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:03.457180 19057 raft_consensus.cc:2955] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 6 to 12, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:03.484370 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:20:03.486693 18412 raft_consensus.cc:606] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 19 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:03.491497 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:20:03.495004 18412 raft_consensus.cc:606] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:03.499290 19054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:20:03.500007 19054 raft_consensus.cc:606] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:03.503185 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:20:03.503841 18412 raft_consensus.cc:606] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 20 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:03.507283 18412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48"
dest_uuid: "20e06cff39b649c48d342b7431135303"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:37140
I20260709 13:20:03.508033 18412 raft_consensus.cc:606] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:03.509804 25049 raft_consensus.cc:993] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:03.510340 25037 raft_consensus.cc:1081] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 19 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:03.511125 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:03.512193 18493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:20:03.512822 18493 raft_consensus.cc:493] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:03.513180 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:03.513180 18493 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:03.540225 18493 raft_consensus.cc:515] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:03.546379 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:20:03.547010 18342 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:03.559027 18342 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 20.
I20260709 13:20:03.563537 18458 leader_election.cc:304] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:20:03.564602 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f56f24cb8c042b4bbdc442e02acaefc" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:03.565367 18412 raft_consensus.cc:3055] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:03.565681 18412 raft_consensus.cc:740] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:03.566192 25073 raft_consensus.cc:2804] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:03.566840 25073 raft_consensus.cc:697] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:03.566696 18412 consensus_queue.cc:260] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:03.568035 18412 raft_consensus.cc:3060] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:03.567904 25073 consensus_queue.cc:237] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:03.588737 25049 raft_consensus.cc:993] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:03.589283 25049 raft_consensus.cc:1081] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 20 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:03.591243 18491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:20:03.591817 18491 raft_consensus.cc:493] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:03.592178 18491 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:03.562073 18493 leader_election.cc:290] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:03.602876 18491 raft_consensus.cc:515] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:03.632117 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:20:03.632997 18342 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:03.633584 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f6372354b84d0ea884a3478b3dfd98" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:03.634289 18417 raft_consensus.cc:3055] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:03.634639 18417 raft_consensus.cc:740] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:03.635444 18417 consensus_queue.cc:260] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:03.636633 18417 raft_consensus.cc:3060] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:03.631536 18491 leader_election.cc:290] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 21 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:03.645823 18417 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 21.
I20260709 13:20:03.606616 18412 raft_consensus.cc:2468] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 20.
I20260709 13:20:03.649333 18457 leader_election.cc:304] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:03.651079 25073 raft_consensus.cc:2804] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:03.655058 25073 raft_consensus.cc:697] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:03.656162 25073 consensus_queue.cc:237] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:03.658599 18342 raft_consensus.cc:2468] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 21.
I20260709 13:20:03.673127 18236 catalog_manager.cc:5697] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index 6 to 12, VOTER d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) evicted. New cstate: current_term: 15 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:03.688660 18242 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54880 (request call id 262) took 1138 ms. Trace:
I20260709 13:20:03.689100 18242 rpcz_store.cc:276] 0709 13:20:02.550753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.551090 (+   337us) service_pool.cc:224] Handling call
0709 13:20:03.688591 (+1137501us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:03.520718 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:03.521297 (+   579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:03.521340 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:20:03.521361 (+    21us) tablet.cc:662] Decoding operations
0709 13:20:03.521726 (+   365us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:03.521803 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:03.521837 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:20:03.522072 (+   235us) tablet.cc:701] Row locks acquired
0709 13:20:03.522090 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:20:03.522230 (+   140us) write_op.cc:270] Start()
0709 13:20:03.522411 (+   181us) write_op.cc:276] Timestamp: P: 1783603203522186 usec, L: 0
0709 13:20:03.522436 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:20:03.523139 (+   703us) log.cc:844] Serialized 533 byte log entry
0709 13:20:03.526355 (+  3216us) op_driver.cc:464] REPLICATION: finished
0709 13:20:03.527606 (+  1251us) write_op.cc:301] APPLY: starting
0709 13:20:03.527695 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:03.528528 (+   833us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:03.528612 (+    84us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:03.529395 (+   783us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:03.529546 (+   151us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:20:03.529592 (+    46us) write_op.cc:312] APPLY: finished
0709 13:20:03.529806 (+   214us) log.cc:844] Serialized 25 byte log entry
0709 13:20:03.538031 (+  8225us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:03.538107 (+    76us) write_op.cc:454] Released schema lock
0709 13:20:03.538144 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:03.538545 (+   401us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:03.538574 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":16380,"mutex_wait_us":2728,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":1008,"apply.run_cpu_time_us":2851,"apply.run_wall_time_us":10862,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4166,"num_ops":1,"prepare.queue_time_us":5218,"prepare.run_cpu_time_us":2718,"prepare.run_wall_time_us":2730,"replication_time_us":3803,"spinlock_wait_cycles":32640}]]}
W20260709 13:20:03.758111 18228 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 02f16ac6b95a48868f83cdf22debb207 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer d03b672b2ff044b8bc2a0dfd8180ee19 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 14 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:03.761448 18328 tablet_service.cc:1558] Processing DeleteTablet for tablet b345033a56994fff90990b7d03324074 with delete_type TABLET_DATA_TOMBSTONED (TS d03b672b2ff044b8bc2a0dfd8180ee19 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:47610
I20260709 13:20:03.783635 18237 catalog_manager.cc:5697] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 20 to 21, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 21 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:03.785655 18237 catalog_manager.cc:5697] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 19 to 20, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 20 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:03.787058 25083 tablet_replica.cc:333] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:03.792101 25037 raft_consensus.cc:993] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:03.792878 25049 raft_consensus.cc:1081] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:03.794678 18488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:20:03.795192 18488 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:03.795573 18488 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.808871 18488 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:03.810899 18488 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:03.814648 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:03.815310 18419 raft_consensus.cc:3055] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:03.815470 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41082fa41d05470eb1937d1997399fa4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:03.815634 18419 raft_consensus.cc:740] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:03.816262 19054 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.817185 25083 raft_consensus.cc:2243] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.816817 18419 consensus_queue.cc:260] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:03.817889 25083 raft_consensus.cc:2272] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.818646 18419 raft_consensus.cc:3060] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.832907 19054 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:20:03.835728 18458 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:03.837689 25073 raft_consensus.cc:2804] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:03.838375 25073 raft_consensus.cc:697] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:03.839457 25073 consensus_queue.cc:237] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:03.840046 25083 ts_tablet_manager.cc:1916] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:03.854204 18419 raft_consensus.cc:2468] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:20:03.872072 18237 catalog_manager.cc:5697] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 15 to 16, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 16 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:03.878316 19060 consensus_queue.cc:237] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:03.885492 25049 raft_consensus.cc:993] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:03.886032 25063 raft_consensus.cc:1081] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:03.887955 18488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:55650
I20260709 13:20:03.888538 18488 raft_consensus.cc:493] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:03.888885 18488 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:03.897531 18488 raft_consensus.cc:515] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:03.939613 18339 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:03.939502 18493 raft_consensus.cc:1275] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:03.941668 25083 ts_tablet_manager.cc:1929] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:20:03.941828 25055 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:03.942299 25083 log.cc:1199] T b345033a56994fff90990b7d03324074 P d03b672b2ff044b8bc2a0dfd8180ee19: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/wals/b345033a56994fff90990b7d03324074
I20260709 13:20:03.942940 25069 consensus_queue.cc:1048] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:03.945075 18228 catalog_manager.cc:5028] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): tablet b345033a56994fff90990b7d03324074 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:20:03.946591 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:20:03.947237 18339 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:03.948547 18419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5da9c99398d461ba6b04325cb5faf48" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:03.949115 18419 raft_consensus.cc:3055] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:03.949406 18419 raft_consensus.cc:740] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:03.950169 18419 consensus_queue.cc:260] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:03.951184 18419 raft_consensus.cc:3060] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:03.954038 18339 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:20:03.955293 18458 leader_election.cc:304] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:20:03.956107 25073 raft_consensus.cc:2804] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:03.956648 25073 raft_consensus.cc:697] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:03.957607 25073 consensus_queue.cc:237] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:03.946774 18488 leader_election.cc:290] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:03.966009 25069 raft_consensus.cc:993] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:03.966533 25058 raft_consensus.cc:1081] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:03.967383 18412 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:03.968469 18491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:35114
I20260709 13:20:03.969079 18491 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:03.969485 18491 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:03.969684 25043 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:03.977279 18491 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:03.986490 18419 raft_consensus.cc:2468] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:20:03.994391 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:03.995021 19060 raft_consensus.cc:3055] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:03.995342 19060 raft_consensus.cc:740] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:03.996132 19060 consensus_queue.cc:260] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:03.997325 19060 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:03.998248 18339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb1497b39de4cbbaf75d8c82f903278" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:20:03.998905 18339 raft_consensus.cc:3060] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.002476 18491 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:04.009824 18237 catalog_manager.cc:5697] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 14 to 15, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 15 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:04.018893 24974 raft_consensus.cc:2955] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 7 to 14, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:04.029695 18342 raft_consensus.cc:2955] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 7 to 14, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:04.040658 18488 raft_consensus.cc:2955] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 7 to 14, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:04.053575 18339 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:20:04.069196 19060 raft_consensus.cc:2468] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 12.
I20260709 13:20:04.070574 18458 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:04.071506 25043 raft_consensus.cc:2804] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:04.071977 25043 raft_consensus.cc:697] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:04.072805 25043 consensus_queue.cc:237] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:04.085628 18237 catalog_manager.cc:5697] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 7 to 14, VOTER 20e06cff39b649c48d342b7431135303 (127.16.211.2) evicted. New cstate: current_term: 21 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:04.124912 18242 catalog_manager.cc:5697] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 11 to 12, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 12 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:04.163856 18400 tablet_service.cc:1558] Processing DeleteTablet for tablet bb654ec8beb54a539b5b6b44aa5181c3 with delete_type TABLET_DATA_TOMBSTONED (TS 20e06cff39b649c48d342b7431135303 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:59638
I20260709 13:20:04.189811 18339 raft_consensus.cc:1275] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:20:04.198210 25093 log.cc:927] Time spent T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:20:04.201030 25096 tablet_replica.cc:333] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:04.202343 25096 raft_consensus.cc:2243] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.203055 25096 raft_consensus.cc:2272] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.206331 25096 ts_tablet_manager.cc:1916] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:04.214267 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb654ec8beb54a539b5b6b44aa5181c3 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:04.223783 18339 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:04.226541 25043 consensus_queue.cc:1048] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:04.235282 25043 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:04.235620 18412 raft_consensus.cc:1275] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:04.246349 25043 consensus_queue.cc:1048] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:04.305124 18417 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:04.317241 25043 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:04.307082 25096 ts_tablet_manager.cc:1929] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.13
I20260709 13:20:04.319226 25096 log.cc:1199] T bb654ec8beb54a539b5b6b44aa5181c3 P 20e06cff39b649c48d342b7431135303: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/wals/bb654ec8beb54a539b5b6b44aa5181c3
I20260709 13:20:04.321321 18227 catalog_manager.cc:5028] TS 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): tablet bb654ec8beb54a539b5b6b44aa5181c3 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:20:04.379751 19057 raft_consensus.cc:1275] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:04.380245 19060 consensus_queue.cc:237] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:04.381330 25035 consensus_queue.cc:1048] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:04.429844 18417 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:04.431313 24974 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:04.464478 18339 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:04.473856 25073 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:04.477676 18339 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:04.482751 25073 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:04.514420 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:04.518589 18417 raft_consensus.cc:1275] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:04.521469 25092 consensus_queue.cc:1048] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:04.526165 25055 raft_consensus.cc:2955] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 5 to 11, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:04.553861 19057 raft_consensus.cc:1275] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:04.573323 25073 consensus_queue.cc:1048] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:04.580317 18412 raft_consensus.cc:2955] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 5 to 11, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:04.666671 18339 raft_consensus.cc:1275] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:04.668310 25058 consensus_queue.cc:1048] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:04.702188 18339 raft_consensus.cc:2955] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 5 to 11, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:04.727272 18228 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b12e68055d54f32b4b3e7d0d0c76af4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
W20260709 13:20:04.794610 25111 log.cc:927] Time spent T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:20:04.781423 18228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 60404.9us
I20260709 13:20:04.821725 18237 catalog_manager.cc:5697] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 reported cstate change: config changed from index 5 to 11, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 15 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:20:04.842116 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 81582us
I20260709 13:20:05.009084 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b12e68055d54f32b4b3e7d0d0c76af4 with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55634
I20260709 13:20:05.037570 25131 tablet_replica.cc:333] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:05.113214 25131 raft_consensus.cc:2243] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:05.113867 25131 raft_consensus.cc:2272] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:05.116963 25131 ts_tablet_manager.cc:1916] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:05.191275 25131 ts_tablet_manager.cc:1929] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:20:05.194118 25131 log.cc:1199] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/2b12e68055d54f32b4b3e7d0d0c76af4
I20260709 13:20:05.196228 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet 2b12e68055d54f32b4b3e7d0d0c76af4 (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:20:05.222640 18417 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
W20260709 13:20:05.240700 18384 consensus_peers.cc:597] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 -> Peer 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): Couldn't send request to peer 31ab487dc52e4f608b39df0fae2fdfa5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4139afe4ea2b4938821aa26d4c12e6ab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:05.243654 18486 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:05.257601 25114 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:20:05.295010 18339 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:05.297662 25037 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:05.317672 25063 raft_consensus.cc:2955] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:20:05.326241 18491 raft_consensus.cc:2955] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:20:05.349545 18234 catalog_manager.cc:5697] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: config changed from index -1 to 11, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New cstate: current_term: 17 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:20:05.368710 18337 raft_consensus.cc:2955] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } } }
I20260709 13:20:05.738974 25137 ts_tablet_manager.cc:933] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5: Initiating tablet copy from peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:05.741415 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:05.796231 25137 tablet_copy_client.cc:323] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.211.2:42251
I20260709 13:20:05.835125 18427 tablet_copy_service.cc:140] P 20e06cff39b649c48d342b7431135303: Received BeginTabletCopySession request for tablet 4139afe4ea2b4938821aa26d4c12e6ab from peer 31ab487dc52e4f608b39df0fae2fdfa5 ({username='slave'} at 127.0.0.1:44916)
I20260709 13:20:05.835978 18427 tablet_copy_service.cc:161] P 20e06cff39b649c48d342b7431135303: Beginning new tablet copy session on tablet 4139afe4ea2b4938821aa26d4c12e6ab from peer 31ab487dc52e4f608b39df0fae2fdfa5 at {username='slave'} at 127.0.0.1:44916: session id = 31ab487dc52e4f608b39df0fae2fdfa5-4139afe4ea2b4938821aa26d4c12e6ab
I20260709 13:20:05.844892 18427 tablet_copy_source_session.cc:215] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:05.858916 19061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:20:05.859651 19061 raft_consensus.cc:606] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:05.864776 19061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:20:05.865339 19061 raft_consensus.cc:606] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
W20260709 13:20:05.865806 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 49255.8us
I20260709 13:20:05.887910 25137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4139afe4ea2b4938821aa26d4c12e6ab. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:20:05.911624 18228 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 02f16ac6b95a48868f83cdf22debb207 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer d03b672b2ff044b8bc2a0dfd8180ee19 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 14 leader_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:20:05.929644 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 52694.1us
I20260709 13:20:05.933398 19060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:20:05.934027 19060 raft_consensus.cc:606] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:05.939213 19060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3"
dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
mode: GRACEFUL
new_leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:53696
I20260709 13:20:05.939877 19060 raft_consensus.cc:606] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Received request to transfer leadership to TS 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:20:05.946730 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 68114.2us
I20260709 13:20:05.949331 18342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79"
dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
mode: GRACEFUL
new_leader_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:43634
I20260709 13:20:05.950031 18342 raft_consensus.cc:606] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Received request to transfer leadership to TS 20e06cff39b649c48d342b7431135303
I20260709 13:20:05.951496 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:05.953437 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:05.973588 25137 tablet_copy_client.cc:806] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:05.974371 25137 tablet_copy_client.cc:670] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:05.979672 25137 tablet_copy_client.cc:538] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:06.018947 25137 tablet_bootstrap.cc:492] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap starting.
I20260709 13:20:06.034082 25140 raft_consensus.cc:993] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:06.034722 25142 raft_consensus.cc:1081] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:06.046964 18491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:35114
I20260709 13:20:06.047592 18491 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:06.047942 18491 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:06.068326 18491 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:06.078866 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:20:06.079532 18342 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:06.087193 18342 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:20:06.088865 18458 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:20:06.089756 25127 raft_consensus.cc:2804] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:06.090302 25127 raft_consensus.cc:697] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:06.091182 25127 consensus_queue.cc:237] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:06.099822 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b2a2d7b65c646deb16cdddec208645e" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:06.100508 19061 raft_consensus.cc:3055] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:06.100841 19061 raft_consensus.cc:740] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:06.101627 19061 consensus_queue.cc:260] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:06.102854 19061 raft_consensus.cc:3060] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:06.108640 25120 raft_consensus.cc:993] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:20:06.109226 25120 raft_consensus.cc:1081] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:20:06.112541 18417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:34462
I20260709 13:20:06.113132 18417 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:06.113585 18417 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.098475 18491 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:06.131657 19061 raft_consensus.cc:2468] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:20:06.129143 18417 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:06.141755 18417 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:06.143064 18342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:20:06.143692 18342 raft_consensus.cc:3055] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:06.144182 18342 raft_consensus.cc:740] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d03b672b2ff044b8bc2a0dfd8180ee19, State: Running, Role: LEADER
I20260709 13:20:06.144296 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a6e60961c64b469cf1a97767887e79" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:06.145236 18491 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.146477 18342 consensus_queue.cc:260] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:06.147851 18342 raft_consensus.cc:3060] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.162640 18342 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:20:06.164031 18384 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19; no voters: 
I20260709 13:20:06.164616 18491 raft_consensus.cc:2468] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 16.
I20260709 13:20:06.165179 25037 raft_consensus.cc:2804] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:06.165720 25037 raft_consensus.cc:697] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:06.166586 25037 consensus_queue.cc:237] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:06.176429 18236 catalog_manager.cc:5697] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 12 to 13, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 13 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.207249 25140 raft_consensus.cc:993] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:06.207801 25141 raft_consensus.cc:1081] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:06.210116 18486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:35114
I20260709 13:20:06.210745 18486 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:06.211081 18486 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.217518 18242 catalog_manager.cc:5697] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 15 to 16, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 16 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.228246 25140 raft_consensus.cc:993] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: : Instructing follower 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:20:06.228782 25112 raft_consensus.cc:1081] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Signalling peer 20e06cff39b649c48d342b7431135303 to start an election
I20260709 13:20:06.231763 18417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4"
dest_uuid: "20e06cff39b649c48d342b7431135303"
 from {username='slave'} at 127.0.0.1:44916
I20260709 13:20:06.232369 18417 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:06.232790 18417 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.249265 18417 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:06.232429 18486 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:06.274588 18337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19"
I20260709 13:20:06.275205 18337 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.285975 18486 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:06.288074 18417 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:06.290189 25137 tablet_bootstrap.cc:492] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:06.291443 25137 tablet_bootstrap.cc:492] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5: Bootstrap complete.
I20260709 13:20:06.292301 25137 ts_tablet_manager.cc:1403] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent bootstrapping tablet: real 0.274s	user 0.044s	sys 0.013s
I20260709 13:20:06.296031 25137 raft_consensus.cc:359] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:20:06.296777 25112 raft_consensus.cc:993] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: : Instructing follower 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:06.297065 25137 raft_consensus.cc:740] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Initialized, Role: LEARNER
I20260709 13:20:06.297683 25140 raft_consensus.cc:1081] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 LEADER]: Signalling peer 9d6cd7c600ec4ab2b5cac479f05d4c0f to start an election
I20260709 13:20:06.299922 18491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b"
dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
 from {username='slave'} at 127.0.0.1:35114
I20260709 13:20:06.300684 18491 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:06.301151 18491 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:06.303011 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:06.303858 18486 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.314074 25137 consensus_queue.cc:260] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: NON_VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: true } }
I20260709 13:20:06.317893 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f8c1407aa1e47808dbc2b1bc02c81a3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:06.318238 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:06.318578 19061 raft_consensus.cc:3055] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:06.318854 19060 raft_consensus.cc:3055] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:06.318946 19061 raft_consensus.cc:740] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:06.319268 19060 raft_consensus.cc:740] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:06.319888 19061 consensus_queue.cc:260] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:06.320057 19060 consensus_queue.cc:260] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:06.321338 19061 raft_consensus.cc:3060] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.321370 19060 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.334013 25137 ts_tablet_manager.cc:1434] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 13:20:06.337357 19060 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:20:06.346148 19061 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:20:06.347956 18427 tablet_copy_service.cc:342] P 20e06cff39b649c48d342b7431135303: Request end of tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-4139afe4ea2b4938821aa26d4c12e6ab received from {username='slave'} at 127.0.0.1:44916
I20260709 13:20:06.348577 18427 tablet_copy_service.cc:434] P 20e06cff39b649c48d342b7431135303: ending tablet copy session 31ab487dc52e4f608b39df0fae2fdfa5-4139afe4ea2b4938821aa26d4c12e6ab on tablet 4139afe4ea2b4938821aa26d4c12e6ab with peer 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:20:06.375080 18491 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:06.380394 18458 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:06.386487 25128 raft_consensus.cc:2804] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:06.387221 25128 raft_consensus.cc:697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:06.388077 18491 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 21 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:06.388432 25128 consensus_queue.cc:237] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:06.393534 18384 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:20:06.407639 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:06.407955 25121 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:06.408263 18417 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:06.419301 18417 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 21.
W20260709 13:20:06.440048 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 60092.7us
I20260709 13:20:06.462544 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d61c75b589420ab4319c7a05b2b72b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:06.463197 19060 raft_consensus.cc:3055] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:06.463505 19060 raft_consensus.cc:740] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:06.464322 19060 consensus_queue.cc:260] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:06.465633 19060 raft_consensus.cc:3060] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:06.467620 18457 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:06.470877 25144 raft_consensus.cc:2804] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:06.475308 19060 raft_consensus.cc:2468] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 21.
I20260709 13:20:06.492903 25144 raft_consensus.cc:697] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:06.494592 25144 consensus_queue.cc:237] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:06.515722 18486 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
W20260709 13:20:06.519281 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 156584us
I20260709 13:20:06.521144 25121 raft_consensus.cc:697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:06.522138 25121 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:06.537603 18337 raft_consensus.cc:2468] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:20:06.576355 19054 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:06.580351 25155 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:06.584491 18337 raft_consensus.cc:1275] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:06.591012 25144 consensus_queue.cc:1048] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:06.609776 18488 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:06.617700 25121 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:20:06.697592 19060 raft_consensus.cc:1217] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:20:06.733430 18342 raft_consensus.cc:1275] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:06.751492 18236 catalog_manager.cc:5697] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 15 to 16, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 16 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.760926 18236 catalog_manager.cc:5697] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 20 to 21, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 21 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.773507 18237 catalog_manager.cc:5697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 13 to 14, leader changed from 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 14 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.893262 25167 consensus_queue.cc:1048] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:06.942090 19054 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:06.943650 25153 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:06.954416 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:06.968621 18309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 63702us
W20260709 13:20:07.021844 18307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 114384us
I20260709 13:20:07.035671 18417 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:20:07.040362 18339 raft_consensus.cc:1275] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:07.047693 18486 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:07.045240 25155 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 13:20:07.053630 25150 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:07.064985 19060 raft_consensus.cc:1275] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:20:07.067301 25155 consensus_queue.cc:1048] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:07.068943 25144 consensus_queue.cc:1048] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:07.092527 19054 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:07.100653 25150 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:07.123919 25037 raft_consensus.cc:1064] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: attempting to promote NON_VOTER 31ab487dc52e4f608b39df0fae2fdfa5 to VOTER
I20260709 13:20:07.132676 25037 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:07.363870 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 77174.4us
I20260709 13:20:07.392830 18491 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:07.395740 25150 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:07.463356 19054 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEARNER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:20:07.519196 19027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:37809, user_credentials={real_user=slave}} blocked reactor thread for 52070.8us
I20260709 13:20:07.542120 18339 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:07.543608 25037 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:07.574873 25187 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:07.583272 25183 raft_consensus.cc:2955] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:07.590970 18337 raft_consensus.cc:2955] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:07.637480 18486 raft_consensus.cc:2955] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:07.643748 18236 catalog_manager.cc:5697] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 reported cstate change: config changed from index 11 to 12, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:07.720072 19055 raft_consensus.cc:2955] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
W20260709 13:20:07.776306 18308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 69362.8us
I20260709 13:20:08.207502 18417 consensus_queue.cc:237] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:08.219048 19057 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:08.221428 25192 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:08.228742 18337 raft_consensus.cc:1275] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:08.234112 25037 raft_consensus.cc:2955] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:08.235852 25187 consensus_queue.cc:1048] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:08.236119 19057 raft_consensus.cc:2955] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:08.243970 18337 raft_consensus.cc:2955] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:08.260185 18242 catalog_manager.cc:5697] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: config changed from index 12 to 13, VOTER 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3) evicted. New cstate: current_term: 17 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } }
I20260709 13:20:08.269236 18227 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4139afe4ea2b4938821aa26d4c12e6ab with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:08.313097 18479 tablet_service.cc:1558] Processing DeleteTablet for tablet 4139afe4ea2b4938821aa26d4c12e6ab with delete_type TABLET_DATA_TOMBSTONED (TS 9d6cd7c600ec4ab2b5cac479f05d4c0f not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:55634
I20260709 13:20:08.323846 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:08.344013 25204 tablet_replica.cc:333] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:08.391031 25204 raft_consensus.cc:2243] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:08.392072 25204 raft_consensus.cc:2272] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:08.396329 25204 ts_tablet_manager.cc:1916] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:08.478418 25204 ts_tablet_manager.cc:1929] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 13:20:08.478941 25204 log.cc:1199] T 4139afe4ea2b4938821aa26d4c12e6ab P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Deleting WAL directory at /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/wals/4139afe4ea2b4938821aa26d4c12e6ab
I20260709 13:20:08.488528 18226 catalog_manager.cc:5028] TS 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): tablet 4139afe4ea2b4938821aa26d4c12e6ab (table test-workload [id=bd0ea25089a54c03b540612819c80898]) successfully deleted
I20260709 13:20:08.547196 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:20:08.559423 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:09.560508 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:09.654831 17228 tablet_server.cc:179] TabletServer@127.16.211.1:0 shutting down...
W20260709 13:20:09.670575 18384 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:09.702775 18384 consensus_peers.cc:597] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.706790 18458 consensus_peers.cc:597] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.753965 19027 consensus_peers.cc:597] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.754786 19027 consensus_peers.cc:597] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.780766 18458 consensus_peers.cc:597] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.795885 19027 consensus_peers.cc:597] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.797465 19027 consensus_peers.cc:597] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.813799 18458 consensus_peers.cc:597] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.822552 19027 consensus_peers.cc:597] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.824736 19027 consensus_peers.cc:597] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.866240 18384 consensus_peers.cc:597] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:09.867039 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:09.869562 17228 tablet_replica.cc:333] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:09.870669 17228 raft_consensus.cc:2243] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.883249 17228 raft_consensus.cc:2272] T 5069a3aa86984fcd93f4fb63a92ef8cd P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:09.885005 19027 consensus_peers.cc:597] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:09.893143 17228 tablet_replica.cc:333] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:09.894383 17228 raft_consensus.cc:2243] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.895388 17228 raft_consensus.cc:2272] T f1a6e60961c64b469cf1a97767887e79 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:09.898110 19027 consensus_peers.cc:597] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:09.912298 17228 tablet_replica.cc:333] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:09.913431 17228 raft_consensus.cc:2243] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.914330 17228 raft_consensus.cc:2272] T 97efddba551a406f8d4427488fc22c5c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.917367 17228 tablet_replica.cc:333] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:09.926241 17228 raft_consensus.cc:2243] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.927217 17228 raft_consensus.cc:2272] T b1734a6c318d4e6ba6b65fd828d4fe66 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.939328 17228 tablet_replica.cc:333] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:09.946663 17228 raft_consensus.cc:2243] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.947796 17228 raft_consensus.cc:2272] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:09.950199 18458 consensus_peers.cc:597] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:09.950928 17228 tablet_replica.cc:333] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:09.951970 17228 raft_consensus.cc:2243] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.953169 17228 raft_consensus.cc:2272] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:09.941195 19027 consensus_peers.cc:597] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.969046 19027 consensus_peers.cc:597] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.971623 19027 consensus_peers.cc:597] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:09.974159 18458 consensus_peers.cc:597] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:09.975932 17228 tablet_replica.cc:333] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
W20260709 13:20:09.988638 19027 consensus_peers.cc:597] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:09.989322 17228 raft_consensus.cc:2243] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.990264 17228 raft_consensus.cc:2272] T 66d70af6941f4d469682dabf08926fc9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.995155 17228 tablet_replica.cc:333] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:09.998633 17228 raft_consensus.cc:2243] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.999858 17228 raft_consensus.cc:2272] T ac1699feafbd4621b7b7a28933b59fec P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:10.002439 18384 consensus_peers.cc:597] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:10.021015 18458 consensus_peers.cc:597] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:10.023029 18458 consensus_peers.cc:597] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:10.024605 17228 tablet_replica.cc:333] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.032922 17228 raft_consensus.cc:2243] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.038375 17228 raft_consensus.cc:2272] T 06fc3d36b088480ab5fb6ac2a5600252 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:10.048741 19027 consensus_peers.cc:597] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:10.049453 19027 consensus_peers.cc:597] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:10.051491 17228 tablet_replica.cc:333] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.052722 17228 raft_consensus.cc:2243] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.053669 17228 raft_consensus.cc:2272] T c860bd12a6124270ba17146fea662e3b P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:10.056048 18228 catalog_manager.cc:4755] TS d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): ChangeConfig:REMOVE_PEER RPC failed for tablet 02f16ac6b95a48868f83cdf22debb207: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:10.059458 17228 tablet_replica.cc:333] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
W20260709 13:20:10.074489 18458 consensus_peers.cc:597] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:10.074676 17228 raft_consensus.cc:2243] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.075659 17228 raft_consensus.cc:2272] T d4511f72b2b34e4d82124396a41054ca P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:10.079568 19027 consensus_peers.cc:597] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:10.085258 17228 tablet_replica.cc:333] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.086314 17228 raft_consensus.cc:2243] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.090358 17228 raft_consensus.cc:2272] T 64f9a8403ec74b85bc4a3ff12e5f686a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.093536 17228 tablet_replica.cc:333] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
W20260709 13:20:10.097461 18384 consensus_peers.cc:597] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:10.098930 17228 raft_consensus.cc:2243] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:20:10.099956 18458 consensus_peers.cc:597] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:10.107838 17228 raft_consensus.cc:2272] T fe80371fdcc94f38a7f06b90e411d03c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.110843 17228 tablet_replica.cc:333] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.118625 17228 raft_consensus.cc:2243] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.119542 17228 raft_consensus.cc:2272] T 4139afe4ea2b4938821aa26d4c12e6ab P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:10.121047 18384 consensus_peers.cc:597] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:10.123786 17228 tablet_replica.cc:333] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.127771 17228 raft_consensus.cc:2243] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:10.131067 17228 raft_consensus.cc:2272] T fcca3d62b9ee4ee98c16e7e079d076b7 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:10.141127 18384 consensus_peers.cc:597] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:10.149609 17228 tablet_replica.cc:333] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.150754 17228 raft_consensus.cc:2243] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.156257 17228 raft_consensus.cc:2272] T b8b55a3ba07d4097b2da619afcf80e3f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.159574 17228 tablet_replica.cc:333] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.164472 17228 raft_consensus.cc:2243] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.167315 17228 raft_consensus.cc:2272] T 21b9264b0a434b79b6292c2ed23bbae0 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.175806 17228 tablet_replica.cc:333] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.186611 17228 raft_consensus.cc:2243] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.187357 17228 raft_consensus.cc:2272] T beb1497b39de4cbbaf75d8c82f903278 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.192233 17228 tablet_replica.cc:333] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.198629 17228 raft_consensus.cc:2243] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:20:10.200198 17228 raft_consensus.cc:2272] T b532a06bf55a4b9b892b97bd8376715a P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.203974 17228 tablet_replica.cc:333] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.204865 17228 raft_consensus.cc:2243] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.214079 17228 raft_consensus.cc:2272] T 3b2a2d7b65c646deb16cdddec208645e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.217569 17228 tablet_replica.cc:333] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.219803 17228 raft_consensus.cc:2243] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:20:10.221055 17228 raft_consensus.cc:2272] T 218ede86207640ab99622c70bae54d07 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.223939 17228 tablet_replica.cc:333] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.224809 17228 raft_consensus.cc:2243] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.225497 17228 raft_consensus.cc:2272] T 132f50d25c404b83b0bafe5445c572e9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.240370 17228 tablet_replica.cc:333] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.241204 17228 raft_consensus.cc:2243] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:20:10.242449 17228 raft_consensus.cc:2272] T bf69de9977524f43803f402f2cfed3d4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.264793 17228 tablet_replica.cc:333] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.283739 17228 raft_consensus.cc:2243] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.284472 17228 raft_consensus.cc:2272] T b972754511104f898e9cbc171aa6c170 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.298316 17228 tablet_replica.cc:333] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.299126 17228 raft_consensus.cc:2243] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.300007 17228 raft_consensus.cc:2272] T 88ca5739563d4349a7b7a6c70d81e653 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.303922 17228 tablet_replica.cc:333] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.304634 17228 raft_consensus.cc:2243] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:20:10.305733 17228 raft_consensus.cc:2272] T 839ba6300c764efc8e880c80a27079b2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.308872 17228 tablet_replica.cc:333] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.309581 17228 raft_consensus.cc:2243] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.310897 17228 raft_consensus.cc:2272] T bb654ec8beb54a539b5b6b44aa5181c3 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.313758 17228 tablet_replica.cc:333] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.327509 17228 raft_consensus.cc:2243] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.328943 17228 raft_consensus.cc:2272] T 2b12e68055d54f32b4b3e7d0d0c76af4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.339993 17228 tablet_replica.cc:333] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.340881 17228 raft_consensus.cc:2243] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.341717 17228 raft_consensus.cc:2272] T 04eef32e6eb14221811a03f4940ae121 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.344487 17228 tablet_replica.cc:333] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.345346 17228 raft_consensus.cc:2243] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:10.350349 17228 raft_consensus.cc:2272] T f99562a3c70c43d2b33161d483871d6c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.368577 17228 tablet_replica.cc:333] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.369463 17228 raft_consensus.cc:2243] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:10.370671 17228 raft_consensus.cc:2272] T 9088f88404fe42cd909dc0c66c1c0c17 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.374032 17228 tablet_replica.cc:333] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.374995 17228 raft_consensus.cc:2243] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:10.376127 17228 raft_consensus.cc:2272] T 8b55cf48798a4468ae4b6aa4a26a477f P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.379169 17228 tablet_replica.cc:333] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.379966 17228 raft_consensus.cc:2243] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.380733 17228 raft_consensus.cc:2272] T 6419a332888d490f92e43b717ff1edd4 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.397642 17228 tablet_replica.cc:333] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.398524 17228 raft_consensus.cc:2243] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.399179 17228 raft_consensus.cc:2272] T 11ec555240a9486fad41ffb02e94fd9c P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.402559 17228 tablet_replica.cc:333] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.403352 17228 raft_consensus.cc:2243] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.403949 17228 raft_consensus.cc:2272] T e1bc6fb6380b4ad7b0907976d075d20e P d03b672b2ff044b8bc2a0dfd8180ee19 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.406747 17228 tablet_replica.cc:333] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.418382 17228 raft_consensus.cc:2243] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.419247 17228 raft_consensus.cc:2272] T 36dd573a999e4211a80fa3aeb1b2dbd2 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.422259 17228 tablet_replica.cc:333] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.423096 17228 raft_consensus.cc:2243] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.423699 17228 raft_consensus.cc:2272] T 1f56f24cb8c042b4bbdc442e02acaefc P d03b672b2ff044b8bc2a0dfd8180ee19 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.440306 17228 tablet_replica.cc:333] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.441179 17228 raft_consensus.cc:2243] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:10.442395 17228 raft_consensus.cc:2272] T 02f16ac6b95a48868f83cdf22debb207 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.445194 17228 tablet_replica.cc:333] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.445948 17228 raft_consensus.cc:2243] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.446517 17228 raft_consensus.cc:2272] T b1c3d9691e854ee98b2b7d81f868c727 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.484803 17228 tablet_replica.cc:333] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.485654 17228 raft_consensus.cc:2243] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:10.486864 17228 raft_consensus.cc:2272] T 9560de944c37467eb1e18d5627ed0fd9 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.493949 17228 tablet_replica.cc:333] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.494709 17228 raft_consensus.cc:2243] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.495309 17228 raft_consensus.cc:2272] T f5da9c99398d461ba6b04325cb5faf48 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.510690 17228 tablet_replica.cc:333] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.517791 17228 raft_consensus.cc:2243] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.518649 17228 raft_consensus.cc:2272] T f0f6372354b84d0ea884a3478b3dfd98 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.521693 17228 tablet_replica.cc:333] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.530483 17228 raft_consensus.cc:2243] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:10.531689 17228 raft_consensus.cc:2272] T 069e2e1b4c714f01a2bc3ad59e3618f1 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.534471 17228 tablet_replica.cc:333] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.535132 17228 raft_consensus.cc:2243] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.545827 17228 raft_consensus.cc:2272] T c88b963fb1b740418ee335cb0fe83049 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:10.548734 17228 tablet_replica.cc:333] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19: stopping tablet replica
I20260709 13:20:10.549474 17228 raft_consensus.cc:2243] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:10.550115 17228 raft_consensus.cc:2272] T f9e75d2ac4114e428bf95ddfa6245037 P d03b672b2ff044b8bc2a0dfd8180ee19 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:11.008646 25212 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.009279 25212 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.011992 25212 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:11.027393 25190 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.028051 25190 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.031481 25190 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:11.037936 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:11.039866 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
W20260709 13:20:11.045821 18384 leader_election.cc:336] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.046782 18384 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:11.045815 18458 leader_election.cc:336] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.049626 18457 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.051918 25190 raft_consensus.cc:2749] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:11.054180 25212 raft_consensus.cc:2749] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:11.060272 25212 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.060868 25212 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.064728 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:11.065438 18486 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:20:11.067113 18382 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:11.068390 25214 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:11.068799 25214 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.069156 25214 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.074235 25212 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:11.104626 25214 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.108428 25211 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.109150 25211 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.111466 25211 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:11.115795 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5069a3aa86984fcd93f4fb63a92ef8cd" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:11.116457 18486 raft_consensus.cc:3060] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.124958 18486 raft_consensus.cc:2468] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:20:11.130195 18382 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:11.131479 25212 raft_consensus.cc:2804] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:11.133762 25212 raft_consensus.cc:697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:11.132606 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:11.134728 25212 consensus_queue.cc:237] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.130357 25214 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:11.133184 18384 leader_election.cc:336] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:11.147763 18458 leader_election.cc:336] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.158483 18458 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:11.152164 18384 leader_election.cc:336] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.160053 25190 raft_consensus.cc:2749] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:11.170396 25206 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.171016 25206 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.173312 25206 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:11.177279 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:20:11.177953 18416 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 18.
I20260709 13:20:11.179697 19026 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:20:11.183928 25182 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:11.184355 25182 raft_consensus.cc:493] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.184710 25182 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.188055 18242 catalog_manager.cc:5697] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 13 to 14, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 14 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:11.195753 19027 leader_election.cc:336] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.229446 25182 raft_consensus.cc:515] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.233757 25206 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.241212 25206 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.244997 25206 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:11.250758 19027 leader_election.cc:336] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:11.252344 19027 leader_election.cc:336] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.254312 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1699feafbd4621b7b7a28933b59fec" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:11.254925 18416 raft_consensus.cc:3060] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.261037 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:11.264317 18416 raft_consensus.cc:2468] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:20:11.265980 25212 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.266031 19025 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.270354 25211 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.270857 25206 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:11.270911 25211 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.271260 25212 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.273518 25212 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:11.274941 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
W20260709 13:20:11.278393 18458 leader_election.cc:336] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.279536 25211 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:20:11.279807 18384 leader_election.cc:336] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.280447 18384 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.281490 25214 raft_consensus.cc:2749] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:11.282239 25182 leader_election.cc:290] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:11.285895 19061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:11.286713 19061 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:20:11.289526 25182 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.289741 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.291121 25211 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:11.291556 25211 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.291952 25211 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:11.298043 25182 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.303727 25182 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:11.306064 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:11.312018 19026 leader_election.cc:304] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.312669 18486 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 20.
I20260709 13:20:11.313294 25206 raft_consensus.cc:2804] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:11.313863 25206 raft_consensus.cc:697] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:11.315177 25206 consensus_queue.cc:237] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.308765 25211 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:11.311754 19027 leader_election.cc:336] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.348469 19025 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.322738 25182 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.354689 25182 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.378172 25167 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.378814 25167 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.381314 25167 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:11.381906 25221 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:11.382397 25221 raft_consensus.cc:493] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.382748 25221 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:11.414919 18234 catalog_manager.cc:5697] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 18 to 19, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 19 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:11.424074 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcca3d62b9ee4ee98c16e7e079d076b7" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:11.419394 25211 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:11.427917 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:11.434494 19054 raft_consensus.cc:3060] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:11.437322 25219 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.438024 25219 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.450464 25182 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:11.453289 25231 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.454047 25231 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.456275 25231 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:11.450836 25219 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:11.470408 19054 raft_consensus.cc:2468] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
W20260709 13:20:11.474822 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 49331.8us
W20260709 13:20:11.475203 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 52762.1us
W20260709 13:20:11.483364 18458 leader_election.cc:336] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:11.484930 19027 leader_election.cc:336] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.489290 18458 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:11.495446 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 70043.3us
I20260709 13:20:11.507071 25221 raft_consensus.cc:515] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.511201 25228 raft_consensus.cc:2804] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:11.513856 18457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42251, user_credentials={real_user=slave}} blocked reactor thread for 88597.9us
W20260709 13:20:11.513495 19027 leader_election.cc:336] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:11.514024 18384 leader_election.cc:336] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.518270 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:11.517827 18384 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.519824 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:20:11.515700 25228 raft_consensus.cc:697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:11.522981 25228 consensus_queue.cc:237] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.525348 25236 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:20:11.527663 18458 leader_election.cc:336] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.531363 25226 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.531602 25167 raft_consensus.cc:2749] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:11.531960 25226 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.533838 25226 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:11.538754 18458 leader_election.cc:336] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.539091 25240 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.539286 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.540169 25240 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.541227 25238 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.541817 25238 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.543423 25240 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:11.544009 25238 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:11.541292 25229 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:11.547266 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:11.547825 19027 leader_election.cc:336] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.548010 25182 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:11.549755 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:20:11.550343 18417 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 18.
I20260709 13:20:11.552230 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.553375 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:11.553889 19054 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 22.
I20260709 13:20:11.555150 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:11.556488 25182 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:11.556905 25182 raft_consensus.cc:493] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.557255 25182 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.562085 25235 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.529774 25236 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.562686 25235 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.565237 25242 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:11.565428 25235 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:11.565745 25242 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.566195 25242 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:11.566555 25221 leader_election.cc:290] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:11.567221 25236 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:11.576812 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb2cd7aaa1d4bd3866023ef0cbae974" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:11.577435 18491 raft_consensus.cc:3060] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:11.577769 18458 leader_election.cc:336] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.578642 25242 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.585973 25242 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 23 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:11.587834 18416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:20:11.588425 18416 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 19.
I20260709 13:20:11.590215 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:20:11.590801 18417 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 13.
I20260709 13:20:11.592864 18491 raft_consensus.cc:2468] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 21.
I20260709 13:20:11.594874 19025 leader_election.cc:304] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:11.595809 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:11.596210 25219 raft_consensus.cc:2804] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:11.596508 18485 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
I20260709 13:20:11.596792 25219 raft_consensus.cc:697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:11.597802 25219 consensus_queue.cc:237] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.599201 18382 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:11.600024 25235 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:11.600394 25235 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.600746 25235 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.606418 18234 catalog_manager.cc:5697] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 17 to 18, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 18 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:11.608390 19027 leader_election.cc:336] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.608067 25235 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.611483 25235 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:11.612051 25235 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:20:11.612341 18384 consensus_peers.cc:597] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:11.612560 25235 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.614732 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55cf48798a4468ae4b6aa4a26a477f" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:11.620021 25228 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.624138 18485 raft_consensus.cc:3060] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.624576 18457 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.624241 25228 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.626664 25228 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:11.626864 25242 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:11.627278 25242 raft_consensus.cc:493] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.627628 25242 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:11.632946 18485 raft_consensus.cc:2468] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
I20260709 13:20:11.634449 18457 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.634924 18382 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:11.640575 25237 raft_consensus.cc:2804] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:11.641129 25237 raft_consensus.cc:697] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:11.641949 25237 consensus_queue.cc:237] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.624275 25182 raft_consensus.cc:515] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.635347 25242 raft_consensus.cc:515] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.636538 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:11.647634 19054 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 19.
I20260709 13:20:11.638126 25221 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.649660 25221 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.638717 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ba6300c764efc8e880c80a27079b2" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:11.646759 25228 raft_consensus.cc:2764] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:11.652442 19055 raft_consensus.cc:3060] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:11.657044 18458 leader_election.cc:336] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.658063 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:20:11.659818 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:11.635525 25235 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:11.661453 25237 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.662029 25237 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:20:11.663196 18384 leader_election.cc:336] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.664057 25237 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:11.662021 25221 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:11.665059 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:11.665706 18485 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 13.
W20260709 13:20:11.666589 18384 leader_election.cc:336] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.666805 18382 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:11.676996 25237 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:11.677488 25237 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
W20260709 13:20:11.677676 18458 leader_election.cc:336] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.672832 18234 catalog_manager.cc:5697] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 13 to 14, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 14 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.674734 18242 catalog_manager.cc:5697] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 20 to 21, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 21 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:11.677995 25237 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.680789 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe80371fdcc94f38a7f06b90e411d03c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:11.681350 18418 raft_consensus.cc:3060] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:11.667866 19055 raft_consensus.cc:2468] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 23.
I20260709 13:20:11.677018 25242 leader_election.cc:290] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:11.680040 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:20:11.687155 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218ede86207640ab99622c70bae54d07" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:11.687729 18417 raft_consensus.cc:3060] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.689939 25237 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.691146 18412 raft_consensus.cc:2393] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 14: Already voted for candidate 20e06cff39b649c48d342b7431135303 in this term.
I20260709 13:20:11.693809 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99562a3c70c43d2b33161d483871d6c" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:11.694473 18485 raft_consensus.cc:3060] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.694774 18417 raft_consensus.cc:2468] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:20:11.694931 18418 raft_consensus.cc:2468] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 20.
I20260709 13:20:11.694012 25182 leader_election.cc:290] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:11.693620 25237 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:11.705376 19026 leader_election.cc:304] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:20:11.718737 18458 leader_election.cc:336] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:11.726383 19027 leader_election.cc:336] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.727720 18458 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.714538 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.722098 25241 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.730268 25241 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.732352 25241 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:11.734038 25182 raft_consensus.cc:2804] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:11.734431 25237 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:11.734547 25182 raft_consensus.cc:697] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:11.734844 25237 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.735260 25237 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:11.735594 25182 consensus_queue.cc:237] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.739642 18486 raft_consensus.cc:1275] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:11.700783 18485 raft_consensus.cc:2468] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 14.
W20260709 13:20:11.741146 19027 leader_election.cc:336] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.705535 25167 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.742547 25228 raft_consensus.cc:2804] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:11.743856 25235 consensus_queue.cc:1048] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:11.744614 25167 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.746230 18382 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:11.746627 25167 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:11.747200 25167 raft_consensus.cc:2804] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:11.747646 25167 raft_consensus.cc:697] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:11.748461 25167 consensus_queue.cc:237] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.749325 18457 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.750361 18457 leader_election.cc:304] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.752027 25228 raft_consensus.cc:697] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 23 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:11.752641 25190 raft_consensus.cc:2749] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:11.752911 25228 consensus_queue.cc:237] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.753522 25190 raft_consensus.cc:2804] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:11.754123 25190 raft_consensus.cc:697] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:11.755105 25190 consensus_queue.cc:237] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:11.756263 19027 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.759012 25221 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:11.775213 25221 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.775944 25221 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:11.777619 18384 leader_election.cc:336] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.780062 25221 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:11.781489 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:11.781941 25237 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:11.783838 18458 leader_election.cc:336] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.784678 25237 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:20:11.780951 18384 leader_election.cc:336] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.788631 18384 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.790083 25235 raft_consensus.cc:2749] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:11.792743 25235 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.793277 25235 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.796339 25235 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:11.798794 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:20:11.799497 18418 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:20:11.800685 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:11.804694 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:11.805538 19055 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 20.
W20260709 13:20:11.819676 19027 leader_election.cc:336] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.820761 19027 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.821691 25229 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:11.835975 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b532a06bf55a4b9b892b97bd8376715a" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:11.836874 19055 raft_consensus.cc:3060] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:11.840060 25241 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.840657 25241 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.842713 25241 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:11.848217 18418 raft_consensus.cc:1275] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:20:11.848862 18458 leader_election.cc:336] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.850131 25221 consensus_queue.cc:1048] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:11.848232 19055 raft_consensus.cc:2468] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 20.
I20260709 13:20:11.858016 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:20:11.858325 18384 leader_election.cc:336] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.858641 19054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:11.858801 19055 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 17.
I20260709 13:20:11.859891 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:11.865775 18384 leader_election.cc:336] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.868044 18457 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.881700 25242 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.882333 25242 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.883946 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:20:11.871610 25228 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:11.888685 25228 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.889101 25228 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:11.891662 25239 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:11.892148 25239 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.892516 25239 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:11.874686 25241 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:11.894671 25241 raft_consensus.cc:493] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.895074 25241 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:11.896986 18458 leader_election.cc:336] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:11.888031 25242 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:11.885672 18384 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:20:11.871671 25236 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.898747 25214 raft_consensus.cc:2804] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:11.899284 25214 raft_consensus.cc:697] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 20 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:11.899130 25236 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.900179 25214 consensus_queue.cc:237] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.901188 25236 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:11.904004 18384 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 20e06cff39b649c48d342b7431135303; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:11.910099 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:11.917219 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:20:11.916587 18234 catalog_manager.cc:5697] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 22 to 23, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 23 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.918602 18234 catalog_manager.cc:5697] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 19 to 20, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 20 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:11.937268 19027 consensus_peers.cc:597] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:11.937376 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:11.943153 18242 catalog_manager.cc:5697] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 18 to 19, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 19 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:11.950673 18458 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 31ab487dc52e4f608b39df0fae2fdfa5, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:11.928449 25237 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:11.935823 25182 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:11.961566 18417 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:20:11.953713 25238 raft_consensus.cc:2749] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:11.962955 25182 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:11.967444 25182 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:11.969430 19055 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 17.
W20260709 13:20:12.011937 17228 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 18365)
I20260709 13:20:12.033576 25243 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:12.034237 25243 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:12.034904 25228 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:12.035233 25241 raft_consensus.cc:515] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:12.037979 25241 leader_election.cc:290] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:12.046767 25228 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:20:12.050348 18458 consensus_peers.cc:597] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:12.051304 18458 leader_election.cc:336] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:12.051885 18458 leader_election.cc:336] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:12.052345 25254 log.cc:927] Time spent T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:12.056779 25239 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:12.059135 25239 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 21 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:12.059357 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:12.059552 25243 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:12.067047 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9088f88404fe42cd909dc0c66c1c0c17" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:12.070698 19055 raft_consensus.cc:3060] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:12.069887 18486 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
W20260709 13:20:12.067628 18382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 117404us
W20260709 13:20:12.069542 19027 leader_election.cc:336] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:12.075872 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:20:12.076452 18418 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:20:12.081373 18237 catalog_manager.cc:5697] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 13 to 14, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 14 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:12.089564 19055 raft_consensus.cc:2468] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
W20260709 13:20:12.089694 19027 leader_election.cc:336] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:12.093431 18458 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:12.094872 25190 raft_consensus.cc:2804] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:12.095541 25190 raft_consensus.cc:697] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:12.096608 25190 consensus_queue.cc:237] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:12.099466 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303" is_pre_election: true
I20260709 13:20:12.100072 18418 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 14.
I20260709 13:20:12.100077 19026 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:12.101509 25243 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:12.101931 25243 raft_consensus.cc:493] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:12.102289 25243 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:12.110849 25243 raft_consensus.cc:515] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:12.112581 25243 leader_election.cc:290] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:12.114722 18417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069e2e1b4c714f01a2bc3ad59e3618f1" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:12.123080 18417 raft_consensus.cc:3060] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:12.125837 19054 raft_consensus.cc:1275] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:12.118397 19026 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:12.131932 18384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 189596us
I20260709 13:20:12.121814 18237 catalog_manager.cc:5697] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 19 to 20, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 20 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:12.135854 18384 leader_election.cc:336] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:12.136938 18384 leader_election.cc:336] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:12.137040 18417 raft_consensus.cc:2468] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 18.
I20260709 13:20:12.138229 19026 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
I20260709 13:20:12.134136 25182 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:12.140115 18458 consensus_peers.cc:597] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:12.140877 25182 raft_consensus.cc:493] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d03b672b2ff044b8bc2a0dfd8180ee19)
I20260709 13:20:12.141386 25182 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.139364 25221 raft_consensus.cc:2804] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:12.142352 25221 raft_consensus.cc:697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:12.143292 25221 consensus_queue.cc:237] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:12.145958 18458 consensus_peers.cc:597] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.140640 18384 leader_election.cc:336] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:12.148097 18458 consensus_peers.cc:597] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:12.152436 25241 consensus_queue.cc:1048] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:20:12.152791 19027 consensus_peers.cc:597] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:12.157034 25182 raft_consensus.cc:515] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:12.153280 19027 consensus_peers.cc:597] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:12.163590 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9560de944c37467eb1e18d5627ed0fd9" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:12.164197 18418 raft_consensus.cc:3060] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:12.166302 18384 leader_election.cc:304] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 
W20260709 13:20:12.171643 18384 leader_election.cc:336] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:12.175374 25257 raft_consensus.cc:2764] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:12.177132 18419 raft_consensus.cc:1275] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:20:12.177776 18384 leader_election.cc:336] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:12.179952 25230 consensus_queue.cc:1048] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:12.181640 18486 raft_consensus.cc:1275] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:20:12.200452 18418 raft_consensus.cc:2468] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 16.
I20260709 13:20:12.206580 18418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "20e06cff39b649c48d342b7431135303"
I20260709 13:20:12.207178 25182 leader_election.cc:290] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Requested vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:12.207403 18418 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.210371 18457 leader_election.cc:304] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:12.224246 25190 raft_consensus.cc:2804] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:12.224915 25190 raft_consensus.cc:697] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:12.227506 19060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf69de9977524f43803f402f2cfed3d4" candidate_uuid: "20e06cff39b649c48d342b7431135303" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:12.228113 19060 raft_consensus.cc:3060] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:12.232923 18418 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:20:12.238641 19060 raft_consensus.cc:2468] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20e06cff39b649c48d342b7431135303 in term 21.
W20260709 13:20:12.239773 18384 consensus_peers.cc:597] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:12.214337 18237 catalog_manager.cc:5697] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 17 to 18, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 18 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:12.263463 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f16ac6b95a48868f83cdf22debb207" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:12.264081 18486 raft_consensus.cc:3060] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.260106 18242 catalog_manager.cc:5697] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 17 to 18, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 18 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:12.266960 18491 raft_consensus.cc:1275] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:12.225853 25190 consensus_queue.cc:237] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:12.283978 25214 consensus_queue.cc:1048] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:20:12.310570 25266 consensus_queue.cc:1048] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:12.323014 18486 raft_consensus.cc:2468] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:20:12.337047 18410 raft_consensus.cc:1275] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:12.330295 19025 leader_election.cc:304] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:12.364037 18491 raft_consensus.cc:1275] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:12.366485 25229 consensus_queue.cc:1048] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:12.369602 25268 raft_consensus.cc:2804] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:12.370419 25268 raft_consensus.cc:697] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:12.371707 25268 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:12.374049 18458 consensus_peers.cc:597] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:12.376170 19025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:43125, user_credentials={real_user=slave}} blocked reactor thread for 45991.4us
W20260709 13:20:12.377235 18384 consensus_peers.cc:597] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:12.369112 19027 consensus_peers.cc:597] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:12.377992 18384 consensus_peers.cc:597] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.378801 19027 leader_election.cc:336] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:12.380038 19027 consensus_peers.cc:597] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:12.387704 18237 catalog_manager.cc:5697] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 15 to 16, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 16 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:12.399606 18384 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5; no voters: d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:12.404122 25257 raft_consensus.cc:2804] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:12.404831 25257 raft_consensus.cc:697] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 21 LEADER]: Becoming Leader. State: Replica: 20e06cff39b649c48d342b7431135303, State: Running, Role: LEADER
I20260709 13:20:12.406038 25257 consensus_queue.cc:237] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:12.424577 19027 leader_election.cc:336] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:12.425781 19027 consensus_peers.cc:597] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:12.428556 19060 raft_consensus.cc:1275] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 23 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:20:12.442335 18458 consensus_peers.cc:597] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:12.446504 25260 consensus_queue.cc:1048] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:20:12.453927 18384 consensus_peers.cc:597] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:12.456007 18384 consensus_peers.cc:597] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.478663 19027 consensus_peers.cc:597] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:12.492434 19060 raft_consensus.cc:1275] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:12.516098 18237 catalog_manager.cc:5697] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 14 to 15, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 15 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:12.526619 19027 consensus_peers.cc:597] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:12.494469 25230 consensus_queue.cc:1048] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
I20260709 13:20:12.532270 25260 consensus_queue.cc:1048] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:20:12.535156 18458 consensus_peers.cc:597] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.547485 19027 consensus_peers.cc:597] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.549638 19027 consensus_peers.cc:597] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.548575 18458 consensus_peers.cc:597] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:12.551167 18234 catalog_manager.cc:5697] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 reported cstate change: term changed from 20 to 21, leader changed from d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1) to 20e06cff39b649c48d342b7431135303 (127.16.211.2). New cstate: current_term: 21 leader_uuid: "20e06cff39b649c48d342b7431135303" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:12.572311 18458 consensus_peers.cc:597] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.606202 19027 consensus_peers.cc:597] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.606689 19027 consensus_peers.cc:597] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.607544 18458 consensus_peers.cc:597] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.608493 25280 log.cc:927] Time spent T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:20:12.683256 19027 consensus_peers.cc:597] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.686784 19027 consensus_peers.cc:597] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.687252 19027 consensus_peers.cc:597] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:12.702695 19060 raft_consensus.cc:1275] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:12.703668 18419 raft_consensus.cc:1275] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:12.716331 25229 consensus_queue.cc:1048] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:20:12.738161 18384 consensus_peers.cc:597] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.743289 18458 consensus_peers.cc:597] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:12.744894 25230 consensus_queue.cc:1048] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:20:12.750217 19027 consensus_peers.cc:597] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.750931 19027 consensus_peers.cc:597] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.759485 18384 consensus_peers.cc:597] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.772441 18458 consensus_peers.cc:597] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.789594 19027 consensus_peers.cc:597] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:12.791306 19027 consensus_peers.cc:597] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:12.795698 18410 raft_consensus.cc:1275] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:20:12.815799 18384 consensus_peers.cc:597] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:12.828935 18410 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:12.831650 25221 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:12.816635 25231 consensus_queue.cc:1048] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 13:20:12.843376 18384 consensus_peers.cc:597] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:12.855845 18458 consensus_peers.cc:597] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:12.875104 18485 raft_consensus.cc:1275] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Refusing update from remote peer 31ab487dc52e4f608b39df0fae2fdfa5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:12.878449 25229 consensus_queue.cc:1048] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:12.890982 18458 consensus_peers.cc:597] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:12.935534 19027 consensus_peers.cc:597] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:12.941447 18384 consensus_peers.cc:597] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:13.005468 19058 raft_consensus.cc:1275] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Refusing update from remote peer 20e06cff39b649c48d342b7431135303: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:20:13.006981 25237 consensus_queue.cc:1048] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:20:13.013298 17228 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 18365)
I20260709 13:20:13.748811 17228 tablet_server.cc:196] TabletServer@127.16.211.1:0 shutdown complete.
W20260709 13:20:13.966109 18384 consensus_peers.cc:597] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:14.081435 19027 consensus_peers.cc:597] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:14.286005 17228 tablet_server.cc:179] TabletServer@127.16.211.2:0 shutting down...
W20260709 13:20:14.336313 19026 consensus_peers.cc:597] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.342128 18457 consensus_peers.cc:597] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.342886 18457 consensus_peers.cc:597] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.349366 19026 consensus_peers.cc:597] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.393795 18457 consensus_peers.cc:597] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.397254 18457 consensus_peers.cc:597] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.424418 19026 consensus_peers.cc:597] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.421993 18457 consensus_peers.cc:597] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.449987 19026 consensus_peers.cc:597] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.453426 19026 consensus_peers.cc:597] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.462558 18457 consensus_peers.cc:597] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.463202 18457 consensus_peers.cc:597] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.467068 19027 consensus_peers.cc:597] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:14.476192 19026 consensus_peers.cc:597] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.486500 18458 consensus_peers.cc:597] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:14.506088 18457 consensus_peers.cc:597] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.510087 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:14.514082 17228 tablet_replica.cc:333] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.515015 17228 raft_consensus.cc:2243] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.516149 17228 raft_consensus.cc:2272] T f1a6e60961c64b469cf1a97767887e79 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.521595 19026 consensus_peers.cc:597] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.521589 17228 tablet_replica.cc:333] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.523450 17228 raft_consensus.cc:2243] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:14.527598 18457 consensus_peers.cc:597] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.532913 17228 raft_consensus.cc:2272] T b1734a6c318d4e6ba6b65fd828d4fe66 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.536001 17228 tablet_replica.cc:333] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.537045 17228 raft_consensus.cc:2243] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.538247 17228 raft_consensus.cc:2272] T 5069a3aa86984fcd93f4fb63a92ef8cd P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.540804 19026 consensus_peers.cc:597] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.540977 17228 tablet_replica.cc:333] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.541899 17228 raft_consensus.cc:2243] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.542725 17228 raft_consensus.cc:2272] T ac1699feafbd4621b7b7a28933b59fec P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.545521 17228 tablet_replica.cc:333] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.547327 17228 raft_consensus.cc:2243] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.555264 17228 raft_consensus.cc:2272] T 06fc3d36b088480ab5fb6ac2a5600252 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.556182 19026 consensus_peers.cc:597] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.560381 17228 tablet_replica.cc:333] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.561362 17228 raft_consensus.cc:2243] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.570339 17228 raft_consensus.cc:2272] T 479d13df82394c22b38ff5fd8a8b5931 P 20e06cff39b649c48d342b7431135303 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.570503 19026 consensus_peers.cc:597] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.583995 18458 consensus_peers.cc:597] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:14.591882 18457 consensus_peers.cc:597] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.592648 18458 consensus_peers.cc:597] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:14.594895 17228 tablet_replica.cc:333] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.595865 17228 raft_consensus.cc:2243] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:20:14.604759 18457 consensus_peers.cc:597] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.610944 17228 raft_consensus.cc:2272] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.614013 17228 tablet_replica.cc:333] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.614948 17228 raft_consensus.cc:2243] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.618244 17228 raft_consensus.cc:2272] T c3024cea1b1847929dd26f32197f9067 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.621207 17228 tablet_replica.cc:333] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.622212 17228 raft_consensus.cc:2243] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.622794 17228 raft_consensus.cc:2272] T 1f56f24cb8c042b4bbdc442e02acaefc P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.625499 17228 tablet_replica.cc:333] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.626511 17228 raft_consensus.cc:2243] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.627543 17228 raft_consensus.cc:2272] T d4511f72b2b34e4d82124396a41054ca P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.634121 18457 consensus_peers.cc:597] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.642019 18384 consensus_peers.cc:597] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:14.642328 17228 tablet_replica.cc:333] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
W20260709 13:20:14.642204 19027 consensus_peers.cc:597] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:14.643383 17228 raft_consensus.cc:2243] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.643971 17228 raft_consensus.cc:2272] T 66d70af6941f4d469682dabf08926fc9 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.646816 17228 tablet_replica.cc:333] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.647651 17228 raft_consensus.cc:2243] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.648218 17228 raft_consensus.cc:2272] T 9986bcf770bb42549bfb7d77ec66768b P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.671788 19027 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111) [suppressed 442 similar messages]
I20260709 13:20:14.675360 17228 tablet_replica.cc:333] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.676364 17228 raft_consensus.cc:2243] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.677080 17228 raft_consensus.cc:2272] T fe80371fdcc94f38a7f06b90e411d03c P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.680364 17228 tablet_replica.cc:333] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.681207 17228 raft_consensus.cc:2243] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:20:14.689555 18458 consensus_peers.cc:597] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:14.697888 17228 raft_consensus.cc:2272] T b532a06bf55a4b9b892b97bd8376715a P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.700862 17228 tablet_replica.cc:333] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.701691 17228 raft_consensus.cc:2243] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.702574 17228 raft_consensus.cc:2272] T 4139afe4ea2b4938821aa26d4c12e6ab P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.703496 18458 consensus_peers.cc:597] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:14.704210 19026 consensus_peers.cc:597] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.712029 18457 consensus_peers.cc:597] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.713548 18457 consensus_peers.cc:597] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.716657 19027 consensus_peers.cc:597] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:14.721957 17228 tablet_replica.cc:333] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.722955 17228 raft_consensus.cc:2243] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.724038 17228 raft_consensus.cc:2272] T b345033a56994fff90990b7d03324074 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.726929 17228 tablet_replica.cc:333] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.727722 17228 raft_consensus.cc:2243] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.728335 17228 raft_consensus.cc:2272] T b8b55a3ba07d4097b2da619afcf80e3f P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.731000 17228 tablet_replica.cc:333] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.731880 17228 raft_consensus.cc:2243] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.744876 17228 raft_consensus.cc:2272] T f9697a1f706e47fa9c62306b225e97fa P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.745059 18384 consensus_peers.cc:597] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:14.747691 17228 tablet_replica.cc:333] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.748551 17228 raft_consensus.cc:2243] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.749141 17228 raft_consensus.cc:2272] T 218ede86207640ab99622c70bae54d07 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.751819 17228 tablet_replica.cc:333] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.752596 17228 raft_consensus.cc:2243] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.753165 17228 raft_consensus.cc:2272] T 132f50d25c404b83b0bafe5445c572e9 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.755739 17228 tablet_replica.cc:333] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.756469 17228 raft_consensus.cc:2243] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.757649 17228 raft_consensus.cc:2272] T bf69de9977524f43803f402f2cfed3d4 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.760223 17228 tablet_replica.cc:333] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.760998 17228 raft_consensus.cc:2243] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:20:14.763393 19027 consensus_peers.cc:597] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:14.794443 17228 raft_consensus.cc:2272] T 77cd16981fa049aaaa881bdeacda2fc3 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.797719 17228 tablet_replica.cc:333] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.798529 17228 raft_consensus.cc:2243] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.799085 17228 raft_consensus.cc:2272] T b972754511104f898e9cbc171aa6c170 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.801738 17228 tablet_replica.cc:333] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.802455 17228 raft_consensus.cc:2243] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.803035 17228 raft_consensus.cc:2272] T f59be45893c741da9dfbf367c31f3851 P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.805534 18458 consensus_peers.cc:597] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:14.805852 17228 tablet_replica.cc:333] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.806684 17228 raft_consensus.cc:2243] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.807794 17228 raft_consensus.cc:2272] T e0c142ad00b14613a8e3623c478ebdaf P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.808185 18458 consensus_peers.cc:597] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:14.819334 17228 tablet_replica.cc:333] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.820281 17228 raft_consensus.cc:2243] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.821411 17228 raft_consensus.cc:2272] T 11ec555240a9486fad41ffb02e94fd9c P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.824150 17228 tablet_replica.cc:333] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.824975 17228 raft_consensus.cc:2243] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.826047 17228 raft_consensus.cc:2272] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.852679 17228 tablet_replica.cc:333] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.853387 17228 raft_consensus.cc:2243] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.854380 17228 raft_consensus.cc:2272] T 8b55cf48798a4468ae4b6aa4a26a477f P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.856765 17228 tablet_replica.cc:333] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.857491 17228 raft_consensus.cc:2243] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:14.863478 19027 consensus_peers.cc:597] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:14.866257 19027 consensus_peers.cc:597] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:14.867306 17228 raft_consensus.cc:2272] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 20e06cff39b649c48d342b7431135303 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.869896 17228 tablet_replica.cc:333] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.870683 17228 raft_consensus.cc:2243] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.871295 17228 raft_consensus.cc:2272] T 102530a9a2f94c3492b2af9e95b376f6 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.874148 17228 tablet_replica.cc:333] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.874943 17228 raft_consensus.cc:2243] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.875536 17228 raft_consensus.cc:2272] T 41082fa41d05470eb1937d1997399fa4 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.882463 17228 tablet_replica.cc:333] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.883186 17228 raft_consensus.cc:2243] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.883721 17228 raft_consensus.cc:2272] T 04eef32e6eb14221811a03f4940ae121 P 20e06cff39b649c48d342b7431135303 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.886232 17228 tablet_replica.cc:333] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.886940 17228 raft_consensus.cc:2243] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.887980 17228 raft_consensus.cc:2272] T f99562a3c70c43d2b33161d483871d6c P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.906607 17228 tablet_replica.cc:333] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.907435 17228 raft_consensus.cc:2243] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.908107 17228 raft_consensus.cc:2272] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.910710 17228 tablet_replica.cc:333] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.911490 17228 raft_consensus.cc:2243] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.912150 17228 raft_consensus.cc:2272] T c88b963fb1b740418ee335cb0fe83049 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.914978 17228 tablet_replica.cc:333] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.915721 17228 raft_consensus.cc:2243] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.916384 17228 raft_consensus.cc:2272] T f9e75d2ac4114e428bf95ddfa6245037 P 20e06cff39b649c48d342b7431135303 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.918881 17228 tablet_replica.cc:333] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.919631 17228 raft_consensus.cc:2243] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.920185 17228 raft_consensus.cc:2272] T 9560de944c37467eb1e18d5627ed0fd9 P 20e06cff39b649c48d342b7431135303 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.929404 18458 consensus_peers.cc:597] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:14.934665 17228 tablet_replica.cc:333] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.935491 17228 raft_consensus.cc:2243] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.936062 17228 raft_consensus.cc:2272] T b5d50aacd9894a6ca1895dbf30df38dc P 20e06cff39b649c48d342b7431135303 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.936162 19027 consensus_peers.cc:597] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:14.938580 17228 tablet_replica.cc:333] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.939353 17228 raft_consensus.cc:2243] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:14.939826 18458 consensus_peers.cc:597] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:14.940060 17228 raft_consensus.cc:2272] T 35d61c75b589420ab4319c7a05b2b72b P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.943322 17228 tablet_replica.cc:333] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.944195 17228 raft_consensus.cc:2243] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.944790 17228 raft_consensus.cc:2272] T 02f16ac6b95a48868f83cdf22debb207 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.948374 19027 consensus_peers.cc:597] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:14.963754 17228 tablet_replica.cc:333] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.964627 17228 raft_consensus.cc:2243] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.965263 17228 raft_consensus.cc:2272] T b1c3d9691e854ee98b2b7d81f868c727 P 20e06cff39b649c48d342b7431135303 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.968231 17228 tablet_replica.cc:333] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.968953 17228 raft_consensus.cc:2243] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.969550 17228 raft_consensus.cc:2272] T f5da9c99398d461ba6b04325cb5faf48 P 20e06cff39b649c48d342b7431135303 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.972544 17228 tablet_replica.cc:333] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.973280 17228 raft_consensus.cc:2243] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 12 LEADER]: Raft consensus shutting down.
W20260709 13:20:14.977250 18458 consensus_peers.cc:597] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:14.978587 19027 consensus_peers.cc:597] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:14.984802 19027 consensus_peers.cc:597] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:14.990487 17228 raft_consensus.cc:2272] T b176e8c616ab4b039f2e48b14549f43b P 20e06cff39b649c48d342b7431135303 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.993459 17228 tablet_replica.cc:333] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303: stopping tablet replica
I20260709 13:20:14.994149 17228 raft_consensus.cc:2243] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.994736 17228 raft_consensus.cc:2272] T f0f6372354b84d0ea884a3478b3dfd98 P 20e06cff39b649c48d342b7431135303 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:15.012602 19027 consensus_peers.cc:597] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:15.036427 19027 consensus_peers.cc:597] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:15.111924 19027 consensus_peers.cc:597] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:15.128813 18458 consensus_peers.cc:597] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:15.165133 18458 consensus_peers.cc:597] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:15.203995 18458 consensus_peers.cc:597] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:15.255973 19027 consensus_peers.cc:597] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:15.272621 19027 consensus_peers.cc:597] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:15.286942 19027 consensus_peers.cc:597] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:15.291029 19027 consensus_peers.cc:597] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:15.325067 19027 consensus_peers.cc:597] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:15.384187 19027 consensus_peers.cc:597] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:15.553333 18458 consensus_peers.cc:597] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:15.579293 25299 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:15.579842 25299 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:15.583784 25299 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:15.590273 19026 leader_election.cc:336] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:15.591952 19027 leader_election.cc:336] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:15.592392 19027 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:15.593132 25299 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:15.760586 25294 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:15.761212 25294 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:15.764379 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:15.771142 25230 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:15.771756 25230 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:15.775013 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:15.788646 25230 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:15.788003 25294 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:20:15.790562 18457 leader_election.cc:336] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:15.791875 18457 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:20:15.793687 25294 raft_consensus.cc:2749] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:15.800355 18457 leader_election.cc:336] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:15.801632 18457 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:20:15.803576 25295 raft_consensus.cc:2749] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:15.813128 25299 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:15.813748 25299 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:15.816001 25299 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:15.833261 19026 leader_election.cc:336] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:15.837023 19027 leader_election.cc:336] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:15.839598 19027 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:15.842813 25299 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:15.935623 25299 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:15.936381 25299 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:15.941229 17228 tablet_server.cc:196] TabletServer@127.16.211.2:0 shutdown complete.
I20260709 13:20:15.944883 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:15.945621 18485 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:20:15.946904 19025 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:15.948005 25296 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:15.948417 25296 raft_consensus.cc:493] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:15.948770 25296 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:15.949200 19026 leader_election.cc:336] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:15.967242 25295 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:15.967904 25295 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:15.968613 25299 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:15.957773 25296 raft_consensus.cc:515] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:15.974112 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:15.976845 25299 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:15.979935 25299 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:15.980962 19055 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 11.
I20260709 13:20:15.973845 25295 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:20:15.980693 18457 leader_election.cc:336] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:15.983726 25299 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:15.985247 25296 leader_election.cc:290] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:15.987735 18458 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:20:15.989065 19026 leader_election.cc:336] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:15.993005 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3024cea1b1847929dd26f32197f9067" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:15.993357 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:15.993609 18486 raft_consensus.cc:3060] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:15.994002 18485 raft_consensus.cc:2468] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 11.
I20260709 13:20:15.994755 25294 raft_consensus.cc:493] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:15.995285 25294 raft_consensus.cc:515] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:15.997617 25294 leader_election.cc:290] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:15.998245 25301 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:15.998725 25301 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:15.999126 25301 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.004362 25300 raft_consensus.cc:493] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.005004 25300 raft_consensus.cc:515] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:16.007665 25299 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.008180 25299 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.010226 25299 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:16.011159 25300 leader_election.cc:290] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:16.009061 25230 raft_consensus.cc:493] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.016929 25230 raft_consensus.cc:515] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:16.014760 18486 raft_consensus.cc:2468] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 20.
I20260709 13:20:16.023077 25230 leader_election.cc:290] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:16.024381 25230 raft_consensus.cc:493] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
W20260709 13:20:16.019672 19026 leader_election.cc:336] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.014884 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:20:16.032094 25296 raft_consensus.cc:2804] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:16.032632 25296 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.033125 25296 raft_consensus.cc:3060] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:16.029584 18457 leader_election.cc:336] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.036832 19025 leader_election.cc:304] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:20:16.038980 25219 raft_consensus.cc:2804] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:16.039499 25219 raft_consensus.cc:697] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
W20260709 13:20:16.040576 19026 leader_election.cc:336] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.040392 25219 consensus_queue.cc:237] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.043708 25301 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.047494 25301 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:16.049434 25299 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.060379 25299 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.049465 25302 raft_consensus.cc:493] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.050474 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:16.051501 25294 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.062201 25302 raft_consensus.cc:515] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:16.062644 25294 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.064522 25302 leader_election.cc:290] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:16.064976 25294 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:16.052718 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:16.065747 18486 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 15.
I20260709 13:20:16.065841 25299 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:16.052871 25295 raft_consensus.cc:493] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.068992 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:16.045351 25230 raft_consensus.cc:515] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
I20260709 13:20:16.075181 19058 raft_consensus.cc:2468] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:20:16.077226 25230 leader_election.cc:290] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:16.066468 25295 raft_consensus.cc:515] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } }
W20260709 13:20:16.073586 19026 leader_election.cc:336] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.083535 18242 catalog_manager.cc:5697] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 19 to 20, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 20 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:16.086395 19027 leader_election.cc:336] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:16.087592 19027 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:16.089372 18458 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:16.090313 25294 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:16.090761 25294 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.091174 25294 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.091763 25295 leader_election.cc:290] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:16.073797 25299 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.054486 25296 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.092552 25299 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.093940 25296 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:16.094245 19055 raft_consensus.cc:2393] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 12: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:20:16.094511 25296 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:16.094735 25299 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:16.057317 18457 leader_election.cc:336] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:16.099301 18457 leader_election.cc:336] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:16.101302 19026 leader_election.cc:336] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.101426 19025 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
W20260709 13:20:16.101852 19026 leader_election.cc:336] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.102890 25296 raft_consensus.cc:2804] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:16.103312 25296 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.103693 25296 raft_consensus.cc:3060] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.110356 25295 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.101872 25294 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.111047 25295 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.112829 25296 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.114086 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:16.114966 19055 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in current term 16: Already voted for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in this term.
I20260709 13:20:16.114987 25301 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.115833 25301 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.116695 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:16.118153 25301 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:16.118868 25296 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:16.118921 25301 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.120644 25219 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.121001 25301 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.121284 25219 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:16.120076 19026 leader_election.cc:336] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.120028 18486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479d13df82394c22b38ff5fd8a8b5931" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:16.120383 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:16.122615 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:16.123093 18486 raft_consensus.cc:2393] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 12: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:20:16.123888 19055 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 18.
I20260709 13:20:16.123042 18485 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 17.
I20260709 13:20:16.119293 25299 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.124989 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b345033a56994fff90990b7d03324074" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:16.125852 18458 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:16.128629 18491 raft_consensus.cc:2393] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 16: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
W20260709 13:20:16.130054 19027 leader_election.cc:336] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:16.125600 25294 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:16.125699 25219 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:16.125833 25295 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:16.132436 19025 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:16.138446 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:20:16.139832 25219 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:16.140602 25301 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:16.127565 25299 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.141487 25294 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.130422 25230 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:16.142119 25294 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.142795 25230 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.143249 25230 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:16.140877 19026 leader_election.cc:336] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.144918 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:16.132884 18457 leader_election.cc:336] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.146636 18457 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:20:16.140367 25304 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:16.147715 25219 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:16.148027 25304 raft_consensus.cc:493] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.147884 25300 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:16.148655 25304 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:16.149984 18457 leader_election.cc:336] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:16.150427 18457 leader_election.cc:336] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:16.150914 18457 leader_election.cc:336] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:16.151249 18457 leader_election.cc:336] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:16.153384 18457 leader_election.cc:336] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.153632 18457 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:20:16.148545 25299 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:16.147780 25294 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:16.156086 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
I20260709 13:20:16.156549 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" is_pre_election: true
W20260709 13:20:16.156088 18457 leader_election.cc:336] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.157634 18457 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
W20260709 13:20:16.161028 18457 leader_election.cc:336] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:16.161597 19026 leader_election.cc:336] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.147449 25296 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.162382 25296 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.163437 19055 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 14.
I20260709 13:20:16.164470 25296 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:16.160763 25300 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:16.164845 25304 raft_consensus.cc:515] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.166241 18458 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:16.166980 25300 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:16.161082 25301 raft_consensus.cc:2749] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:16.167418 25300 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.168026 25300 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:16.168251 18457 leader_election.cc:336] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:16.168875 18457 leader_election.cc:336] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.169283 18457 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, 31ab487dc52e4f608b39df0fae2fdfa5
I20260709 13:20:16.169981 25301 raft_consensus.cc:2749] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:16.179234 25300 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.153749 25230 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.194059 25230 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
W20260709 13:20:16.190857 19027 leader_election.cc:336] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:16.189967 19026 leader_election.cc:336] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.194815 25304 leader_election.cc:290] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:16.195581 19027 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:16.198575 19055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cd16981fa049aaaa881bdeacda2fc3" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
W20260709 13:20:16.198735 18457 leader_election.cc:336] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.199102 19055 raft_consensus.cc:3060] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:16.199198 18457 leader_election.cc:336] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.200690 25300 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611)
I20260709 13:20:16.203536 19058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "31ab487dc52e4f608b39df0fae2fdfa5"
I20260709 13:20:16.204329 19058 raft_consensus.cc:3060] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.205588 19055 raft_consensus.cc:2468] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 19.
I20260709 13:20:16.206094 25306 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:16.209578 18458 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:20:16.210398 25294 raft_consensus.cc:2804] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:16.210920 25294 raft_consensus.cc:697] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
W20260709 13:20:16.211949 19026 leader_election.cc:336] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.213367 19058 raft_consensus.cc:2468] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in term 15.
I20260709 13:20:16.212951 25294 consensus_queue.cc:237] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.217579 18458 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:20:16.217767 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d775fb4ae54c3ab8335a03e2ad44f4" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:16.219380 18485 raft_consensus.cc:2393] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31ab487dc52e4f608b39df0fae2fdfa5 in current term 15: Already voted for candidate 9d6cd7c600ec4ab2b5cac479f05d4c0f in this term.
I20260709 13:20:16.219806 25230 raft_consensus.cc:2804] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:16.220340 25230 raft_consensus.cc:697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Becoming Leader. State: Replica: 9d6cd7c600ec4ab2b5cac479f05d4c0f, State: Running, Role: LEADER
I20260709 13:20:16.221192 25230 consensus_queue.cc:237] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.222065 18485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c142ad00b14613a8e3623c478ebdaf" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:16.222638 18485 raft_consensus.cc:3060] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.223326 19025 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:16.226538 25304 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:16.232534 18485 raft_consensus.cc:2468] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 18.
I20260709 13:20:16.239609 18234 catalog_manager.cc:5697] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 18 to 19, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 19 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.243026 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:16.246187 25296 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.246343 25304 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:16.246765 25296 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.247565 19025 leader_election.cc:304] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:20:16.248956 25304 raft_consensus.cc:2804] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:16.249055 25296 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:16.249648 25304 raft_consensus.cc:697] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:16.251132 25304 consensus_queue.cc:237] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.259514 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:16.260241 18491 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 19.
I20260709 13:20:16.262212 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
W20260709 13:20:16.262928 19026 leader_election.cc:336] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.263171 25219 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:16.263828 25219 raft_consensus.cc:493] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.264312 25219 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.277695 25219 raft_consensus.cc:515] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.307762 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9697a1f706e47fa9c62306b225e97fa" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:16.308310 18491 raft_consensus.cc:3060] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.315186 25299 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.315837 25299 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.318102 25299 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:16.321350 18491 raft_consensus.cc:2468] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 20.
W20260709 13:20:16.326126 19026 leader_election.cc:336] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:16.333204 19026 leader_election.cc:336] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.343433 25219 leader_election.cc:290] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:16.345034 19025 leader_election.cc:304] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:20:16.345897 25219 raft_consensus.cc:2804] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:16.346542 25219 raft_consensus.cc:697] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:16.347636 25219 consensus_queue.cc:237] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.349943 18234 catalog_manager.cc:5697] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f reported cstate change: term changed from 14 to 15, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3). New cstate: current_term: 15 leader_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.351583 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" is_pre_election: true
I20260709 13:20:16.354426 18491 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 12.
I20260709 13:20:16.361883 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303
I20260709 13:20:16.363016 25304 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:16.363394 25304 raft_consensus.cc:493] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:16.363729 25304 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.372145 25304 raft_consensus.cc:515] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:16.385417 25304 leader_election.cc:290] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Requested vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:16.386786 18491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176e8c616ab4b039f2e48b14549f43b" candidate_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f"
I20260709 13:20:16.387485 18491 raft_consensus.cc:3060] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.389307 18234 catalog_manager.cc:5697] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 17 to 18, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 18 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.402908 18491 raft_consensus.cc:2468] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ab487dc52e4f608b39df0fae2fdfa5 in term 13.
I20260709 13:20:16.404246 19025 leader_election.cc:304] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5, 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 
I20260709 13:20:16.405639 25304 raft_consensus.cc:2804] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:16.406391 25304 raft_consensus.cc:697] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Becoming Leader. State: Replica: 31ab487dc52e4f608b39df0fae2fdfa5, State: Running, Role: LEADER
I20260709 13:20:16.407351 25304 consensus_queue.cc:237] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:16.407938 19026 leader_election.cc:336] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:16.414204 17228 tablet_server.cc:179] TabletServer@127.16.211.3:0 shutting down...
W20260709 13:20:16.420738 19025 consensus_peers.cc:597] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.441550 18234 catalog_manager.cc:5697] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 19 to 20, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 20 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.443542 18234 catalog_manager.cc:5697] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 reported cstate change: term changed from 12 to 13, leader changed from 20e06cff39b649c48d342b7431135303 (127.16.211.2) to 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4). New cstate: current_term: 13 leader_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:16.455627 19025 consensus_peers.cc:597] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:16.516613 19026 consensus_peers.cc:597] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.539093 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:20:16.538992 19027 consensus_peers.cc:597] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:16.544235 17228 tablet_replica.cc:333] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.545226 17228 raft_consensus.cc:2243] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.546094 17228 raft_consensus.cc:2272] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.549240 17228 tablet_replica.cc:333] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.550170 17228 raft_consensus.cc:2243] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.550812 17228 raft_consensus.cc:2272] T 88ca5739563d4349a7b7a6c70d81e653 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.553414 17228 tablet_replica.cc:333] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.555580 17228 raft_consensus.cc:2243] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.556192 17228 raft_consensus.cc:2272] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.561043 17228 tablet_replica.cc:333] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.561844 17228 raft_consensus.cc:2243] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:20:16.566995 19025 consensus_peers.cc:597] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.567854 17228 raft_consensus.cc:2272] T 9088f88404fe42cd909dc0c66c1c0c17 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.570654 17228 tablet_replica.cc:333] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.571430 17228 raft_consensus.cc:2243] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.572104 17228 raft_consensus.cc:2272] T 97efddba551a406f8d4427488fc22c5c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.574528 17228 tablet_replica.cc:333] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.575289 17228 raft_consensus.cc:2243] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.575872 17228 raft_consensus.cc:2272] T 21b9264b0a434b79b6292c2ed23bbae0 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.578531 17228 tablet_replica.cc:333] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.579321 17228 raft_consensus.cc:2243] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.580230 17228 raft_consensus.cc:2272] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.582906 17228 tablet_replica.cc:333] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.583632 17228 raft_consensus.cc:2243] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.584178 17228 raft_consensus.cc:2272] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:16.585741 18457 consensus_peers.cc:597] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:16.586645 17228 tablet_replica.cc:333] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.587536 17228 raft_consensus.cc:2243] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.588400 17228 raft_consensus.cc:2272] T 04eef32e6eb14221811a03f4940ae121 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.591421 17228 tablet_replica.cc:333] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.592234 17228 raft_consensus.cc:2243] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.592914 17228 raft_consensus.cc:2272] T c860bd12a6124270ba17146fea662e3b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.595471 17228 tablet_replica.cc:333] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.596235 17228 raft_consensus.cc:2243] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.597075 17228 raft_consensus.cc:2272] T 66d70af6941f4d469682dabf08926fc9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.599606 17228 tablet_replica.cc:333] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
W20260709 13:20:16.604789 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.607781 19025 consensus_peers.cc:597] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:16.615949 19025 consensus_peers.cc:597] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.617292 17228 raft_consensus.cc:2243] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.618057 17228 raft_consensus.cc:2272] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.620527 17228 tablet_replica.cc:333] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.621526 17228 raft_consensus.cc:2243] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:20:16.622248 18457 consensus_peers.cc:597] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.622411 17228 raft_consensus.cc:2272] T fcca3d62b9ee4ee98c16e7e079d076b7 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.625350 17228 tablet_replica.cc:333] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.626224 17228 raft_consensus.cc:2243] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.626966 17228 raft_consensus.cc:2272] T 64f9a8403ec74b85bc4a3ff12e5f686a P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.629540 17228 tablet_replica.cc:333] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.630360 17228 raft_consensus.cc:2243] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.631412 17228 raft_consensus.cc:2272] T 9986bcf770bb42549bfb7d77ec66768b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.633973 17228 tablet_replica.cc:333] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.634734 17228 raft_consensus.cc:2243] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.635772 17228 raft_consensus.cc:2272] T fe80371fdcc94f38a7f06b90e411d03c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.638372 17228 tablet_replica.cc:333] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.639148 17228 raft_consensus.cc:2243] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.639765 17228 raft_consensus.cc:2272] T 479d13df82394c22b38ff5fd8a8b5931 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:16.645248 19025 consensus_peers.cc:597] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.645706 17228 tablet_replica.cc:333] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.646631 17228 raft_consensus.cc:2243] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.647205 17228 raft_consensus.cc:2272] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.650301 17228 tablet_replica.cc:333] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.651098 17228 raft_consensus.cc:2243] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.652099 17228 raft_consensus.cc:2272] T c3024cea1b1847929dd26f32197f9067 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.655431 17228 tablet_replica.cc:333] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.656250 17228 raft_consensus.cc:2243] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.657131 17228 raft_consensus.cc:2272] T 1f56f24cb8c042b4bbdc442e02acaefc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.659969 17228 tablet_replica.cc:333] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.660770 17228 raft_consensus.cc:2243] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.661775 17228 raft_consensus.cc:2272] T b345033a56994fff90990b7d03324074 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.664651 17228 tablet_replica.cc:333] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.665438 17228 raft_consensus.cc:2243] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.666077 17228 raft_consensus.cc:2272] T e1bc6fb6380b4ad7b0907976d075d20e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.668864 17228 tablet_replica.cc:333] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.669633 17228 raft_consensus.cc:2243] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.670557 17228 raft_consensus.cc:2272] T 3b2a2d7b65c646deb16cdddec208645e P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.673027 17228 tablet_replica.cc:333] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.673765 17228 raft_consensus.cc:2243] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.674659 17228 raft_consensus.cc:2272] T 132f50d25c404b83b0bafe5445c572e9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.677331 17228 tablet_replica.cc:333] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.678108 17228 raft_consensus.cc:2243] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.679144 17228 raft_consensus.cc:2272] T f59be45893c741da9dfbf367c31f3851 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.681833 17228 tablet_replica.cc:333] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.682667 17228 raft_consensus.cc:2243] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.683768 17228 raft_consensus.cc:2272] T 102530a9a2f94c3492b2af9e95b376f6 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.686590 17228 tablet_replica.cc:333] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.687378 17228 raft_consensus.cc:2243] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:20:16.687481 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.688516 17228 raft_consensus.cc:2272] T 41082fa41d05470eb1937d1997399fa4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.691176 17228 tablet_replica.cc:333] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.691992 17228 raft_consensus.cc:2243] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.692708 17228 raft_consensus.cc:2272] T e0c142ad00b14613a8e3623c478ebdaf P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.695411 17228 tablet_replica.cc:333] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
W20260709 13:20:16.710065 19025 consensus_peers.cc:597] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:16.710713 19025 consensus_peers.cc:597] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.711128 17228 raft_consensus.cc:2243] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.711961 17228 raft_consensus.cc:2272] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:16.714373 19026 consensus_peers.cc:597] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:16.715040 17228 tablet_replica.cc:333] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.715868 17228 raft_consensus.cc:2243] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.716401 17228 raft_consensus.cc:2272] T 6419a332888d490f92e43b717ff1edd4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.719283 17228 tablet_replica.cc:333] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
W20260709 13:20:16.727891 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.730221 19026 consensus_peers.cc:597] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:16.732789 18457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.736147 17228 raft_consensus.cc:2243] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.737391 17228 raft_consensus.cc:2272] T bb654ec8beb54a539b5b6b44aa5181c3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:16.740698 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.743436 18457 consensus_peers.cc:597] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:16.746490 19058 raft_consensus.cc:1275] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:16.790817 25230 consensus_queue.cc:1048] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:16.792785 17228 tablet_replica.cc:333] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.798856 17228 raft_consensus.cc:2243] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.802153 17228 raft_consensus.cc:2272] T 839ba6300c764efc8e880c80a27079b2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:16.793255 18458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:45611, user_credentials={real_user=slave}} blocked reactor thread for 45511.3us
W20260709 13:20:16.803817 18457 consensus_peers.cc:597] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:16.809722 18457 consensus_peers.cc:597] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:16.810235 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.812934 19026 consensus_peers.cc:597] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:16.814109 19026 consensus_peers.cc:597] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:16.815320 19026 consensus_peers.cc:597] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.815579 19058 raft_consensus.cc:1275] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Refusing update from remote peer 9d6cd7c600ec4ab2b5cac479f05d4c0f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:20:16.816778 19025 consensus_peers.cc:597] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.817246 17228 tablet_replica.cc:333] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
W20260709 13:20:16.818713 19025 consensus_peers.cc:597] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.818130 17228 raft_consensus.cc:2243] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.820009 17228 pending_rounds.cc:70] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Trying to abort 1 pending ops.
I20260709 13:20:16.820303 17228 pending_rounds.cc:77] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: Aborting op as it isn't in flight: id { term: 19 index: 15 } timestamp: 7305638773622321152 op_type: NO_OP noop_request { }
I20260709 13:20:16.820814 17228 raft_consensus.cc:2889] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:16.821427 17228 raft_consensus.cc:2272] T 77cd16981fa049aaaa881bdeacda2fc3 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:16.823537 19027 consensus_peers.cc:597] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:16.845827 19025 consensus_peers.cc:597] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:16.848268 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.826972 17228 tablet_replica.cc:333] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
W20260709 13:20:16.828464 19026 consensus_peers.cc:597] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:16.865952 17228 raft_consensus.cc:2243] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.868423 17228 raft_consensus.cc:2272] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:16.871104 19026 consensus_peers.cc:597] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.872589 17228 tablet_replica.cc:333] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.873953 17228 raft_consensus.cc:2243] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.874661 17228 raft_consensus.cc:2272] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:16.879926 19025 consensus_peers.cc:597] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.880887 17228 tablet_replica.cc:333] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.881697 17228 raft_consensus.cc:2243] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.882375 17228 raft_consensus.cc:2272] T 02f16ac6b95a48868f83cdf22debb207 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:16.883652 19026 consensus_peers.cc:597] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:16.884847 17228 tablet_replica.cc:333] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.885651 17228 raft_consensus.cc:2243] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.886520 17228 raft_consensus.cc:2272] T f5da9c99398d461ba6b04325cb5faf48 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:16.890102 19026 consensus_peers.cc:597] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:16.892870 18457 consensus_peers.cc:597] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:16.898447 17228 tablet_replica.cc:333] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
W20260709 13:20:16.892926 19026 consensus_peers.cc:597] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:16.903100 17228 raft_consensus.cc:2243] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.903898 17228 raft_consensus.cc:2272] T b176e8c616ab4b039f2e48b14549f43b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.906631 17228 tablet_replica.cc:333] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.907435 17228 raft_consensus.cc:2243] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.908340 17228 raft_consensus.cc:2272] T f0f6372354b84d0ea884a3478b3dfd98 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.912182 17228 tablet_replica.cc:333] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.912895 17228 raft_consensus.cc:2243] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.913940 17228 raft_consensus.cc:2272] T 9560de944c37467eb1e18d5627ed0fd9 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:16.915468 19026 consensus_peers.cc:597] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:16.916381 17228 tablet_replica.cc:333] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.917235 17228 raft_consensus.cc:2243] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.918329 17228 raft_consensus.cc:2272] T beb1497b39de4cbbaf75d8c82f903278 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.921095 17228 tablet_replica.cc:333] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.921911 17228 raft_consensus.cc:2243] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.922612 17228 raft_consensus.cc:2272] T f9697a1f706e47fa9c62306b225e97fa P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.926164 17228 tablet_replica.cc:333] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.926852 17228 raft_consensus.cc:2243] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.927922 17228 raft_consensus.cc:2272] T b5d50aacd9894a6ca1895dbf30df38dc P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.930500 17228 tablet_replica.cc:333] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f: stopping tablet replica
I20260709 13:20:16.931210 17228 raft_consensus.cc:2243] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.932266 17228 raft_consensus.cc:2272] T 35d61c75b589420ab4319c7a05b2b72b P 9d6cd7c600ec4ab2b5cac479f05d4c0f [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:16.951824 19026 consensus_peers.cc:597] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:16.965713 19026 consensus_peers.cc:597] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:16.981068 19025 consensus_peers.cc:597] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:17.010294 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.014930 18456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.014866 18458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.016359 18458 leader_election.cc:336] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:17.019372 18458 leader_election.cc:304] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:17.020090 18458 raft_consensus.cc:2686] T 5069a3aa86984fcd93f4fb63a92ef8cd P 9d6cd7c600ec4ab2b5cac479f05d4c0f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:20:17.020934 18458 leader_election.cc:336] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:17.018944 18459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.022661 19025 consensus_peers.cc:597] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:17.029685 18458 leader_election.cc:304] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:17.032318 18458 raft_consensus.cc:2686] T f99562a3c70c43d2b33161d483871d6c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:20:17.034315 18458 leader_election.cc:336] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:17.034744 18458 leader_election.cc:304] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:17.035420 18458 raft_consensus.cc:2686] T f1a6e60961c64b469cf1a97767887e79 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:20:17.046181 18458 leader_election.cc:336] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:17.046669 18458 leader_election.cc:304] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:17.047345 18458 raft_consensus.cc:2686] T 8b55cf48798a4468ae4b6aa4a26a477f P 9d6cd7c600ec4ab2b5cac479f05d4c0f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:20:17.048868 18458 leader_election.cc:336] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:17.049252 18458 leader_election.cc:304] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:17.049813 18458 raft_consensus.cc:2686] T 36dd573a999e4211a80fa3aeb1b2dbd2 P 9d6cd7c600ec4ab2b5cac479f05d4c0f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:20:17.051620 18458 leader_election.cc:336] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:17.058959 18458 leader_election.cc:304] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:17.061404 18458 raft_consensus.cc:2686] T 11ec555240a9486fad41ffb02e94fd9c P 9d6cd7c600ec4ab2b5cac479f05d4c0f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:20:17.102378 19026 consensus_peers.cc:597] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:17.226991 19027 consensus_peers.cc:597] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:17.236058 19027 consensus_peers.cc:597] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:17.308759 19027 consensus_peers.cc:597] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:17.367161 19027 consensus_peers.cc:597] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:17.369601 25219 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:17.374135 25219 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:17.376358 25219 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:17.411769 19026 leader_election.cc:336] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:17.414893 19027 consensus_peers.cc:597] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:17.418202 19027 leader_election.cc:336] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:17.421582 19027 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:17.422744 25219 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:17.423804 19027 consensus_peers.cc:597] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:17.459410 19027 consensus_peers.cc:597] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:17.464418 19027 consensus_peers.cc:597] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:17.531426 19027 consensus_peers.cc:597] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:17.558800 19027 consensus_peers.cc:597] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:17.559424 19027 consensus_peers.cc:597] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:17.570310 25219 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:17.570948 25219 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:17.573396 25219 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:17.581041 19026 leader_election.cc:336] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:17.586640 19027 leader_election.cc:336] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:17.587137 19027 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:17.587899 25219 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:17.612681 19027 consensus_peers.cc:597] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:17.615357 19027 consensus_peers.cc:597] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:17.620381 25219 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:17.620975 25219 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:17.622838 25219 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:17.630577 19026 leader_election.cc:336] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:17.633318 19025 leader_election.cc:336] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:17.633809 19025 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:17.635048 25219 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:17.699086 25219 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:17.699756 25219 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:17.706789 19026 leader_election.cc:336] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:17.707753 25304 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:17.708335 25304 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:17.710592 25304 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:17.711866 25304 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:17.712427 25304 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:17.714493 25304 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:17.719151 25219 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:17.720659 25299 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:17.721273 25299 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:17.723783 25299 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:17.733758 19026 leader_election.cc:336] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:17.744709 19025 leader_election.cc:336] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:17.751111 19027 leader_election.cc:336] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:17.752076 19027 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:17.753640 25219 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:17.751588 19025 leader_election.cc:336] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:17.758795 19027 leader_election.cc:336] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:17.765830 19027 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:17.766741 19025 leader_election.cc:336] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:17.770915 19025 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:17.771677 25219 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:17.772672 19025 leader_election.cc:336] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:17.773547 19025 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:17.773128 25219 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:17.777874 25304 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:17.791975 19027 consensus_peers.cc:597] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:17.800654 19027 consensus_peers.cc:597] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:17.821566 25219 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:17.822178 25219 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:17.824007 25219 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:17.834535 19025 leader_election.cc:336] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:17.844899 19027 leader_election.cc:336] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:17.845772 19027 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:17.846928 25219 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:17.886476 25304 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:17.887001 25304 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:17.888988 25304 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:17.894383 19026 leader_election.cc:336] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:17.919414 25219 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:17.919989 25219 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:17.923193 25219 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:17.956826 19025 leader_election.cc:336] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:17.958491 19025 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:20:17.957679 19027 consensus_peers.cc:597] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:17.964702 25304 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:18.004626 19027 leader_election.cc:336] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:18.010645 19025 leader_election.cc:336] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:18.011121 19025 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:18.015071 25299 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:18.093029 17228 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 18514)
I20260709 13:20:18.142077 25219 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:18.143602 25219 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:18.172166 25219 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:18.184320 25304 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:18.185449 25304 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:18.177815 19027 consensus_peers.cc:597] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:18.188990 25304 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:18.190953 19027 consensus_peers.cc:597] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:18.199184 19027 leader_election.cc:336] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:18.201073 25219 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:18.202035 25219 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:18.204406 25219 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:18.206288 19026 leader_election.cc:336] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:18.212044 19027 leader_election.cc:336] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:18.212493 19025 leader_election.cc:336] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:18.215348 19026 leader_election.cc:336] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:18.215764 19026 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:18.218659 25299 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:18.219655 25299 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:18.222640 25299 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:18.218096 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:18.228509 25299 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:18.229089 25304 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:18.233592 19025 leader_election.cc:336] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:18.234984 19027 leader_election.cc:336] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:18.235770 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:18.236523 25299 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:18.241580 25299 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:18.242432 25299 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:18.245115 25299 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:18.248785 19026 leader_election.cc:336] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:18.249341 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
W20260709 13:20:18.251977 19027 leader_election.cc:336] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:18.252627 19026 leader_election.cc:336] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:18.253086 19026 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:18.253908 25304 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:18.254703 25304 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:18.267376 19058 consensus_queue.cc:237] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:18.292351 19025 consensus_peers.cc:597] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.302088 19026 consensus_peers.cc:597] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.332696 25299 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:18.333410 25299 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:18.335342 25299 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:18.339581 19025 leader_election.cc:336] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:18.340471 19026 leader_election.cc:336] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:18.340832 19026 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:18.341401 25299 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:18.345552 25299 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.346167 25299 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:18.348865 25304 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.349512 25304 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:18.351639 25304 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:18.355669 19025 leader_election.cc:336] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:18.357012 19026 leader_election.cc:336] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:18.360497 19026 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:18.361217 25304 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:18.359158 25299 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:18.364015 19025 leader_election.cc:336] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:18.365967 19026 leader_election.cc:336] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:18.366390 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:18.367584 25304 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:18.368306 25304 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:18.369122 25304 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:18.371320 25304 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:18.377122 19027 leader_election.cc:336] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:18.377669 19025 leader_election.cc:336] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:18.378170 19025 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:18.379914 25304 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:18.422617 25299 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.423241 25299 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:18.425065 25299 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:18.428359 25299 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
W20260709 13:20:18.429229 19026 leader_election.cc:336] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:18.429064 25299 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:18.431908 19025 leader_election.cc:336] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:18.433337 25299 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:18.432369 19025 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:18.435230 25299 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:18.435256 19026 leader_election.cc:336] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:18.439728 19025 leader_election.cc:336] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:18.440099 19025 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:18.440752 25299 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:18.749629 19027 consensus_peers.cc:597] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:18.944223 19025 consensus_peers.cc:597] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:18.949811 19025 consensus_peers.cc:597] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:18.986294 19025 consensus_peers.cc:597] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.001459 19026 consensus_peers.cc:597] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:19.022547 19025 consensus_peers.cc:597] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.073135 18273 debug-util.cc:398] Leaking SignalData structure 0x7b08001757e0 after lost signal to thread 17231
W20260709 13:20:19.075094 18273 debug-util.cc:398] Leaking SignalData structure 0x7b08002a0620 after lost signal to thread 18276
W20260709 13:20:19.076741 18273 debug-util.cc:398] Leaking SignalData structure 0x7b0800103860 after lost signal to thread 19086
W20260709 13:20:19.093948 17228 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 18514)
I20260709 13:20:19.104997 25299 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:19.105844 25299 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:19.108089 25299 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:19.113746 19027 leader_election.cc:336] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:19.118731 19026 leader_election.cc:336] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:19.119271 19026 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:19.120059 25299 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:19.145800 19026 consensus_peers.cc:597] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:19.182639 19025 consensus_peers.cc:597] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.204541 19025 consensus_peers.cc:597] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.207784 19025 consensus_peers.cc:597] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.235741 19025 consensus_peers.cc:597] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.243597 19026 consensus_peers.cc:597] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.249241 19025 consensus_peers.cc:597] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.307312 19026 consensus_peers.cc:597] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.317373 19026 consensus_peers.cc:597] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:19.327387 19026 consensus_peers.cc:597] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:19.328495 19025 consensus_peers.cc:597] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.331583 19025 consensus_peers.cc:597] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.351488 19025 consensus_peers.cc:597] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.361315 19026 consensus_peers.cc:597] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.396945 19026 consensus_peers.cc:597] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:19.414084 25299 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:19.414837 25299 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:19.416844 25299 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:19.426424 19025 leader_election.cc:336] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:19.429989 19026 leader_election.cc:336] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:19.432529 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:20:19.443421 19027 consensus_peers.cc:597] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:19.445391 25304 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:19.527130 19026 consensus_peers.cc:597] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:19.533321 19025 consensus_peers.cc:597] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.543530 19026 consensus_peers.cc:597] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:19.573335 19027 consensus_peers.cc:597] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:19.581758 19026 consensus_peers.cc:597] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:19.607095 25299 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:19.608011 25299 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:19.610179 25299 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:19.620306 19027 leader_election.cc:336] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:19.621416 19025 leader_election.cc:336] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:19.621976 19025 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:19.623212 25299 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:19.635797 19026 consensus_peers.cc:597] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:19.661192 25304 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:19.661957 25304 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:19.664176 25304 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:19.668632 19027 consensus_peers.cc:597] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:19.677706 19025 leader_election.cc:336] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:19.678556 19026 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111) [suppressed 623 similar messages]
W20260709 13:20:19.686165 19026 consensus_peers.cc:597] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:19.686697 25304 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:19.687876 25304 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:19.697592 25304 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:19.700052 19026 leader_election.cc:336] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:19.703126 19027 leader_election.cc:336] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:19.705380 19026 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:19.711306 25323 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:19.715662 19025 leader_election.cc:336] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:19.716857 19025 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:19.718986 25323 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:19.716351 19026 consensus_peers.cc:597] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:19.761770 19027 consensus_peers.cc:597] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:19.769564 19027 consensus_peers.cc:597] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:19.779075 25323 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:19.789780 25323 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:19.796183 25323 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:19.816359 19025 leader_election.cc:336] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:19.822624 19027 leader_election.cc:336] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:19.823886 19027 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:19.825395 25323 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:19.870666 19027 consensus_peers.cc:597] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:19.884716 25323 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:19.885556 25323 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:19.887874 25323 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:19.897856 19025 leader_election.cc:336] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:19.903815 19027 leader_election.cc:336] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:19.904336 19027 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:19.905158 25323 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:19.918366 25323 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:19.919034 25323 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:19.922324 25323 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:19.928671 19026 leader_election.cc:336] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:19.941347 19025 leader_election.cc:336] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:19.942790 19025 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:20:19.945390 19027 consensus_peers.cc:597] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:19.946244 25304 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:19.971922 25323 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:19.972805 25323 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:19.973817 25304 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.974402 25304 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:19.976814 25304 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:19.979632 25323 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:19.990238 19026 leader_election.cc:336] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:19.991822 25299 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:19.995863 25299 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:19.997887 25299 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:19.998602 19026 leader_election.cc:336] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:20.018946 19027 consensus_peers.cc:597] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:20.019706 19025 leader_election.cc:336] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:20.021574 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:20.025650 25299 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:20.027089 19025 leader_election.cc:336] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:20.028105 19025 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:20:20.027604 19027 leader_election.cc:336] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:20.029421 25299 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:20.035022 19025 leader_election.cc:336] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:20.035574 19025 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:20.036437 25299 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:20.040688 25299 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:20.041296 25299 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:20.050472 19026 leader_election.cc:336] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:20.054431 25299 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:20.066236 19027 consensus_peers.cc:597] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:20.067220 19027 leader_election.cc:336] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:20.067720 19027 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:20.068507 25299 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:20.094472 17228 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 18514)
I20260709 13:20:20.109351 25299 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:20.110098 25299 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:20.112296 25299 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:20.114241 25323 raft_consensus.cc:493] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:20.115891 25323 raft_consensus.cc:515] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:20.119843 25323 leader_election.cc:290] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
I20260709 13:20:20.130106 25299 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:20.130964 25299 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:20.137135 25299 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:20.132503 19026 leader_election.cc:336] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:20.140703 19027 leader_election.cc:336] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:20.144515 19027 consensus_peers.cc:597] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:20.145046 19026 leader_election.cc:336] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:20.145871 19026 leader_election.cc:304] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:20.148025 25299 raft_consensus.cc:2749] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:20.148509 19025 leader_election.cc:336] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:20.152050 19025 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:20.157271 25299 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:20.160650 19027 consensus_peers.cc:597] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:20.162647 19026 leader_election.cc:336] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:20.170320 19025 leader_election.cc:336] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:20.172433 19025 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:20.174762 25299 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:20.176332 19027 consensus_peers.cc:597] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:20.181130 19027 consensus_peers.cc:597] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:20.217505 19027 consensus_peers.cc:597] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:20.298415 19027 consensus_peers.cc:597] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:20.299858 19027 consensus_peers.cc:597] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:20.354496 19027 consensus_peers.cc:597] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:20.408259 25299 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:20.408802 25299 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:20.421600 25299 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:20.422322 19026 leader_election.cc:336] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:20.429299 19025 leader_election.cc:336] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:20.429824 19025 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:20.430712 25299 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:20.475173 19027 consensus_peers.cc:597] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:20.499406 25323 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:20.499977 25323 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:20.502065 25323 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:20.513445 19025 leader_election.cc:336] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:20.516111 19027 leader_election.cc:336] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:20.518011 19027 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:20.519153 25323 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:20.687721 25323 raft_consensus.cc:493] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.688251 25323 raft_consensus.cc:515] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:20.690445 25323 leader_election.cc:290] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:20.696512 19025 leader_election.cc:336] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:20.697217 19026 leader_election.cc:336] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:20.697623 19026 leader_election.cc:304] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:20.698341 25323 raft_consensus.cc:2749] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:20.712239 25323 raft_consensus.cc:493] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.712872 25323 raft_consensus.cc:515] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:20.716063 25323 leader_election.cc:290] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:20.721544 19025 leader_election.cc:336] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:20.722024 19026 leader_election.cc:336] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:20.722510 19026 leader_election.cc:304] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:20.723356 25323 raft_consensus.cc:2749] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:20.852385 25323 raft_consensus.cc:493] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:20.852999 25323 raft_consensus.cc:515] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:20.855646 25323 leader_election.cc:290] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:20.859576 19027 leader_election.cc:336] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:20.861567 19026 leader_election.cc:336] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:20.862013 19026 leader_election.cc:304] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:20.862771 25323 raft_consensus.cc:2749] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:20.888792 19026 consensus_peers.cc:597] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:21.027267 19027 consensus_peers.cc:597] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:21.035723 19025 consensus_peers.cc:597] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:21.094990 17228 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 18514)
I20260709 13:20:21.242993 25299 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:21.243677 25299 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:21.245813 25299 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:21.251444 19026 leader_election.cc:336] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:21.251971 19027 leader_election.cc:336] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:21.252434 19027 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:21.253218 25299 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:21.288821 25323 raft_consensus.cc:493] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:21.289352 25323 raft_consensus.cc:515] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:21.291343 25323 leader_election.cc:290] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:21.298029 19027 leader_election.cc:336] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:21.301443 19026 leader_election.cc:336] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:21.301949 19026 leader_election.cc:304] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:21.302714 25299 raft_consensus.cc:2749] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:21.332532 19025 consensus_peers.cc:597] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:21.348701 19026 consensus_peers.cc:597] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:21.481364 19025 consensus_peers.cc:597] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:21.574503 25323 raft_consensus.cc:493] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:21.575026 25323 raft_consensus.cc:515] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:21.575757 19025 consensus_peers.cc:597] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:21.577327 25323 leader_election.cc:290] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:21.579023 19025 consensus_peers.cc:597] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:21.582731 19025 leader_election.cc:336] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:21.616551 25326 raft_consensus.cc:493] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:21.617159 25326 raft_consensus.cc:515] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:21.641987 19027 leader_election.cc:336] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:21.642480 19027 leader_election.cc:304] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:21.643253 25299 raft_consensus.cc:2749] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:21.653241 19026 consensus_peers.cc:597] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:21.654470 25326 leader_election.cc:290] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:21.657274 19025 consensus_peers.cc:597] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:21.661845 19025 leader_election.cc:336] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:21.663661 19026 leader_election.cc:336] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:21.666584 19026 leader_election.cc:304] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
W20260709 13:20:21.667593 19026 consensus_peers.cc:597] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:21.667869 25327 raft_consensus.cc:2749] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:21.674357 19025 consensus_peers.cc:597] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:21.727662 25327 raft_consensus.cc:493] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:21.728331 25327 raft_consensus.cc:515] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:21.731047 25327 leader_election.cc:290] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:21.732801 19025 consensus_peers.cc:597] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:21.734725 19025 leader_election.cc:336] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:21.736581 19026 leader_election.cc:336] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:21.736919 19026 leader_election.cc:304] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:21.737520 25327 raft_consensus.cc:2749] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:21.747869 19026 consensus_peers.cc:597] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:21.758473 19025 consensus_peers.cc:597] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:21.769627 25327 raft_consensus.cc:493] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:21.770254 25327 raft_consensus.cc:515] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:21.772675 25327 leader_election.cc:290] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:21.775977 19027 leader_election.cc:336] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:21.777027 19025 leader_election.cc:336] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:21.777372 19025 leader_election.cc:304] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:21.777967 25327 raft_consensus.cc:2749] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:21.793283 19026 consensus_peers.cc:597] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:21.824115 19025 consensus_peers.cc:597] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:21.833280 19025 consensus_peers.cc:597] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:21.866882 19027 consensus_peers.cc:597] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:21.873651 19026 consensus_peers.cc:597] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:21.888077 19026 consensus_peers.cc:597] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:21.920483 19027 consensus_peers.cc:597] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:21.944160 19026 consensus_peers.cc:597] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:21.944582 19026 consensus_peers.cc:597] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:21.996379 19026 consensus_peers.cc:597] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:22.000360 19025 consensus_peers.cc:597] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:22.013832 25327 raft_consensus.cc:493] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:22.014526 25327 raft_consensus.cc:515] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:22.017019 25327 leader_election.cc:290] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:22.020714 19027 leader_election.cc:336] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:22.021245 19025 leader_election.cc:336] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:22.021759 19025 leader_election.cc:304] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:22.022673 25327 raft_consensus.cc:2749] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:22.038300 19026 consensus_peers.cc:597] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:22.051882 19027 consensus_peers.cc:597] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:22.084602 19025 consensus_peers.cc:597] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:22.095515 17228 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 18514)
I20260709 13:20:22.096274 25323 raft_consensus.cc:493] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:22.096814 25323 raft_consensus.cc:515] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:22.099561 25323 leader_election.cc:290] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:22.100708 19026 consensus_peers.cc:597] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:22.102972 19026 leader_election.cc:336] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:22.104193 19025 leader_election.cc:336] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:22.104604 19025 leader_election.cc:304] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:22.105376 25323 raft_consensus.cc:2749] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:22.144497 25323 raft_consensus.cc:493] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:22.144938 25323 raft_consensus.cc:515] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:22.146766 25323 leader_election.cc:290] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:22.150394 19026 leader_election.cc:336] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:22.156165 19025 leader_election.cc:336] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:22.157001 19026 leader_election.cc:304] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:22.157945 25327 raft_consensus.cc:2749] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:22.183430 25323 raft_consensus.cc:493] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:22.183913 25323 raft_consensus.cc:515] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:22.185658 25323 leader_election.cc:290] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:22.190125 19026 leader_election.cc:336] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:22.190632 19025 leader_election.cc:336] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:22.191022 19025 leader_election.cc:304] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:22.191601 25323 raft_consensus.cc:2749] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:22.208204 19027 consensus_peers.cc:597] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:22.220219 25323 raft_consensus.cc:493] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:22.220768 25323 raft_consensus.cc:515] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:22.222710 25323 leader_election.cc:290] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:22.227164 19025 leader_election.cc:336] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:22.228428 19027 leader_election.cc:336] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:22.228905 19027 leader_election.cc:304] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:22.229696 25323 raft_consensus.cc:2749] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:22.254469 19025 consensus_peers.cc:597] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Couldn't send request to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:22.281618 19026 consensus_peers.cc:597] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:22.316037 19026 consensus_peers.cc:597] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Couldn't send request to peer 20e06cff39b649c48d342b7431135303. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:22.317572 19027 consensus_peers.cc:597] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:22.361824 19027 consensus_peers.cc:597] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:22.381256 19027 consensus_peers.cc:597] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:22.541326 19027 consensus_peers.cc:597] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:22.563607 19027 consensus_peers.cc:597] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:22.566306 19027 consensus_peers.cc:597] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:22.592463 19027 consensus_peers.cc:597] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:22.592835 19027 consensus_peers.cc:597] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:22.616210 19083 debug-util.cc:398] Leaking SignalData structure 0x7b080039fac0 after lost signal to thread 17231
W20260709 13:20:22.617102 19083 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4b00 after lost signal to thread 18276
W20260709 13:20:22.618288 19083 debug-util.cc:398] Leaking SignalData structure 0x7b0800398b20 after lost signal to thread 19086
W20260709 13:20:22.649019 19027 consensus_peers.cc:597] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:22.656517 25323 raft_consensus.cc:493] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.657196 25323 raft_consensus.cc:515] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:22.659765 25323 leader_election.cc:290] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:22.666880 19026 leader_election.cc:336] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
W20260709 13:20:22.673409 19025 leader_election.cc:336] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
I20260709 13:20:22.674539 19025 leader_election.cc:304] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:22.675602 25327 raft_consensus.cc:2749] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:22.676723 19027 consensus_peers.cc:597] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:22.691084 19027 consensus_peers.cc:597] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:22.734158 25327 raft_consensus.cc:493] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:22.734965 25327 raft_consensus.cc:515] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:22.740492 25323 raft_consensus.cc:493] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:22.741191 25323 raft_consensus.cc:515] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:22.743947 25323 leader_election.cc:290] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:22.753037 19025 leader_election.cc:336] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:22.756280 19027 leader_election.cc:336] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:22.757387 19026 leader_election.cc:336] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:22.757767 19026 leader_election.cc:304] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:22.758514 25323 raft_consensus.cc:2749] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:22.759183 25323 raft_consensus.cc:493] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:22.759241 25327 leader_election.cc:290] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:22.759749 25323 raft_consensus.cc:515] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
W20260709 13:20:22.760382 19026 leader_election.cc:336] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:22.760802 19026 leader_election.cc:304] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:22.762120 25323 leader_election.cc:290] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
I20260709 13:20:22.762737 25323 raft_consensus.cc:2749] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:22.766602 19025 leader_election.cc:336] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:22.773324 19026 leader_election.cc:336] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:22.773722 19026 leader_election.cc:304] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, 9d6cd7c600ec4ab2b5cac479f05d4c0f
I20260709 13:20:22.774674 25329 raft_consensus.cc:2749] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:22.842139 19027 consensus_peers.cc:597] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:22.898082 19027 consensus_peers.cc:597] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:22.921716 19027 consensus_peers.cc:597] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 -> Peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Couldn't send request to peer d03b672b2ff044b8bc2a0dfd8180ee19. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:22.941354 25327 raft_consensus.cc:493] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:22.941994 25327 raft_consensus.cc:515] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:22.944118 25327 leader_election.cc:290] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:22.950158 19025 leader_election.cc:336] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:22.951889 19027 leader_election.cc:336] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:22.952378 19027 leader_election.cc:304] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:22.953188 25327 raft_consensus.cc:2749] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:23.011304 25327 raft_consensus.cc:493] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d6cd7c600ec4ab2b5cac479f05d4c0f)
I20260709 13:20:23.011896 25327 raft_consensus.cc:515] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:23.014053 25327 leader_election.cc:290] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125)
W20260709 13:20:23.019064 19025 leader_election.cc:336] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9d6cd7c600ec4ab2b5cac479f05d4c0f (127.16.211.3:43125): Network error: Client connection negotiation failed: client connection to 127.16.211.3:43125: connect: Connection refused (error 111)
W20260709 13:20:23.020753 19027 leader_election.cc:336] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
I20260709 13:20:23.021245 19027 leader_election.cc:304] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 9d6cd7c600ec4ab2b5cac479f05d4c0f, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:23.022024 25327 raft_consensus.cc:2749] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:23.089386 17228 tablet_server.cc:196] TabletServer@127.16.211.3:0 shutdown complete.
I20260709 13:20:23.122748 25323 raft_consensus.cc:493] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 20e06cff39b649c48d342b7431135303)
I20260709 13:20:23.123490 25323 raft_consensus.cc:515] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } }
I20260709 13:20:23.126102 25323 leader_election.cc:290] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809), 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251)
W20260709 13:20:23.131709 19027 leader_election.cc:336] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer d03b672b2ff044b8bc2a0dfd8180ee19 (127.16.211.1:37809): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37809: connect: Connection refused (error 111)
W20260709 13:20:23.132306 19026 leader_election.cc:336] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 20e06cff39b649c48d342b7431135303 (127.16.211.2:42251): Network error: Client connection negotiation failed: client connection to 127.16.211.2:42251: connect: Connection refused (error 111)
I20260709 13:20:23.132804 19026 leader_election.cc:304] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31ab487dc52e4f608b39df0fae2fdfa5; no voters: 20e06cff39b649c48d342b7431135303, d03b672b2ff044b8bc2a0dfd8180ee19
I20260709 13:20:23.133667 25323 raft_consensus.cc:2749] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:23.226970 17228 tablet_server.cc:179] TabletServer@127.16.211.4:0 shutting down...
I20260709 13:20:23.278067 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:23.278787 17228 tablet_replica.cc:333] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.279492 17228 raft_consensus.cc:2243] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.280584 17228 raft_consensus.cc:2272] T 4139afe4ea2b4938821aa26d4c12e6ab P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.282929 17228 tablet_replica.cc:333] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.283548 17228 raft_consensus.cc:2243] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.284294 17228 pending_rounds.cc:70] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Trying to abort 1 pending ops.
I20260709 13:20:23.284533 17228 pending_rounds.cc:77] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting op as it isn't in flight: id { term: 15 index: 13 } timestamp: 7305638782003929088 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "02f16ac6b95a48868f83cdf22debb207" old_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d03b672b2ff044b8bc2a0dfd8180ee19" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37809 } attrs { replace: true } } peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } } new_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "20e06cff39b649c48d342b7431135303" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42251 } } peers { permanent_uuid: "9d6cd7c600ec4ab2b5cac479f05d4c0f" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 43125 } } peers { permanent_uuid: "31ab487dc52e4f608b39df0fae2fdfa5" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 45611 } attrs { promote: false } } } }
I20260709 13:20:23.285205 17228 raft_consensus.cc:2917] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Aborting config change with OpId 15.13: Aborted: Op aborted
I20260709 13:20:23.285447 17228 raft_consensus.cc:2889] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:20:23.285779 17228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43676 (request call id 2) took 5025 ms. Trace:
I20260709 13:20:23.286060 17228 rpcz_store.cc:276] 0709 13:20:18.260291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.260568 (+   277us) service_pool.cc:224] Handling call
0709 13:20:18.275367 (+ 14799us) log.cc:844] Serialized 494 byte log entry
0709 13:20:23.285727 (+5010360us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":212,"raft.run_cpu_time_us":1069,"raft.run_wall_time_us":1068,"spinlock_wait_cycles":111360,"thread_start_us":10637,"threads_started":1,"wal-append.queue_time_us":7152,"wal-append.run_cpu_time_us":2695,"wal-append.run_wall_time_us":1007259}
I20260709 13:20:23.287084 17228 raft_consensus.cc:2272] T 02f16ac6b95a48868f83cdf22debb207 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:23.287578 18228 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 02f16ac6b95a48868f83cdf22debb207 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted
I20260709 13:20:23.289129 17228 tablet_replica.cc:333] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.289783 17228 raft_consensus.cc:2243] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.290729 17228 raft_consensus.cc:2272] T b1c3d9691e854ee98b2b7d81f868c727 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.292604 17228 tablet_replica.cc:333] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.293201 17228 raft_consensus.cc:2243] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.293725 17228 raft_consensus.cc:2272] T b345033a56994fff90990b7d03324074 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.295619 17228 tablet_replica.cc:333] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.296202 17228 raft_consensus.cc:2243] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.297853 17228 raft_consensus.cc:2272] T 64f9a8403ec74b85bc4a3ff12e5f686a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.299978 17228 tablet_replica.cc:333] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.300576 17228 raft_consensus.cc:2243] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.301465 17228 raft_consensus.cc:2272] T ac1699feafbd4621b7b7a28933b59fec P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.303546 17228 tablet_replica.cc:333] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.304122 17228 raft_consensus.cc:2243] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.305011 17228 raft_consensus.cc:2272] T 97efddba551a406f8d4427488fc22c5c P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.307049 17228 tablet_replica.cc:333] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.307556 17228 raft_consensus.cc:2243] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.308310 17228 raft_consensus.cc:2272] T 479d13df82394c22b38ff5fd8a8b5931 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.310294 17228 tablet_replica.cc:333] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.311117 17228 raft_consensus.cc:2243] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.312222 17228 raft_consensus.cc:2272] T 2b12e68055d54f32b4b3e7d0d0c76af4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.315057 17228 tablet_replica.cc:333] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.315692 17228 raft_consensus.cc:2243] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.316792 17228 raft_consensus.cc:2272] T b1734a6c318d4e6ba6b65fd828d4fe66 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.319093 17228 tablet_replica.cc:333] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.319658 17228 raft_consensus.cc:2243] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.320335 17228 raft_consensus.cc:2272] T b5d50aacd9894a6ca1895dbf30df38dc P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.322297 17228 tablet_replica.cc:333] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.322813 17228 raft_consensus.cc:2243] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.323292 17228 raft_consensus.cc:2272] T 35d61c75b589420ab4319c7a05b2b72b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.325084 17228 tablet_replica.cc:333] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.325613 17228 raft_consensus.cc:2243] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.326561 17228 raft_consensus.cc:2272] T bb654ec8beb54a539b5b6b44aa5181c3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.328585 17228 tablet_replica.cc:333] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.329144 17228 raft_consensus.cc:2243] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.330044 17228 raft_consensus.cc:2272] T 88ca5739563d4349a7b7a6c70d81e653 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.331790 17228 tablet_replica.cc:333] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.332336 17228 raft_consensus.cc:2243] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.333154 17228 raft_consensus.cc:2272] T 21b9264b0a434b79b6292c2ed23bbae0 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.334932 17228 tablet_replica.cc:333] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.335446 17228 raft_consensus.cc:2243] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.335907 17228 raft_consensus.cc:2272] T beb1497b39de4cbbaf75d8c82f903278 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.337719 17228 tablet_replica.cc:333] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.338294 17228 raft_consensus.cc:2243] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.338783 17228 raft_consensus.cc:2272] T 9986bcf770bb42549bfb7d77ec66768b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.340500 17228 tablet_replica.cc:333] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.341042 17228 raft_consensus.cc:2243] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.341879 17228 raft_consensus.cc:2272] T f9e75d2ac4114e428bf95ddfa6245037 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.343757 17228 tablet_replica.cc:333] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.344322 17228 raft_consensus.cc:2243] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.344830 17228 raft_consensus.cc:2272] T 06fc3d36b088480ab5fb6ac2a5600252 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.346773 17228 tablet_replica.cc:333] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.347306 17228 raft_consensus.cc:2243] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.348210 17228 raft_consensus.cc:2272] T 069e2e1b4c714f01a2bc3ad59e3618f1 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.350039 17228 tablet_replica.cc:333] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.350595 17228 raft_consensus.cc:2243] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.351480 17228 raft_consensus.cc:2272] T 3eb2cd7aaa1d4bd3866023ef0cbae974 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.353323 17228 tablet_replica.cc:333] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.353881 17228 raft_consensus.cc:2243] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.354446 17228 raft_consensus.cc:2272] T 3b2a2d7b65c646deb16cdddec208645e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.356741 17228 tablet_replica.cc:333] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.357491 17228 raft_consensus.cc:2243] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.358624 17228 raft_consensus.cc:2272] T 218ede86207640ab99622c70bae54d07 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.360498 17228 tablet_replica.cc:333] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.360991 17228 raft_consensus.cc:2243] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.361740 17228 raft_consensus.cc:2272] T c88b963fb1b740418ee335cb0fe83049 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.363516 17228 tablet_replica.cc:333] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.363984 17228 raft_consensus.cc:2243] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.364641 17228 raft_consensus.cc:2272] T 102530a9a2f94c3492b2af9e95b376f6 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.366382 17228 tablet_replica.cc:333] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.366828 17228 raft_consensus.cc:2243] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.367569 17228 raft_consensus.cc:2272] T b8b55a3ba07d4097b2da619afcf80e3f P 31ab487dc52e4f608b39df0fae2fdfa5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.369262 17228 tablet_replica.cc:333] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.369715 17228 raft_consensus.cc:2243] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.370467 17228 pending_rounds.cc:70] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Trying to abort 1 pending ops.
I20260709 13:20:23.370664 17228 pending_rounds.cc:77] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting op as it isn't in flight: id { term: 18 index: 14 } timestamp: 7305638773789679616 op_type: NO_OP noop_request { }
I20260709 13:20:23.370916 17228 raft_consensus.cc:2889] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:23.371134 17228 raft_consensus.cc:2272] T e0c142ad00b14613a8e3623c478ebdaf P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.372699 17228 tablet_replica.cc:333] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.373157 17228 raft_consensus.cc:2243] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.373848 17228 pending_rounds.cc:70] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Trying to abort 1 pending ops.
I20260709 13:20:23.374066 17228 pending_rounds.cc:77] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting op as it isn't in flight: id { term: 20 index: 17 } timestamp: 7305638774171099136 op_type: NO_OP noop_request { }
I20260709 13:20:23.374277 17228 raft_consensus.cc:2889] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:23.374478 17228 raft_consensus.cc:2272] T f9697a1f706e47fa9c62306b225e97fa P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.376137 17228 tablet_replica.cc:333] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.376711 17228 raft_consensus.cc:2243] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.377141 17228 raft_consensus.cc:2272] T 9088f88404fe42cd909dc0c66c1c0c17 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.378888 17228 tablet_replica.cc:333] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.379436 17228 raft_consensus.cc:2243] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.379876 17228 raft_consensus.cc:2272] T 36d775fb4ae54c3ab8335a03e2ad44f4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.381522 17228 tablet_replica.cc:333] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.382045 17228 raft_consensus.cc:2243] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.382407 17228 raft_consensus.cc:2272] T 4f8c1407aa1e47808dbc2b1bc02c81a3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.384044 17228 tablet_replica.cc:333] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.384490 17228 raft_consensus.cc:2243] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.384873 17228 raft_consensus.cc:2272] T f59be45893c741da9dfbf367c31f3851 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.386442 17228 tablet_replica.cc:333] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.386942 17228 raft_consensus.cc:2243] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.387646 17228 pending_rounds.cc:70] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Trying to abort 1 pending ops.
I20260709 13:20:23.387820 17228 pending_rounds.cc:77] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting op as it isn't in flight: id { term: 20 index: 16 } timestamp: 7305638772914315264 op_type: NO_OP noop_request { }
I20260709 13:20:23.388094 17228 raft_consensus.cc:2889] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:23.388329 17228 raft_consensus.cc:2272] T c3024cea1b1847929dd26f32197f9067 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.390065 17228 tablet_replica.cc:333] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.390503 17228 raft_consensus.cc:2243] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.391269 17228 raft_consensus.cc:2272] T e1bc6fb6380b4ad7b0907976d075d20e P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.392964 17228 tablet_replica.cc:333] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.393432 17228 raft_consensus.cc:2243] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.394210 17228 pending_rounds.cc:70] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Trying to abort 1 pending ops.
I20260709 13:20:23.394369 17228 pending_rounds.cc:77] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5: Aborting op as it isn't in flight: id { term: 13 index: 12 } timestamp: 7305638774414344192 op_type: NO_OP noop_request { }
I20260709 13:20:23.394578 17228 raft_consensus.cc:2889] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:23.394778 17228 raft_consensus.cc:2272] T b176e8c616ab4b039f2e48b14549f43b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.396473 17228 tablet_replica.cc:333] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.396919 17228 raft_consensus.cc:2243] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.397607 17228 raft_consensus.cc:2272] T 839ba6300c764efc8e880c80a27079b2 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.399322 17228 tablet_replica.cc:333] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.399765 17228 raft_consensus.cc:2243] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.400594 17228 raft_consensus.cc:2272] T b972754511104f898e9cbc171aa6c170 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.402396 17228 tablet_replica.cc:333] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.402820 17228 raft_consensus.cc:2243] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.403322 17228 raft_consensus.cc:2272] T 77cd16981fa049aaaa881bdeacda2fc3 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.404939 17228 tablet_replica.cc:333] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.405335 17228 raft_consensus.cc:2243] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.405750 17228 raft_consensus.cc:2272] T bf69de9977524f43803f402f2cfed3d4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.407384 17228 tablet_replica.cc:333] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.407909 17228 raft_consensus.cc:2243] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.408284 17228 raft_consensus.cc:2272] T 41082fa41d05470eb1937d1997399fa4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.410046 17228 tablet_replica.cc:333] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.410458 17228 raft_consensus.cc:2243] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.411198 17228 raft_consensus.cc:2272] T c860bd12a6124270ba17146fea662e3b P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.412835 17228 tablet_replica.cc:333] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.413250 17228 raft_consensus.cc:2243] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.413604 17228 raft_consensus.cc:2272] T d4511f72b2b34e4d82124396a41054ca P 31ab487dc52e4f608b39df0fae2fdfa5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.415268 17228 tablet_replica.cc:333] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.415653 17228 raft_consensus.cc:2243] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.416043 17228 raft_consensus.cc:2272] T fcca3d62b9ee4ee98c16e7e079d076b7 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.417661 17228 tablet_replica.cc:333] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.418154 17228 raft_consensus.cc:2243] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:23.418583 17228 raft_consensus.cc:2272] T b532a06bf55a4b9b892b97bd8376715a P 31ab487dc52e4f608b39df0fae2fdfa5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.420267 17228 tablet_replica.cc:333] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5: stopping tablet replica
I20260709 13:20:23.420635 17228 raft_consensus.cc:2243] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:20:23.421375 17228 raft_consensus.cc:2272] T 6419a332888d490f92e43b717ff1edd4 P 31ab487dc52e4f608b39df0fae2fdfa5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:23.934350 17228 tablet_server.cc:196] TabletServer@127.16.211.4:0 shutdown complete.
I20260709 13:20:24.002892 17228 master.cc:562] Master@127.16.211.62:40381 shutting down...
W20260709 13:20:39.718549 18228 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.211.4:45611: connect: Connection refused (error 111) [suppressed 425 similar messages]
W20260709 13:20:39.722074 18228 catalog_manager.cc:4755] TS 31ab487dc52e4f608b39df0fae2fdfa5 (127.16.211.4:45611): ChangeConfig:REMOVE_PEER RPC failed for tablet 02f16ac6b95a48868f83cdf22debb207: Network error: Client connection negotiation failed: client connection to 127.16.211.4:45611: connect: Connection refused (error 111)
I20260709 13:20:41.044765 17228 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:41.045847 17228 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:41.046226 17228 tablet_replica.cc:333] T 00000000000000000000000000000000 P ea3145ed28eb426e9222df0873a0b8d5: stopping tablet replica
I20260709 13:20:41.284894 17228 master.cc:584] Master@127.16.211.62:40381 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (229445 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:20:41.400985 17228 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.211.62:42373
I20260709 13:20:41.402217 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:41.407961 25335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:41.407982 25334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:41.409155 25337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:41.410552 17228 server_base.cc:1061] running on GCE node
I20260709 13:20:41.413653 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:41.413844 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:41.414039 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603241414024 us; error 0 us; skew 500 ppm
I20260709 13:20:41.414597 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:41.417057 17228 webserver.cc:533] Webserver started at http://127.16.211.62:40797/ using document root <none> and password file <none>
I20260709 13:20:41.417552 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:41.417748 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:41.418322 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:41.419585 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/master-0-root/instance:
uuid: "b3ae1c1987214dabbd7971a4f18cb4bc"
format_stamp: "Formatted at 2026-07-09 13:20:41 on dist-test-slave-96c3"
I20260709 13:20:41.424000 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:20:41.427233 25342 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:41.427959 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:41.428246 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/master-0-root
uuid: "b3ae1c1987214dabbd7971a4f18cb4bc"
format_stamp: "Formatted at 2026-07-09 13:20:41 on dist-test-slave-96c3"
I20260709 13:20:41.428629 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:41.455369 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:41.456580 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:41.495100 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.62:42373
I20260709 13:20:41.495211 25393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.62:42373 every 8 connection(s)
I20260709 13:20:41.499387 25394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.511637 25394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc: Bootstrap starting.
I20260709 13:20:41.516829 25394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.521348 25394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc: No bootstrap required, opened a new log
I20260709 13:20:41.523794 25394 raft_consensus.cc:359] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ae1c1987214dabbd7971a4f18cb4bc" member_type: VOTER }
I20260709 13:20:41.524292 25394 raft_consensus.cc:385] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.524535 25394 raft_consensus.cc:740] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ae1c1987214dabbd7971a4f18cb4bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.525306 25394 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ae1c1987214dabbd7971a4f18cb4bc" member_type: VOTER }
I20260709 13:20:41.525771 25394 raft_consensus.cc:399] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:41.526101 25394 raft_consensus.cc:493] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:41.526419 25394 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.531534 25394 raft_consensus.cc:515] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ae1c1987214dabbd7971a4f18cb4bc" member_type: VOTER }
I20260709 13:20:41.532088 25394 leader_election.cc:304] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3ae1c1987214dabbd7971a4f18cb4bc; no voters: 
I20260709 13:20:41.533263 25394 leader_election.cc:290] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:41.533552 25397 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:41.534972 25397 raft_consensus.cc:697] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [term 1 LEADER]: Becoming Leader. State: Replica: b3ae1c1987214dabbd7971a4f18cb4bc, State: Running, Role: LEADER
I20260709 13:20:41.535694 25397 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ae1c1987214dabbd7971a4f18cb4bc" member_type: VOTER }
I20260709 13:20:41.536522 25394 sys_catalog.cc:565] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:41.542826 25399 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3ae1c1987214dabbd7971a4f18cb4bc. Latest consensus state: current_term: 1 leader_uuid: "b3ae1c1987214dabbd7971a4f18cb4bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ae1c1987214dabbd7971a4f18cb4bc" member_type: VOTER } }
I20260709 13:20:41.543020 25398 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3ae1c1987214dabbd7971a4f18cb4bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ae1c1987214dabbd7971a4f18cb4bc" member_type: VOTER } }
I20260709 13:20:41.543557 25399 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:41.543605 25398 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:41.545574 25406 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:41.550544 25406 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:41.553169 17228 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:41.560366 25406 catalog_manager.cc:1383] Generated new cluster ID: e3b1137e9898422a9a34a9403a3d344e
I20260709 13:20:41.560699 25406 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:41.579071 25406 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:41.580304 25406 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:41.603473 25406 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc: Generated new TSK 0
I20260709 13:20:41.604030 25406 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:41.624100 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:41.630688 25415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:41.632028 25416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:41.632820 25418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:41.634976 17228 server_base.cc:1061] running on GCE node
I20260709 13:20:41.637058 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:41.637267 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:41.637445 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603241637412 us; error 0 us; skew 500 ppm
I20260709 13:20:41.638114 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:41.640435 17228 webserver.cc:533] Webserver started at http://127.16.211.1:39125/ using document root <none> and password file <none>
I20260709 13:20:41.640991 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:41.641183 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:41.641458 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:41.642709 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/instance:
uuid: "812474b88dc54c39bc37428d77dcb7a9"
format_stamp: "Formatted at 2026-07-09 13:20:41 on dist-test-slave-96c3"
I20260709 13:20:41.647176 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:20:41.650506 25423 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:41.651335 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:20:41.651631 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-0-root
uuid: "812474b88dc54c39bc37428d77dcb7a9"
format_stamp: "Formatted at 2026-07-09 13:20:41 on dist-test-slave-96c3"
I20260709 13:20:41.651935 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:41.667248 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:41.668466 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:41.670002 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:41.672367 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:41.672592 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:41.672827 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:41.673013 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:41.715543 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.1:45089
I20260709 13:20:41.715628 25485 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.1:45089 every 8 connection(s)
I20260709 13:20:41.720774 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:41.727946 25490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:41.728848 25491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:41.733982 25493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:41.734040 17228 server_base.cc:1061] running on GCE node
I20260709 13:20:41.736549 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:41.736788 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:41.737021 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603241737000 us; error 0 us; skew 500 ppm
I20260709 13:20:41.737753 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:41.738423 25486 heartbeater.cc:344] Connected to a master server at 127.16.211.62:42373
I20260709 13:20:41.738921 25486 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:41.739791 25486 heartbeater.cc:507] Master 127.16.211.62:42373 requested a full tablet report, sending...
I20260709 13:20:41.740494 17228 webserver.cc:533] Webserver started at http://127.16.211.2:35873/ using document root <none> and password file <none>
I20260709 13:20:41.741017 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:41.741230 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:41.741521 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:41.742267 25359 ts_manager.cc:194] Registered new tserver with Master: 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:41.743296 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/instance:
uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
format_stamp: "Formatted at 2026-07-09 13:20:41 on dist-test-slave-96c3"
I20260709 13:20:41.744866 25359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45730
I20260709 13:20:41.748644 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:20:41.752228 25498 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:41.753042 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:20:41.753329 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-1-root
uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
format_stamp: "Formatted at 2026-07-09 13:20:41 on dist-test-slave-96c3"
I20260709 13:20:41.753618 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:41.777513 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:41.778829 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:41.780361 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:41.782614 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:41.782800 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:41.783099 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:41.783234 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:41.825973 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.2:33863
I20260709 13:20:41.826175 25560 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.2:33863 every 8 connection(s)
I20260709 13:20:41.830968 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:41.839195 25564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:41.841662 25565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:41.842679 25567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:41.842840 17228 server_base.cc:1061] running on GCE node
I20260709 13:20:41.844255 25561 heartbeater.cc:344] Connected to a master server at 127.16.211.62:42373
I20260709 13:20:41.844492 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:20:41.844645 25561 heartbeater.cc:461] Registering TS with master...
W20260709 13:20:41.844871 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:41.845103 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603241845086 us; error 0 us; skew 500 ppm
I20260709 13:20:41.845592 25561 heartbeater.cc:507] Master 127.16.211.62:42373 requested a full tablet report, sending...
I20260709 13:20:41.845713 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:41.847790 25359 ts_manager.cc:194] Registered new tserver with Master: ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:41.848508 17228 webserver.cc:533] Webserver started at http://127.16.211.3:41451/ using document root <none> and password file <none>
I20260709 13:20:41.849020 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:41.849205 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:41.849413 25359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45744
I20260709 13:20:41.849488 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:41.851207 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/instance:
uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
format_stamp: "Formatted at 2026-07-09 13:20:41 on dist-test-slave-96c3"
I20260709 13:20:41.856006 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:20:41.859800 25572 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:41.860729 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:20:41.860975 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-2-root
uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
format_stamp: "Formatted at 2026-07-09 13:20:41 on dist-test-slave-96c3"
I20260709 13:20:41.861207 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:41.883334 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:41.884531 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:41.886027 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:41.888307 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:41.888477 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:41.888768 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:41.888978 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:41.933429 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.3:40853
I20260709 13:20:41.933612 25634 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.3:40853 every 8 connection(s)
I20260709 13:20:41.938532 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:41.946401 25638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:41.946717 25639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:41.949971 25641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:41.950670 17228 server_base.cc:1061] running on GCE node
I20260709 13:20:41.950670 25635 heartbeater.cc:344] Connected to a master server at 127.16.211.62:42373
I20260709 13:20:41.951246 25635 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:41.951710 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:41.952004 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:41.952198 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603241952177 us; error 0 us; skew 500 ppm
I20260709 13:20:41.952122 25635 heartbeater.cc:507] Master 127.16.211.62:42373 requested a full tablet report, sending...
I20260709 13:20:41.952986 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:41.954424 25359 ts_manager.cc:194] Registered new tserver with Master: 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:41.955971 25359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45752
I20260709 13:20:41.958489 17228 webserver.cc:533] Webserver started at http://127.16.211.4:44021/ using document root <none> and password file <none>
I20260709 13:20:41.959041 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:41.959261 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:41.959528 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:41.960672 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-3-root/instance:
uuid: "f8a9e56b2e1e46de810671b2180d8a68"
format_stamp: "Formatted at 2026-07-09 13:20:41 on dist-test-slave-96c3"
I20260709 13:20:41.965360 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:41.968935 25646 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:41.970077 17228 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:41.970439 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-3-root
uuid: "f8a9e56b2e1e46de810671b2180d8a68"
format_stamp: "Formatted at 2026-07-09 13:20:41 on dist-test-slave-96c3"
I20260709 13:20:41.970784 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:41.983796 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:41.985165 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:41.986943 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:41.989310 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:41.989557 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:41.989818 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:41.990043 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:20:42.035425 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.4:44609
I20260709 13:20:42.035537 25708 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.4:44609 every 8 connection(s)
I20260709 13:20:42.051321 25709 heartbeater.cc:344] Connected to a master server at 127.16.211.62:42373
I20260709 13:20:42.051887 25709 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:42.052711 25709 heartbeater.cc:507] Master 127.16.211.62:42373 requested a full tablet report, sending...
I20260709 13:20:42.054973 25359 ts_manager.cc:194] Registered new tserver with Master: f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:42.055557 17228 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01643835s
I20260709 13:20:42.056800 25359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45762
I20260709 13:20:42.083982 25359 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45770:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:20:42.468953 25599 tablet_service.cc:1511] Processing CreateTablet for tablet 2be301b0a3ad4513936a33b8c989ab3d (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:20:42.496091 25599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be301b0a3ad4513936a33b8c989ab3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.511094 25596 tablet_service.cc:1511] Processing CreateTablet for tablet 015cfc692b904ffb8d66556e17bd9ed1 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:20:42.512528 25673 tablet_service.cc:1511] Processing CreateTablet for tablet 2be301b0a3ad4513936a33b8c989ab3d (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:20:42.513880 25597 tablet_service.cc:1511] Processing CreateTablet for tablet 4b54054e46384e8aa7153f332c5c366f (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:20:42.501981 25666 tablet_service.cc:1511] Processing CreateTablet for tablet 9b275ea51fb94eeaac1650d139e43706 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:20:42.518028 25673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be301b0a3ad4513936a33b8c989ab3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.523136 25667 tablet_service.cc:1511] Processing CreateTablet for tablet f703b8e7da3f432e95c5d1b9fc735f71 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:20:42.524570 25667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f703b8e7da3f432e95c5d1b9fc735f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.526268 25666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b275ea51fb94eeaac1650d139e43706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.527100 25446 tablet_service.cc:1511] Processing CreateTablet for tablet 015cfc692b904ffb8d66556e17bd9ed1 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:20:42.528024 25672 tablet_service.cc:1511] Processing CreateTablet for tablet e2520ae829ce4b3082870ad84db70f7d (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:20:42.528632 25446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 015cfc692b904ffb8d66556e17bd9ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.529299 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2520ae829ce4b3082870ad84db70f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.531209 25445 tablet_service.cc:1511] Processing CreateTablet for tablet edc06587e5c544c7a834950d9f45c6c8 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:20:42.512588 25596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 015cfc692b904ffb8d66556e17bd9ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.534852 25443 tablet_service.cc:1511] Processing CreateTablet for tablet f703b8e7da3f432e95c5d1b9fc735f71 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:20:42.539148 25447 tablet_service.cc:1511] Processing CreateTablet for tablet 74f6d48dac364e25bcc18c1388db7fb6 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:20:42.541438 25449 tablet_service.cc:1511] Processing CreateTablet for tablet 2be301b0a3ad4513936a33b8c989ab3d (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:20:42.541862 25595 tablet_service.cc:1511] Processing CreateTablet for tablet 9aed70992ac24e10943f5bcab0a11d67 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:20:42.542626 25451 tablet_service.cc:1511] Processing CreateTablet for tablet 8734a5e02643462e85823bc7afb27b93 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:20:42.543205 25595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aed70992ac24e10943f5bcab0a11d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.547271 25670 tablet_service.cc:1511] Processing CreateTablet for tablet 015cfc692b904ffb8d66556e17bd9ed1 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
W20260709 13:20:42.548237 25407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:42.548635 25670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 015cfc692b904ffb8d66556e17bd9ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.551942 25668 tablet_service.cc:1511] Processing CreateTablet for tablet 36073ec086cc47098e9a796722246728 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:20:42.553218 25668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36073ec086cc47098e9a796722246728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.553838 25451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8734a5e02643462e85823bc7afb27b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.555433 25443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f703b8e7da3f432e95c5d1b9fc735f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.556843 25445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc06587e5c544c7a834950d9f45c6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.533576 25665 tablet_service.cc:1511] Processing CreateTablet for tablet acdfccdb823e4badaf6a647eccefcc66 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:20:42.560446 25447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f6d48dac364e25bcc18c1388db7fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.560845 25665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acdfccdb823e4badaf6a647eccefcc66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.562049 25449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be301b0a3ad4513936a33b8c989ab3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.561820 25671 tablet_service.cc:1511] Processing CreateTablet for tablet 74f6d48dac364e25bcc18c1388db7fb6 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:20:42.563194 25671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f6d48dac364e25bcc18c1388db7fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.489485 25598 tablet_service.cc:1511] Processing CreateTablet for tablet e2520ae829ce4b3082870ad84db70f7d (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:20:42.564667 25598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2520ae829ce4b3082870ad84db70f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.567663 25669 tablet_service.cc:1511] Processing CreateTablet for tablet 9aed70992ac24e10943f5bcab0a11d67 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:20:42.569120 25669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aed70992ac24e10943f5bcab0a11d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.571357 25444 tablet_service.cc:1511] Processing CreateTablet for tablet 36073ec086cc47098e9a796722246728 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:20:42.572798 25444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36073ec086cc47098e9a796722246728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.580145 25594 tablet_service.cc:1511] Processing CreateTablet for tablet edc06587e5c544c7a834950d9f45c6c8 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:20:42.581393 25674 tablet_service.cc:1511] Processing CreateTablet for tablet 4abab287ccaf44d4a4872b89f3012fa9 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:20:42.582834 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abab287ccaf44d4a4872b89f3012fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.583180 25448 tablet_service.cc:1511] Processing CreateTablet for tablet 4b54054e46384e8aa7153f332c5c366f (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:20:42.587460 25521 tablet_service.cc:1511] Processing CreateTablet for tablet 9aed70992ac24e10943f5bcab0a11d67 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:20:42.588097 25526 tablet_service.cc:1511] Processing CreateTablet for tablet 8734a5e02643462e85823bc7afb27b93 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:20:42.589128 25521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aed70992ac24e10943f5bcab0a11d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.590602 25442 tablet_service.cc:1511] Processing CreateTablet for tablet b4f6b0cbdad040bcb11d809dd492bc8d (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:20:42.592092 25525 tablet_service.cc:1511] Processing CreateTablet for tablet 4abab287ccaf44d4a4872b89f3012fa9 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:20:42.592489 25600 tablet_service.cc:1511] Processing CreateTablet for tablet 8734a5e02643462e85823bc7afb27b93 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:20:42.592947 25526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8734a5e02643462e85823bc7afb27b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.594465 25523 tablet_service.cc:1511] Processing CreateTablet for tablet 4b54054e46384e8aa7153f332c5c366f (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:20:42.595351 25520 tablet_service.cc:1511] Processing CreateTablet for tablet edc06587e5c544c7a834950d9f45c6c8 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:20:42.595850 25523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b54054e46384e8aa7153f332c5c366f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.596698 25520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc06587e5c544c7a834950d9f45c6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.597041 25524 tablet_service.cc:1511] Processing CreateTablet for tablet e2520ae829ce4b3082870ad84db70f7d (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:20:42.589597 25522 tablet_service.cc:1511] Processing CreateTablet for tablet 74f6d48dac364e25bcc18c1388db7fb6 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:20:42.599628 25442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f6b0cbdad040bcb11d809dd492bc8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.599987 25597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b54054e46384e8aa7153f332c5c366f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.601238 25525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abab287ccaf44d4a4872b89f3012fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.602499 25448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b54054e46384e8aa7153f332c5c366f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.603387 25450 tablet_service.cc:1511] Processing CreateTablet for tablet 4abab287ccaf44d4a4872b89f3012fa9 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:20:42.604815 25450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abab287ccaf44d4a4872b89f3012fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.606271 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8734a5e02643462e85823bc7afb27b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.610306 25594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc06587e5c544c7a834950d9f45c6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.611207 25519 tablet_service.cc:1511] Processing CreateTablet for tablet 36073ec086cc47098e9a796722246728 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:20:42.611591 25593 tablet_service.cc:1511] Processing CreateTablet for tablet f703b8e7da3f432e95c5d1b9fc735f71 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:20:42.613035 25593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f703b8e7da3f432e95c5d1b9fc735f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.614190 25518 tablet_service.cc:1511] Processing CreateTablet for tablet 9b275ea51fb94eeaac1650d139e43706 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:20:42.615625 25592 tablet_service.cc:1511] Processing CreateTablet for tablet 9b275ea51fb94eeaac1650d139e43706 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:20:42.617050 25592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b275ea51fb94eeaac1650d139e43706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.616860 25591 tablet_service.cc:1511] Processing CreateTablet for tablet b4f6b0cbdad040bcb11d809dd492bc8d (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:20:42.615633 25518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b275ea51fb94eeaac1650d139e43706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.618230 25591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f6b0cbdad040bcb11d809dd492bc8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.622283 25524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2520ae829ce4b3082870ad84db70f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.622992 25522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f6d48dac364e25bcc18c1388db7fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.625418 25519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36073ec086cc47098e9a796722246728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.627164 25517 tablet_service.cc:1511] Processing CreateTablet for tablet b4f6b0cbdad040bcb11d809dd492bc8d (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:20:42.628588 25517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f6b0cbdad040bcb11d809dd492bc8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.729569 25666 tablet_service.cc:1511] Processing CreateTablet for tablet b9bfde4ba996435bb05645af25e1f2c7 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:20:42.774399 25674 tablet_service.cc:1511] Processing CreateTablet for tablet 540f940c49e54189a08d7ed4d84f2ac6 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:20:42.747854 25486 heartbeater.cc:499] Master 127.16.211.62:42373 was elected leader, sending a full tablet report...
I20260709 13:20:42.779718 25594 tablet_service.cc:1511] Processing CreateTablet for tablet b1d018923485454fbcc0dccb5823166e (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:20:42.774858 25599 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4b9518dd674972b99e9595c9b1c686 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:20:42.752959 25520 tablet_service.cc:1511] Processing CreateTablet for tablet acdfccdb823e4badaf6a647eccefcc66 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:20:42.755373 25730 tablet_bootstrap.cc:492] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:42.762493 25526 tablet_service.cc:1511] Processing CreateTablet for tablet 81dbddeb15af47cbbe275279293370fa (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:20:42.763486 25732 tablet_bootstrap.cc:492] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:42.766661 25731 tablet_bootstrap.cc:492] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:42.766772 25673 tablet_service.cc:1511] Processing CreateTablet for tablet 81dbddeb15af47cbbe275279293370fa (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:20:42.767051 25519 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4b9518dd674972b99e9595c9b1c686 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:20:42.768483 25522 tablet_service.cc:1511] Processing CreateTablet for tablet 540f940c49e54189a08d7ed4d84f2ac6 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:20:42.768661 25595 tablet_service.cc:1511] Processing CreateTablet for tablet b9bfde4ba996435bb05645af25e1f2c7 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:20:42.772605 25596 tablet_service.cc:1511] Processing CreateTablet for tablet 81dbddeb15af47cbbe275279293370fa (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:20:42.739615 25729 tablet_bootstrap.cc:492] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:42.805096 25451 tablet_service.cc:1511] Processing CreateTablet for tablet 540f940c49e54189a08d7ed4d84f2ac6 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:20:42.805733 25669 tablet_service.cc:1511] Processing CreateTablet for tablet cc265439c9a64543b0c69805e9131cfe (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:20:42.806473 25451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540f940c49e54189a08d7ed4d84f2ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.774799 25666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bfde4ba996435bb05645af25e1f2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.810585 25673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81dbddeb15af47cbbe275279293370fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.781859 25524 tablet_service.cc:1511] Processing CreateTablet for tablet f8168790b26f4632b04441b2780e479a (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:20:42.783910 25671 tablet_service.cc:1511] Processing CreateTablet for tablet b1d018923485454fbcc0dccb5823166e (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:20:42.814365 25732 tablet_bootstrap.cc:654] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.814839 25671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d018923485454fbcc0dccb5823166e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.816991 25592 tablet_service.cc:1511] Processing CreateTablet for tablet adc7c5727cfc47e2b169253aee4be079 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:20:42.792631 25442 tablet_service.cc:1511] Processing CreateTablet for tablet b9bfde4ba996435bb05645af25e1f2c7 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:20:42.826907 25442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bfde4ba996435bb05645af25e1f2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.783921 25591 tablet_service.cc:1511] Processing CreateTablet for tablet 66a4d25643be42a6bf6f0b1d65400bee (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:20:42.786168 25448 tablet_service.cc:1511] Processing CreateTablet for tablet acdfccdb823e4badaf6a647eccefcc66 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:20:42.790092 25594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d018923485454fbcc0dccb5823166e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.825627 25593 tablet_service.cc:1511] Processing CreateTablet for tablet f9c681632e82489da482ce4f96f3a902 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:20:42.836024 25523 tablet_service.cc:1511] Processing CreateTablet for tablet adc7c5727cfc47e2b169253aee4be079 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:20:42.821060 25729 tablet_bootstrap.cc:654] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.842038 25668 tablet_service.cc:1511] Processing CreateTablet for tablet f8168790b26f4632b04441b2780e479a (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:20:42.833436 25447 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4b9518dd674972b99e9595c9b1c686 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:20:42.852324 25518 tablet_service.cc:1511] Processing CreateTablet for tablet c15e4fb6800449ceb211a61be3587ecc (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:20:42.853652 25672 tablet_service.cc:1511] Processing CreateTablet for tablet 2704c533ff304006941c451f2f6d4660 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:20:42.854621 25443 tablet_service.cc:1511] Processing CreateTablet for tablet aa0ee5fc6b56426093f29d36600f7af4 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:20:42.838590 25449 tablet_service.cc:1511] Processing CreateTablet for tablet b1d018923485454fbcc0dccb5823166e (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:20:42.813390 25598 tablet_service.cc:1511] Processing CreateTablet for tablet aa0ee5fc6b56426093f29d36600f7af4 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:20:42.840814 25446 tablet_service.cc:1511] Processing CreateTablet for tablet f9c681632e82489da482ce4f96f3a902 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:20:42.819096 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540f940c49e54189a08d7ed4d84f2ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.837234 25521 tablet_service.cc:1511] Processing CreateTablet for tablet cc265439c9a64543b0c69805e9131cfe (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:20:42.863528 25525 tablet_service.cc:1511] Processing CreateTablet for tablet 2704c533ff304006941c451f2f6d4660 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:20:42.863689 25600 tablet_service.cc:1511] Processing CreateTablet for tablet f8168790b26f4632b04441b2780e479a (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:20:42.865025 25731 tablet_bootstrap.cc:654] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.865512 25668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8168790b26f4632b04441b2780e479a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.851981 25561 heartbeater.cc:499] Master 127.16.211.62:42373 was elected leader, sending a full tablet report...
I20260709 13:20:42.868171 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2704c533ff304006941c451f2f6d4660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.870714 25517 tablet_service.cc:1511] Processing CreateTablet for tablet aa0ee5fc6b56426093f29d36600f7af4 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:20:42.848115 25593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9c681632e82489da482ce4f96f3a902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.875036 25598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0ee5fc6b56426093f29d36600f7af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.845055 25444 tablet_service.cc:1511] Processing CreateTablet for tablet adc7c5727cfc47e2b169253aee4be079 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:20:42.858811 25450 tablet_service.cc:1511] Processing CreateTablet for tablet 2704c533ff304006941c451f2f6d4660 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:20:42.878750 25667 tablet_service.cc:1511] Processing CreateTablet for tablet 9e879da59df949eca2ae0618a4c5ddc2 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:20:42.880093 25667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e879da59df949eca2ae0618a4c5ddc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.847237 25670 tablet_service.cc:1511] Processing CreateTablet for tablet f9c681632e82489da482ce4f96f3a902 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:20:42.887737 25670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9c681632e82489da482ce4f96f3a902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.844579 25665 tablet_service.cc:1511] Processing CreateTablet for tablet c15e4fb6800449ceb211a61be3587ecc (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:20:42.844718 25448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acdfccdb823e4badaf6a647eccefcc66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.846485 25520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acdfccdb823e4badaf6a647eccefcc66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.843796 25597 tablet_service.cc:1511] Processing CreateTablet for tablet c15e4fb6800449ceb211a61be3587ecc (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:20:42.890628 25449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d018923485454fbcc0dccb5823166e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.901515 25444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc7c5727cfc47e2b169253aee4be079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.902334 25732 tablet_bootstrap.cc:492] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:42.902868 25732 ts_tablet_manager.cc:1403] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.140s	user 0.005s	sys 0.013s
I20260709 13:20:42.846515 25445 tablet_service.cc:1511] Processing CreateTablet for tablet cc265439c9a64543b0c69805e9131cfe (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:20:42.905890 25732 raft_consensus.cc:359] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:42.908087 25732 raft_consensus.cc:385] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.908450 25732 raft_consensus.cc:740] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.907063 25445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc265439c9a64543b0c69805e9131cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.912715 25450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2704c533ff304006941c451f2f6d4660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.912968 25526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81dbddeb15af47cbbe275279293370fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.918278 25523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc7c5727cfc47e2b169253aee4be079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.918931 25519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4b9518dd674972b99e9595c9b1c686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.918272 25443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0ee5fc6b56426093f29d36600f7af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.922241 25517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0ee5fc6b56426093f29d36600f7af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.923893 25525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2704c533ff304006941c451f2f6d4660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.926388 25522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540f940c49e54189a08d7ed4d84f2ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.930274 25521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc265439c9a64543b0c69805e9131cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.930965 25518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15e4fb6800449ceb211a61be3587ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.934307 25524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8168790b26f4632b04441b2780e479a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.947747 25451 tablet_service.cc:1511] Processing CreateTablet for tablet 9e879da59df949eca2ae0618a4c5ddc2 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:20:42.953429 25669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc265439c9a64543b0c69805e9131cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.896965 25592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc7c5727cfc47e2b169253aee4be079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.959482 25635 heartbeater.cc:499] Master 127.16.211.62:42373 was elected leader, sending a full tablet report...
I20260709 13:20:42.970207 25732 consensus_queue.cc:260] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:42.987609 25731 tablet_bootstrap.cc:492] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:42.988433 25595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bfde4ba996435bb05645af25e1f2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.980135 25447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4b9518dd674972b99e9595c9b1c686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:42.998780 25665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15e4fb6800449ceb211a61be3587ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.055743 25673 tablet_service.cc:1511] Processing CreateTablet for tablet c0e89c6170734a98849f97b6441df9e4 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:20:43.057768 25673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e89c6170734a98849f97b6441df9e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.060170 25709 heartbeater.cc:499] Master 127.16.211.62:42373 was elected leader, sending a full tablet report...
I20260709 13:20:43.061107 25671 tablet_service.cc:1511] Processing CreateTablet for tablet b3f61b96593545c79c1d08d45ad98dee (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:20:43.062469 25671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f61b96593545c79c1d08d45ad98dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.079344 25446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9c681632e82489da482ce4f96f3a902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.082304 25451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e879da59df949eca2ae0618a4c5ddc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.079367 25599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4b9518dd674972b99e9595c9b1c686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.089977 25731 ts_tablet_manager.cc:1403] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.324s	user 0.039s	sys 0.042s
I20260709 13:20:43.077711 25598 tablet_service.cc:1511] Processing CreateTablet for tablet 9e879da59df949eca2ae0618a4c5ddc2 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:20:43.108446 25591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66a4d25643be42a6bf6f0b1d65400bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.137964 25597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15e4fb6800449ceb211a61be3587ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.142259 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8168790b26f4632b04441b2780e479a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.142976 25732 ts_tablet_manager.cc:1434] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.240s	user 0.022s	sys 0.046s
I20260709 13:20:43.144227 25730 tablet_bootstrap.cc:654] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:43.146260 25596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81dbddeb15af47cbbe275279293370fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.148057 25732 tablet_bootstrap.cc:492] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:43.152765 25450 tablet_service.cc:1511] Processing CreateTablet for tablet b3f61b96593545c79c1d08d45ad98dee (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:20:43.153440 25523 tablet_service.cc:1511] Processing CreateTablet for tablet d4f270f0fdf64e0790bc9e2247ab15c3 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:20:43.160341 25598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e879da59df949eca2ae0618a4c5ddc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.164588 25519 tablet_service.cc:1511] Processing CreateTablet for tablet e0d6387533134a0099e05d485ca902e6 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:20:43.168155 25521 tablet_service.cc:1511] Processing CreateTablet for tablet 5866aa38b1814ecfacca55ec773e6562 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:20:43.169688 25729 tablet_bootstrap.cc:492] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:43.178712 25729 ts_tablet_manager.cc:1403] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.440s	user 0.022s	sys 0.017s
I20260709 13:20:43.180239 25672 tablet_service.cc:1511] Processing CreateTablet for tablet e0d6387533134a0099e05d485ca902e6 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:20:43.181607 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d6387533134a0099e05d485ca902e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.186333 25523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f270f0fdf64e0790bc9e2247ab15c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.171483 25666 tablet_service.cc:1511] Processing CreateTablet for tablet 6397caa427af450ca361a53cc74cf838 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:20:43.188750 25666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6397caa427af450ca361a53cc74cf838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.193019 25450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f61b96593545c79c1d08d45ad98dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.193245 25517 tablet_service.cc:1511] Processing CreateTablet for tablet c0e89c6170734a98849f97b6441df9e4 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:20:43.195021 25517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e89c6170734a98849f97b6441df9e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.196074 25448 tablet_service.cc:1511] Processing CreateTablet for tablet 5866aa38b1814ecfacca55ec773e6562 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:20:43.197418 25448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5866aa38b1814ecfacca55ec773e6562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.197875 25443 tablet_service.cc:1511] Processing CreateTablet for tablet dc39a93c665a491a81bb0925b35ccf33 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:20:43.199630 25443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc39a93c665a491a81bb0925b35ccf33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.169963 25442 tablet_service.cc:1511] Processing CreateTablet for tablet d4f270f0fdf64e0790bc9e2247ab15c3 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:20:43.155484 25449 tablet_service.cc:1511] Processing CreateTablet for tablet 6397caa427af450ca361a53cc74cf838 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:20:43.183167 25525 tablet_service.cc:1511] Processing CreateTablet for tablet b3f61b96593545c79c1d08d45ad98dee (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:20:43.224143 25525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f61b96593545c79c1d08d45ad98dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.184876 25674 tablet_service.cc:1511] Processing CreateTablet for tablet dc39a93c665a491a81bb0925b35ccf33 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:20:43.230786 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc39a93c665a491a81bb0925b35ccf33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.233011 25444 tablet_service.cc:1511] Processing CreateTablet for tablet cddcb2168c0d4acaba5e547ac0c03ebb (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:20:43.234850 25593 tablet_service.cc:1511] Processing CreateTablet for tablet c0e89c6170734a98849f97b6441df9e4 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:20:43.236248 25593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e89c6170734a98849f97b6441df9e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.199143 25594 tablet_service.cc:1511] Processing CreateTablet for tablet d4f270f0fdf64e0790bc9e2247ab15c3 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:20:43.238678 25594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f270f0fdf64e0790bc9e2247ab15c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.240334 25445 tablet_service.cc:1511] Processing CreateTablet for tablet d5001675947e47d284c3bc4729cf9fd9 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:20:43.241691 25521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5866aa38b1814ecfacca55ec773e6562. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:20:43.242741 25487 tablet.cc:2406] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:20:43.213142 25668 tablet_service.cc:1511] Processing CreateTablet for tablet cddcb2168c0d4acaba5e547ac0c03ebb (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:20:43.173976 25522 tablet_service.cc:1511] Processing CreateTablet for tablet dc39a93c665a491a81bb0925b35ccf33 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:20:43.214720 25737 raft_consensus.cc:493] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.219038 25729 raft_consensus.cc:359] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:43.220801 25731 raft_consensus.cc:359] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:43.248031 25731 raft_consensus.cc:385] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:43.254576 25731 raft_consensus.cc:740] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:43.254882 25599 tablet_service.cc:1511] Processing CreateTablet for tablet 6397caa427af450ca361a53cc74cf838 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:20:43.255368 25731 consensus_queue.cc:260] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:43.256229 25599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6397caa427af450ca361a53cc74cf838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.247900 25729 raft_consensus.cc:385] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:43.257071 25729 raft_consensus.cc:740] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:43.246733 25668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cddcb2168c0d4acaba5e547ac0c03ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.257846 25729 consensus_queue.cc:260] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:43.247749 25737 raft_consensus.cc:515] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:43.250476 25449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6397caa427af450ca361a53cc74cf838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.244807 25526 tablet_service.cc:1511] Processing CreateTablet for tablet d5001675947e47d284c3bc4729cf9fd9 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:20:43.265820 25442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f270f0fdf64e0790bc9e2247ab15c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.273543 25595 tablet_service.cc:1511] Processing CreateTablet for tablet e0d6387533134a0099e05d485ca902e6 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:20:43.275408 25595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d6387533134a0099e05d485ca902e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.247484 25522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc39a93c665a491a81bb0925b35ccf33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.309633 25600 tablet_service.cc:1511] Processing CreateTablet for tablet cddcb2168c0d4acaba5e547ac0c03ebb (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:20:43.311508 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cddcb2168c0d4acaba5e547ac0c03ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.319090 25737 leader_election.cc:290] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:43.298799 25444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cddcb2168c0d4acaba5e547ac0c03ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.329150 25667 tablet_service.cc:1511] Processing CreateTablet for tablet eea867c357cd4e4d970226215f94bfe7 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:20:43.330518 25667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea867c357cd4e4d970226215f94bfe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.342846 25520 tablet_service.cc:1511] Processing CreateTablet for tablet 85033b16e63444238f30de7eae6d6634 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:20:43.343264 25592 tablet_service.cc:1511] Processing CreateTablet for tablet eea867c357cd4e4d970226215f94bfe7 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:20:43.345098 25592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea867c357cd4e4d970226215f94bfe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.356334 25451 tablet_service.cc:1511] Processing CreateTablet for tablet 85033b16e63444238f30de7eae6d6634 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:20:43.355996 25596 tablet_service.cc:1511] Processing CreateTablet for tablet d5001675947e47d284c3bc4729cf9fd9 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:20:43.380518 25526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5001675947e47d284c3bc4729cf9fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.213143 25524 tablet_service.cc:1511] Processing CreateTablet for tablet eea867c357cd4e4d970226215f94bfe7 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:20:43.379331 25732 tablet_bootstrap.cc:654] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:43.398738 25449 tablet_service.cc:1511] Processing CreateTablet for tablet de2624a22f2144868a7c62051f58771b (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:20:43.402172 25445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5001675947e47d284c3bc4729cf9fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.410372 25596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5001675947e47d284c3bc4729cf9fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.410588 25667 tablet_service.cc:1511] Processing CreateTablet for tablet de2624a22f2144868a7c62051f58771b (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:20:43.411854 25667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2624a22f2144868a7c62051f58771b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.414388 25729 ts_tablet_manager.cc:1434] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.235s	user 0.012s	sys 0.015s
I20260709 13:20:43.415534 25729 tablet_bootstrap.cc:492] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:43.415153 25442 tablet_service.cc:1511] Processing CreateTablet for tablet afd9e5943fb6488091b514fd1aa47162 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:20:43.418915 25442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd9e5943fb6488091b514fd1aa47162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.430172 25729 tablet_bootstrap.cc:654] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:43.430830 25451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85033b16e63444238f30de7eae6d6634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.434568 25665 tablet_service.cc:1511] Processing CreateTablet for tablet 278c9060803541ebb56ccb47687d3d4d (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:20:43.436218 25665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278c9060803541ebb56ccb47687d3d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.437891 25446 tablet_service.cc:1511] Processing CreateTablet for tablet 081346db72a04ea4b600a44f560616ff (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:20:43.439641 25446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081346db72a04ea4b600a44f560616ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.380203 25669 tablet_service.cc:1511] Processing CreateTablet for tablet 85033b16e63444238f30de7eae6d6634 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:20:43.444591 25598 tablet_service.cc:1511] Processing CreateTablet for tablet c02cdf0754524b77ada52992d6e0b20e (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:20:43.446061 25731 ts_tablet_manager.cc:1434] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.343s	user 0.011s	sys 0.027s
I20260709 13:20:43.464969 25669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85033b16e63444238f30de7eae6d6634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.470960 25449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2624a22f2144868a7c62051f58771b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.470022 25520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85033b16e63444238f30de7eae6d6634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.466748 25594 tablet_service.cc:1511] Processing CreateTablet for tablet de2624a22f2144868a7c62051f58771b (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 13:20:43.487344 25390 debug-util.cc:398] Leaking SignalData structure 0x7b0800396e20 after lost signal to thread 17231
W20260709 13:20:43.489876 25390 debug-util.cc:398] Leaking SignalData structure 0x7b08003f94e0 after lost signal to thread 25393
W20260709 13:20:43.491247 25390 debug-util.cc:398] Leaking SignalData structure 0x7b08002a4660 after lost signal to thread 25485
W20260709 13:20:43.494204 25390 debug-util.cc:398] Leaking SignalData structure 0x7b08000ca0c0 after lost signal to thread 25708
I20260709 13:20:43.498219 25524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea867c357cd4e4d970226215f94bfe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.500690 25730 tablet_bootstrap.cc:492] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:43.500377 25671 tablet_service.cc:1511] Processing CreateTablet for tablet 66a4d25643be42a6bf6f0b1d65400bee (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:20:43.501775 25671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66a4d25643be42a6bf6f0b1d65400bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.502266 25519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d6387533134a0099e05d485ca902e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.506492 25731 tablet_bootstrap.cc:492] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:43.510264 25730 ts_tablet_manager.cc:1403] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.755s	user 0.064s	sys 0.050s
I20260709 13:20:43.545064 25730 raft_consensus.cc:359] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:43.417719 25670 tablet_service.cc:1511] Processing CreateTablet for tablet c02cdf0754524b77ada52992d6e0b20e (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:20:43.547891 25670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02cdf0754524b77ada52992d6e0b20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.547806 25672 tablet_service.cc:1511] Processing CreateTablet for tablet 56a7192762c540d5aed9ffabc2695f7e (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:20:43.545832 25730 raft_consensus.cc:385] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:43.549218 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a7192762c540d5aed9ffabc2695f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.549362 25730 raft_consensus.cc:740] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
W20260709 13:20:43.550715 25407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:43.550890 25600 tablet_service.cc:1511] Processing CreateTablet for tablet cc9240e31c174ddab78702a2343b3d64 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:20:43.552199 25591 tablet_service.cc:1511] Processing CreateTablet for tablet 5866aa38b1814ecfacca55ec773e6562 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:20:43.524942 25668 tablet_service.cc:1511] Processing CreateTablet for tablet 16f2f69975c44dceb5130378505518a2 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:20:43.531513 25518 tablet_service.cc:1511] Processing CreateTablet for tablet afd9e5943fb6488091b514fd1aa47162 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:20:43.533975 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:43.539057 25673 tablet_service.cc:1511] Processing CreateTablet for tablet cc9240e31c174ddab78702a2343b3d64 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:20:43.473605 25598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02cdf0754524b77ada52992d6e0b20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.541325 25740 raft_consensus.cc:493] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.519270 25597 tablet_service.cc:1511] Processing CreateTablet for tablet afd9e5943fb6488091b514fd1aa47162 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:20:43.554388 25730 consensus_queue.cc:260] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:20:43.574513 25425 leader_election.cc:343] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:43.574841 25597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd9e5943fb6488091b514fd1aa47162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.573578 25740 raft_consensus.cc:515] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:43.576462 25594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2624a22f2144868a7c62051f58771b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.555727 25666 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37052 (request call id 22) took 1006 ms. Trace:
I20260709 13:20:43.505775 25521 tablet_service.cc:1511] Processing CreateTablet for tablet c02cdf0754524b77ada52992d6e0b20e (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:20:43.567080 25674 tablet_service.cc:1511] Processing CreateTablet for tablet 3bcc479ee6b94c918ab197a87e9e969a (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:20:43.607281 25739 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.607868 25739 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:43.612764 25731 tablet_bootstrap.cc:654] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:43.577761 25740 leader_election.cc:290] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:43.617458 25447 tablet_service.cc:1511] Processing CreateTablet for tablet 278c9060803541ebb56ccb47687d3d4d (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:20:43.619385 25447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278c9060803541ebb56ccb47687d3d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.620566 25593 tablet_service.cc:1511] Processing CreateTablet for tablet 081346db72a04ea4b600a44f560616ff (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:20:43.622234 25517 tablet_service.cc:1511] Processing CreateTablet for tablet 278c9060803541ebb56ccb47687d3d4d (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:20:43.640599 25592 tablet_service.cc:1511] Processing CreateTablet for tablet 56a7192762c540d5aed9ffabc2695f7e (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:20:43.624547 25673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc9240e31c174ddab78702a2343b3d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.624388 25518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd9e5943fb6488091b514fd1aa47162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.639246 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc9240e31c174ddab78702a2343b3d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.662290 25526 tablet_service.cc:1511] Processing CreateTablet for tablet 66a4d25643be42a6bf6f0b1d65400bee (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:20:43.667491 25729 tablet_bootstrap.cc:492] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:43.668071 25729 ts_tablet_manager.cc:1403] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.253s	user 0.011s	sys 0.009s
I20260709 13:20:43.669034 25450 tablet_service.cc:1511] Processing CreateTablet for tablet 56a7192762c540d5aed9ffabc2695f7e (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:20:43.670388 25523 tablet_service.cc:1511] Processing CreateTablet for tablet 081346db72a04ea4b600a44f560616ff (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:20:43.672029 25525 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 22) took 1004 ms. Trace:
I20260709 13:20:43.672411 25525 rpcz_store.cc:276] 0709 13:20:42.667948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.155679 (+487731us) service_pool.cc:224] Handling call
0709 13:20:43.223697 (+ 68018us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.223785 (+    88us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.319733 (+ 95948us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.572871 (+253138us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.657842 (+ 84971us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b58000e9798. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb81a2 00007f40a4cf9bb9 00007f40a3e2ad88 00007f40a3ef1973 00007f40a3eed70f 00007f40a3eedecd 00007f40a3e9c400 00007f409d321af4 00007f409d321a82
0709 13:20:43.671973 (+ 14131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30619008}
I20260709 13:20:43.672964 25671 tablet_service.cc:1511] Processing CreateTablet for tablet 2cdda0f89bd34da2ab6e2dcc9f918eb5 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:20:43.674947 25739 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:43.678239 25668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f2f69975c44dceb5130378505518a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.680406 25517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 278c9060803541ebb56ccb47687d3d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.682281 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bcc479ee6b94c918ab197a87e9e969a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.683854 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
W20260709 13:20:43.685423 25424 leader_election.cc:343] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:43.682325 25523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081346db72a04ea4b600a44f560616ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.685869 25424 leader_election.cc:304] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:43.688794 25737 raft_consensus.cc:2749] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:43.689927 25526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66a4d25643be42a6bf6f0b1d65400bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.690603 25525 tablet_service.cc:1511] Processing CreateTablet for tablet 3bcc479ee6b94c918ab197a87e9e969a (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:20:43.691874 25525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bcc479ee6b94c918ab197a87e9e969a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.583760 25666 rpcz_store.cc:276] 0709 13:20:42.549780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.170571 (+620791us) service_pool.cc:224] Handling call
0709 13:20:43.188099 (+ 17528us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.188291 (+   192us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.360114 (+171823us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.555228 (+195114us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.555672 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.694576 25444 tablet_service.cc:1511] Processing CreateTablet for tablet 16f2f69975c44dceb5130378505518a2 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:20:43.695613 25519 tablet_service.cc:1511] Processing CreateTablet for tablet 16f2f69975c44dceb5130378505518a2 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:20:43.695914 25666 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed58b0dbded4dfc9447d9712ff39fea (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:20:43.696903 25519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f2f69975c44dceb5130378505518a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.698730 25596 tablet_service.cc:1511] Processing CreateTablet for tablet 3bcc479ee6b94c918ab197a87e9e969a (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:20:43.699199 25522 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 25) took 1030 ms. Trace:
I20260709 13:20:43.699620 25522 rpcz_store.cc:276] 0709 13:20:42.668946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.172995 (+504049us) service_pool.cc:224] Handling call
0709 13:20:43.247033 (+ 74038us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.247127 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.624629 (+377502us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.698671 (+ 74042us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.699140 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.702306 25450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a7192762c540d5aed9ffabc2695f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.704131 25520 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 28) took 1005 ms. Trace:
I20260709 13:20:43.704540 25520 rpcz_store.cc:276] 0709 13:20:42.698382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.299171 (+600789us) service_pool.cc:224] Handling call
0709 13:20:43.343797 (+ 44626us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.343896 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.595396 (+251500us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.703632 (+108236us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.704075 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.706634 25669 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37052 (request call id 27) took 1039 ms. Trace:
I20260709 13:20:43.706957 25451 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48416 (request call id 28) took 1037 ms. Trace:
I20260709 13:20:43.707162 25669 rpcz_store.cc:276] 0709 13:20:42.667258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.370053 (+702795us) service_pool.cc:224] Handling call
0709 13:20:43.441626 (+ 71573us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.441746 (+   120us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.622937 (+181191us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.706164 (+ 83227us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.706578 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.707392 25451 rpcz_store.cc:276] 0709 13:20:42.669159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.355130 (+685971us) service_pool.cc:224] Handling call
0709 13:20:43.396036 (+ 40906us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.404812 (+  8776us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.561407 (+156595us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.678057 (+116650us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.706899 (+ 28842us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.708593 25667 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37052 (request call id 28) took 1018 ms. Trace:
I20260709 13:20:43.715911 25520 tablet_service.cc:1511] Processing CreateTablet for tablet 2cdda0f89bd34da2ab6e2dcc9f918eb5 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:20:43.717430 25591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5866aa38b1814ecfacca55ec773e6562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.717939 25599 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60984 (request call id 22) took 1041 ms. Trace:
I20260709 13:20:43.718348 25599 rpcz_store.cc:276] 0709 13:20:42.676658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.252825 (+576167us) service_pool.cc:224] Handling call
0709 13:20:43.255736 (+  2911us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.255878 (+   142us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.514051 (+258173us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.717413 (+203362us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.717861 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.720281 25599 tablet_service.cc:1511] Processing CreateTablet for tablet 788ee1912fba47fe8873f543b02189f7 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:20:43.721555 25592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a7192762c540d5aed9ffabc2695f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.695778 25729 raft_consensus.cc:359] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:43.727053 25729 raft_consensus.cc:385] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:43.727386 25729 raft_consensus.cc:740] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:43.728098 25729 consensus_queue.cc:260] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:43.730062 25671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cdda0f89bd34da2ab6e2dcc9f918eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.738765 25666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed58b0dbded4dfc9447d9712ff39fea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.739038 25670 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37052 (request call id 29) took 1048 ms. Trace:
I20260709 13:20:43.739573 25670 rpcz_store.cc:276] 0709 13:20:42.690757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.416885 (+726128us) service_pool.cc:224] Handling call
0709 13:20:43.547409 (+130524us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.547504 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.565080 (+ 17576us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.661804 (+ 96724us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.738973 (+ 77169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.743485 25596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bcc479ee6b94c918ab197a87e9e969a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.746348 25593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081346db72a04ea4b600a44f560616ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.750130 25521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02cdf0754524b77ada52992d6e0b20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.753062 25729 ts_tablet_manager.cc:1434] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.085s	user 0.002s	sys 0.005s
I20260709 13:20:43.754510 25729 tablet_bootstrap.cc:492] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:43.755909 25444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f2f69975c44dceb5130378505518a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.757129 25599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788ee1912fba47fe8873f543b02189f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.746585 25443 tablet_service.cc:1511] Processing CreateTablet for tablet cc9240e31c174ddab78702a2343b3d64 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:20:43.776226 25595 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60984 (request call id 23) took 1099 ms. Trace:
I20260709 13:20:43.777151 25443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc9240e31c174ddab78702a2343b3d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.779063 25665 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37052 (request call id 30) took 1088 ms. Trace:
I20260709 13:20:43.799068 25730 ts_tablet_manager.cc:1434] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.257s	user 0.028s	sys 0.051s
I20260709 13:20:43.800240 25730 tablet_bootstrap.cc:492] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:43.776695 25595 rpcz_store.cc:276] 0709 13:20:42.677023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.272275 (+595252us) service_pool.cc:224] Handling call
0709 13:20:43.274787 (+  2512us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.274905 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.675865 (+400960us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.775692 (+ 99827us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.776163 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.806412 25451 tablet_service.cc:1511] Processing CreateTablet for tablet 788ee1912fba47fe8873f543b02189f7 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:20:43.709025 25667 rpcz_store.cc:276] 0709 13:20:42.690336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.409604 (+719268us) service_pool.cc:224] Handling call
0709 13:20:43.411414 (+  1810us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.411503 (+    89us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.589654 (+178151us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.708113 (+118459us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.708537 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.807791 25451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788ee1912fba47fe8873f543b02189f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.807490 25595 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed58b0dbded4dfc9447d9712ff39fea (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:20:43.808758 25595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed58b0dbded4dfc9447d9712ff39fea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.709281 25669 tablet_service.cc:1511] Processing CreateTablet for tablet d04d94e738a343788e9a90a4470dc4c3 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:20:43.810933 25669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d04d94e738a343788e9a90a4470dc4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.812635 25667 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4a5b928a5a4ca3a0959ce95d445c42 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:20:43.741930 25670 tablet_service.cc:1511] Processing CreateTablet for tablet 445f8e17e0e2419bb3b63d012776f356 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:20:43.818940 25667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4a5b928a5a4ca3a0959ce95d445c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.701505 25522 tablet_service.cc:1511] Processing CreateTablet for tablet 788ee1912fba47fe8873f543b02189f7 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:20:43.819610 25523 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 33) took 1075 ms. Trace:
I20260709 13:20:43.820154 25522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788ee1912fba47fe8873f543b02189f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.821089 25665 rpcz_store.cc:276] 0709 13:20:42.691106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.433305 (+742199us) service_pool.cc:224] Handling call
0709 13:20:43.435634 (+  2329us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.435754 (+   120us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.571000 (+135246us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.778612 (+207612us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.779012 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.823470 25449 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48416 (request call id 29) took 1117 ms. Trace:
I20260709 13:20:43.824010 25448 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48416 (request call id 24) took 1156 ms. Trace:
I20260709 13:20:43.825309 25524 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 26) took 1156 ms. Trace:
I20260709 13:20:43.825822 25446 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48416 (request call id 33) took 1081 ms. Trace:
I20260709 13:20:43.826385 25442 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48416 (request call id 30) took 1119 ms. Trace:
I20260709 13:20:43.826944 25670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445f8e17e0e2419bb3b63d012776f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.835328 25732 tablet_bootstrap.cc:492] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:43.843117 25448 rpcz_store.cc:276] 0709 13:20:42.667786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.195105 (+527319us) service_pool.cc:224] Handling call
0709 13:20:43.196939 (+  1834us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.197042 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.532169 (+335127us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.768900 (+236731us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.823956 (+ 55056us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54568}
I20260709 13:20:43.838162 25445 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48416 (request call id 27) took 1169 ms. Trace:
I20260709 13:20:43.816164 25517 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 31) took 1116 ms. Trace:
I20260709 13:20:43.857832 25445 rpcz_store.cc:276] 0709 13:20:42.668804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.239430 (+570626us) service_pool.cc:224] Handling call
0709 13:20:43.241169 (+  1739us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.241255 (+    86us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.527498 (+286243us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.689386 (+161888us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.836837 (+147451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.841737 25449 rpcz_store.cc:276] 0709 13:20:42.706427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.386847 (+680420us) service_pool.cc:224] Handling call
0709 13:20:43.406958 (+ 20111us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.407051 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.570792 (+163741us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.767767 (+196975us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.823411 (+ 55644us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54895}
I20260709 13:20:43.863363 25449 tablet_service.cc:1511] Processing CreateTablet for tablet 1c91ee1848f2435bb3dba61a2370f733 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:20:43.863988 25732 ts_tablet_manager.cc:1403] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.716s	user 0.023s	sys 0.013s
I20260709 13:20:43.864619 25449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c91ee1848f2435bb3dba61a2370f733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.856312 25448 tablet_service.cc:1511] Processing CreateTablet for tablet 2cdda0f89bd34da2ab6e2dcc9f918eb5 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:20:43.867147 25448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cdda0f89bd34da2ab6e2dcc9f918eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.868244 25732 raft_consensus.cc:359] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:43.869256 25732 raft_consensus.cc:385] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:43.871071 25445 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed58b0dbded4dfc9447d9712ff39fea (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:20:43.872506 25746 raft_consensus.cc:493] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.872994 25746 raft_consensus.cc:515] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:43.874024 25445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed58b0dbded4dfc9447d9712ff39fea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.874392 25672 tablet_service.cc:1511] Processing CreateTablet for tablet ae2d62f90435440491da63b1ae0e710e (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:20:43.849859 25597 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60984 (request call id 30) took 1126 ms. Trace:
I20260709 13:20:43.875762 25746 leader_election.cc:290] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:43.843287 25524 rpcz_store.cc:276] 0709 13:20:42.669230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.212199 (+542969us) service_pool.cc:224] Handling call
0709 13:20:43.461459 (+249260us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.466553 (+  5094us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.570506 (+103953us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.824844 (+254338us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.825252 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.878899 25520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cdda0f89bd34da2ab6e2dcc9f918eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.853000 25447 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48416 (request call id 31) took 1145 ms. Trace:
I20260709 13:20:43.894658 25447 rpcz_store.cc:276] 0709 13:20:42.707185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.582605 (+875420us) service_pool.cc:224] Handling call
0709 13:20:43.618719 (+ 36114us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.618844 (+   125us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.697800 (+ 78956us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.852375 (+154575us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.852929 (+   554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.875329 25597 rpcz_store.cc:276] 0709 13:20:42.723606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.518244 (+794638us) service_pool.cc:224] Handling call
0709 13:20:43.573710 (+ 55466us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.573812 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.701318 (+127506us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.849239 (+147921us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.849784 (+   545us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.896823 25447 tablet_service.cc:1511] Processing CreateTablet for tablet 445f8e17e0e2419bb3b63d012776f356 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:20:43.875679 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2d62f90435440491da63b1ae0e710e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.855983 25442 rpcz_store.cc:276] 0709 13:20:42.706811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.414246 (+707435us) service_pool.cc:224] Handling call
0709 13:20:43.418441 (+  4195us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.418533 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.481164 (+ 62631us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.788053 (+306889us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.826324 (+ 38271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37803}
I20260709 13:20:43.888387 25731 tablet_bootstrap.cc:492] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:43.876845 25732 raft_consensus.cc:740] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:43.853057 25518 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 30) took 1154 ms. Trace:
I20260709 13:20:43.836768 25523 rpcz_store.cc:276] 0709 13:20:42.744039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.637663 (+893624us) service_pool.cc:224] Handling call
0709 13:20:43.671198 (+ 33535us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.671304 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.777713 (+106409us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.819065 (+ 41352us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.819553 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.898394 25447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445f8e17e0e2419bb3b63d012776f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.914362 25731 ts_tablet_manager.cc:1403] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.408s	user 0.017s	sys 0.003s
I20260709 13:20:43.918744 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:43.918972 25732 consensus_queue.cc:260] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:43.921554 25732 ts_tablet_manager.cc:1434] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:20:43.922556 25732 tablet_bootstrap.cc:492] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:43.923018 25731 raft_consensus.cc:359] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:43.923834 25731 raft_consensus.cc:385] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:43.924130 25731 raft_consensus.cc:740] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:43.925141 25731 consensus_queue.cc:260] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:43.926489 25599 tablet_service.cc:1511] Processing CreateTablet for tablet 1c91ee1848f2435bb3dba61a2370f733 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:20:43.927946 25594 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60984 (request call id 28) took 1205 ms. Trace:
I20260709 13:20:43.928402 25594 rpcz_store.cc:276] 0709 13:20:42.722902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.421144 (+698242us) service_pool.cc:224] Handling call
0709 13:20:43.478683 (+ 57539us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.478787 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.677471 (+198684us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.927440 (+249969us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.927889 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.929287 25599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c91ee1848f2435bb3dba61a2370f733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.930225 25740 raft_consensus.cc:493] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.930727 25740 raft_consensus.cc:515] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:43.930994 25597 tablet_service.cc:1511] Processing CreateTablet for tablet d04d94e738a343788e9a90a4470dc4c3 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:20:43.932366 25597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d04d94e738a343788e9a90a4470dc4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.933887 25740 leader_election.cc:290] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:43.939667 25442 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4a5b928a5a4ca3a0959ce95d445c42 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:20:43.939884 25523 tablet_service.cc:1511] Processing CreateTablet for tablet 1c91ee1848f2435bb3dba61a2370f733 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:20:43.941663 25523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c91ee1848f2435bb3dba61a2370f733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.909293 25591 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60984 (request call id 24) took 1231 ms. Trace:
I20260709 13:20:43.859074 25517 rpcz_store.cc:276] 0709 13:20:42.699317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.613774 (+914457us) service_pool.cc:224] Handling call
0709 13:20:43.656537 (+ 42763us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.662054 (+  5517us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.725298 (+ 63244us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.815653 (+ 90355us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.816105 (+   452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.942984 25591 rpcz_store.cc:276] 0709 13:20:42.677337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.294764 (+617427us) service_pool.cc:224] Handling call
0709 13:20:43.579497 (+284733us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.592626 (+ 13129us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.804145 (+211519us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.875150 (+ 71005us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.908311 (+ 33161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.944317 25517 tablet_service.cc:1511] Processing CreateTablet for tablet 445f8e17e0e2419bb3b63d012776f356 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:20:43.945556 25517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445f8e17e0e2419bb3b63d012776f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.945151 25591 tablet_service.cc:1511] Processing CreateTablet for tablet ae2d62f90435440491da63b1ae0e710e (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:20:43.975234 25599 tablet_service.cc:1511] Processing CreateTablet for tablet e85f98cb5cd14fa9a4a620defb96cb6c (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:20:43.911233 25518 rpcz_store.cc:276] 0709 13:20:42.699015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.530536 (+831521us) service_pool.cc:224] Handling call
0709 13:20:43.585168 (+ 54632us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.602669 (+ 17501us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.771984 (+169315us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.852565 (+ 80581us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.853001 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.978565 25591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2d62f90435440491da63b1ae0e710e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.978305 25442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4a5b928a5a4ca3a0959ce95d445c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.980525 25599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85f98cb5cd14fa9a4a620defb96cb6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.959205 25730 tablet_bootstrap.cc:654] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:43.949208 25647 leader_election.cc:343] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:43.856593 25446 rpcz_store.cc:276] 0709 13:20:42.744504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.390946 (+646442us) service_pool.cc:224] Handling call
0709 13:20:43.439061 (+ 48115us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.439176 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.660604 (+221428us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.787016 (+126412us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.825766 (+ 38750us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38259}
I20260709 13:20:43.938741 25665 tablet_service.cc:1511] Processing CreateTablet for tablet f8f052365b064537ba68ac4701e53694 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:20:43.990334 25665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f052365b064537ba68ac4701e53694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.992381 25600 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60984 (request call id 31) took 1268 ms. Trace:
I20260709 13:20:43.951953 25519 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 34) took 1154 ms. Trace:
I20260709 13:20:43.995201 25446 tablet_service.cc:1511] Processing CreateTablet for tablet e85f98cb5cd14fa9a4a620defb96cb6c (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:20:43.996634 25446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85f98cb5cd14fa9a4a620defb96cb6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.994144 25600 rpcz_store.cc:276] 0709 13:20:42.723939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.549985 (+826046us) service_pool.cc:224] Handling call
0709 13:20:43.551718 (+  1733us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.551812 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.882146 (+330334us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.991827 (+109681us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.992316 (+   489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.995010 25519 rpcz_store.cc:276] 0709 13:20:42.797180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.669298 (+872118us) service_pool.cc:224] Handling call
0709 13:20:43.696434 (+ 27136us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.696533 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.826160 (+129627us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.951440 (+125280us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.951895 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.002478 25668 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37052 (request call id 33) took 1239 ms. Trace:
I20260709 13:20:44.004849 25668 rpcz_store.cc:276] 0709 13:20:42.763478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.523942 (+760464us) service_pool.cc:224] Handling call
0709 13:20:43.617129 (+ 93187us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b5800076298. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb81a2 00007f40a4cf9bb9 00007f40a3e2ad88 00007f40a3eedb80 00007f40a3e9c400 00007f409d321af4 00007f409d321a82 00007f409d3219b1 00007f409d32192c
0709 13:20:43.638262 (+ 21133us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.651059 (+ 12797us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.830108 (+179049us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.999520 (+169412us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.002409 (+  2889us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8028928}
I20260709 13:20:43.974086 25598 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60984 (request call id 29) took 1250 ms. Trace:
I20260709 13:20:44.014461 25526 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 32) took 1314 ms. Trace:
I20260709 13:20:44.014945 25526 rpcz_store.cc:276] 0709 13:20:42.699627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.631725 (+932098us) service_pool.cc:224] Handling call
0709 13:20:43.663230 (+ 31505us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.663322 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.792959 (+129637us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.013882 (+220923us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.014399 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.017164 25526 tablet_service.cc:1511] Processing CreateTablet for tablet f8f052365b064537ba68ac4701e53694 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:20:44.024935 25674 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37052 (request call id 35) took 1094 ms. Trace:
I20260709 13:20:43.999166 25524 tablet_service.cc:1511] Processing CreateTablet for tablet d04d94e738a343788e9a90a4470dc4c3 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:20:44.002420 25594 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4a5b928a5a4ca3a0959ce95d445c42 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:20:44.025409 25674 rpcz_store.cc:276] 0709 13:20:42.930365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.566103 (+635738us) service_pool.cc:224] Handling call
0709 13:20:43.651140 (+ 85037us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.661994 (+ 10854us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.794098 (+132104us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.010700 (+216602us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.024862 (+ 14162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44446}
I20260709 13:20:44.026774 25524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d04d94e738a343788e9a90a4470dc4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:44.028718 25674 tablet_service.cc:1511] Processing CreateTablet for tablet c9206e4480e54c158fe2a2ecab45efa8 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:20:44.026816 25594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4a5b928a5a4ca3a0959ce95d445c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:44.019944 25592 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60984 (request call id 34) took 1137 ms. Trace:
I20260709 13:20:44.018765 25731 ts_tablet_manager.cc:1434] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.001s
I20260709 13:20:44.030370 25526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f052365b064537ba68ac4701e53694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:44.049192 25525 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 35) took 1136 ms. Trace:
I20260709 13:20:44.049641 25525 rpcz_store.cc:276] 0709 13:20:42.912796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.673577 (+760781us) service_pool.cc:224] Handling call
0709 13:20:43.691428 (+ 17851us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.691531 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.848817 (+157286us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.048624 (+199807us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.049126 (+   502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.012607 25598 rpcz_store.cc:276] 0709 13:20:42.723249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.443360 (+720111us) service_pool.cc:224] Handling call
0709 13:20:43.445728 (+  2368us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.445853 (+   125us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.827594 (+381741us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:43.973493 (+145899us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:43.974014 (+   521us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.061017 25596 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60984 (request call id 35) took 1141 ms. Trace:
I20260709 13:20:44.061484 25596 rpcz_store.cc:276] 0709 13:20:42.919637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.636752 (+717115us) service_pool.cc:224] Handling call
0709 13:20:43.699561 (+ 62809us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.699648 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.936827 (+237179us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.060396 (+123569us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.060951 (+   555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.066709 25518 tablet_service.cc:1511] Processing CreateTablet for tablet ae2d62f90435440491da63b1ae0e710e (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:20:44.036406 25592 rpcz_store.cc:276] 0709 13:20:42.882909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.602402 (+719493us) service_pool.cc:224] Handling call
0709 13:20:43.694682 (+ 92280us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b5800075998. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3f10831 00007f40a3eedac3 00007f40a3e9c400 00007f409d321af4 00007f409d321a82 00007f409d3219b1
0709 13:20:43.694847 (+   165us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.694941 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.845362 (+150421us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.019418 (+174056us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.019883 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15715200}
I20260709 13:20:44.065667 25671 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37052 (request call id 36) took 1042 ms. Trace:
I20260709 13:20:44.079689 25519 tablet_service.cc:1511] Processing CreateTablet for tablet e85f98cb5cd14fa9a4a620defb96cb6c (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:20:44.082479 25739 raft_consensus.cc:493] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.083046 25739 raft_consensus.cc:515] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.085223 25739 leader_election.cc:290] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:44.087287 25729 tablet_bootstrap.cc:654] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.091588 25444 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48416 (request call id 34) took 1327 ms. Trace:
I20260709 13:20:44.092075 25444 rpcz_store.cc:276] 0709 13:20:42.764337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.629572 (+865235us) service_pool.cc:224] Handling call
0709 13:20:43.702046 (+ 72474us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.702142 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.970600 (+268458us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.091040 (+120440us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.091523 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.094630 25444 tablet_service.cc:1511] Processing CreateTablet for tablet f8f052365b064537ba68ac4701e53694 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:20:44.105057 25731 tablet_bootstrap.cc:492] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:44.075590 25671 rpcz_store.cc:276] 0709 13:20:43.023571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.672053 (+648482us) service_pool.cc:224] Handling call
0709 13:20:43.673740 (+  1687us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.673840 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.841030 (+167190us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.065094 (+224064us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.065603 (+   509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.110745 25600 tablet_service.cc:1511] Processing CreateTablet for tablet c9206e4480e54c158fe2a2ecab45efa8 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:20:44.112046 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9206e4480e54c158fe2a2ecab45efa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:44.112645 25732 tablet_bootstrap.cc:654] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.074853 25673 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37052 (request call id 31) took 1382 ms. Trace:
I20260709 13:20:44.114270 25673 rpcz_store.cc:276] 0709 13:20:42.691506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.464454 (+772948us) service_pool.cc:224] Handling call
0709 13:20:43.592668 (+128214us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.624053 (+ 31385us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b5800076298. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb8785 00007f40a3eed298 00007f40a3eedc7d 00007f40a3e9c400 00007f409d321af4 00007f409d321a82 00007f409d3219b1 00007f409d32192c 00007f409d320be2 00007f409d21748c
0709 13:20:43.624206 (+   153us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.795968 (+171762us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.011795 (+215827us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.073953 (+ 62158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44119,"spinlock_wait_cycles":15595776}
I20260709 13:20:44.120198 25443 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48416 (request call id 32) took 1412 ms. Trace:
I20260709 13:20:44.120683 25443 rpcz_store.cc:276] 0709 13:20:42.707541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.602798 (+895257us) service_pool.cc:224] Handling call
0709 13:20:43.757856 (+155058us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.758010 (+   154us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.957330 (+199320us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.119672 (+162342us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.120125 (+   453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.121932 25518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2d62f90435440491da63b1ae0e710e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:44.122685 25519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85f98cb5cd14fa9a4a620defb96cb6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:44.099977 25593 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60984 (request call id 33) took 1341 ms. Trace:
I20260709 13:20:44.134057 25593 rpcz_store.cc:276] 0709 13:20:42.758321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.583391 (+825070us) service_pool.cc:224] Handling call
0709 13:20:43.642933 (+ 59542us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.655299 (+ 12366us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.864562 (+209263us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.099353 (+234791us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.099911 (+   558us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.104360 25450 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48416 (request call id 35) took 1192 ms. Trace:
I20260709 13:20:44.135171 25450 rpcz_store.cc:276] 0709 13:20:42.912199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.668032 (+755833us) service_pool.cc:224] Handling call
0709 13:20:43.669906 (+  1874us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.701949 (+ 32043us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.912263 (+210314us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.103856 (+191593us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.104300 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.136862 25448 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48416 (request call id 37) took 1023 ms. Trace:
I20260709 13:20:44.137151 25450 tablet_service.cc:1511] Processing CreateTablet for tablet c9206e4480e54c158fe2a2ecab45efa8 (DEFAULT_TABLE table=test-workload [id=7649cec9c1c3421d8ffb1881e14d3fec]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:20:44.133708 25444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f052365b064537ba68ac4701e53694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:44.137362 25448 rpcz_store.cc:276] 0709 13:20:43.113182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.855309 (+742127us) service_pool.cc:224] Handling call
0709 13:20:43.866698 (+ 11389us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.866802 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:44.015497 (+148695us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.136228 (+120731us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.136785 (+   557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.141163 25450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9206e4480e54c158fe2a2ecab45efa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:44.142829 25521 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 29) took 1444 ms. Trace:
I20260709 13:20:44.143266 25521 rpcz_store.cc:276] 0709 13:20:42.698727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.504835 (+806108us) service_pool.cc:224] Handling call
0709 13:20:43.626753 (+121918us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b58000e9798. stack: 00007f409bdbd343 00007f409bdbd240 00007f409b74c1d4 00007f40a548a304 00007f40a548a299 00007f409bc77db1 00007f409bdb7b71 00007f409bdb7a22 00007f40a4cd0c09 00007f40a3e2aee0 00007f40a3f10831 00007f40a3eedac3 00007f40a3e9c400 00007f409d321af4 00007f409d321a82 00007f409d3219b1
0709 13:20:43.626938 (+   185us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.627068 (+   130us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.821129 (+194061us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.142329 (+321200us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.142769 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2463104}
I20260709 13:20:44.122713 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9206e4480e54c158fe2a2ecab45efa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:44.168807 25520 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 37) took 1012 ms. Trace:
I20260709 13:20:44.169263 25731 tablet_bootstrap.cc:654] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.169346 25520 rpcz_store.cc:276] 0709 13:20:43.157456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.705515 (+548059us) service_pool.cc:224] Handling call
0709 13:20:43.716889 (+ 11374us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.716991 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:44.082334 (+365343us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.168292 (+ 85958us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.168744 (+   452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.193228 25666 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37052 (request call id 37) took 1026 ms. Trace:
I20260709 13:20:44.194197 25737 raft_consensus.cc:493] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.194777 25737 raft_consensus.cc:515] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.197139 25737 leader_election.cc:290] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:44.193794 25666 rpcz_store.cc:276] 0709 13:20:43.166647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.695010 (+528363us) service_pool.cc:224] Handling call
0709 13:20:43.696778 (+  1768us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.696862 (+    84us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.929028 (+232166us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.176115 (+247087us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.193153 (+ 17038us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43258}
I20260709 13:20:44.199280 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b54054e46384e8aa7153f332c5c366f" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:20:44.202502 25425 leader_election.cc:343] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.201599 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b54054e46384e8aa7153f332c5c366f" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
W20260709 13:20:44.204828 25424 leader_election.cc:343] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.205399 25424 leader_election.cc:304] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:44.206768 25737 raft_consensus.cc:2749] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:44.211632 25522 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 36) took 1263 ms. Trace:
I20260709 13:20:44.212064 25522 rpcz_store.cc:276] 0709 13:20:42.948341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.700602 (+752261us) service_pool.cc:224] Handling call
0709 13:20:43.819709 (+119107us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.819801 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:43.997574 (+177773us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.211102 (+213528us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.211565 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.216485 25729 tablet_bootstrap.cc:492] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:44.217047 25729 ts_tablet_manager.cc:1403] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.463s	user 0.009s	sys 0.014s
I20260709 13:20:44.219446 25451 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48416 (request call id 36) took 1272 ms. Trace:
I20260709 13:20:44.220469 25729 raft_consensus.cc:359] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.221385 25729 raft_consensus.cc:385] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.221608 25730 tablet_bootstrap.cc:492] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:44.222257 25730 ts_tablet_manager.cc:1403] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.422s	user 0.011s	sys 0.013s
I20260709 13:20:44.222625 25595 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60984 (request call id 37) took 1062 ms. Trace:
I20260709 13:20:44.223078 25595 rpcz_store.cc:276] 0709 13:20:43.159801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.806587 (+646786us) service_pool.cc:224] Handling call
0709 13:20:43.808329 (+  1742us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.808413 (+    84us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:44.094344 (+285931us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.222101 (+127757us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.222564 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.226267 25730 raft_consensus.cc:359] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.226982 25730 raft_consensus.cc:385] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.227301 25730 raft_consensus.cc:740] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.221730 25729 raft_consensus.cc:740] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.219899 25451 rpcz_store.cc:276] 0709 13:20:42.947096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.709072 (+761976us) service_pool.cc:224] Handling call
0709 13:20:43.807301 (+ 98229us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.807400 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:44.145496 (+338096us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.218910 (+ 73414us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.219384 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.240497 25524 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52980 (request call id 38) took 1018 ms. Trace:
I20260709 13:20:44.240952 25524 rpcz_store.cc:276] 0709 13:20:43.222382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.888448 (+666066us) service_pool.cc:224] Handling call
0709 13:20:44.026305 (+137857us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:44.026385 (+    80us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:44.177479 (+151094us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.239980 (+ 62501us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.240436 (+   456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792}
I20260709 13:20:44.242830 25729 consensus_queue.cc:260] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.248992 25732 tablet_bootstrap.cc:492] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:44.249547 25732 ts_tablet_manager.cc:1403] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.327s	user 0.016s	sys 0.007s
I20260709 13:20:44.252707 25732 raft_consensus.cc:359] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.253412 25732 raft_consensus.cc:385] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.254228 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:44.254948 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:44.253716 25732 raft_consensus.cc:740] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
W20260709 13:20:44.257246 25648 leader_election.cc:343] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.261423 25648 leader_election.cc:304] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:44.262236 25740 raft_consensus.cc:2749] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:44.262068 25730 consensus_queue.cc:260] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
W20260709 13:20:44.262702 25648 leader_election.cc:343] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.257942 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015cfc692b904ffb8d66556e17bd9ed1" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:44.261729 25732 consensus_queue.cc:260] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.258977 25729 ts_tablet_manager.cc:1434] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.005s
I20260709 13:20:44.264503 25730 ts_tablet_manager.cc:1434] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.002s
I20260709 13:20:44.235661 25597 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60984 (request call id 38) took 1011 ms. Trace:
I20260709 13:20:44.270128 25731 tablet_bootstrap.cc:492] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:44.270185 25597 rpcz_store.cc:276] 0709 13:20:43.223374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.916613 (+693239us) service_pool.cc:224] Handling call
0709 13:20:43.931860 (+ 15247us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:20:43.931963 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:20:44.093519 (+161556us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:44.213671 (+120152us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:44.234216 (+ 20545us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:44.271045 25573 leader_election.cc:343] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.270814 25731 ts_tablet_manager.cc:1403] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.194s	user 0.016s	sys 0.013s
I20260709 13:20:44.270615 25729 tablet_bootstrap.cc:492] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:44.272923 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015cfc692b904ffb8d66556e17bd9ed1" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:44.273356 25730 tablet_bootstrap.cc:492] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:44.273543 25461 raft_consensus.cc:2468] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:44.274607 25746 raft_consensus.cc:493] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.275205 25746 raft_consensus.cc:515] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.277194 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:44.278870 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:44.289254 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:44.292685 25731 raft_consensus.cc:359] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.293654 25731 raft_consensus.cc:385] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.294068 25731 raft_consensus.cc:740] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.294896 25729 tablet_bootstrap.cc:654] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.295166 25731 consensus_queue.cc:260] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.297184 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:44.298197 25731 ts_tablet_manager.cc:1434] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.004s
I20260709 13:20:44.299363 25731 tablet_bootstrap.cc:492] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:44.300009 25746 leader_election.cc:290] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:44.301522 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:44.302522 25647 leader_election.cc:343] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.303071 25647 leader_election.cc:304] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:44.303957 25740 raft_consensus.cc:2749] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:20:44.304831 25499 leader_election.cc:343] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:44.305616 25499 leader_election.cc:343] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:44.306326 25499 leader_election.cc:343] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.306756 25499 leader_election.cc:304] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:44.308743 25731 tablet_bootstrap.cc:654] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.309463 25573 leader_election.cc:304] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:44.309898 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:44.311863 25739 raft_consensus.cc:2749] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:44.322031 25746 raft_consensus.cc:2804] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:44.322695 25746 raft_consensus.cc:493] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.323184 25746 raft_consensus.cc:3060] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:44.324141 25573 leader_election.cc:343] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:44.312780 25499 leader_election.cc:343] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.330881 25499 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:44.332530 25739 raft_consensus.cc:2749] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:44.336999 25730 tablet_bootstrap.cc:654] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.339459 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
W20260709 13:20:44.342608 25573 leader_election.cc:343] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.343230 25573 leader_election.cc:304] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:44.356671 25746 raft_consensus.cc:515] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.359179 25732 ts_tablet_manager.cc:1434] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.000s
I20260709 13:20:44.360471 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015cfc692b904ffb8d66556e17bd9ed1" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:44.360848 25732 tablet_bootstrap.cc:492] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
W20260709 13:20:44.364976 25573 leader_election.cc:343] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.371791 25767 raft_consensus.cc:2749] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:44.379936 25746 leader_election.cc:290] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:44.380716 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015cfc692b904ffb8d66556e17bd9ed1" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:44.381167 25732 tablet_bootstrap.cc:654] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.381507 25461 raft_consensus.cc:3060] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.384214 25729 tablet_bootstrap.cc:492] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:44.384994 25729 ts_tablet_manager.cc:1403] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.049s
I20260709 13:20:44.388453 25729 raft_consensus.cc:359] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.389981 25729 raft_consensus.cc:385] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.390331 25729 raft_consensus.cc:740] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.391155 25729 consensus_queue.cc:260] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.391742 25731 tablet_bootstrap.cc:492] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:44.392292 25731 ts_tablet_manager.cc:1403] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.093s	user 0.032s	sys 0.035s
I20260709 13:20:44.396013 25730 tablet_bootstrap.cc:492] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:44.396548 25730 ts_tablet_manager.cc:1403] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.123s	user 0.027s	sys 0.027s
I20260709 13:20:44.396616 25731 raft_consensus.cc:359] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.397537 25731 raft_consensus.cc:385] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.397886 25731 raft_consensus.cc:740] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.398593 25461 raft_consensus.cc:2468] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:44.400343 25573 leader_election.cc:304] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:44.401544 25746 raft_consensus.cc:2804] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:44.402045 25746 raft_consensus.cc:697] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:44.402865 25746 consensus_queue.cc:237] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.404022 25730 raft_consensus.cc:359] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.405200 25730 raft_consensus.cc:385] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.405536 25730 raft_consensus.cc:740] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.406517 25732 tablet_bootstrap.cc:492] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:44.406275 25730 consensus_queue.cc:260] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.398847 25731 consensus_queue.cc:260] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.408530 25730 ts_tablet_manager.cc:1434] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:20:44.409104 25731 ts_tablet_manager.cc:1434] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:20:44.409731 25730 tablet_bootstrap.cc:492] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:44.407056 25732 ts_tablet_manager.cc:1403] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.008s
I20260709 13:20:44.413635 25732 raft_consensus.cc:359] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.414431 25732 raft_consensus.cc:385] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.414862 25732 raft_consensus.cc:740] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.410228 25731 tablet_bootstrap.cc:492] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:44.404733 25729 ts_tablet_manager.cc:1434] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:20:44.416610 25729 tablet_bootstrap.cc:492] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:44.417819 25730 tablet_bootstrap.cc:654] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.423148 25729 tablet_bootstrap.cc:654] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.430265 25731 tablet_bootstrap.cc:654] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.425015 25732 consensus_queue.cc:260] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.436452 25358 catalog_manager.cc:5697] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.443892 25739 raft_consensus.cc:493] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.444605 25739 raft_consensus.cc:515] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.448526 25739 leader_election.cc:290] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:44.451620 25732 ts_tablet_manager.cc:1434] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:20:44.460248 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc06587e5c544c7a834950d9f45c6c8" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:44.460638 25730 tablet_bootstrap.cc:492] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:44.461228 25730 ts_tablet_manager.cc:1403] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.011s
W20260709 13:20:44.462038 25499 leader_election.cc:343] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.464072 25732 tablet_bootstrap.cc:492] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:44.466442 25740 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.465864 25730 raft_consensus.cc:359] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.467590 25730 raft_consensus.cc:385] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.467981 25730 raft_consensus.cc:740] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.467336 25740 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.468756 25730 consensus_queue.cc:260] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.470636 25740 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:44.471678 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:44.472100 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:44.472769 25536 raft_consensus.cc:2468] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
W20260709 13:20:44.472968 25647 leader_election.cc:343] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.474083 25647 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:44.474361 25732 tablet_bootstrap.cc:654] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.475304 25740 raft_consensus.cc:2804] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:44.475721 25740 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.476104 25740 raft_consensus.cc:3060] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.478719 25730 ts_tablet_manager.cc:1434] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:20:44.483431 25730 tablet_bootstrap.cc:492] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:44.474105 25729 tablet_bootstrap.cc:492] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:44.485229 25731 tablet_bootstrap.cc:492] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:44.488436 25729 ts_tablet_manager.cc:1403] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.072s	user 0.023s	sys 0.019s
I20260709 13:20:44.488750 25731 ts_tablet_manager.cc:1403] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.026s
I20260709 13:20:44.491840 25740 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.494719 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
W20260709 13:20:44.496582 25647 leader_election.cc:343] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.492035 25731 raft_consensus.cc:359] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.497781 25729 raft_consensus.cc:359] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.498329 25731 raft_consensus.cc:385] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.498559 25729 raft_consensus.cc:385] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.498678 25731 raft_consensus.cc:740] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.498975 25729 raft_consensus.cc:740] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.496709 25732 tablet_bootstrap.cc:492] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:44.499724 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc06587e5c544c7a834950d9f45c6c8" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:44.499862 25732 ts_tablet_manager.cc:1403] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.037s	user 0.024s	sys 0.002s
I20260709 13:20:44.499958 25731 consensus_queue.cc:260] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.500424 25740 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:44.500909 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:44.501479 25536 raft_consensus.cc:3060] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.502499 25731 ts_tablet_manager.cc:1434] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:20:44.497877 25730 tablet_bootstrap.cc:654] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.503537 25731 tablet_bootstrap.cc:492] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:44.500509 25609 raft_consensus.cc:2468] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:44.503537 25732 raft_consensus.cc:359] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.507830 25732 raft_consensus.cc:385] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.508226 25732 raft_consensus.cc:740] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.508267 25500 leader_election.cc:304] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:44.509480 25536 raft_consensus.cc:2468] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:44.509459 25732 consensus_queue.cc:260] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.509979 25739 raft_consensus.cc:2804] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:44.510699 25739 raft_consensus.cc:493] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.511052 25739 raft_consensus.cc:3060] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.512562 25732 ts_tablet_manager.cc:1434] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:20:44.513633 25732 tablet_bootstrap.cc:492] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:44.514979 25647 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:44.499773 25729 consensus_queue.cc:260] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.520169 25732 tablet_bootstrap.cc:654] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.526670 25731 tablet_bootstrap.cc:654] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.536985 25740 raft_consensus.cc:2804] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:44.538507 25740 raft_consensus.cc:697] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:44.539357 25740 consensus_queue.cc:237] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.539875 25730 tablet_bootstrap.cc:492] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:44.540207 25729 ts_tablet_manager.cc:1434] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.008s
I20260709 13:20:44.540391 25730 ts_tablet_manager.cc:1403] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.006s
I20260709 13:20:44.543995 25739 raft_consensus.cc:515] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.548573 25729 tablet_bootstrap.cc:492] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:44.550096 25739 leader_election.cc:290] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:44.550109 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc06587e5c544c7a834950d9f45c6c8" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:44.551560 25730 raft_consensus.cc:359] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.551461 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc06587e5c544c7a834950d9f45c6c8" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:44.554168 25730 raft_consensus.cc:385] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:20:44.556103 25499 leader_election.cc:343] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.556509 25609 raft_consensus.cc:3060] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.558331 25730 raft_consensus.cc:740] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.559271 25731 tablet_bootstrap.cc:492] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:44.559170 25730 consensus_queue.cc:260] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.559875 25731 ts_tablet_manager.cc:1403] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.004s
W20260709 13:20:44.556248 25407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:44.563300 25731 raft_consensus.cc:359] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.564018 25731 raft_consensus.cc:385] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.564311 25731 raft_consensus.cc:740] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.565073 25731 consensus_queue.cc:260] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.570132 25746 raft_consensus.cc:493] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.566249 25609 raft_consensus.cc:2468] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:44.574803 25729 tablet_bootstrap.cc:654] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.574872 25746 raft_consensus.cc:515] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.576881 25746 leader_election.cc:290] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:44.577329 25740 raft_consensus.cc:493] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.577730 25740 raft_consensus.cc:515] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.579761 25740 leader_election.cc:290] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:44.580358 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:44.581135 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:44.581482 25500 leader_election.cc:304] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
W20260709 13:20:44.582172 25647 leader_election.cc:343] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.582544 25729 tablet_bootstrap.cc:492] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
W20260709 13:20:44.582871 25647 leader_election.cc:343] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.583065 25729 ts_tablet_manager.cc:1403] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.009s
I20260709 13:20:44.582952 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:44.583720 25535 raft_consensus.cc:2468] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:44.583278 25647 leader_election.cc:304] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:44.574082 25732 tablet_bootstrap.cc:492] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:44.580289 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:44.585253 25740 raft_consensus.cc:2749] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:44.585439 25732 ts_tablet_manager.cc:1403] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.072s	user 0.004s	sys 0.008s
I20260709 13:20:44.585763 25461 raft_consensus.cc:2468] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:44.586704 25573 leader_election.cc:304] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:44.587307 25746 raft_consensus.cc:2804] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:44.587656 25746 raft_consensus.cc:493] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.584571 25739 raft_consensus.cc:2804] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:44.588071 25746 raft_consensus.cc:3060] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.588389 25358 catalog_manager.cc:5697] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.570843 25730 ts_tablet_manager.cc:1434] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
I20260709 13:20:44.590448 25730 tablet_bootstrap.cc:492] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:44.567628 25731 ts_tablet_manager.cc:1434] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:44.592294 25731 tablet_bootstrap.cc:492] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:44.595659 25732 raft_consensus.cc:359] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.596884 25732 raft_consensus.cc:385] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.597864 25732 raft_consensus.cc:740] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.598872 25731 tablet_bootstrap.cc:654] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.600456 25729 raft_consensus.cc:359] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.601951 25729 raft_consensus.cc:385] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.602259 25729 raft_consensus.cc:740] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.602389 25732 consensus_queue.cc:260] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.603231 25729 consensus_queue.cc:260] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.603957 25746 raft_consensus.cc:515] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.606539 25729 ts_tablet_manager.cc:1434] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:20:44.607703 25729 tablet_bootstrap.cc:492] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:44.608420 25732 ts_tablet_manager.cc:1434] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:20:44.609798 25732 tablet_bootstrap.cc:492] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:44.615043 25739 raft_consensus.cc:697] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:20:44.616108 25739 consensus_queue.cc:237] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.618105 25730 tablet_bootstrap.cc:654] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.620105 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:44.620745 25535 raft_consensus.cc:3060] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.631603 25737 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.632505 25737 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.631536 25740 raft_consensus.cc:493] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.634748 25746 leader_election.cc:290] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:44.634667 25740 raft_consensus.cc:515] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.635998 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:44.636677 25461 raft_consensus.cc:3060] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.636745 25740 leader_election.cc:290] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:44.636812 25737 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:44.640255 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:44.640934 25536 raft_consensus.cc:2468] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:44.641405 25731 tablet_bootstrap.cc:492] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:44.641894 25731 ts_tablet_manager.cc:1403] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.019s
I20260709 13:20:44.642907 25647 leader_election.cc:304] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:44.644011 25746 raft_consensus.cc:493] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.644181 25740 raft_consensus.cc:2804] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:44.644783 25740 raft_consensus.cc:493] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.644594 25746 raft_consensus.cc:515] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.645326 25740 raft_consensus.cc:3060] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.647302 25746 leader_election.cc:290] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:44.648810 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:44.649466 25460 raft_consensus.cc:2468] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:44.654476 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:44.655159 25684 raft_consensus.cc:2468] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:44.657407 25573 leader_election.cc:304] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:44.658836 25746 raft_consensus.cc:2804] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:44.659229 25746 raft_consensus.cc:493] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.659571 25746 raft_consensus.cc:3060] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.654824 25729 tablet_bootstrap.cc:654] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.664042 25535 raft_consensus.cc:2468] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:44.671926 25746 raft_consensus.cc:515] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.674073 25746 leader_election.cc:290] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:44.649804 25732 tablet_bootstrap.cc:654] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.679194 25740 raft_consensus.cc:515] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.683303 25731 raft_consensus.cc:359] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.684032 25731 raft_consensus.cc:385] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.684334 25731 raft_consensus.cc:740] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.682587 25573 leader_election.cc:304] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:44.687439 25731 consensus_queue.cc:260] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.688038 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:44.688611 25460 raft_consensus.cc:3060] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.689983 25731 ts_tablet_manager.cc:1434] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.002s
I20260709 13:20:44.691075 25731 tablet_bootstrap.cc:492] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:44.687039 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:44.694298 25684 raft_consensus.cc:3060] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.701555 25730 tablet_bootstrap.cc:492] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:44.702175 25730 ts_tablet_manager.cc:1403] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.013s
I20260709 13:20:44.702261 25460 raft_consensus.cc:2468] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:44.703670 25573 leader_election.cc:304] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:44.704697 25767 raft_consensus.cc:2804] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:44.698818 25746 raft_consensus.cc:2804] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:44.706398 25730 raft_consensus.cc:359] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.710307 25730 raft_consensus.cc:385] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.710611 25730 raft_consensus.cc:740] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.711354 25730 consensus_queue.cc:260] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.711236 25355 catalog_manager.cc:5697] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.711771 25684 raft_consensus.cc:2468] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:44.712797 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:44.715102 25729 tablet_bootstrap.cc:492] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:44.715256 25535 raft_consensus.cc:2393] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 812474b88dc54c39bc37428d77dcb7a9 in current term 1: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
I20260709 13:20:44.716344 25729 ts_tablet_manager.cc:1403] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.109s	user 0.018s	sys 0.013s
I20260709 13:20:44.717435 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:44.718088 25536 raft_consensus.cc:3060] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.712867 25740 leader_election.cc:290] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:44.722283 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:44.712579 25461 raft_consensus.cc:2468] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:44.728437 25731 tablet_bootstrap.cc:654] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:44.729741 25647 leader_election.cc:343] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.731621 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
W20260709 13:20:44.734108 25647 leader_election.cc:343] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.720305 25729 raft_consensus.cc:359] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.736143 25729 raft_consensus.cc:385] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.736565 25729 raft_consensus.cc:740] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.730635 25767 raft_consensus.cc:697] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:44.738310 25767 consensus_queue.cc:237] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.739260 25729 consensus_queue.cc:260] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.744500 25740 raft_consensus.cc:493] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.727924 25536 raft_consensus.cc:2468] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:44.749519 25746 raft_consensus.cc:697] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:44.745236 25740 raft_consensus.cc:515] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.750480 25746 consensus_queue.cc:237] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:44.758328 25647 leader_election.cc:304] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:44.761334 25730 ts_tablet_manager.cc:1434] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.059s	user 0.011s	sys 0.031s
I20260709 13:20:44.761713 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015cfc692b904ffb8d66556e17bd9ed1" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:44.762480 25730 tablet_bootstrap.cc:492] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:44.761200 25780 raft_consensus.cc:2804] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:44.762988 25780 raft_consensus.cc:697] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:44.763712 25740 leader_election.cc:290] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:44.763813 25780 consensus_queue.cc:237] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.765834 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015cfc692b904ffb8d66556e17bd9ed1" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:44.766732 25461 raft_consensus.cc:2393] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 1: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
I20260709 13:20:44.774253 25739 raft_consensus.cc:493] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.774775 25779 raft_consensus.cc:493] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.775264 25779 raft_consensus.cc:515] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.777339 25779 leader_election.cc:290] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:44.774837 25739 raft_consensus.cc:515] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.780009 25739 leader_election.cc:290] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:44.781710 25730 tablet_bootstrap.cc:654] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.782397 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:44.783162 25536 raft_consensus.cc:2468] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:44.783222 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:44.782318 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:44.784547 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:44.784664 25610 raft_consensus.cc:2468] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:44.782541 25647 leader_election.cc:304] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
W20260709 13:20:44.786378 25500 leader_election.cc:343] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:44.786917 25499 leader_election.cc:343] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.787195 25648 leader_election.cc:304] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:44.787354 25499 leader_election.cc:304] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:44.787580 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:44.788080 25740 raft_consensus.cc:3060] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.788528 25739 raft_consensus.cc:2749] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:44.790050 25424 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:44.794553 25737 raft_consensus.cc:3060] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.791326 25779 raft_consensus.cc:2804] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:44.795151 25779 raft_consensus.cc:493] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.795557 25779 raft_consensus.cc:3060] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.801898 25737 raft_consensus.cc:2749] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:44.808468 25732 tablet_bootstrap.cc:492] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:44.809103 25732 ts_tablet_manager.cc:1403] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.200s	user 0.011s	sys 0.004s
I20260709 13:20:44.811236 25740 raft_consensus.cc:2749] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:44.812566 25732 raft_consensus.cc:359] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.812796 25779 raft_consensus.cc:515] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.813350 25732 raft_consensus.cc:385] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.813648 25732 raft_consensus.cc:740] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.815366 25729 ts_tablet_manager.cc:1434] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.003s
I20260709 13:20:44.816514 25729 tablet_bootstrap.cc:492] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:44.817381 25730 tablet_bootstrap.cc:492] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:44.817963 25730 ts_tablet_manager.cc:1403] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.005s
I20260709 13:20:44.821090 25730 raft_consensus.cc:359] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.821849 25730 raft_consensus.cc:385] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.822167 25730 raft_consensus.cc:740] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.822923 25730 consensus_queue.cc:260] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.824255 25729 tablet_bootstrap.cc:654] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.827169 25732 consensus_queue.cc:260] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.830386 25732 ts_tablet_manager.cc:1434] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 13:20:44.831670 25779 leader_election.cc:290] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:44.831936 25732 tablet_bootstrap.cc:492] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:44.831857 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:44.832656 25536 raft_consensus.cc:3060] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.837555 25730 ts_tablet_manager.cc:1434] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:20:44.837566 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:44.838647 25730 tablet_bootstrap.cc:492] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:44.838673 25609 raft_consensus.cc:3060] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.844722 25359 catalog_manager.cc:5697] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.836393 25355 catalog_manager.cc:5697] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.846566 25730 tablet_bootstrap.cc:654] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.849033 25359 catalog_manager.cc:5697] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.856408 25732 tablet_bootstrap.cc:654] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.858970 25609 raft_consensus.cc:2468] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:44.860208 25648 leader_election.cc:304] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:44.861586 25779 raft_consensus.cc:2804] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:44.862286 25779 raft_consensus.cc:697] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:44.863373 25779 consensus_queue.cc:237] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.865284 25746 raft_consensus.cc:493] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.865832 25746 raft_consensus.cc:515] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.868016 25746 leader_election.cc:290] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:44.867909 25536 raft_consensus.cc:2468] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:44.870594 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
W20260709 13:20:44.872102 25573 leader_election.cc:343] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.872980 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:44.873611 25536 raft_consensus.cc:2468] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:44.874075 25731 tablet_bootstrap.cc:492] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:44.874720 25731 ts_tablet_manager.cc:1403] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.184s	user 0.021s	sys 0.026s
I20260709 13:20:44.874800 25573 leader_election.cc:304] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:44.876070 25746 raft_consensus.cc:2804] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:44.876435 25746 raft_consensus.cc:493] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.876778 25746 raft_consensus.cc:3060] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.885999 25746 raft_consensus.cc:515] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.889285 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:44.890300 25535 raft_consensus.cc:3060] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.891482 25731 raft_consensus.cc:359] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.892156 25731 raft_consensus.cc:385] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.892405 25731 raft_consensus.cc:740] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.892864 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:44.893143 25359 catalog_manager.cc:5697] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:44.894456 25573 leader_election.cc:343] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.895584 25746 leader_election.cc:290] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:44.899395 25535 raft_consensus.cc:2468] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:44.902325 25729 tablet_bootstrap.cc:492] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:44.904192 25729 ts_tablet_manager.cc:1403] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.002s
I20260709 13:20:44.905061 25732 tablet_bootstrap.cc:492] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:44.905584 25732 ts_tablet_manager.cc:1403] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.011s
I20260709 13:20:44.893142 25731 consensus_queue.cc:260] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.907444 25729 raft_consensus.cc:359] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.909653 25729 raft_consensus.cc:385] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.910055 25729 raft_consensus.cc:740] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.910653 25731 ts_tablet_manager.cc:1434] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:20:44.910971 25729 consensus_queue.cc:260] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:44.912222 25731 tablet_bootstrap.cc:492] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:44.908195 25732 raft_consensus.cc:359] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.913251 25730 tablet_bootstrap.cc:492] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:44.913357 25732 raft_consensus.cc:385] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.913710 25730 ts_tablet_manager.cc:1403] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.024s
I20260709 13:20:44.913727 25732 raft_consensus.cc:740] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.908951 25573 leader_election.cc:304] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:44.916507 25730 raft_consensus.cc:359] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.917284 25730 raft_consensus.cc:385] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.917529 25746 raft_consensus.cc:2804] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:44.917564 25730 raft_consensus.cc:740] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.918252 25746 raft_consensus.cc:697] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:44.916442 25732 consensus_queue.cc:260] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.918581 25730 consensus_queue.cc:260] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.919121 25746 consensus_queue.cc:237] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:44.920953 25730 ts_tablet_manager.cc:1434] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:44.921857 25730 tablet_bootstrap.cc:492] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:44.922431 25731 tablet_bootstrap.cc:654] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.924610 25732 ts_tablet_manager.cc:1434] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:20:44.925521 25729 ts_tablet_manager.cc:1434] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:20:44.927088 25729 tablet_bootstrap.cc:492] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:44.931562 25739 raft_consensus.cc:493] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.932098 25739 raft_consensus.cc:515] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.925702 25732 tablet_bootstrap.cc:492] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:44.934271 25739 leader_election.cc:290] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:44.936609 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b54054e46384e8aa7153f332c5c366f" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:44.937325 25461 raft_consensus.cc:2468] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:44.938499 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b54054e46384e8aa7153f332c5c366f" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:44.939884 25729 tablet_bootstrap.cc:654] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:44.940037 25500 leader_election.cc:343] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.940310 25730 tablet_bootstrap.cc:654] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.941301 25499 leader_election.cc:304] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:20:44.942605 25739 raft_consensus.cc:2804] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:44.943408 25739 raft_consensus.cc:493] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.943831 25739 raft_consensus.cc:3060] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.949698 25732 tablet_bootstrap.cc:654] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.950126 25359 catalog_manager.cc:5697] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.950773 25739 raft_consensus.cc:515] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:44.953555 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b54054e46384e8aa7153f332c5c366f" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:44.954149 25461 raft_consensus.cc:3060] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.961448 25461 raft_consensus.cc:2468] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:44.963908 25746 consensus_queue.cc:1048] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:44.965111 25499 leader_election.cc:304] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:44.966115 25786 raft_consensus.cc:2804] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:44.979264 25731 tablet_bootstrap.cc:492] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:44.979984 25731 ts_tablet_manager.cc:1403] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.001s
I20260709 13:20:44.983610 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b54054e46384e8aa7153f332c5c366f" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
W20260709 13:20:44.988754 25500 leader_election.cc:343] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:44.999356 25739 leader_election.cc:290] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:45.011893 25786 raft_consensus.cc:697] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:20:45.012420 25729 tablet_bootstrap.cc:492] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:45.013129 25729 ts_tablet_manager.cc:1403] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.016s
I20260709 13:20:45.013123 25786 consensus_queue.cc:237] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.017089 25794 raft_consensus.cc:493] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.017787 25794 raft_consensus.cc:515] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:45.018105 25729 raft_consensus.cc:359] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:45.019062 25729 raft_consensus.cc:385] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.019423 25729 raft_consensus.cc:740] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.020560 25794 leader_election.cc:290] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:45.022176 25730 tablet_bootstrap.cc:492] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:45.022893 25730 ts_tablet_manager.cc:1403] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.025s
I20260709 13:20:45.024230 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:45.024278 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:45.025369 25535 raft_consensus.cc:2468] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:45.025154 25684 raft_consensus.cc:2468] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:45.027451 25729 consensus_queue.cc:260] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:45.030344 25729 ts_tablet_manager.cc:1434] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:20:45.002632 25731 raft_consensus.cc:359] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.030987 25731 raft_consensus.cc:385] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.031313 25731 raft_consensus.cc:740] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.031898 25359 catalog_manager.cc:5697] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:45.033203 25730 raft_consensus.cc:359] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.034003 25730 raft_consensus.cc:385] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.034373 25730 raft_consensus.cc:740] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.035245 25730 consensus_queue.cc:260] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.035936 25573 leader_election.cc:304] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:45.037534 25730 ts_tablet_manager.cc:1434] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:20:45.038636 25730 tablet_bootstrap.cc:492] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:45.040835 25729 tablet_bootstrap.cc:492] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:45.041818 25794 raft_consensus.cc:2804] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.042259 25794 raft_consensus.cc:493] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.042601 25794 raft_consensus.cc:3060] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.044629 25730 tablet_bootstrap.cc:654] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.047083 25729 tablet_bootstrap.cc:654] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.050537 25746 consensus_queue.cc:1048] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:45.058156 25779 consensus_queue.cc:1048] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:45.058332 25731 consensus_queue.cc:260] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.059381 25730 tablet_bootstrap.cc:492] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:45.060061 25730 ts_tablet_manager.cc:1403] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.005s
I20260709 13:20:45.060490 25780 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.062050 25780 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.064059 25780 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:45.064141 25730 raft_consensus.cc:359] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.064867 25730 raft_consensus.cc:385] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.065135 25730 raft_consensus.cc:740] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.065840 25730 consensus_queue.cc:260] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.067873 25730 ts_tablet_manager.cc:1434] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:45.068384 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:45.070127 25731 ts_tablet_manager.cc:1434] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.002s
I20260709 13:20:45.070407 25732 tablet_bootstrap.cc:492] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
W20260709 13:20:45.070890 25647 leader_election.cc:343] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.073321 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:45.071007 25732 ts_tablet_manager.cc:1403] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.145s	user 0.033s	sys 0.040s
I20260709 13:20:45.074493 25731 tablet_bootstrap.cc:492] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:45.074560 25730 tablet_bootstrap.cc:492] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:45.080749 25732 raft_consensus.cc:359] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
W20260709 13:20:45.081670 25647 leader_election.cc:343] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.082082 25732 raft_consensus.cc:385] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.082203 25647 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:45.083519 25780 raft_consensus.cc:2749] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.082439 25732 raft_consensus.cc:740] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.084905 25732 consensus_queue.cc:260] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.090044 25730 tablet_bootstrap.cc:654] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.095629 25794 raft_consensus.cc:515] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:45.101771 25732 ts_tablet_manager.cc:1434] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:20:45.102908 25732 tablet_bootstrap.cc:492] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:45.106972 25729 tablet_bootstrap.cc:492] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:45.106979 25794 leader_election.cc:290] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:45.107492 25729 ts_tablet_manager.cc:1403] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.017s
I20260709 13:20:45.109254 25780 consensus_queue.cc:1048] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:45.111397 25729 raft_consensus.cc:359] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.112058 25729 raft_consensus.cc:385] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.112332 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:45.116356 25732 tablet_bootstrap.cc:654] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.117149 25731 tablet_bootstrap.cc:654] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.112357 25729 raft_consensus.cc:740] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.112957 25684 raft_consensus.cc:3060] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.120108 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:45.120765 25536 raft_consensus.cc:3060] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.122368 25729 consensus_queue.cc:260] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.131472 25729 ts_tablet_manager.cc:1434] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:20:45.132586 25729 tablet_bootstrap.cc:492] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:45.130218 25536 raft_consensus.cc:2468] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:45.130213 25684 raft_consensus.cc:2468] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:45.134020 25573 leader_election.cc:304] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:45.135293 25794 raft_consensus.cc:2804] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:45.135810 25794 raft_consensus.cc:697] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:45.136677 25794 consensus_queue.cc:237] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:45.141712 25730 tablet_bootstrap.cc:492] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:45.142453 25730 ts_tablet_manager.cc:1403] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.000s
I20260709 13:20:45.147210 25737 raft_consensus.cc:493] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.149108 25737 raft_consensus.cc:515] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.152272 25737 leader_election.cc:290] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:45.154992 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc06587e5c544c7a834950d9f45c6c8" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:45.156013 25610 raft_consensus.cc:2393] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 812474b88dc54c39bc37428d77dcb7a9 in current term 1: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:20:45.157938 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc06587e5c544c7a834950d9f45c6c8" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:45.160993 25424 leader_election.cc:304] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:45.159317 25786 consensus_queue.cc:1048] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:20:45.165673 25737 raft_consensus.cc:3060] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.166009 25732 tablet_bootstrap.cc:492] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:45.166754 25732 ts_tablet_manager.cc:1403] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.004s
I20260709 13:20:45.170140 25732 raft_consensus.cc:359] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.170855 25732 raft_consensus.cc:385] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.171972 25729 tablet_bootstrap.cc:654] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.171154 25732 raft_consensus.cc:740] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.175367 25732 consensus_queue.cc:260] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.180378 25730 raft_consensus.cc:359] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.181396 25730 raft_consensus.cc:385] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.181758 25730 raft_consensus.cc:740] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.184890 25746 raft_consensus.cc:493] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.185472 25746 raft_consensus.cc:515] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.187728 25746 leader_election.cc:290] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:45.188844 25731 tablet_bootstrap.cc:492] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:45.189517 25731 ts_tablet_manager.cc:1403] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.006s
I20260709 13:20:45.189710 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:45.191313 25459 raft_consensus.cc:2468] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:45.192996 25573 leader_election.cc:304] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:45.193063 25731 raft_consensus.cc:359] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.194178 25731 raft_consensus.cc:385] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.194538 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:45.195442 25535 raft_consensus.cc:2468] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:45.194762 25746 raft_consensus.cc:2804] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.196640 25746 raft_consensus.cc:493] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.197196 25746 raft_consensus.cc:3060] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.198704 25737 raft_consensus.cc:2749] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.198580 25767 consensus_queue.cc:1048] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:45.194592 25731 raft_consensus.cc:740] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.185139 25730 consensus_queue.cc:260] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.210781 25730 ts_tablet_manager.cc:1434] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 13:20:45.211776 25730 tablet_bootstrap.cc:492] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:45.218353 25731 consensus_queue.cc:260] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.218124 25786 consensus_queue.cc:1048] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:20:45.220561 25767 consensus_queue.cc:1048] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:20:45.225106 25731 ts_tablet_manager.cc:1434] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:20:45.226178 25731 tablet_bootstrap.cc:492] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:45.229303 25732 ts_tablet_manager.cc:1434] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.062s	user 0.020s	sys 0.009s
I20260709 13:20:45.231860 25732 tablet_bootstrap.cc:492] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:45.238106 25731 tablet_bootstrap.cc:654] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.242384 25794 consensus_queue.cc:1048] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:20:45.249091 25729 tablet_bootstrap.cc:492] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:45.249655 25729 ts_tablet_manager.cc:1403] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.117s	user 0.021s	sys 0.012s
I20260709 13:20:45.254817 25358 catalog_manager.cc:5697] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:45.264626 25746 raft_consensus.cc:515] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.267230 25746 leader_election.cc:290] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:45.273233 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:45.274480 25459 raft_consensus.cc:3060] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.275410 25739 raft_consensus.cc:493] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.275972 25739 raft_consensus.cc:515] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.277212 25740 raft_consensus.cc:493] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.277434 25829 raft_consensus.cc:493] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.266490 25827 raft_consensus.cc:493] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.278090 25829 raft_consensus.cc:515] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.283854 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:45.284528 25683 raft_consensus.cc:2468] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:45.287401 25729 raft_consensus.cc:359] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:45.288103 25729 raft_consensus.cc:385] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.287955 25499 leader_election.cc:304] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:45.288443 25729 raft_consensus.cc:740] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.288247 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:45.288879 25786 raft_consensus.cc:2804] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.289261 25729 consensus_queue.cc:260] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:45.277705 25740 raft_consensus.cc:515] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:45.294052 25730 tablet_bootstrap.cc:654] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.289294 25786 raft_consensus.cc:493] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.293946 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:45.289698 25739 leader_election.cc:290] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:45.300611 25729 ts_tablet_manager.cc:1434] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:20:45.301460 25732 tablet_bootstrap.cc:654] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.297490 25786 raft_consensus.cc:3060] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.297120 25740 leader_election.cc:290] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:45.297848 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:45.304256 25729 tablet_bootstrap.cc:492] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:45.298316 25460 raft_consensus.cc:2468] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:45.290580 25827 raft_consensus.cc:515] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.302623 25535 raft_consensus.cc:3060] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.310029 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:45.310791 25683 raft_consensus.cc:2468] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:45.312961 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:45.314056 25536 raft_consensus.cc:2393] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 1: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
I20260709 13:20:45.314239 25424 leader_election.cc:304] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:45.315308 25737 raft_consensus.cc:2804] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.319734 25779 consensus_queue.cc:1048] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:20:45.315708 25737 raft_consensus.cc:493] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.321749 25737 raft_consensus.cc:3060] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.324146 25648 leader_election.cc:304] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:45.326866 25740 consensus_queue.cc:1048] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:45.328567 25740 raft_consensus.cc:3060] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.334671 25794 consensus_queue.cc:1048] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:45.343976 25535 raft_consensus.cc:2468] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:45.343803 25779 consensus_queue.cc:1048] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:45.351976 25459 raft_consensus.cc:2468] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:45.353703 25573 leader_election.cc:304] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:45.366962 25729 tablet_bootstrap.cc:654] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.355804 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:45.356665 25731 tablet_bootstrap.cc:492] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:45.372421 25731 ts_tablet_manager.cc:1403] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.008s
I20260709 13:20:45.358997 25746 raft_consensus.cc:493] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.354519 25829 leader_election.cc:290] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:45.364265 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:45.364290 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:45.362946 25827 leader_election.cc:290] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:45.399844 25795 raft_consensus.cc:2804] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:45.400238 25794 consensus_queue.cc:1048] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:45.406139 25833 log.cc:927] Time spent T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:20:45.400449 25795 raft_consensus.cc:697] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:45.379012 25746 raft_consensus.cc:515] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.395941 25610 raft_consensus.cc:2468] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:45.394783 25682 raft_consensus.cc:2468] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:45.412992 25767 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.422547 25731 raft_consensus.cc:359] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.423298 25731 raft_consensus.cc:385] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.423573 25731 raft_consensus.cc:740] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.423823 25459 raft_consensus.cc:3060] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.424271 25731 consensus_queue.cc:260] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.440749 25731 ts_tablet_manager.cc:1434] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.001s
I20260709 13:20:45.441669 25425 leader_election.cc:304] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:45.447431 25746 leader_election.cc:290] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:45.448721 25730 tablet_bootstrap.cc:492] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:45.449275 25730 ts_tablet_manager.cc:1403] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.238s	user 0.017s	sys 0.019s
I20260709 13:20:45.450449 25838 raft_consensus.cc:2804] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.451049 25838 raft_consensus.cc:493] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.451522 25838 raft_consensus.cc:3060] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.455111 25795 consensus_queue.cc:237] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.427647 25767 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.464409 25767 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:45.465766 25739 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.466341 25739 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.467995 25732 tablet_bootstrap.cc:492] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:45.468688 25732 ts_tablet_manager.cc:1403] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.238s	user 0.017s	sys 0.017s
I20260709 13:20:45.472563 25732 raft_consensus.cc:359] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.473229 25732 raft_consensus.cc:385] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.473492 25732 raft_consensus.cc:740] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.473949 25731 tablet_bootstrap.cc:492] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:45.474339 25732 consensus_queue.cc:260] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.476617 25732 ts_tablet_manager.cc:1434] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:20:45.477505 25732 tablet_bootstrap.cc:492] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:45.467895 25786 raft_consensus.cc:515] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.480554 25531 raft_consensus.cc:2393] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 812474b88dc54c39bc37428d77dcb7a9 in current term 1: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:20:45.483047 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b54054e46384e8aa7153f332c5c366f" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:45.484366 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:45.484923 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:45.485029 25535 raft_consensus.cc:2468] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:45.486056 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:20:45.486388 25499 leader_election.cc:343] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.486699 25609 raft_consensus.cc:2468] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:45.487936 25737 raft_consensus.cc:515] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.502748 25740 raft_consensus.cc:2749] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.505084 25500 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:45.505753 25573 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:45.506167 25810 raft_consensus.cc:2804] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.506664 25810 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.507009 25810 raft_consensus.cc:3060] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.508466 25737 leader_election.cc:290] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:45.501227 25730 raft_consensus.cc:359] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.509768 25730 raft_consensus.cc:385] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.510218 25843 raft_consensus.cc:2804] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.510331 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b54054e46384e8aa7153f332c5c366f" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:45.510840 25843 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.511271 25843 raft_consensus.cc:3060] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.511515 25461 raft_consensus.cc:2393] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 1: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:20:45.510215 25730 raft_consensus.cc:740] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.491048 25739 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:45.514654 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:45.529898 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:45.523536 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 100948us
I20260709 13:20:45.529256 25610 raft_consensus.cc:3060] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.547420 25535 raft_consensus.cc:2393] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 812474b88dc54c39bc37428d77dcb7a9 in current term 1: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:20:45.548997 25786 leader_election.cc:290] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:45.551810 25740 raft_consensus.cc:493] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.528185 25732 tablet_bootstrap.cc:654] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.552309 25740 raft_consensus.cc:515] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:45.556069 25740 leader_election.cc:290] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:45.554395 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:45.564275 25737 raft_consensus.cc:493] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.574483 25843 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.533653 25730 consensus_queue.cc:260] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:20:45.568040 25407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:45.570736 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:45.572501 25838 raft_consensus.cc:515] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.557389 25573 leader_election.cc:304] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:45.575460 25737 raft_consensus.cc:515] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.566462 25810 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.576431 25786 consensus_queue.cc:1048] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:45.577672 25843 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:45.574502 25457 raft_consensus.cc:2393] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ae560ddb7e6849f69d0c5f47075d3bf9 in current term 1: Already voted for candidate 812474b88dc54c39bc37428d77dcb7a9 in this term.
I20260709 13:20:45.586812 25730 ts_tablet_manager.cc:1434] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.137s	user 0.010s	sys 0.004s
I20260709 13:20:45.590164 25730 tablet_bootstrap.cc:492] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:45.592451 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:45.593094 25683 raft_consensus.cc:3060] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.593186 25838 leader_election.cc:290] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:45.593887 25737 leader_election.cc:290] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:45.595197 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
W20260709 13:20:45.603053 25573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 45814.4us
I20260709 13:20:45.595460 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:45.604290 25684 raft_consensus.cc:3060] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:45.584764 25648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:40853, user_credentials={real_user=slave}} blocked reactor thread for 172886us
I20260709 13:20:45.600940 25810 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:45.598687 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:45.594347 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:45.600113 25844 consensus_queue.cc:1048] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:20:45.617890 25737 raft_consensus.cc:493] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.618937 25737 raft_consensus.cc:515] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.609409 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:45.620901 25532 raft_consensus.cc:2393] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 1: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:20:45.621270 25737 leader_election.cc:290] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:45.618311 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:45.624032 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540f940c49e54189a08d7ed4d84f2ac6" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
W20260709 13:20:45.624053 25499 leader_election.cc:343] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:45.626649 25424 leader_election.cc:343] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.593605 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:45.636062 25609 raft_consensus.cc:3060] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.639235 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:45.640569 25683 raft_consensus.cc:2468] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:45.648510 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:45.649389 25608 raft_consensus.cc:2393] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ae560ddb7e6849f69d0c5f47075d3bf9 in current term 1: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
I20260709 13:20:45.650071 25729 tablet_bootstrap.cc:492] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:45.650950 25729 ts_tablet_manager.cc:1403] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.349s	user 0.018s	sys 0.009s
I20260709 13:20:45.651575 25609 raft_consensus.cc:2468] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:45.653451 25425 leader_election.cc:304] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:45.653650 25767 consensus_queue.cc:1048] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:45.654449 25737 raft_consensus.cc:2804] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:45.654913 25737 raft_consensus.cc:697] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:45.654969 25729 raft_consensus.cc:359] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.656076 25729 raft_consensus.cc:385] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.655814 25737 consensus_queue.cc:237] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.656487 25729 raft_consensus.cc:740] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.657680 25767 consensus_queue.cc:1048] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:45.657481 25729 consensus_queue.cc:260] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:20:45.659373 25573 leader_election.cc:343] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:45.660359 25573 leader_election.cc:343] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.660818 25573 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:45.661128 25729 ts_tablet_manager.cc:1434] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:20:45.662561 25729 tablet_bootstrap.cc:492] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:45.665438 25356 catalog_manager.cc:5697] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:45.673851 25746 raft_consensus.cc:2749] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:20:45.635040 25647 leader_election.cc:343] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.629899 25684 raft_consensus.cc:2468] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:45.681855 25730 tablet_bootstrap.cc:654] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:45.686177 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 73211.3us
I20260709 13:20:45.692971 25729 tablet_bootstrap.cc:654] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.698050 25767 raft_consensus.cc:2749] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.705935 25424 leader_election.cc:304] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:45.707283 25424 leader_election.cc:304] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:45.707428 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540f940c49e54189a08d7ed4d84f2ac6" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:45.697149 25732 tablet_bootstrap.cc:492] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:45.708949 25732 ts_tablet_manager.cc:1403] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.232s	user 0.021s	sys 0.030s
I20260709 13:20:45.709618 25838 raft_consensus.cc:2749] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:45.710404 25838 raft_consensus.cc:2749] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.710963 25731 tablet_bootstrap.cc:654] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:45.711400 25424 leader_election.cc:343] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.711925 25424 leader_election.cc:304] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:45.712670 25838 raft_consensus.cc:2749] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.713320 25499 leader_election.cc:304] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:45.714557 25739 raft_consensus.cc:2804] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:45.715072 25739 raft_consensus.cc:697] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:20:45.715958 25739 consensus_queue.cc:237] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.718487 25500 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:45.720664 25732 raft_consensus.cc:359] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.721622 25732 raft_consensus.cc:385] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.721946 25732 raft_consensus.cc:740] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.721781 25786 raft_consensus.cc:2749] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.722429 25859 consensus_queue.cc:1048] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:45.724066 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:20:45.728960 25648 leader_election.cc:343] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.729427 25648 leader_election.cc:304] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:45.730548 25844 raft_consensus.cc:2749] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.736203 25767 consensus_queue.cc:1048] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:45.741461 25730 tablet_bootstrap.cc:492] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:45.741984 25730 ts_tablet_manager.cc:1403] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.002s
I20260709 13:20:45.744773 25730 raft_consensus.cc:359] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.745430 25730 raft_consensus.cc:385] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.722986 25732 consensus_queue.cc:260] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.748454 25732 ts_tablet_manager.cc:1434] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:20:45.749394 25732 tablet_bootstrap.cc:492] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:45.752030 25731 tablet_bootstrap.cc:492] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:45.752652 25731 ts_tablet_manager.cc:1403] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.279s	user 0.008s	sys 0.004s
I20260709 13:20:45.756119 25731 raft_consensus.cc:359] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.745703 25730 raft_consensus.cc:740] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.762259 25730 consensus_queue.cc:260] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.756979 25731 raft_consensus.cc:385] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.763262 25731 raft_consensus.cc:740] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.764004 25731 consensus_queue.cc:260] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.766360 25730 ts_tablet_manager.cc:1434] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:20:45.768536 25731 ts_tablet_manager.cc:1434] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 13:20:45.770680 25730 tablet_bootstrap.cc:492] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:45.782065 25731 tablet_bootstrap.cc:492] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:45.786779 25355 catalog_manager.cc:5697] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:45.790848 25732 tablet_bootstrap.cc:654] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.809674 25731 tablet_bootstrap.cc:654] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.812361 25730 tablet_bootstrap.cc:654] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.828682 25729 tablet_bootstrap.cc:492] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:45.829209 25729 ts_tablet_manager.cc:1403] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.167s	user 0.040s	sys 0.034s
I20260709 13:20:45.832003 25843 raft_consensus.cc:493] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.832590 25843 raft_consensus.cc:515] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.834750 25843 leader_election.cc:290] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:45.836355 25729 raft_consensus.cc:359] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.837164 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:45.837858 25684 raft_consensus.cc:2468] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:45.838937 25732 tablet_bootstrap.cc:492] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:45.839564 25732 ts_tablet_manager.cc:1403] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.002s
I20260709 13:20:45.837157 25729 raft_consensus.cc:385] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.839183 25573 leader_election.cc:304] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:45.840108 25729 raft_consensus.cc:740] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.846108 25843 raft_consensus.cc:493] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.846374 25729 consensus_queue.cc:260] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.846619 25843 raft_consensus.cc:515] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.847383 25732 raft_consensus.cc:359] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.848598 25843 leader_election.cc:290] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:45.848666 25732 raft_consensus.cc:385] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.849048 25729 ts_tablet_manager.cc:1434] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:20:45.849272 25732 raft_consensus.cc:740] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.850186 25732 consensus_queue.cc:260] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.850976 25356 catalog_manager.cc:5697] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:45.854274 25843 raft_consensus.cc:2804] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.854694 25843 raft_consensus.cc:493] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.844847 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:45.855012 25843 raft_consensus.cc:3060] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.856456 25732 ts_tablet_manager.cc:1434] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:20:45.857494 25732 tablet_bootstrap.cc:492] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:45.858487 25729 tablet_bootstrap.cc:492] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:45.859776 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c681632e82489da482ce4f96f3a902" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
W20260709 13:20:45.863243 25573 leader_election.cc:343] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:45.863940 25573 leader_election.cc:343] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.865722 25729 tablet_bootstrap.cc:654] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.867444 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c681632e82489da482ce4f96f3a902" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:45.874639 25730 tablet_bootstrap.cc:492] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:45.875393 25730 ts_tablet_manager.cc:1403] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.010s
I20260709 13:20:45.876221 25732 tablet_bootstrap.cc:654] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:45.871999 25573 leader_election.cc:343] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.878453 25573 leader_election.cc:304] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:45.878539 25730 raft_consensus.cc:359] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:45.879644 25730 raft_consensus.cc:385] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.879534 25746 raft_consensus.cc:2749] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.880124 25730 raft_consensus.cc:740] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.881363 25731 tablet_bootstrap.cc:492] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:45.880975 25730 consensus_queue.cc:260] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:45.881996 25731 ts_tablet_manager.cc:1403] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.011s
I20260709 13:20:45.884039 25730 ts_tablet_manager.cc:1434] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:45.885210 25730 tablet_bootstrap.cc:492] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:45.884908 25731 raft_consensus.cc:359] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.885722 25731 raft_consensus.cc:385] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.886089 25731 raft_consensus.cc:740] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.886863 25731 consensus_queue.cc:260] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.889050 25731 ts_tablet_manager.cc:1434] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:45.890053 25731 tablet_bootstrap.cc:492] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:45.892167 25730 tablet_bootstrap.cc:654] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.879242 25843 raft_consensus.cc:515] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.895803 25843 leader_election.cc:290] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:45.896095 25731 tablet_bootstrap.cc:654] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.897842 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:45.898499 25684 raft_consensus.cc:3060] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.898619 25729 tablet_bootstrap.cc:492] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:45.899183 25729 ts_tablet_manager.cc:1403] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.002s
I20260709 13:20:45.902287 25729 raft_consensus.cc:359] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.903028 25729 raft_consensus.cc:385] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.903455 25729 raft_consensus.cc:740] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.913355 25684 raft_consensus.cc:2468] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:45.914489 25729 consensus_queue.cc:260] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.907332 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:45.916097 25573 leader_election.cc:304] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:45.917039 25843 raft_consensus.cc:2804] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:20:45.917559 25573 leader_election.cc:343] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.920194 25732 tablet_bootstrap.cc:492] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:45.917534 25843 raft_consensus.cc:697] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:45.920787 25732 ts_tablet_manager.cc:1403] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.003s
I20260709 13:20:45.921470 25843 consensus_queue.cc:237] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.923293 25729 ts_tablet_manager.cc:1434] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
I20260709 13:20:45.924309 25729 tablet_bootstrap.cc:492] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:45.923961 25732 raft_consensus.cc:359] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.924739 25732 raft_consensus.cc:385] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.925063 25732 raft_consensus.cc:740] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.925822 25732 consensus_queue.cc:260] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.928167 25732 ts_tablet_manager.cc:1434] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:45.933000 25729 tablet_bootstrap.cc:654] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.936714 25730 tablet_bootstrap.cc:492] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:45.937225 25730 ts_tablet_manager.cc:1403] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.007s
I20260709 13:20:45.940459 25731 tablet_bootstrap.cc:492] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:45.941058 25731 ts_tablet_manager.cc:1403] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.007s
I20260709 13:20:45.941745 25358 catalog_manager.cc:5697] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:45.944199 25731 raft_consensus.cc:359] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.944977 25731 raft_consensus.cc:385] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.945278 25731 raft_consensus.cc:740] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.948336 25730 raft_consensus.cc:359] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.948992 25730 raft_consensus.cc:385] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.949275 25730 raft_consensus.cc:740] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.950030 25730 consensus_queue.cc:260] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:45.951061 25731 consensus_queue.cc:260] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.954159 25731 ts_tablet_manager.cc:1434] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:20:45.955184 25731 tablet_bootstrap.cc:492] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:45.958184 25732 tablet_bootstrap.cc:492] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:45.963260 25730 ts_tablet_manager.cc:1434] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.003s
I20260709 13:20:45.964771 25730 tablet_bootstrap.cc:492] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:45.967139 25729 tablet_bootstrap.cc:492] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:45.968139 25729 ts_tablet_manager.cc:1403] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.005s
I20260709 13:20:45.971441 25730 tablet_bootstrap.cc:654] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.974455 25731 tablet_bootstrap.cc:654] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.976405 25729 raft_consensus.cc:359] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.979103 25729 raft_consensus.cc:385] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.979494 25729 raft_consensus.cc:740] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.989355 25731 tablet_bootstrap.cc:492] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:45.989811 25731 ts_tablet_manager.cc:1403] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.004s
I20260709 13:20:45.992122 25730 tablet_bootstrap.cc:492] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:45.992631 25730 ts_tablet_manager.cc:1403] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.000s
I20260709 13:20:45.982204 25729 consensus_queue.cc:260] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.992812 25731 raft_consensus.cc:359] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.993764 25731 raft_consensus.cc:385] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.994686 25731 raft_consensus.cc:740] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.995621 25731 consensus_queue.cc:260] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:45.996587 25739 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.997361 25732 tablet_bootstrap.cc:654] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.997140 25739 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:45.999065 25729 ts_tablet_manager.cc:1434] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:20:45.995988 25730 raft_consensus.cc:359] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.000059 25739 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:46.000383 25730 raft_consensus.cc:385] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.000829 25730 raft_consensus.cc:740] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.001641 25730 consensus_queue.cc:260] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.002537 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:46.002424 25731 ts_tablet_manager.cc:1434] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:20:46.003901 25730 ts_tablet_manager.cc:1434] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:20:46.003929 25731 tablet_bootstrap.cc:492] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:46.005118 25730 tablet_bootstrap.cc:492] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
W20260709 13:20:46.005766 25499 leader_election.cc:343] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:46.000684 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:20:46.007623 25500 leader_election.cc:343] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:46.008126 25500 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:46.009410 25739 raft_consensus.cc:2749] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:46.000046 25729 tablet_bootstrap.cc:492] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:46.012053 25730 tablet_bootstrap.cc:654] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.014024 25731 tablet_bootstrap.cc:654] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.016312 25729 tablet_bootstrap.cc:654] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.029208 25844 raft_consensus.cc:493] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.030043 25844 raft_consensus.cc:515] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.034222 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfde4ba996435bb05645af25e1f2c7" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:46.035218 25457 raft_consensus.cc:2468] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:46.036890 25647 leader_election.cc:304] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:46.038074 25779 raft_consensus.cc:2804] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:46.038558 25779 raft_consensus.cc:493] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.039016 25779 raft_consensus.cc:3060] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.040426 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfde4ba996435bb05645af25e1f2c7" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:46.041119 25610 raft_consensus.cc:2468] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:46.043499 25844 leader_election.cc:290] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:46.058162 25731 tablet_bootstrap.cc:492] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:46.058805 25731 ts_tablet_manager.cc:1403] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.006s
I20260709 13:20:46.058955 25843 consensus_queue.cc:1048] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.060514 25779 raft_consensus.cc:515] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.063160 25737 raft_consensus.cc:493] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.063803 25737 raft_consensus.cc:515] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.066164 25737 leader_election.cc:290] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:46.063172 25729 tablet_bootstrap.cc:492] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:46.067416 25737 raft_consensus.cc:493] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.067942 25737 raft_consensus.cc:515] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.069049 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:46.069931 25684 raft_consensus.cc:2468] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:46.070991 25729 ts_tablet_manager.cc:1403] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.003s
I20260709 13:20:46.071080 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:46.070984 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:46.072324 25532 raft_consensus.cc:2468] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:46.073880 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:46.074230 25424 leader_election.cc:304] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:46.075853 25737 leader_election.cc:290] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:46.062090 25731 raft_consensus.cc:359] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.076292 25838 raft_consensus.cc:2804] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:46.075090 25684 raft_consensus.cc:2393] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 812474b88dc54c39bc37428d77dcb7a9 in current term 1: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
I20260709 13:20:46.076754 25838 raft_consensus.cc:493] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.081185 25838 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.082085 25424 leader_election.cc:304] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:46.086179 25779 leader_election.cc:290] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:46.086410 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfde4ba996435bb05645af25e1f2c7" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:46.093526 25795 consensus_queue.cc:1048] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:46.094266 25459 raft_consensus.cc:3060] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.085778 25737 raft_consensus.cc:3060] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.090667 25843 raft_consensus.cc:493] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.091009 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfde4ba996435bb05645af25e1f2c7" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:46.098755 25610 raft_consensus.cc:3060] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.098735 25843 raft_consensus.cc:515] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.107609 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:46.076632 25731 raft_consensus.cc:385] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.107575 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:46.110880 25838 raft_consensus.cc:515] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.116688 25731 raft_consensus.cc:740] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.116734 25459 raft_consensus.cc:2468] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
W20260709 13:20:46.117884 25573 leader_election.cc:343] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:46.118057 25647 leader_election.cc:304] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:46.113432 25610 raft_consensus.cc:2468] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:46.117602 25731 consensus_queue.cc:260] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.113474 25881 consensus_queue.cc:1048] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:20:46.119712 25844 raft_consensus.cc:2804] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:46.120225 25844 raft_consensus.cc:697] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:46.120857 25731 ts_tablet_manager.cc:1434] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 13:20:46.121098 25844 consensus_queue.cc:237] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.122128 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:46.122429 25731 tablet_bootstrap.cc:492] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:46.122715 25534 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.122912 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:46.123481 25683 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.105942 25843 leader_election.cc:290] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
W20260709 13:20:46.126374 25573 leader_election.cc:343] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:46.091739 25730 tablet_bootstrap.cc:492] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:46.075050 25729 raft_consensus.cc:359] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.127668 25730 ts_tablet_manager.cc:1403] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.123s	user 0.025s	sys 0.010s
I20260709 13:20:46.127745 25729 raft_consensus.cc:385] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.131512 25730 raft_consensus.cc:359] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.132270 25730 raft_consensus.cc:385] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.132570 25730 raft_consensus.cc:740] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.132694 25534 raft_consensus.cc:2468] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:46.133224 25731 tablet_bootstrap.cc:654] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.133621 25729 raft_consensus.cc:740] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.134899 25730 consensus_queue.cc:260] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.126958 25573 leader_election.cc:304] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:46.128636 25838 leader_election.cc:290] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:46.148381 25729 consensus_queue.cc:260] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.153503 25424 leader_election.cc:304] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:46.150012 25843 raft_consensus.cc:2749] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:46.161332 25683 raft_consensus.cc:2468] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:46.163610 25737 raft_consensus.cc:2749] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:46.164065 25732 tablet_bootstrap.cc:492] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:46.164377 25737 raft_consensus.cc:2804] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:46.164556 25732 ts_tablet_manager.cc:1403] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.208s	user 0.019s	sys 0.028s
I20260709 13:20:46.164973 25737 raft_consensus.cc:697] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:46.166734 25730 ts_tablet_manager.cc:1434] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.003s
I20260709 13:20:46.167651 25729 ts_tablet_manager.cc:1434] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.000s
I20260709 13:20:46.167692 25730 tablet_bootstrap.cc:492] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:46.169073 25729 tablet_bootstrap.cc:492] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:46.175442 25732 raft_consensus.cc:359] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.176005 25732 raft_consensus.cc:385] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.176232 25732 raft_consensus.cc:740] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.177192 25732 consensus_queue.cc:260] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.190234 25732 ts_tablet_manager.cc:1434] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:20:46.192142 25732 tablet_bootstrap.cc:492] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:46.185721 25729 tablet_bootstrap.cc:654] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.166311 25737 consensus_queue.cc:237] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.201136 25838 consensus_queue.cc:1048] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.202003 25732 tablet_bootstrap.cc:654] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.204200 25731 tablet_bootstrap.cc:492] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:46.207504 25780 raft_consensus.cc:493] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.208186 25780 raft_consensus.cc:515] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.210605 25780 leader_election.cc:290] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:46.212458 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540f940c49e54189a08d7ed4d84f2ac6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:46.214605 25457 raft_consensus.cc:2468] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:46.216100 25647 leader_election.cc:304] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:46.215890 25355 catalog_manager.cc:5697] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.217118 25779 raft_consensus.cc:2804] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:46.217517 25779 raft_consensus.cc:493] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.213682 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540f940c49e54189a08d7ed4d84f2ac6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:46.218377 25534 raft_consensus.cc:2468] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:46.217882 25779 raft_consensus.cc:3060] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.231339 25731 ts_tablet_manager.cc:1403] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.005s
I20260709 13:20:46.236917 25779 raft_consensus.cc:515] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.248207 25730 tablet_bootstrap.cc:654] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.256736 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540f940c49e54189a08d7ed4d84f2ac6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:46.257261 25732 tablet_bootstrap.cc:492] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:46.257539 25730 tablet_bootstrap.cc:492] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:46.258045 25732 ts_tablet_manager.cc:1403] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.066s	user 0.020s	sys 0.010s
I20260709 13:20:46.257845 25457 raft_consensus.cc:3060] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.258045 25730 ts_tablet_manager.cc:1403] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.006s
I20260709 13:20:46.263314 25732 raft_consensus.cc:359] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.263502 25739 consensus_queue.cc:1048] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.264909 25732 raft_consensus.cc:385] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.265281 25732 raft_consensus.cc:740] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.266003 25732 consensus_queue.cc:260] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.266933 25795 raft_consensus.cc:493] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.267547 25795 raft_consensus.cc:515] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.268797 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540f940c49e54189a08d7ed4d84f2ac6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:46.269446 25534 raft_consensus.cc:3060] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.269619 25732 ts_tablet_manager.cc:1434] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:20:46.269892 25795 leader_election.cc:290] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:46.271850 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8168790b26f4632b04441b2780e479a" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:46.272512 25684 raft_consensus.cc:2468] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:46.273562 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8168790b26f4632b04441b2780e479a" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:46.272464 25730 raft_consensus.cc:359] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.276500 25730 raft_consensus.cc:385] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.276788 25730 raft_consensus.cc:740] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.276643 25573 leader_election.cc:304] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:46.277544 25795 raft_consensus.cc:2804] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:46.277907 25795 raft_consensus.cc:493] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.278044 25732 tablet_bootstrap.cc:492] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:46.278312 25795 raft_consensus.cc:3060] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.279299 25731 raft_consensus.cc:359] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.280033 25731 raft_consensus.cc:385] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.280333 25731 raft_consensus.cc:740] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.282622 25730 consensus_queue.cc:260] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.282264 25731 consensus_queue.cc:260] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.290923 25732 tablet_bootstrap.cc:654] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.293943 25730 ts_tablet_manager.cc:1434] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:20:46.295081 25730 tablet_bootstrap.cc:492] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:46.289628 25457 raft_consensus.cc:2468] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:46.282346 25779 leader_election.cc:290] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:46.310976 25730 tablet_bootstrap.cc:654] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.312104 25731 ts_tablet_manager.cc:1434] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:20:46.313741 25731 tablet_bootstrap.cc:492] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:46.319730 25532 raft_consensus.cc:2468] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:46.332913 25838 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.333002 25534 raft_consensus.cc:2468] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:46.340487 25838 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.339078 25647 leader_election.cc:304] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:46.344353 25729 tablet_bootstrap.cc:492] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:46.344887 25729 ts_tablet_manager.cc:1403] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.000s
I20260709 13:20:46.345160 25779 raft_consensus.cc:2804] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:46.345721 25779 raft_consensus.cc:697] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:46.346839 25779 consensus_queue.cc:237] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.347898 25838 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:46.349388 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:46.349772 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:46.350103 25683 raft_consensus.cc:2468] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:46.349864 25729 raft_consensus.cc:359] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.350797 25729 raft_consensus.cc:385] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.351078 25729 raft_consensus.cc:740] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
W20260709 13:20:46.351192 25424 leader_election.cc:343] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:46.351101 25739 consensus_queue.cc:1048] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:46.351553 25838 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.352326 25838 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.352645 25424 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:46.354082 25881 raft_consensus.cc:2804] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:46.354480 25881 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.354700 25838 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:46.354907 25881 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.357306 25729 consensus_queue.cc:260] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.358275 25739 raft_consensus.cc:493] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.358776 25739 raft_consensus.cc:515] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.360951 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:46.361250 25739 leader_election.cc:290] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:46.361161 25795 raft_consensus.cc:515] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.362257 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4b9518dd674972b99e9595c9b1c686" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:46.361869 25610 raft_consensus.cc:2393] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 812474b88dc54c39bc37428d77dcb7a9 in current term 1: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
I20260709 13:20:46.372027 25732 tablet_bootstrap.cc:492] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:46.372716 25732 ts_tablet_manager.cc:1403] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.025s
W20260709 13:20:46.374414 25499 leader_election.cc:343] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:46.375141 25746 consensus_queue.cc:1048] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.375555 25795 leader_election.cc:290] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:46.375777 25732 raft_consensus.cc:359] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.376479 25732 raft_consensus.cc:385] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.376823 25732 raft_consensus.cc:740] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.364590 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:46.365482 25729 ts_tablet_manager.cc:1434] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 13:20:46.376530 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8168790b26f4632b04441b2780e479a" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:46.378515 25532 raft_consensus.cc:3060] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.378556 25729 tablet_bootstrap.cc:492] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:46.381045 25534 raft_consensus.cc:2393] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 812474b88dc54c39bc37428d77dcb7a9 in current term 1: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:20:46.383625 25424 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:46.381681 25732 consensus_queue.cc:260] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.385264 25880 raft_consensus.cc:3060] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.377025 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4b9518dd674972b99e9595c9b1c686" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:46.386618 25610 raft_consensus.cc:2468] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:46.387274 25732 ts_tablet_manager.cc:1434] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:20:46.387461 25729 tablet_bootstrap.cc:654] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.389819 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8168790b26f4632b04441b2780e479a" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:46.391060 25684 raft_consensus.cc:3060] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.391317 25731 tablet_bootstrap.cc:654] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.392839 25880 raft_consensus.cc:2749] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:46.392081 25732 tablet_bootstrap.cc:492] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:46.394960 25500 leader_election.cc:304] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:46.395924 25739 raft_consensus.cc:2804] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:46.396405 25739 raft_consensus.cc:493] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.396797 25739 raft_consensus.cc:3060] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.399705 25684 raft_consensus.cc:2468] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:46.417470 25732 tablet_bootstrap.cc:654] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.419616 25731 tablet_bootstrap.cc:492] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:46.425069 25731 ts_tablet_manager.cc:1403] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.003s
I20260709 13:20:46.428987 25731 raft_consensus.cc:359] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.433761 25731 raft_consensus.cc:385] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.434572 25731 raft_consensus.cc:740] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.435536 25731 consensus_queue.cc:260] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.432242 25739 raft_consensus.cc:515] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.435861 25573 leader_election.cc:304] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:46.421766 25881 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.439050 25732 tablet_bootstrap.cc:492] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:46.439481 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4b9518dd674972b99e9595c9b1c686" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:46.439751 25732 ts_tablet_manager.cc:1403] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.002s
I20260709 13:20:46.439813 25795 raft_consensus.cc:2804] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:46.440589 25795 raft_consensus.cc:697] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
W20260709 13:20:46.440841 25499 leader_election.cc:343] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:46.441573 25795 consensus_queue.cc:237] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.442741 25767 consensus_queue.cc:1048] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.443426 25739 leader_election.cc:290] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:46.444089 25739 raft_consensus.cc:493] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.444587 25739 raft_consensus.cc:515] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.444756 25732 raft_consensus.cc:359] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.445384 25732 raft_consensus.cc:385] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.445664 25732 raft_consensus.cc:740] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.448523 25731 ts_tablet_manager.cc:1434] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:20:46.448819 25732 consensus_queue.cc:260] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.451079 25732 ts_tablet_manager.cc:1434] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:20:46.452082 25732 tablet_bootstrap.cc:492] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:46.456079 25356 catalog_manager.cc:5697] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.457258 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:46.457866 25683 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.459580 25731 tablet_bootstrap.cc:492] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:46.462606 25729 tablet_bootstrap.cc:492] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:46.463145 25729 ts_tablet_manager.cc:1403] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.001s
I20260709 13:20:46.419926 25358 catalog_manager.cc:5697] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.462380 25737 raft_consensus.cc:493] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.474344 25737 raft_consensus.cc:515] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.476507 25737 leader_election.cc:290] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:46.478355 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:46.479279 25534 raft_consensus.cc:2468] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:46.480033 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:46.480700 25682 raft_consensus.cc:2468] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:46.481101 25424 leader_election.cc:304] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:46.482172 25737 raft_consensus.cc:2804] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:46.482525 25737 raft_consensus.cc:493] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.482864 25737 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.484969 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4b9518dd674972b99e9595c9b1c686" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:46.485571 25610 raft_consensus.cc:3060] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.488960 25732 tablet_bootstrap.cc:654] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.491214 25880 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.491719 25737 raft_consensus.cc:515] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.491691 25880 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.495581 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:46.496228 25534 raft_consensus.cc:2468] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:46.497757 25880 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:46.497603 25424 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:46.499375 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:46.500046 25609 raft_consensus.cc:2468] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:46.500243 25880 raft_consensus.cc:2804] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:46.500633 25880 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.500995 25880 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.503916 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:46.505697 25737 leader_election.cc:290] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
W20260709 13:20:46.505892 25424 leader_election.cc:343] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:46.507146 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:46.492671 25731 tablet_bootstrap.cc:654] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.509990 25682 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.502589 25881 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:46.497571 25532 raft_consensus.cc:2468] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:46.514016 25730 tablet_bootstrap.cc:492] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:46.515678 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:46.515678 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:46.518416 25534 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.521806 25730 ts_tablet_manager.cc:1403] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.227s	user 0.035s	sys 0.052s
I20260709 13:20:46.522946 25682 raft_consensus.cc:2468] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:46.523641 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:46.524437 25459 raft_consensus.cc:2393] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae560ddb7e6849f69d0c5f47075d3bf9 in current term 1: Already voted for candidate 812474b88dc54c39bc37428d77dcb7a9 in this term.
I20260709 13:20:46.524957 25424 leader_election.cc:304] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:46.530225 25730 raft_consensus.cc:359] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.530920 25730 raft_consensus.cc:385] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.481150 25683 raft_consensus.cc:2468] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:46.531337 25730 raft_consensus.cc:740] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.530802 25499 leader_election.cc:304] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:46.534307 25730 consensus_queue.cc:260] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.521540 25880 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.540427 25880 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:46.537956 25729 raft_consensus.cc:359] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.542873 25729 raft_consensus.cc:385] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.543243 25729 raft_consensus.cc:740] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.531603 25739 leader_election.cc:290] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:46.547963 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:46.534240 25881 raft_consensus.cc:2804] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:46.548619 25609 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.551330 25729 consensus_queue.cc:260] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.553045 25424 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:46.556916 25730 ts_tablet_manager.cc:1434] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:20:46.556800 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:46.557617 25532 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.558036 25730 tablet_bootstrap.cc:492] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:46.560083 25534 raft_consensus.cc:2468] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:46.560693 25810 raft_consensus.cc:2749] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:46.564549 25737 raft_consensus.cc:2804] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:46.563588 25881 raft_consensus.cc:697] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:46.570001 25731 tablet_bootstrap.cc:492] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:46.574265 25731 ts_tablet_manager.cc:1403] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.019s
I20260709 13:20:46.575950 25732 tablet_bootstrap.cc:492] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:46.576474 25732 ts_tablet_manager.cc:1403] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.009s
I20260709 13:20:46.577411 25729 ts_tablet_manager.cc:1434] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.114s	user 0.009s	sys 0.000s
I20260709 13:20:46.579236 25729 tablet_bootstrap.cc:492] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:46.576802 25737 raft_consensus.cc:697] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:46.579926 25355 catalog_manager.cc:5697] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.580489 25737 consensus_queue.cc:237] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.583847 25881 consensus_queue.cc:237] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.600628 25780 consensus_queue.cc:1048] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.603778 25532 raft_consensus.cc:2468] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:46.605978 25610 raft_consensus.cc:2468] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:46.610785 25500 leader_election.cc:304] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:46.612483 25424 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:46.612876 25609 raft_consensus.cc:2468] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:46.613435 25838 raft_consensus.cc:2804] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:46.614873 25838 raft_consensus.cc:697] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:46.615741 25838 consensus_queue.cc:237] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.620538 25739 raft_consensus.cc:2804] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:46.623216 25739 raft_consensus.cc:697] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:20:46.630336 25739 consensus_queue.cc:237] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.632063 25729 tablet_bootstrap.cc:654] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.640164 25730 tablet_bootstrap.cc:654] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.648614 25732 raft_consensus.cc:359] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.649973 25732 raft_consensus.cc:385] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.650339 25732 raft_consensus.cc:740] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.651387 25732 consensus_queue.cc:260] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.655189 25731 raft_consensus.cc:359] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.656270 25731 raft_consensus.cc:385] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.656689 25731 raft_consensus.cc:740] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.663488 25731 consensus_queue.cc:260] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:46.666438 25731 ts_tablet_manager.cc:1434] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.000s
I20260709 13:20:46.667759 25731 tablet_bootstrap.cc:492] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:46.669420 25732 ts_tablet_manager.cc:1434] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.002s
I20260709 13:20:46.679126 25731 tablet_bootstrap.cc:654] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.680392 25355 catalog_manager.cc:5697] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.681375 25732 tablet_bootstrap.cc:492] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:46.702240 25739 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.703989 25739 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
W20260709 13:20:46.706571 25407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:46.707782 25357 catalog_manager.cc:5697] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.709503 25739 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:46.690029 25355 catalog_manager.cc:5697] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.711202 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:46.712026 25684 raft_consensus.cc:2393] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae560ddb7e6849f69d0c5f47075d3bf9 in current term 1: Already voted for candidate 812474b88dc54c39bc37428d77dcb7a9 in this term.
I20260709 13:20:46.712932 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:46.719317 25731 tablet_bootstrap.cc:492] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:46.719194 25739 raft_consensus.cc:493] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.719578 25499 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:46.719915 25731 ts_tablet_manager.cc:1403] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.007s
I20260709 13:20:46.719966 25739 raft_consensus.cc:515] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.720780 25903 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.722204 25739 leader_election.cc:290] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:46.723243 25731 raft_consensus.cc:359] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.723927 25731 raft_consensus.cc:385] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.724175 25731 raft_consensus.cc:740] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.724872 25731 consensus_queue.cc:260] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.728328 25732 tablet_bootstrap.cc:654] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.732564 25730 tablet_bootstrap.cc:492] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:46.733083 25730 ts_tablet_manager.cc:1403] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.175s	user 0.009s	sys 0.012s
I20260709 13:20:46.734062 25731 ts_tablet_manager.cc:1434] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:20:46.734951 25731 tablet_bootstrap.cc:492] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:46.737464 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:46.738243 25610 raft_consensus.cc:2468] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:46.739508 25500 leader_election.cc:304] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:46.744134 25739 raft_consensus.cc:2804] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:46.741889 25903 raft_consensus.cc:2749] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:46.744854 25779 consensus_queue.cc:1048] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.745772 25739 raft_consensus.cc:493] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.747097 25739 raft_consensus.cc:3060] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.750860 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:46.755228 25780 raft_consensus.cc:493] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.752871 25881 consensus_queue.cc:1048] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:20:46.756153 25684 raft_consensus.cc:2468] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:46.768189 25729 tablet_bootstrap.cc:492] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:46.755764 25780 raft_consensus.cc:515] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.771831 25731 tablet_bootstrap.cc:654] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.769691 25729 ts_tablet_manager.cc:1403] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.191s	user 0.012s	sys 0.009s
I20260709 13:20:46.772986 25780 leader_election.cc:290] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:46.773171 25730 raft_consensus.cc:359] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.775851 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e879da59df949eca2ae0618a4c5ddc2" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:46.776993 25730 raft_consensus.cc:385] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.777352 25730 raft_consensus.cc:740] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.779129 25730 consensus_queue.cc:260] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:46.783285 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e879da59df949eca2ae0618a4c5ddc2" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:46.778821 25457 raft_consensus.cc:2468] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
W20260709 13:20:46.786549 25648 leader_election.cc:343] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:46.791756 25647 leader_election.cc:304] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:20:46.793424 25779 raft_consensus.cc:2804] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:46.793980 25779 raft_consensus.cc:493] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.794409 25779 raft_consensus.cc:3060] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.804925 25732 tablet_bootstrap.cc:492] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:46.805675 25732 ts_tablet_manager.cc:1403] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.125s	user 0.017s	sys 0.005s
I20260709 13:20:46.807641 25729 raft_consensus.cc:359] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.787349 25739 raft_consensus.cc:515] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.811875 25881 consensus_queue.cc:1048] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.813148 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:46.813773 25684 raft_consensus.cc:3060] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.822289 25731 tablet_bootstrap.cc:492] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:46.822875 25731 ts_tablet_manager.cc:1403] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.031s
I20260709 13:20:46.823350 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:46.823984 25609 raft_consensus.cc:3060] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.820472 25732 raft_consensus.cc:359] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.825963 25732 raft_consensus.cc:385] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.825928 25731 raft_consensus.cc:359] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.826574 25732 raft_consensus.cc:740] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.826727 25731 raft_consensus.cc:385] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.827032 25731 raft_consensus.cc:740] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.827324 25732 consensus_queue.cc:260] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.827647 25731 consensus_queue.cc:260] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.829403 25732 ts_tablet_manager.cc:1434] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:20:46.829902 25731 ts_tablet_manager.cc:1434] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:46.830426 25729 raft_consensus.cc:385] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.831032 25729 raft_consensus.cc:740] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.831115 25731 tablet_bootstrap.cc:492] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:46.809341 25730 ts_tablet_manager.cc:1434] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.000s
I20260709 13:20:46.830861 25739 leader_election.cc:290] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:46.833657 25729 consensus_queue.cc:260] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.835952 25730 tablet_bootstrap.cc:492] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:46.821587 25684 raft_consensus.cc:2468] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:46.839802 25729 ts_tablet_manager.cc:1434] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:20:46.840097 25609 raft_consensus.cc:2468] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:46.842003 25732 tablet_bootstrap.cc:492] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:46.842550 25729 tablet_bootstrap.cc:492] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:46.841231 25499 leader_election.cc:304] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:46.844136 25739 raft_consensus.cc:2804] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:46.844610 25739 raft_consensus.cc:697] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:20:46.845505 25739 consensus_queue.cc:237] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.848224 25731 tablet_bootstrap.cc:654] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.824673 25779 raft_consensus.cc:515] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.877216 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e879da59df949eca2ae0618a4c5ddc2" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:46.879210 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e879da59df949eca2ae0618a4c5ddc2" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
W20260709 13:20:46.880183 25648 leader_election.cc:343] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:46.880219 25457 raft_consensus.cc:3060] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.878830 25779 leader_election.cc:290] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:46.881887 25730 tablet_bootstrap.cc:654] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.890359 25729 tablet_bootstrap.cc:654] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.894556 25779 consensus_queue.cc:1048] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:46.899191 25355 catalog_manager.cc:5697] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.916589 25457 raft_consensus.cc:2468] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:46.916836 25731 tablet_bootstrap.cc:492] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:46.922294 25731 ts_tablet_manager.cc:1403] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.091s	user 0.012s	sys 0.023s
I20260709 13:20:46.922298 25732 tablet_bootstrap.cc:654] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.921070 25730 tablet_bootstrap.cc:492] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:46.923139 25729 tablet_bootstrap.cc:492] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:46.923461 25730 ts_tablet_manager.cc:1403] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.091s	user 0.022s	sys 0.020s
I20260709 13:20:46.923611 25729 ts_tablet_manager.cc:1403] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.000s
I20260709 13:20:46.926872 25730 raft_consensus.cc:359] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.927614 25730 raft_consensus.cc:385] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.928850 25795 consensus_queue.cc:1048] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:46.929546 25730 raft_consensus.cc:740] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.930343 25730 consensus_queue.cc:260] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.931282 25780 consensus_queue.cc:1048] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.943743 25731 raft_consensus.cc:359] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.944481 25731 raft_consensus.cc:385] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.944736 25731 raft_consensus.cc:740] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.946312 25647 leader_election.cc:304] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:20:46.945370 25731 consensus_queue.cc:260] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.948114 25779 raft_consensus.cc:2804] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:46.949978 25730 ts_tablet_manager.cc:1434] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:20:46.951334 25779 raft_consensus.cc:697] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:46.952270 25779 consensus_queue.cc:237] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:46.953223 25730 tablet_bootstrap.cc:492] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:46.957540 25729 raft_consensus.cc:359] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.969441 25729 raft_consensus.cc:385] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:46.963960 25767 consensus_queue.cc:1048] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.960238 25731 ts_tablet_manager.cc:1434] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:20:46.971213 25731 tablet_bootstrap.cc:492] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:46.972018 25729 raft_consensus.cc:740] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:46.986563 25355 catalog_manager.cc:5697] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.989042 25729 consensus_queue.cc:260] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:46.991397 25729 ts_tablet_manager.cc:1434] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:20:46.995919 25730 tablet_bootstrap.cc:654] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:46.997665 25779 raft_consensus.cc:493] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.004858 25729 tablet_bootstrap.cc:492] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:47.006404 25880 consensus_queue.cc:1048] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.998399 25779 raft_consensus.cc:515] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.009588 25779 leader_election.cc:290] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:47.019009 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e89c6170734a98849f97b6441df9e4" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:47.019384 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e89c6170734a98849f97b6441df9e4" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:47.021183 25534 raft_consensus.cc:2468] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:47.019367 25731 tablet_bootstrap.cc:654] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.022593 25647 leader_election.cc:304] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:47.023751 25780 raft_consensus.cc:2804] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:47.024155 25780 raft_consensus.cc:493] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.024515 25780 raft_consensus.cc:3060] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:47.028375 25648 leader_election.cc:343] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.032804 25746 raft_consensus.cc:493] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.033330 25729 tablet_bootstrap.cc:654] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.033411 25746 raft_consensus.cc:515] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.035609 25732 tablet_bootstrap.cc:492] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:47.036190 25732 ts_tablet_manager.cc:1403] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.194s	user 0.034s	sys 0.017s
I20260709 13:20:47.042943 25746 leader_election.cc:290] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:47.036803 25358 catalog_manager.cc:5697] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:47.059515 25731 tablet_bootstrap.cc:492] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:47.060309 25731 ts_tablet_manager.cc:1403] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.005s
I20260709 13:20:47.063527 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e879da59df949eca2ae0618a4c5ddc2" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:47.052973 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e879da59df949eca2ae0618a4c5ddc2" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:47.044353 25880 consensus_queue.cc:1048] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:20:47.065647 25732 raft_consensus.cc:359] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.067166 25732 raft_consensus.cc:385] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.067585 25732 raft_consensus.cc:740] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.070209 25739 raft_consensus.cc:493] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.070991 25739 raft_consensus.cc:515] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.073879 25838 consensus_queue.cc:1048] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:47.075532 25739 leader_election.cc:290] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:47.076331 25457 raft_consensus.cc:2393] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 1: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
I20260709 13:20:47.080286 25573 leader_election.cc:304] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:47.082223 25746 raft_consensus.cc:3060] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.082692 25732 consensus_queue.cc:260] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.077198 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15e4fb6800449ceb211a61be3587ecc" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:47.085433 25730 tablet_bootstrap.cc:492] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:47.086838 25730 ts_tablet_manager.cc:1403] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.136s	user 0.012s	sys 0.009s
W20260709 13:20:47.093382 25500 leader_election.cc:343] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.094164 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15e4fb6800449ceb211a61be3587ecc" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
W20260709 13:20:47.096114 25499 leader_election.cc:343] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.096365 25731 raft_consensus.cc:359] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.096798 25499 leader_election.cc:304] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:47.097730 25731 raft_consensus.cc:385] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.098533 25731 raft_consensus.cc:740] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.099886 25731 consensus_queue.cc:260] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.098086 25739 raft_consensus.cc:2749] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:47.103603 25881 consensus_queue.cc:1048] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:47.104497 25732 ts_tablet_manager.cc:1434] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.004s
I20260709 13:20:47.136476 25732 tablet_bootstrap.cc:492] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:47.147679 25737 raft_consensus.cc:493] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.147900 25731 ts_tablet_manager.cc:1434] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.001s
I20260709 13:20:47.150750 25731 tablet_bootstrap.cc:492] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:47.111016 25838 consensus_queue.cc:1048] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:47.112071 25767 raft_consensus.cc:493] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.112939 25780 raft_consensus.cc:515] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.155932 25767 raft_consensus.cc:515] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.157336 25780 leader_election.cc:290] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:47.113372 25895 raft_consensus.cc:493] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.158093 25895 raft_consensus.cc:515] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.116194 25729 tablet_bootstrap.cc:492] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:47.159893 25729 ts_tablet_manager.cc:1403] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.155s	user 0.027s	sys 0.005s
I20260709 13:20:47.148268 25737 raft_consensus.cc:515] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.108530 25746 raft_consensus.cc:2749] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:47.158380 25767 leader_election.cc:290] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:47.152220 25732 tablet_bootstrap.cc:654] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.162874 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:47.162925 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:47.163746 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e89c6170734a98849f97b6441df9e4" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:47.168759 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e89c6170734a98849f97b6441df9e4" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:47.169382 25730 raft_consensus.cc:359] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.171613 25729 raft_consensus.cc:359] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.179376 25729 raft_consensus.cc:385] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.179672 25729 raft_consensus.cc:740] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.173583 25895 leader_election.cc:290] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:47.175632 25737 leader_election.cc:290] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:47.177066 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
W20260709 13:20:47.183593 25573 leader_election.cc:343] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.184085 25532 raft_consensus.cc:3060] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:47.184382 25424 leader_election.cc:343] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.187095 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:47.188757 25895 raft_consensus.cc:493] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:47.188962 25573 leader_election.cc:343] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.189343 25895 raft_consensus.cc:515] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:20:47.190210 25425 leader_election.cc:343] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.190649 25425 leader_election.cc:304] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:47.191560 25895 leader_election.cc:290] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:47.191776 25838 raft_consensus.cc:2749] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:47.189608 25573 leader_election.cc:304] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
W20260709 13:20:47.192584 25648 leader_election.cc:343] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.192602 25767 raft_consensus.cc:2749] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:47.194015 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5001675947e47d284c3bc4729cf9fd9" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:47.197091 25499 leader_election.cc:343] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.182956 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:47.197608 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5001675947e47d284c3bc4729cf9fd9" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:47.188843 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:47.182415 25729 consensus_queue.cc:260] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:20:47.198887 25499 leader_election.cc:343] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.199745 25729 ts_tablet_manager.cc:1434] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.002s
I20260709 13:20:47.180351 25730 raft_consensus.cc:385] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.200852 25729 tablet_bootstrap.cc:492] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
W20260709 13:20:47.199697 25500 leader_election.cc:343] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.201506 25500 leader_election.cc:304] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
W20260709 13:20:47.203016 25500 leader_election.cc:343] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.203626 25500 leader_election.cc:304] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:47.205096 25903 raft_consensus.cc:2749] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:47.206018 25730 raft_consensus.cc:740] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.206199 25903 raft_consensus.cc:2749] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:47.208509 25838 consensus_queue.cc:1048] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:47.217622 25499 consensus_peers.cc:597] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:47.219936 25730 consensus_queue.cc:260] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.235935 25895 consensus_queue.cc:1048] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:47.241286 25532 raft_consensus.cc:2468] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:47.244271 25895 consensus_queue.cc:1048] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:47.244333 25729 tablet_bootstrap.cc:654] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.251332 25730 ts_tablet_manager.cc:1434] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.164s	user 0.008s	sys 0.000s
I20260709 13:20:47.256202 25732 tablet_bootstrap.cc:492] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:47.257102 25731 tablet_bootstrap.cc:654] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.262713 25647 leader_election.cc:304] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:20:47.263989 25779 raft_consensus.cc:2804] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:47.264546 25779 raft_consensus.cc:697] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:47.265614 25732 ts_tablet_manager.cc:1403] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.129s	user 0.009s	sys 0.003s
I20260709 13:20:47.265523 25779 consensus_queue.cc:237] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.276333 25729 tablet_bootstrap.cc:492] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:47.276625 25731 tablet_bootstrap.cc:492] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:47.276897 25729 ts_tablet_manager.cc:1403] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.014s
I20260709 13:20:47.277315 25731 ts_tablet_manager.cc:1403] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.002s
I20260709 13:20:47.279213 25732 raft_consensus.cc:359] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.280030 25729 raft_consensus.cc:359] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.285158 25732 raft_consensus.cc:385] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.285271 25729 raft_consensus.cc:385] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.285527 25732 raft_consensus.cc:740] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.286376 25732 consensus_queue.cc:260] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.285679 25729 raft_consensus.cc:740] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.286748 25358 catalog_manager.cc:5697] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.281579 25730 tablet_bootstrap.cc:492] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:47.284423 25838 raft_consensus.cc:493] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.290603 25838 raft_consensus.cc:515] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.293181 25838 leader_election.cc:290] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:47.293315 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c681632e82489da482ce4f96f3a902" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:47.294142 25607 raft_consensus.cc:2468] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:47.295717 25425 leader_election.cc:304] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:47.288070 25729 consensus_queue.cc:260] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.296751 25838 raft_consensus.cc:2804] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:47.297222 25838 raft_consensus.cc:493] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.297663 25838 raft_consensus.cc:3060] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.300737 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c681632e82489da482ce4f96f3a902" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:47.301535 25683 raft_consensus.cc:2468] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:47.280514 25731 raft_consensus.cc:359] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.305366 25731 raft_consensus.cc:385] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.305692 25731 raft_consensus.cc:740] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.306492 25731 consensus_queue.cc:260] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.297950 25729 ts_tablet_manager.cc:1434] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 13:20:47.308192 25729 tablet_bootstrap.cc:492] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:47.309249 25730 tablet_bootstrap.cc:654] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.312960 25731 ts_tablet_manager.cc:1434] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:20:47.313952 25903 consensus_queue.cc:1048] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:47.318620 25729 tablet_bootstrap.cc:654] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.333199 25746 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.333801 25746 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.313989 25731 tablet_bootstrap.cc:492] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:47.335875 25746 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:47.338511 25732 ts_tablet_manager.cc:1434] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:20:47.338694 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:47.338723 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:47.339346 25461 raft_consensus.cc:2468] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:47.339613 25532 raft_consensus.cc:2468] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:47.342546 25573 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:47.343983 25767 raft_consensus.cc:493] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.344458 25767 raft_consensus.cc:515] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.346807 25767 leader_election.cc:290] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:47.348222 25767 raft_consensus.cc:2804] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:47.348950 25767 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.350051 25767 raft_consensus.cc:3060] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:47.351414 25731 tablet_bootstrap.cc:654] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.339516 25732 tablet_bootstrap.cc:492] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:47.358222 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15e4fb6800449ceb211a61be3587ecc" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:47.358939 25683 raft_consensus.cc:2468] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:47.359313 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15e4fb6800449ceb211a61be3587ecc" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:47.359922 25532 raft_consensus.cc:2468] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:47.361179 25573 leader_election.cc:304] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:47.362107 25746 raft_consensus.cc:2804] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:47.362498 25746 raft_consensus.cc:493] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.362869 25746 raft_consensus.cc:3060] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.345007 25838 raft_consensus.cc:515] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.361178 25729 tablet_bootstrap.cc:492] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:47.367221 25729 ts_tablet_manager.cc:1403] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.059s	user 0.024s	sys 0.015s
I20260709 13:20:47.369225 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c681632e82489da482ce4f96f3a902" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:47.370071 25608 raft_consensus.cc:3060] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.370558 25729 raft_consensus.cc:359] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.371338 25729 raft_consensus.cc:385] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.371661 25732 tablet_bootstrap.cc:654] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.371625 25729 raft_consensus.cc:740] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.376519 25746 raft_consensus.cc:515] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.378258 25737 raft_consensus.cc:493] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.378815 25737 raft_consensus.cc:515] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.379665 25730 tablet_bootstrap.cc:492] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:47.380143 25730 ts_tablet_manager.cc:1403] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.004s
I20260709 13:20:47.381125 25737 leader_election.cc:290] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:47.379674 25729 consensus_queue.cc:260] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.382767 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15e4fb6800449ceb211a61be3587ecc" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:47.382898 25730 raft_consensus.cc:359] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.383405 25532 raft_consensus.cc:3060] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.383612 25730 raft_consensus.cc:385] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.383906 25730 raft_consensus.cc:740] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.383037 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:47.384269 25729 ts_tablet_manager.cc:1434] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:20:47.384783 25534 raft_consensus.cc:2468] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:47.386308 25424 leader_election.cc:304] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:47.381224 25746 leader_election.cc:290] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:47.387362 25737 raft_consensus.cc:2804] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:47.387629 25729 tablet_bootstrap.cc:492] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:47.387789 25737 raft_consensus.cc:493] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.388188 25737 raft_consensus.cc:3060] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.390444 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15e4fb6800449ceb211a61be3587ecc" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:47.395260 25684 raft_consensus.cc:3060] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.396941 25532 raft_consensus.cc:2468] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:47.397138 25779 raft_consensus.cc:493] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.397761 25779 raft_consensus.cc:515] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.400104 25779 leader_election.cc:290] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:47.402390 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea867c357cd4e4d970226215f94bfe7" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:47.402626 25573 leader_election.cc:304] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:47.403620 25746 raft_consensus.cc:2804] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:47.384583 25730 consensus_queue.cc:260] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.404045 25838 leader_election.cc:290] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:47.405287 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c681632e82489da482ce4f96f3a902" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:47.408538 25683 raft_consensus.cc:3060] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.411607 25608 raft_consensus.cc:2468] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
W20260709 13:20:47.406337 25648 leader_election.cc:343] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.407052 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:47.414108 25737 raft_consensus.cc:515] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.414170 25779 raft_consensus.cc:493] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.417475 25779 raft_consensus.cc:515] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.419010 25737 leader_election.cc:290] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:47.394688 25729 tablet_bootstrap.cc:654] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.420972 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:47.421792 25534 raft_consensus.cc:3060] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.422881 25425 leader_election.cc:304] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:47.416770 25684 raft_consensus.cc:2468] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:47.425839 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f61b96593545c79c1d08d45ad98dee" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:47.427791 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f61b96593545c79c1d08d45ad98dee" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:47.435272 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:47.440011 25737 raft_consensus.cc:2804] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:47.441056 25737 raft_consensus.cc:697] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:47.414124 25610 raft_consensus.cc:2468] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:47.442121 25737 consensus_queue.cc:237] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:20:47.439813 25647 leader_election.cc:343] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.444211 25779 leader_election.cc:290] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
W20260709 13:20:47.444561 25647 leader_election.cc:343] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.446357 25647 leader_election.cc:304] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:47.447582 25888 raft_consensus.cc:2749] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:47.438344 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea867c357cd4e4d970226215f94bfe7" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:47.450469 25746 raft_consensus.cc:697] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:47.455751 25767 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:20:47.452366 25647 leader_election.cc:343] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.457065 25647 leader_election.cc:304] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:47.458389 25779 raft_consensus.cc:2749] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:47.459465 25683 raft_consensus.cc:2468] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:47.459493 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:47.463753 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:47.464061 25457 raft_consensus.cc:3060] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:47.464403 25532 raft_consensus.cc:3060] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:47.464581 25731 tablet_bootstrap.cc:492] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:47.465322 25731 ts_tablet_manager.cc:1403] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.152s	user 0.017s	sys 0.010s
I20260709 13:20:47.471956 25457 raft_consensus.cc:2468] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:20:47.463212 25746 consensus_queue.cc:237] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.473450 25573 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:47.474359 25795 raft_consensus.cc:2804] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:47.479107 25732 tablet_bootstrap.cc:492] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:47.454430 25952 raft_consensus.cc:493] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.479682 25732 ts_tablet_manager.cc:1403] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.140s	user 0.015s	sys 0.010s
I20260709 13:20:47.479853 25952 raft_consensus.cc:515] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.487440 25730 ts_tablet_manager.cc:1434] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.107s	user 0.016s	sys 0.006s
I20260709 13:20:47.488296 25730 tablet_bootstrap.cc:492] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:47.463488 25767 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:47.494441 25358 catalog_manager.cc:5697] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.497110 25779 consensus_queue.cc:1048] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:47.500553 25732 raft_consensus.cc:359] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.500779 25731 raft_consensus.cc:359] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.471957 25532 raft_consensus.cc:2468] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:20:47.501475 25731 raft_consensus.cc:385] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.501820 25731 raft_consensus.cc:740] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.501286 25732 raft_consensus.cc:385] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.502542 25731 consensus_queue.cc:260] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.502945 25732 raft_consensus.cc:740] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.504176 25732 consensus_queue.cc:260] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.505072 25731 ts_tablet_manager.cc:1434] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:20:47.506026 25731 tablet_bootstrap.cc:492] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:47.506193 25795 raft_consensus.cc:697] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:47.507171 25795 consensus_queue.cc:237] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.515568 25952 leader_election.cc:290] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:47.520835 25731 tablet_bootstrap.cc:654] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.522087 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e89c6170734a98849f97b6441df9e4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:47.523166 25536 raft_consensus.cc:2393] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 1: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
I20260709 13:20:47.523947 25730 tablet_bootstrap.cc:654] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.518668 25534 raft_consensus.cc:2468] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:47.526502 25424 leader_election.cc:304] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:20:47.527822 25737 raft_consensus.cc:2804] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:47.528362 25737 raft_consensus.cc:697] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:47.529488 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e89c6170734a98849f97b6441df9e4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:47.529314 25737 consensus_queue.cc:237] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.531121 25573 leader_election.cc:304] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:47.533214 25955 raft_consensus.cc:3060] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.535905 25729 tablet_bootstrap.cc:492] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:47.536612 25729 ts_tablet_manager.cc:1403] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.151s	user 0.014s	sys 0.022s
I20260709 13:20:47.538409 25732 ts_tablet_manager.cc:1434] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260709 13:20:47.541122 25732 tablet_bootstrap.cc:492] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:47.547032 25779 consensus_queue.cc:1048] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:47.555239 25358 catalog_manager.cc:5697] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:47.556599 25730 tablet_bootstrap.cc:492] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:47.558115 25730 ts_tablet_manager.cc:1403] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.002s
I20260709 13:20:47.558907 25955 raft_consensus.cc:2749] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:47.561777 25730 raft_consensus.cc:359] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.562436 25730 raft_consensus.cc:385] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.562676 25730 raft_consensus.cc:740] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.562904 25729 raft_consensus.cc:359] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.563287 25730 consensus_queue.cc:260] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.565419 25730 ts_tablet_manager.cc:1434] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:20:47.566265 25730 tablet_bootstrap.cc:492] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:47.563685 25729 raft_consensus.cc:385] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.571554 25729 raft_consensus.cc:740] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.573271 25730 tablet_bootstrap.cc:654] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.573218 25729 consensus_queue.cc:260] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.574463 25355 catalog_manager.cc:5697] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:47.577035 25729 ts_tablet_manager.cc:1434] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:20:47.578197 25729 tablet_bootstrap.cc:492] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:47.602200 25729 tablet_bootstrap.cc:654] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.608039 25732 tablet_bootstrap.cc:654] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.609032 25903 raft_consensus.cc:493] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.609634 25903 raft_consensus.cc:515] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.611194 25731 tablet_bootstrap.cc:492] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:47.611706 25731 ts_tablet_manager.cc:1403] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.106s	user 0.018s	sys 0.011s
I20260709 13:20:47.612097 25903 leader_election.cc:290] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:47.614583 25731 raft_consensus.cc:359] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.615625 25731 raft_consensus.cc:385] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.615895 25731 raft_consensus.cc:740] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.616500 25731 consensus_queue.cc:260] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.619566 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:47.621702 25731 ts_tablet_manager.cc:1434] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.007s
I20260709 13:20:47.622830 25731 tablet_bootstrap.cc:492] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:47.623231 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
W20260709 13:20:47.625197 25499 leader_election.cc:343] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.628396 25731 tablet_bootstrap.cc:654] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:47.629235 25500 leader_election.cc:343] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.629953 25500 leader_election.cc:304] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:47.632581 25903 raft_consensus.cc:2749] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:47.637894 25730 tablet_bootstrap.cc:492] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:47.638441 25730 ts_tablet_manager.cc:1403] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.072s	user 0.032s	sys 0.017s
I20260709 13:20:47.641288 25730 raft_consensus.cc:359] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.642028 25730 raft_consensus.cc:385] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.642314 25730 raft_consensus.cc:740] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.644685 25730 consensus_queue.cc:260] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.648043 25731 tablet_bootstrap.cc:492] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:47.648612 25731 ts_tablet_manager.cc:1403] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.005s
I20260709 13:20:47.651539 25731 raft_consensus.cc:359] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.652241 25731 raft_consensus.cc:385] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.652510 25731 raft_consensus.cc:740] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.653151 25731 consensus_queue.cc:260] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.655138 25730 ts_tablet_manager.cc:1434] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:20:47.644605 25729 tablet_bootstrap.cc:492] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:47.657588 25730 tablet_bootstrap.cc:492] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:47.657861 25729 ts_tablet_manager.cc:1403] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.080s	user 0.020s	sys 0.004s
I20260709 13:20:47.659456 25888 consensus_queue.cc:1048] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:47.660684 25729 raft_consensus.cc:359] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.661406 25729 raft_consensus.cc:385] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.661655 25729 raft_consensus.cc:740] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.662314 25729 consensus_queue.cc:260] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.663929 25730 tablet_bootstrap.cc:654] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.656569 25731 ts_tablet_manager.cc:1434] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:20:47.667528 25731 tablet_bootstrap.cc:492] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:47.670261 25729 ts_tablet_manager.cc:1434] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:20:47.671278 25729 tablet_bootstrap.cc:492] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:47.673041 25731 tablet_bootstrap.cc:654] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.669940 25356 catalog_manager.cc:5697] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 2, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 2 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.678357 25730 tablet_bootstrap.cc:492] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:47.678829 25730 ts_tablet_manager.cc:1403] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:20:47.681824 25730 raft_consensus.cc:359] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.682540 25730 raft_consensus.cc:385] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.682826 25730 raft_consensus.cc:740] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.684408 25730 consensus_queue.cc:260] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.689419 25732 tablet_bootstrap.cc:492] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:47.690030 25732 ts_tablet_manager.cc:1403] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.149s	user 0.012s	sys 0.014s
I20260709 13:20:47.692186 25729 tablet_bootstrap.cc:654] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.693053 25732 raft_consensus.cc:359] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.696835 25731 tablet_bootstrap.cc:492] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:47.697345 25731 ts_tablet_manager.cc:1403] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:20:47.697300 25888 consensus_queue.cc:1048] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:47.700513 25731 raft_consensus.cc:359] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.701236 25731 raft_consensus.cc:385] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.701494 25731 raft_consensus.cc:740] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.702217 25731 consensus_queue.cc:260] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.703363 25795 raft_consensus.cc:493] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.703855 25795 raft_consensus.cc:515] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.704701 25730 ts_tablet_manager.cc:1434] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:20:47.705773 25730 tablet_bootstrap.cc:492] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:47.693856 25732 raft_consensus.cc:385] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.706687 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddcb2168c0d4acaba5e547ac0c03ebb" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:47.707474 25684 raft_consensus.cc:2468] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:47.706841 25732 raft_consensus.cc:740] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.709551 25732 consensus_queue.cc:260] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.710785 25573 leader_election.cc:304] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:47.711613 25955 raft_consensus.cc:2804] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:47.712026 25955 raft_consensus.cc:493] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.712357 25955 raft_consensus.cc:3060] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.715469 25732 ts_tablet_manager.cc:1434] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:20:47.716483 25732 tablet_bootstrap.cc:492] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:47.719259 25955 raft_consensus.cc:515] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.711557 25731 ts_tablet_manager.cc:1434] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:20:47.722277 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddcb2168c0d4acaba5e547ac0c03ebb" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:47.722697 25731 tablet_bootstrap.cc:492] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:47.722819 25684 raft_consensus.cc:3060] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.726004 25732 tablet_bootstrap.cc:654] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.728861 25731 tablet_bootstrap.cc:654] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.731324 25955 leader_election.cc:290] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:47.731974 25795 leader_election.cc:290] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:47.737468 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddcb2168c0d4acaba5e547ac0c03ebb" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:47.738729 25730 tablet_bootstrap.cc:654] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.742189 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddcb2168c0d4acaba5e547ac0c03ebb" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:47.767292 25955 raft_consensus.cc:493] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.768081 25955 raft_consensus.cc:515] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
W20260709 13:20:47.777580 25573 leader_election.cc:343] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:47.778529 25573 leader_election.cc:343] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.795182 25955 leader_election.cc:290] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:47.797331 25457 raft_consensus.cc:3060] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.801545 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea867c357cd4e4d970226215f94bfe7" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:47.802635 25683 raft_consensus.cc:2468] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:47.803426 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea867c357cd4e4d970226215f94bfe7" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
W20260709 13:20:47.814910 25573 leader_election.cc:343] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.815234 25732 tablet_bootstrap.cc:492] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:47.815887 25732 ts_tablet_manager.cc:1403] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.100s	user 0.030s	sys 0.030s
I20260709 13:20:47.818819 25732 raft_consensus.cc:359] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.815632 25573 leader_election.cc:304] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:47.823464 25729 tablet_bootstrap.cc:492] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:47.823781 25732 raft_consensus.cc:385] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.823689 25955 raft_consensus.cc:2804] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:47.827634 25732 raft_consensus.cc:740] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.828305 25955 raft_consensus.cc:493] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.827622 25729 ts_tablet_manager.cc:1403] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.157s	user 0.011s	sys 0.021s
I20260709 13:20:47.828780 25955 raft_consensus.cc:3060] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.825773 25684 raft_consensus.cc:2468] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:47.831687 25573 leader_election.cc:304] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:47.832597 25952 raft_consensus.cc:2804] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:47.833078 25952 raft_consensus.cc:697] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:47.833956 25952 consensus_queue.cc:237] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.831694 25729 raft_consensus.cc:359] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.836560 25729 raft_consensus.cc:385] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.835471 25732 consensus_queue.cc:260] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.837090 25729 raft_consensus.cc:740] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.838230 25729 consensus_queue.cc:260] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.840472 25729 ts_tablet_manager.cc:1434] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:20:47.841884 25729 tablet_bootstrap.cc:492] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:47.848678 25732 ts_tablet_manager.cc:1434] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:20:47.855468 25955 raft_consensus.cc:515] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.860817 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea867c357cd4e4d970226215f94bfe7" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:47.862193 25795 raft_consensus.cc:493] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.870299 25731 tablet_bootstrap.cc:492] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:47.871284 25731 ts_tablet_manager.cc:1403] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.149s	user 0.026s	sys 0.015s
I20260709 13:20:47.874680 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea867c357cd4e4d970226215f94bfe7" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:47.876186 25684 raft_consensus.cc:3060] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.877362 25732 tablet_bootstrap.cc:492] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:47.878444 25730 tablet_bootstrap.cc:492] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:47.878964 25730 ts_tablet_manager.cc:1403] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.173s	user 0.023s	sys 0.011s
W20260709 13:20:47.880261 25573 leader_election.cc:343] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.873435 25955 leader_election.cc:290] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:47.872385 25795 raft_consensus.cc:515] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:47.895967 25731 raft_consensus.cc:359] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.896761 25731 raft_consensus.cc:385] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.896972 25731 raft_consensus.cc:740] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.897485 25731 consensus_queue.cc:260] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.898586 25888 raft_consensus.cc:493] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.899065 25888 raft_consensus.cc:515] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.900355 25795 leader_election.cc:290] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:47.901152 25888 leader_election.cc:290] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:47.904111 25730 raft_consensus.cc:359] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.904774 25730 raft_consensus.cc:385] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.905016 25730 raft_consensus.cc:740] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.905730 25730 consensus_queue.cc:260] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:47.907697 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5001675947e47d284c3bc4729cf9fd9" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:47.908164 25731 ts_tablet_manager.cc:1434] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:20:47.909178 25731 tablet_bootstrap.cc:492] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:47.909989 25730 ts_tablet_manager.cc:1434] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:20:47.910949 25730 tablet_bootstrap.cc:492] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:47.911695 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5001675947e47d284c3bc4729cf9fd9" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:47.912596 25534 raft_consensus.cc:2468] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:47.912961 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc39a93c665a491a81bb0925b35ccf33" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:47.913641 25461 raft_consensus.cc:2468] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:47.915441 25647 leader_election.cc:304] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:47.916591 25730 tablet_bootstrap.cc:654] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.909181 25359 catalog_manager.cc:5697] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:47.916987 25779 raft_consensus.cc:2804] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:47.917506 25779 raft_consensus.cc:493] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.917870 25779 raft_consensus.cc:3060] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.923525 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc39a93c665a491a81bb0925b35ccf33" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:47.924315 25535 raft_consensus.cc:2468] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:47.930183 25731 tablet_bootstrap.cc:654] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.934077 25573 leader_election.cc:304] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
W20260709 13:20:47.935491 25573 leader_election.cc:343] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:47.938787 25955 raft_consensus.cc:2804] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:47.939218 25955 raft_consensus.cc:493] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.939560 25955 raft_consensus.cc:3060] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.941210 25729 tablet_bootstrap.cc:654] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.941534 25684 raft_consensus.cc:2468] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:47.892858 25952 consensus_queue.cc:1048] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.049s
I20260709 13:20:47.946143 25732 tablet_bootstrap.cc:654] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.955472 25779 raft_consensus.cc:515] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:47.975765 25573 leader_election.cc:304] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:47.983361 25746 raft_consensus.cc:2804] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:47.984052 25746 raft_consensus.cc:697] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:47.985047 25746 consensus_queue.cc:237] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.996878 25767 raft_consensus.cc:493] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.997465 25767 raft_consensus.cc:515] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:47.999665 25767 leader_election.cc:290] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:48.007864 25732 tablet_bootstrap.cc:492] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:48.008951 25732 ts_tablet_manager.cc:1403] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.132s	user 0.012s	sys 0.027s
I20260709 13:20:48.013238 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:48.014223 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:48.015028 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc39a93c665a491a81bb0925b35ccf33" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
W20260709 13:20:48.015333 25573 leader_election.cc:343] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.015838 25457 raft_consensus.cc:3060] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.016144 25903 raft_consensus.cc:493] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:48.039821 25573 leader_election.cc:343] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.040474 25573 leader_election.cc:304] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:20:48.020468 25407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:48.049561 25767 raft_consensus.cc:2749] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:48.049717 25461 raft_consensus.cc:1275] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:20:48.043820 25730 tablet_bootstrap.cc:492] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:48.054574 25730 ts_tablet_manager.cc:1403] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.144s	user 0.026s	sys 0.042s
I20260709 13:20:48.057588 25731 tablet_bootstrap.cc:492] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:48.058331 25731 ts_tablet_manager.cc:1403] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.149s	user 0.028s	sys 0.016s
I20260709 13:20:48.063292 25767 consensus_queue.cc:1048] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:48.063539 25737 consensus_queue.cc:1048] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:48.065534 25732 raft_consensus.cc:359] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:48.066751 25732 raft_consensus.cc:385] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.036612 25903 raft_consensus.cc:515] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:48.067075 25732 raft_consensus.cc:740] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.069247 25732 consensus_queue.cc:260] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:48.074178 25810 raft_consensus.cc:493] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.074703 25810 raft_consensus.cc:515] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:48.075582 25610 raft_consensus.cc:3060] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.075899 25731 raft_consensus.cc:359] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:48.076581 25731 raft_consensus.cc:385] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.076719 25810 leader_election.cc:290] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:48.076884 25731 raft_consensus.cc:740] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.077587 25731 consensus_queue.cc:260] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:48.079730 25731 ts_tablet_manager.cc:1434] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:20:48.082827 25881 consensus_queue.cc:1048] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:48.068504 25955 raft_consensus.cc:515] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:48.087482 25732 ts_tablet_manager.cc:1434] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.078s	user 0.012s	sys 0.003s
I20260709 13:20:48.088841 25732 tablet_bootstrap.cc:492] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:48.062036 25779 leader_election.cc:290] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:48.091321 25532 raft_consensus.cc:1275] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:20:48.092708 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:48.094280 25499 leader_election.cc:343] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.102407 25780 raft_consensus.cc:493] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.102972 25780 raft_consensus.cc:515] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:48.104920 25780 leader_election.cc:290] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:48.109521 25730 raft_consensus.cc:359] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:48.112821 25730 raft_consensus.cc:385] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.113094 25731 tablet_bootstrap.cc:492] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:48.113193 25730 raft_consensus.cc:740] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.117297 25730 consensus_queue.cc:260] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:48.117318 25355 catalog_manager.cc:5697] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:48.119920 25729 tablet_bootstrap.cc:492] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:48.120548 25729 ts_tablet_manager.cc:1403] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.279s	user 0.010s	sys 0.026s
I20260709 13:20:48.122051 25730 ts_tablet_manager.cc:1434] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260709 13:20:48.123426 25730 tablet_bootstrap.cc:492] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:48.109874 25457 raft_consensus.cc:2468] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:48.136202 25731 tablet_bootstrap.cc:654] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.138619 25767 consensus_queue.cc:1048] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:20:48.141610 25730 tablet_bootstrap.cc:654] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.144609 25903 leader_election.cc:290] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
W20260709 13:20:48.151072 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 88579.3us
I20260709 13:20:48.165295 25984 consensus_queue.cc:1048] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:20:48.189141 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc39a93c665a491a81bb0925b35ccf33" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:48.189764 25535 raft_consensus.cc:3060] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.173439 25838 consensus_queue.cc:1048] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:20:48.189585 25729 raft_consensus.cc:359] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:48.194178 25729 raft_consensus.cc:385] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.194429 25729 raft_consensus.cc:740] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.173548 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:48.194973 25729 consensus_queue.cc:260] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:48.197156 25732 tablet_bootstrap.cc:654] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.198593 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f61b96593545c79c1d08d45ad98dee" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:48.199251 25461 raft_consensus.cc:2468] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:48.206017 25729 ts_tablet_manager.cc:1434] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.085s	user 0.005s	sys 0.002s
I20260709 13:20:48.201689 25606 raft_consensus.cc:2468] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:48.207262 25795 raft_consensus.cc:493] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.196111 25737 consensus_queue.cc:1048] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:20:48.209137 25795 raft_consensus.cc:515] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:48.211181 25795 leader_election.cc:290] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:48.219538 25729 tablet_bootstrap.cc:492] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:48.221987 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:48.243993 25647 leader_election.cc:304] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:48.246994 25955 leader_election.cc:290] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:48.247560 25888 raft_consensus.cc:2804] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:48.244938 25731 tablet_bootstrap.cc:492] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:48.245105 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f61b96593545c79c1d08d45ad98dee" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:48.249761 25731 ts_tablet_manager.cc:1403] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.137s	user 0.022s	sys 0.000s
I20260709 13:20:48.252400 25683 raft_consensus.cc:2468] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:48.253562 25729 tablet_bootstrap.cc:654] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.248183 25888 raft_consensus.cc:697] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:48.255295 25888 consensus_queue.cc:237] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:48.263923 25731 raft_consensus.cc:359] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:48.265506 25731 raft_consensus.cc:385] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.265902 25731 raft_consensus.cc:740] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.266772 25731 consensus_queue.cc:260] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:48.312817 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5001675947e47d284c3bc4729cf9fd9" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:48.343554 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:48.344756 25533 raft_consensus.cc:2468] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:48.351528 25731 ts_tablet_manager.cc:1434] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.101s	user 0.009s	sys 0.000s
I20260709 13:20:48.359345 25730 tablet_bootstrap.cc:492] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:48.366942 25730 ts_tablet_manager.cc:1403] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.244s	user 0.010s	sys 0.010s
I20260709 13:20:48.371176 25732 tablet_bootstrap.cc:492] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:48.369211 25838 raft_consensus.cc:493] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.379154 25838 raft_consensus.cc:515] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:48.386226 25838 leader_election.cc:290] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:48.389950 25986 raft_consensus.cc:493] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.390969 25986 raft_consensus.cc:515] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:48.393893 25810 raft_consensus.cc:493] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.394219 25499 leader_election.cc:304] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:48.394647 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddcb2168c0d4acaba5e547ac0c03ebb" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:48.394899 25810 raft_consensus.cc:515] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
W20260709 13:20:48.395691 25499 leader_election.cc:343] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.396528 25499 leader_election.cc:304] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:48.397212 25976 raft_consensus.cc:2804] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:48.397689 25976 raft_consensus.cc:493] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.398166 25976 raft_consensus.cc:3060] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.397804 25810 leader_election.cc:290] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:48.399328 25810 raft_consensus.cc:2749] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:48.400486 25647 leader_election.cc:304] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:48.402419 25989 raft_consensus.cc:2804] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:48.402850 25989 raft_consensus.cc:493] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.403234 25989 raft_consensus.cc:3060] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.411125 25731 tablet_bootstrap.cc:492] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:48.411592 25986 leader_election.cc:290] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:48.426833 25732 ts_tablet_manager.cc:1403] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.338s	user 0.016s	sys 0.029s
I20260709 13:20:48.428719 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5001675947e47d284c3bc4729cf9fd9" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:48.436033 25534 raft_consensus.cc:3060] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.436240 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:48.437063 25683 raft_consensus.cc:2468] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:48.446580 25729 tablet_bootstrap.cc:492] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:48.448311 25729 ts_tablet_manager.cc:1403] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.229s	user 0.014s	sys 0.003s
I20260709 13:20:48.461012 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:48.462142 25608 raft_consensus.cc:2468] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:48.466759 25730 raft_consensus.cc:359] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:48.468232 25730 raft_consensus.cc:385] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.468657 25730 raft_consensus.cc:740] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.472534 25355 catalog_manager.cc:5697] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:48.478672 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:48.479596 25457 raft_consensus.cc:2468] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:48.457201 25976 raft_consensus.cc:515] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:48.483407 25730 consensus_queue.cc:260] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:48.503428 26004 raft_consensus.cc:493] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.504334 26004 raft_consensus.cc:515] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:48.509796 26004 leader_election.cc:290] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:48.516208 25461 raft_consensus.cc:3060] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.527446 25531 raft_consensus.cc:3060] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.495949 25729 raft_consensus.cc:359] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:48.543089 25729 raft_consensus.cc:385] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.543686 25729 raft_consensus.cc:740] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.546049 25534 raft_consensus.cc:2468] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:48.547557 25573 leader_election.cc:304] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:48.550163 25767 raft_consensus.cc:2804] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:48.550567 25767 raft_consensus.cc:493] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.550885 25767 raft_consensus.cc:3060] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.552675 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:48.559064 25535 raft_consensus.cc:2468] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:48.563409 25993 consensus_queue.cc:1048] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:48.566035 25732 raft_consensus.cc:359] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:48.566851 25732 raft_consensus.cc:385] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.567126 25732 raft_consensus.cc:740] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.567929 25732 consensus_queue.cc:260] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:48.570792 25732 ts_tablet_manager.cc:1434] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.143s	user 0.006s	sys 0.002s
W20260709 13:20:48.572491 25573 leader_election.cc:343] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.578195 25648 leader_election.cc:304] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:48.580376 25888 raft_consensus.cc:2804] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:48.580984 25888 raft_consensus.cc:493] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.581501 25888 raft_consensus.cc:3060] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.591001 25976 leader_election.cc:290] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:48.591228 25989 raft_consensus.cc:515] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
W20260709 13:20:48.593714 25424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 106402us
W20260709 13:20:48.598814 25500 leader_election.cc:343] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.599144 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddcb2168c0d4acaba5e547ac0c03ebb" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
W20260709 13:20:48.603874 25499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:44609, user_credentials={real_user=slave}} blocked reactor thread for 208315us
I20260709 13:20:48.607851 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278c9060803541ebb56ccb47687d3d4d" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:48.612387 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278c9060803541ebb56ccb47687d3d4d" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:48.608608 25767 raft_consensus.cc:515] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:48.622839 25424 leader_election.cc:304] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:48.623535 25573 leader_election.cc:304] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:48.623842 25881 raft_consensus.cc:2749] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:48.624770 25993 raft_consensus.cc:2804] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:48.625334 25993 raft_consensus.cc:697] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:48.625752 25732 tablet_bootstrap.cc:492] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:48.626149 25767 leader_election.cc:290] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:48.626475 25993 consensus_queue.cc:237] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:48.635337 25730 ts_tablet_manager.cc:1434] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.267s	user 0.002s	sys 0.007s
I20260709 13:20:48.634887 25888 raft_consensus.cc:515] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:48.637449 25730 tablet_bootstrap.cc:492] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:48.647313 25731 tablet_bootstrap.cc:700] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent opening tablet: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:20:48.660516 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:48.661475 25680 raft_consensus.cc:2393] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 1: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
I20260709 13:20:48.664575 25746 consensus_queue.cc:1048] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:20:48.666415 25952 consensus_queue.cc:1048] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:48.647264 25888 leader_election.cc:290] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:48.677460 25955 consensus_queue.cc:1048] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:20:48.679478 25955 raft_consensus.cc:493] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.680101 25955 raft_consensus.cc:515] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:48.683575 25731 tablet_bootstrap.cc:654] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.687914 25729 consensus_queue.cc:260] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:48.694394 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:48.695519 25989 leader_election.cc:290] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:48.696027 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:48.697038 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:48.703557 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:48.715848 25460 raft_consensus.cc:2468] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:48.718634 25730 tablet_bootstrap.cc:654] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.731767 25732 tablet_bootstrap.cc:654] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.732162 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:48.732987 25610 raft_consensus.cc:3060] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.739172 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f61b96593545c79c1d08d45ad98dee" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:48.740042 25456 raft_consensus.cc:3060] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.740761 25976 raft_consensus.cc:493] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.741272 25976 raft_consensus.cc:515] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:48.742408 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:48.742991 25533 raft_consensus.cc:3060] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.744463 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f61b96593545c79c1d08d45ad98dee" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:48.745148 25684 raft_consensus.cc:3060] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.763643 25976 leader_election.cc:290] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:48.764843 25684 raft_consensus.cc:2468] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:48.759120 25573 leader_election.cc:304] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:20:48.751612 25499 leader_election.cc:343] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.772996 25746 raft_consensus.cc:2749] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:20:48.775481 25499 leader_election.cc:343] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.779295 25499 leader_election.cc:304] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:48.777573 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:48.780480 25976 raft_consensus.cc:2749] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:48.787432 25607 raft_consensus.cc:2393] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 1: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
I20260709 13:20:48.793292 25533 raft_consensus.cc:2468] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:48.804032 25955 leader_election.cc:290] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:48.810362 25780 raft_consensus.cc:493] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.811018 25780 raft_consensus.cc:515] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:48.813376 25780 leader_election.cc:290] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:48.826508 25456 raft_consensus.cc:2468] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
W20260709 13:20:48.827178 25499 leader_election.cc:343] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.827675 25499 leader_election.cc:304] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:48.830852 25729 ts_tablet_manager.cc:1434] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.382s	user 0.013s	sys 0.003s
I20260709 13:20:48.832247 25729 tablet_bootstrap.cc:492] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:48.835707 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:48.836474 25647 leader_election.cc:304] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:48.837352 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea867c357cd4e4d970226215f94bfe7" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:48.838522 25989 raft_consensus.cc:2804] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:48.838932 25976 raft_consensus.cc:2749] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:48.839018 25989 raft_consensus.cc:697] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:48.840299 25989 consensus_queue.cc:237] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:48.836531 25606 raft_consensus.cc:2468] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:48.845369 25648 leader_election.cc:304] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:48.847673 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd9e5943fb6488091b514fd1aa47162" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:48.847944 25610 raft_consensus.cc:2468] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:48.848322 25986 raft_consensus.cc:2749] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:48.850529 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea867c357cd4e4d970226215f94bfe7" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:48.852819 25779 consensus_queue.cc:1048] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:48.855664 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd9e5943fb6488091b514fd1aa47162" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:48.858572 25499 leader_election.cc:304] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:48.859463 25810 raft_consensus.cc:2804] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:20:48.859586 25573 leader_election.cc:343] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.860018 25810 raft_consensus.cc:697] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:20:48.861229 25810 consensus_queue.cc:237] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
W20260709 13:20:48.863242 25573 leader_election.cc:343] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.863816 25573 leader_election.cc:304] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:48.864745 25955 raft_consensus.cc:2749] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:48.864943 25355 catalog_manager.cc:5697] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:48.890676 25648 leader_election.cc:304] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:48.893760 25780 raft_consensus.cc:2804] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:48.894225 25780 raft_consensus.cc:493] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.894574 25780 raft_consensus.cc:3060] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.904969 25729 tablet_bootstrap.cc:654] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.874758 25499 leader_election.cc:304] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:48.907814 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:48.909348 26004 raft_consensus.cc:2749] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:48.917263 25737 raft_consensus.cc:493] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.917785 25737 raft_consensus.cc:515] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:48.920075 25737 leader_election.cc:290] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:48.936621 25732 tablet_bootstrap.cc:492] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:48.937156 25732 ts_tablet_manager.cc:1403] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.365s	user 0.032s	sys 0.017s
I20260709 13:20:48.951140 25731 tablet_bootstrap.cc:492] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:48.951706 25731 ts_tablet_manager.cc:1403] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.541s	user 0.009s	sys 0.028s
I20260709 13:20:48.952368 25732 raft_consensus.cc:359] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:48.953091 25732 raft_consensus.cc:385] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.953362 25732 raft_consensus.cc:740] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.954509 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:48.948123 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:48.955560 25732 consensus_queue.cc:260] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:48.955999 25530 raft_consensus.cc:2468] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:48.957408 25424 leader_election.cc:304] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:48.958181 25732 ts_tablet_manager.cc:1434] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.005s
I20260709 13:20:48.958334 25737 raft_consensus.cc:2804] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:48.958761 25737 raft_consensus.cc:493] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:48.959052 25647 leader_election.cc:343] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.959111 25737 raft_consensus.cc:3060] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.960209 25731 raft_consensus.cc:359] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:48.960983 25731 raft_consensus.cc:385] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.961337 25731 raft_consensus.cc:740] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.962129 25731 consensus_queue.cc:260] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:48.962646 26024 consensus_queue.cc:1048] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:48.961434 25780 raft_consensus.cc:515] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
W20260709 13:20:48.965725 25424 leader_election.cc:343] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.968137 25780 leader_election.cc:290] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:48.959316 25732 tablet_bootstrap.cc:492] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:48.969128 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:48.971206 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:48.969165 25737 raft_consensus.cc:515] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:48.972731 25607 raft_consensus.cc:3060] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.975854 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:48.977057 25533 raft_consensus.cc:3060] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.980350 25732 tablet_bootstrap.cc:654] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.984953 25533 raft_consensus.cc:2468] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:48.985615 25731 ts_tablet_manager.cc:1434] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:20:48.986047 25737 leader_election.cc:290] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:48.986688 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
W20260709 13:20:48.987444 25647 leader_election.cc:343] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.992640 25358 catalog_manager.cc:5697] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.008565 25730 tablet_bootstrap.cc:492] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:49.009146 25730 ts_tablet_manager.cc:1403] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.372s	user 0.025s	sys 0.009s
I20260709 13:20:49.012131 25730 raft_consensus.cc:359] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.012840 25730 raft_consensus.cc:385] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.013114 25730 raft_consensus.cc:740] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.013823 25730 consensus_queue.cc:260] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.020541 25730 ts_tablet_manager.cc:1434] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:20:49.007278 25607 raft_consensus.cc:2468] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:49.032341 25729 tablet_bootstrap.cc:492] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:49.032905 25729 ts_tablet_manager.cc:1403] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.201s	user 0.012s	sys 0.009s
I20260709 13:20:49.033761 25731 tablet_bootstrap.cc:492] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:49.035866 25729 raft_consensus.cc:359] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.037679 25729 raft_consensus.cc:385] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.038033 25729 raft_consensus.cc:740] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.038558 25729 consensus_queue.cc:260] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.038865 25648 leader_election.cc:304] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:49.039759 25780 raft_consensus.cc:2804] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:49.040243 25780 raft_consensus.cc:697] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:49.041080 25780 consensus_queue.cc:237] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
W20260709 13:20:49.029160 25424 leader_election.cc:343] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.045805 25424 leader_election.cc:304] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:49.047315 26003 raft_consensus.cc:2804] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:49.047820 26003 raft_consensus.cc:697] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:49.048636 26003 consensus_queue.cc:237] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.056104 25731 tablet_bootstrap.cc:654] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.063412 25993 consensus_queue.cc:1048] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.064576 25729 ts_tablet_manager.cc:1434] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:20:49.066325 25729 tablet_bootstrap.cc:492] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:49.084080 25730 tablet_bootstrap.cc:492] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:49.095239 25729 tablet_bootstrap.cc:654] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.080945 25355 catalog_manager.cc:5697] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.106396 25457 raft_consensus.cc:3060] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.117614 25732 tablet_bootstrap.cc:492] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:49.118187 25732 ts_tablet_manager.cc:1403] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.159s	user 0.016s	sys 0.008s
I20260709 13:20:49.121109 25732 raft_consensus.cc:359] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:49.123872 25731 tablet_bootstrap.cc:492] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:49.124419 25731 ts_tablet_manager.cc:1403] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.000s
I20260709 13:20:49.125059 25810 raft_consensus.cc:493] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.125618 25810 raft_consensus.cc:515] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.129040 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd9e5943fb6488091b514fd1aa47162" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:49.133349 25499 leader_election.cc:343] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.135476 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd9e5943fb6488091b514fd1aa47162" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:49.136384 25607 raft_consensus.cc:2468] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:49.138106 25500 leader_election.cc:304] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:49.139336 26004 raft_consensus.cc:2804] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:49.139782 26004 raft_consensus.cc:493] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.140172 26004 raft_consensus.cc:3060] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.140479 25730 tablet_bootstrap.cc:654] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.144901 25731 raft_consensus.cc:359] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.145879 25731 raft_consensus.cc:385] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.145985 25810 leader_election.cc:290] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:49.146078 25955 consensus_queue.cc:1048] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.121804 25732 raft_consensus.cc:385] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.151664 25732 raft_consensus.cc:740] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.158197 25732 consensus_queue.cc:260] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:49.160751 25732 ts_tablet_manager.cc:1434] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:20:49.162159 25732 tablet_bootstrap.cc:492] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:49.162922 25729 tablet_bootstrap.cc:492] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:49.162863 25731 raft_consensus.cc:740] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.163514 25729 ts_tablet_manager.cc:1403] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.005s
W20260709 13:20:49.173341 25407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:49.173679 25730 tablet_bootstrap.cc:492] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:49.174496 25730 ts_tablet_manager.cc:1403] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.001s
I20260709 13:20:49.175794 25356 catalog_manager.cc:5697] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.165369 25731 consensus_queue.cc:260] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.179728 25731 ts_tablet_manager.cc:1434] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 13:20:49.181172 25731 tablet_bootstrap.cc:492] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:49.184020 25729 raft_consensus.cc:359] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:49.184760 25729 raft_consensus.cc:385] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.185037 25729 raft_consensus.cc:740] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.193089 25955 raft_consensus.cc:493] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.174235 26004 raft_consensus.cc:515] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.193747 25955 raft_consensus.cc:515] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.195932 25955 leader_election.cc:290] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:49.196539 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd9e5943fb6488091b514fd1aa47162" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:49.195873 25359 catalog_manager.cc:5697] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:49.198028 25499 leader_election.cc:343] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.199736 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:49.199970 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:49.200939 25533 raft_consensus.cc:2468] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
W20260709 13:20:49.202096 25573 leader_election.cc:343] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.202822 25573 leader_election.cc:304] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:49.203657 25955 raft_consensus.cc:2804] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:49.204023 25955 raft_consensus.cc:493] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.204360 25955 raft_consensus.cc:3060] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.193050 25729 consensus_queue.cc:260] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:49.214515 26004 leader_election.cc:290] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:49.214607 25731 tablet_bootstrap.cc:654] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.215709 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd9e5943fb6488091b514fd1aa47162" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:49.216296 25607 raft_consensus.cc:3060] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.227960 25780 raft_consensus.cc:493] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.228555 25780 raft_consensus.cc:515] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.232853 25780 leader_election.cc:290] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:49.240911 25729 ts_tablet_manager.cc:1434] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.001s
I20260709 13:20:49.234869 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:49.274678 25732 tablet_bootstrap.cc:654] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.275134 25533 raft_consensus.cc:2393] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 1: Already voted for candidate 812474b88dc54c39bc37428d77dcb7a9 in this term.
I20260709 13:20:49.275453 25729 tablet_bootstrap.cc:492] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:49.249115 25955 raft_consensus.cc:515] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.284409 25955 leader_election.cc:290] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:49.251226 25607 raft_consensus.cc:2468] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:49.241876 25730 raft_consensus.cc:359] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.286816 25730 raft_consensus.cc:385] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.287081 25730 raft_consensus.cc:740] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.235301 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:49.287361 25500 leader_election.cc:304] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:49.287820 25730 consensus_queue.cc:260] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.288318 26004 raft_consensus.cc:2804] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:49.288935 26004 raft_consensus.cc:697] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:20:49.289068 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:49.289719 25533 raft_consensus.cc:3060] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.290459 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:49.291421 25647 leader_election.cc:304] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:49.292933 25779 raft_consensus.cc:3060] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.294387 26004 consensus_queue.cc:237] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:20:49.295398 25573 leader_election.cc:343] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.298146 25533 raft_consensus.cc:2468] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:49.303925 25573 leader_election.cc:304] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:49.305378 25955 raft_consensus.cc:2804] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:49.306514 25955 raft_consensus.cc:697] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:49.306767 25732 tablet_bootstrap.cc:492] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:49.307281 25732 ts_tablet_manager.cc:1403] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.145s	user 0.021s	sys 0.018s
I20260709 13:20:49.307380 25955 consensus_queue.cc:237] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.299556 25730 ts_tablet_manager.cc:1434] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.001s
I20260709 13:20:49.311142 25730 tablet_bootstrap.cc:492] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:49.311226 25732 raft_consensus.cc:359] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.311944 25732 raft_consensus.cc:385] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.312239 25732 raft_consensus.cc:740] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.313140 25732 consensus_queue.cc:260] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.314523 25989 consensus_queue.cc:1048] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.322002 25779 raft_consensus.cc:2749] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:49.324446 25729 tablet_bootstrap.cc:654] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.334986 25731 tablet_bootstrap.cc:492] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:49.335492 25731 ts_tablet_manager.cc:1403] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.155s	user 0.021s	sys 0.000s
I20260709 13:20:49.333448 25359 catalog_manager.cc:5697] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:49.337622 25730 tablet_bootstrap.cc:654] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.340466 25732 ts_tablet_manager.cc:1434] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:20:49.344858 25732 tablet_bootstrap.cc:492] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:49.365861 25729 tablet_bootstrap.cc:492] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:49.362931 25731 raft_consensus.cc:359] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:49.366413 25731 raft_consensus.cc:385] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.366509 25729 ts_tablet_manager.cc:1403] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.003s
I20260709 13:20:49.370059 25779 consensus_queue.cc:1048] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:49.366695 25731 raft_consensus.cc:740] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.376746 25976 consensus_queue.cc:1048] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:49.384150 25359 catalog_manager.cc:5697] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.392150 25732 tablet_bootstrap.cc:654] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.388111 25729 raft_consensus.cc:359] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:49.395885 25729 raft_consensus.cc:385] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.396157 25729 raft_consensus.cc:740] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.396940 25731 consensus_queue.cc:260] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:49.403132 25737 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.402326 25729 consensus_queue.cc:260] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:49.403589 25737 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:49.404907 25731 ts_tablet_manager.cc:1434] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 13:20:49.413630 25737 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:49.414995 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:49.417361 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:49.418087 25683 raft_consensus.cc:2468] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:49.419863 25424 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:49.420670 25737 raft_consensus.cc:2804] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:49.421084 25737 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.421443 25737 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.422452 25731 tablet_bootstrap.cc:492] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:49.436877 25737 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:49.439666 25729 ts_tablet_manager.cc:1434] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.003s
I20260709 13:20:49.444386 25531 raft_consensus.cc:3060] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:49.444339 25425 leader_election.cc:343] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.454608 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
W20260709 13:20:49.457039 25425 leader_election.cc:343] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.460851 26004 consensus_queue.cc:1048] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.478343 25737 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:49.486692 25729 tablet_bootstrap.cc:492] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:49.492698 25731 tablet_bootstrap.cc:654] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.496430 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:49.497166 25682 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.500669 25732 tablet_bootstrap.cc:492] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:49.501362 25732 ts_tablet_manager.cc:1403] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.158s	user 0.022s	sys 0.009s
I20260709 13:20:49.514655 25730 tablet_bootstrap.cc:492] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:49.515240 25730 ts_tablet_manager.cc:1403] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.204s	user 0.023s	sys 0.016s
I20260709 13:20:49.514354 25737 consensus_queue.cc:1048] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:49.518868 25729 tablet_bootstrap.cc:654] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.519011 25779 raft_consensus.cc:493] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.519439 25779 raft_consensus.cc:515] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:49.521394 25779 leader_election.cc:290] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:49.522037 25730 raft_consensus.cc:359] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:49.522856 25730 raft_consensus.cc:385] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.522994 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:49.523677 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:49.525267 25730 raft_consensus.cc:740] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
W20260709 13:20:49.526168 25648 leader_election.cc:343] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.527595 25732 raft_consensus.cc:359] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.530572 25732 raft_consensus.cc:385] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.531136 25732 raft_consensus.cc:740] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
W20260709 13:20:49.533901 25647 leader_election.cc:343] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.533058 25732 consensus_queue.cc:260] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.543596 25731 tablet_bootstrap.cc:492] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:49.544345 25731 ts_tablet_manager.cc:1403] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.122s	user 0.003s	sys 0.009s
I20260709 13:20:49.544839 25647 leader_election.cc:304] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:49.545612 25779 raft_consensus.cc:2749] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:49.546784 25730 consensus_queue.cc:260] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:49.566524 25732 ts_tablet_manager.cc:1434] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.002s
I20260709 13:20:49.568975 25732 tablet_bootstrap.cc:492] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:49.573992 25682 raft_consensus.cc:2468] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:49.574951 25730 ts_tablet_manager.cc:1434] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:20:49.576239 25730 tablet_bootstrap.cc:492] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:49.574877 25737 raft_consensus.cc:493] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.579831 25737 raft_consensus.cc:515] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.582947 25737 leader_election.cc:290] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:49.584663 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:20:49.586310 25425 leader_election.cc:343] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.587512 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:49.588277 25531 raft_consensus.cc:2468] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:49.589553 26004 raft_consensus.cc:493] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.589701 25424 leader_election.cc:304] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:20:49.590171 26004 raft_consensus.cc:515] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.591003 25424 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:20:49.591185 25731 raft_consensus.cc:359] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:49.591849 25731 raft_consensus.cc:385] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.592737 25737 raft_consensus.cc:2804] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:49.593092 25737 raft_consensus.cc:493] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.593241 26003 raft_consensus.cc:2804] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:49.593909 26003 raft_consensus.cc:697] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:49.594830 26003 consensus_queue.cc:237] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:49.598299 26004 leader_election.cc:290] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:49.593410 25737 raft_consensus.cc:3060] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.592120 25731 raft_consensus.cc:740] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.611203 25731 consensus_queue.cc:260] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:49.605558 25780 consensus_queue.cc:1048] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:20:49.614979 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:49.616552 25499 leader_election.cc:343] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.610780 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:49.621615 25729 tablet_bootstrap.cc:492] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:49.622141 25729 ts_tablet_manager.cc:1403] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.136s	user 0.008s	sys 0.029s
I20260709 13:20:49.626071 25732 tablet_bootstrap.cc:654] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.643303 25730 tablet_bootstrap.cc:654] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.646404 25731 ts_tablet_manager.cc:1434] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.001s
I20260709 13:20:49.647992 25731 tablet_bootstrap.cc:492] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:49.624838 25729 raft_consensus.cc:359] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.658136 25729 raft_consensus.cc:385] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.658569 25729 raft_consensus.cc:740] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.660635 25737 raft_consensus.cc:515] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.667827 25732 tablet_bootstrap.cc:492] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:49.668385 25732 ts_tablet_manager.cc:1403] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.028s
I20260709 13:20:49.671959 26055 consensus_queue.cc:1048] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:20:49.664618 25499 leader_election.cc:343] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.680053 25499 leader_election.cc:304] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:49.680215 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:49.680833 25530 raft_consensus.cc:3060] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.681475 25903 raft_consensus.cc:2749] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:49.686764 25729 consensus_queue.cc:260] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.690986 25732 raft_consensus.cc:359] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.691530 25737 leader_election.cc:290] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:49.692034 25732 raft_consensus.cc:385] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.692368 25732 raft_consensus.cc:740] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.696264 25729 ts_tablet_manager.cc:1434] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
I20260709 13:20:49.696556 25779 consensus_queue.cc:1048] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:49.703001 25732 consensus_queue.cc:260] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.707086 25732 ts_tablet_manager.cc:1434] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:20:49.708185 25732 tablet_bootstrap.cc:492] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:49.720327 25356 catalog_manager.cc:5697] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.705216 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
W20260709 13:20:49.723968 25425 leader_election.cc:343] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.730422 25729 tablet_bootstrap.cc:492] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:49.754172 25731 tablet_bootstrap.cc:654] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.759301 25779 raft_consensus.cc:493] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.760006 25779 raft_consensus.cc:515] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.764240 25730 tablet_bootstrap.cc:492] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:49.765025 25730 ts_tablet_manager.cc:1403] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.189s	user 0.024s	sys 0.001s
I20260709 13:20:49.768318 25779 leader_election.cc:290] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:49.770390 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278c9060803541ebb56ccb47687d3d4d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:49.771342 25533 raft_consensus.cc:2468] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:49.774485 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278c9060803541ebb56ccb47687d3d4d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:49.774834 25730 raft_consensus.cc:359] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.775802 25730 raft_consensus.cc:385] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:20:49.777372 25647 leader_election.cc:343] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.778921 25647 leader_election.cc:304] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:49.779632 25779 raft_consensus.cc:2804] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:49.779961 25730 raft_consensus.cc:740] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.780434 25779 raft_consensus.cc:493] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.780925 25779 raft_consensus.cc:3060] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.787009 25729 tablet_bootstrap.cc:654] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.786464 25730 consensus_queue.cc:260] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.787016 25955 raft_consensus.cc:493] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.799146 25955 raft_consensus.cc:515] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.801240 25955 leader_election.cc:290] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:49.804973 25737 raft_consensus.cc:493] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.805486 25737 raft_consensus.cc:515] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:49.807312 25737 leader_election.cc:290] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:49.808068 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:49.811394 25531 raft_consensus.cc:2393] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 812474b88dc54c39bc37428d77dcb7a9 in current term 1: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
I20260709 13:20:49.812426 25810 raft_consensus.cc:493] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.808823 25732 tablet_bootstrap.cc:654] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.810702 25457 raft_consensus.cc:3060] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.817342 25984 consensus_queue.cc:1048] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:49.822695 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788ee1912fba47fe8873f543b02189f7" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:49.823832 25530 raft_consensus.cc:2468] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:49.812919 25810 raft_consensus.cc:515] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:49.827726 25810 leader_election.cc:290] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:49.828261 25779 raft_consensus.cc:515] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.829346 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:49.830971 25779 leader_election.cc:290] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:49.829931 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788ee1912fba47fe8873f543b02189f7" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
W20260709 13:20:49.833016 25499 leader_election.cc:343] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.833216 25424 leader_election.cc:304] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:20:49.833304 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278c9060803541ebb56ccb47687d3d4d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:49.834187 25985 raft_consensus.cc:2804] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:49.834668 25985 raft_consensus.cc:697] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:49.835521 25985 consensus_queue.cc:237] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:20:49.836586 25573 leader_election.cc:343] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.836689 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:20:49.839613 25647 leader_election.cc:343] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:49.840921 25500 leader_election.cc:343] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.841348 25500 leader_election.cc:304] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:20:49.841192 25573 leader_election.cc:343] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.844622 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278c9060803541ebb56ccb47687d3d4d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:49.844874 25573 leader_election.cc:304] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:49.845232 25534 raft_consensus.cc:3060] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.847460 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:49.849023 25425 leader_election.cc:304] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:49.850181 26055 raft_consensus.cc:3060] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.850385 25810 raft_consensus.cc:2749] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:49.850083 25955 raft_consensus.cc:2749] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:49.867681 25810 consensus_queue.cc:1048] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:49.883001 25731 tablet_bootstrap.cc:492] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:49.883548 25731 ts_tablet_manager.cc:1403] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.236s	user 0.017s	sys 0.005s
I20260709 13:20:49.883273 25534 raft_consensus.cc:2468] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:49.882936 25730 ts_tablet_manager.cc:1434] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.117s	user 0.005s	sys 0.003s
I20260709 13:20:49.887501 25647 leader_election.cc:304] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:49.889719 25779 raft_consensus.cc:2804] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:49.890153 25779 raft_consensus.cc:697] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:49.890844 25779 consensus_queue.cc:237] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.891451 25731 raft_consensus.cc:359] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:49.892167 25731 raft_consensus.cc:385] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.892429 25731 raft_consensus.cc:740] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.893064 25731 consensus_queue.cc:260] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:49.896051 25359 catalog_manager.cc:5697] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:49.897060 26055 raft_consensus.cc:2749] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:49.904541 25984 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.905169 25984 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:49.906286 25729 tablet_bootstrap.cc:492] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:49.906787 25729 ts_tablet_manager.cc:1403] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.201s	user 0.008s	sys 0.011s
I20260709 13:20:49.906867 25732 tablet_bootstrap.cc:492] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:49.907445 25984 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:49.907394 25732 ts_tablet_manager.cc:1403] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.199s	user 0.006s	sys 0.007s
I20260709 13:20:49.909523 25729 raft_consensus.cc:359] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:49.912865 25730 tablet_bootstrap.cc:492] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:49.914785 25810 consensus_queue.cc:1048] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:49.915257 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:49.915751 25731 ts_tablet_manager.cc:1434] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:20:49.916013 25684 raft_consensus.cc:2393] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 1: Already voted for candidate 812474b88dc54c39bc37428d77dcb7a9 in this term.
I20260709 13:20:49.912359 25729 raft_consensus.cc:385] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.916725 25729 raft_consensus.cc:740] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.918835 25729 consensus_queue.cc:260] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:49.919713 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:49.922444 25729 ts_tablet_manager.cc:1434] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:20:49.923523 25729 tablet_bootstrap.cc:492] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:49.931125 25573 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:49.931393 25729 tablet_bootstrap.cc:654] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.937490 25984 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.945581 25730 tablet_bootstrap.cc:654] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.946077 25732 raft_consensus.cc:359] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.947132 25732 raft_consensus.cc:385] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.950098 25732 raft_consensus.cc:740] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.950150 25731 tablet_bootstrap.cc:492] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:49.956137 25732 consensus_queue.cc:260] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:49.974155 25731 tablet_bootstrap.cc:654] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.987421 25984 raft_consensus.cc:2749] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:49.989312 25732 ts_tablet_manager.cc:1434] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:20:49.990939 25732 tablet_bootstrap.cc:492] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:49.981724 25358 catalog_manager.cc:5697] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:49.985003 25952 consensus_queue.cc:1048] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:20:50.025147 25732 tablet_bootstrap.cc:654] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.049150 26055 consensus_queue.cc:1048] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:50.061717 25985 consensus_queue.cc:1048] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:50.098539 25729 tablet_bootstrap.cc:492] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:50.099105 25729 ts_tablet_manager.cc:1403] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.176s	user 0.017s	sys 0.015s
I20260709 13:20:50.097776 25730 tablet_bootstrap.cc:492] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:50.101351 25730 ts_tablet_manager.cc:1403] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.189s	user 0.019s	sys 0.020s
I20260709 13:20:50.104882 25731 tablet_bootstrap.cc:492] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:50.105531 25731 ts_tablet_manager.cc:1403] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.186s	user 0.026s	sys 0.040s
I20260709 13:20:50.109061 25731 raft_consensus.cc:359] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:50.109712 25731 raft_consensus.cc:385] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.116109 25731 raft_consensus.cc:740] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.118227 25729 raft_consensus.cc:359] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:50.123978 25729 raft_consensus.cc:385] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.120128 25731 consensus_queue.cc:260] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:50.124393 25729 raft_consensus.cc:740] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.130296 25729 consensus_queue.cc:260] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:50.136122 25729 ts_tablet_manager.cc:1434] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.005s
I20260709 13:20:50.138512 25731 ts_tablet_manager.cc:1434] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.003s
I20260709 13:20:50.139820 25731 tablet_bootstrap.cc:492] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:50.142554 25779 raft_consensus.cc:493] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.143096 25779 raft_consensus.cc:515] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.145984 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:50.147424 25647 leader_election.cc:343] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.150775 25730 raft_consensus.cc:359] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:50.151503 25730 raft_consensus.cc:385] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.151811 25730 raft_consensus.cc:740] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.152603 25730 consensus_queue.cc:260] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:50.156394 25729 tablet_bootstrap.cc:492] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:50.167583 25730 ts_tablet_manager.cc:1434] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.000s
I20260709 13:20:50.168704 25779 leader_election.cc:290] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:50.169377 25955 raft_consensus.cc:493] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.169883 25955 raft_consensus.cc:515] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:20:50.172771 25573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:44609, user_credentials={real_user=slave}} blocked reactor thread for 46118.9us
I20260709 13:20:50.175163 25955 leader_election.cc:290] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:50.175722 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:50.179961 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:50.180577 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:50.189116 25730 tablet_bootstrap.cc:492] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:50.190160 25732 tablet_bootstrap.cc:492] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:50.190682 25732 ts_tablet_manager.cc:1403] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.200s	user 0.022s	sys 0.011s
I20260709 13:20:50.193838 25732 raft_consensus.cc:359] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:50.194502 25732 raft_consensus.cc:385] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.194766 25732 raft_consensus.cc:740] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.195446 25732 consensus_queue.cc:260] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
W20260709 13:20:50.200011 25648 leader_election.cc:343] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.200641 25648 leader_election.cc:304] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:50.202411 25986 raft_consensus.cc:2749] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:20:50.204039 25573 leader_election.cc:343] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.214578 25986 raft_consensus.cc:493] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.215241 25986 raft_consensus.cc:515] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:50.217304 25986 leader_election.cc:290] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:50.220228 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:50.220738 25730 tablet_bootstrap.cc:654] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.220959 25461 raft_consensus.cc:2468] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:50.221555 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:50.222018 25732 ts_tablet_manager.cc:1434] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 13:20:50.220227 25729 tablet_bootstrap.cc:654] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.222230 25531 raft_consensus.cc:2468] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:50.223068 25732 tablet_bootstrap.cc:492] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:50.223855 25647 leader_election.cc:304] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:50.225419 25986 raft_consensus.cc:2804] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.225790 25986 raft_consensus.cc:493] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.227283 25731 tablet_bootstrap.cc:654] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.226519 25986 raft_consensus.cc:3060] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:50.237124 25573 leader_election.cc:343] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.242321 25573 leader_election.cc:304] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:50.244521 25952 raft_consensus.cc:2749] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.250231 25731 tablet_bootstrap.cc:492] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:50.250847 25731 ts_tablet_manager.cc:1403] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.004s
I20260709 13:20:50.262131 25729 tablet_bootstrap.cc:492] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:50.264125 25729 ts_tablet_manager.cc:1403] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.011s
I20260709 13:20:50.262239 25731 raft_consensus.cc:359] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:50.265447 25731 raft_consensus.cc:385] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.265633 25731 raft_consensus.cc:740] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.269255 25731 consensus_queue.cc:260] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:50.273299 25730 tablet_bootstrap.cc:492] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:50.273800 25730 ts_tablet_manager.cc:1403] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.085s	user 0.006s	sys 0.009s
I20260709 13:20:50.278481 25732 tablet_bootstrap.cc:654] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:50.286232 25407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:50.288139 25731 ts_tablet_manager.cc:1434] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:20:50.289568 25731 tablet_bootstrap.cc:492] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:50.291280 25986 raft_consensus.cc:515] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:50.293313 25986 leader_election.cc:290] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:50.295107 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:50.295917 25456 raft_consensus.cc:3060] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.298549 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:50.299352 25531 raft_consensus.cc:3060] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.299805 25730 raft_consensus.cc:359] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.300489 25730 raft_consensus.cc:385] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.300792 25730 raft_consensus.cc:740] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.301512 25730 consensus_queue.cc:260] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.304685 25730 ts_tablet_manager.cc:1434] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.000s
I20260709 13:20:50.305050 25729 raft_consensus.cc:359] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:50.305845 25729 raft_consensus.cc:385] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.306191 25729 raft_consensus.cc:740] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.310505 25729 consensus_queue.cc:260] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:50.312608 25732 tablet_bootstrap.cc:492] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:50.313097 25732 ts_tablet_manager.cc:1403] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.090s	user 0.023s	sys 0.013s
I20260709 13:20:50.311002 25730 tablet_bootstrap.cc:492] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:50.313423 25531 raft_consensus.cc:2468] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:50.314086 25729 ts_tablet_manager.cc:1434] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:20:50.314679 25647 leader_election.cc:304] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:50.316264 25732 raft_consensus.cc:359] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.316922 25732 raft_consensus.cc:385] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.317155 25780 raft_consensus.cc:2804] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.317699 25780 raft_consensus.cc:697] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:50.318583 25780 consensus_queue.cc:237] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:50.317175 25732 raft_consensus.cc:740] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.322962 25732 consensus_queue.cc:260] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.325253 25732 ts_tablet_manager.cc:1434] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:20:50.328722 25810 raft_consensus.cc:493] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.329262 25810 raft_consensus.cc:515] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:50.331358 25810 leader_election.cc:290] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:50.335211 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:50.331607 25729 tablet_bootstrap.cc:492] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:50.339555 25682 raft_consensus.cc:2468] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:50.341270 25499 leader_election.cc:304] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:50.342145 25810 raft_consensus.cc:2804] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.342595 25810 raft_consensus.cc:493] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.342950 25810 raft_consensus.cc:3060] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.345907 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:50.346648 25608 raft_consensus.cc:2468] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:50.348198 26064 consensus_queue.cc:1048] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.349736 25976 raft_consensus.cc:493] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.350322 25976 raft_consensus.cc:515] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:50.352535 25976 leader_election.cc:290] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:50.354578 26004 raft_consensus.cc:493] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.355017 26004 raft_consensus.cc:515] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:50.355572 25731 tablet_bootstrap.cc:654] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.357057 26004 leader_election.cc:290] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:50.357868 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:50.360172 25499 leader_election.cc:343] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.361402 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdda0f89bd34da2ab6e2dcc9f918eb5" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:50.363240 25499 leader_election.cc:343] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.363268 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdda0f89bd34da2ab6e2dcc9f918eb5" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:50.363336 26064 raft_consensus.cc:493] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.364816 26064 raft_consensus.cc:515] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:50.365888 25730 tablet_bootstrap.cc:654] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.367072 26064 leader_election.cc:290] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:50.368050 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278c9060803541ebb56ccb47687d3d4d" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:50.368848 25534 raft_consensus.cc:2393] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 812474b88dc54c39bc37428d77dcb7a9 in current term 1: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
I20260709 13:20:50.370769 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:50.371409 25607 raft_consensus.cc:2468] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:50.371583 25729 tablet_bootstrap.cc:654] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.372555 25500 leader_election.cc:304] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:50.373828 26004 raft_consensus.cc:2804] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.374212 26004 raft_consensus.cc:493] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.374518 26004 raft_consensus.cc:3060] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.375072 25732 tablet_bootstrap.cc:492] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:50.378754 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278c9060803541ebb56ccb47687d3d4d" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
W20260709 13:20:50.379747 25499 leader_election.cc:343] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.380184 25499 leader_election.cc:304] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:50.381704 25976 raft_consensus.cc:2749] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.382797 25424 leader_election.cc:304] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:50.384121 26064 raft_consensus.cc:3060] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.340276 25456 raft_consensus.cc:2468] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:50.385624 26004 raft_consensus.cc:515] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:50.410689 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:50.410454 25359 catalog_manager.cc:5697] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.411710 26064 raft_consensus.cc:2749] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:20:50.412173 25499 leader_election.cc:343] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.413216 26004 leader_election.cc:290] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:50.388787 25810 raft_consensus.cc:515] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:50.417027 25810 leader_election.cc:290] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:50.418258 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:50.418843 25607 raft_consensus.cc:3060] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.419090 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:50.419718 25682 raft_consensus.cc:3060] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.423400 25731 tablet_bootstrap.cc:492] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:50.423902 25731 ts_tablet_manager.cc:1403] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.135s	user 0.014s	sys 0.005s
I20260709 13:20:50.419135 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:50.427445 25610 raft_consensus.cc:3060] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.428541 25732 tablet_bootstrap.cc:654] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.440830 25610 raft_consensus.cc:2468] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:50.440048 25731 raft_consensus.cc:359] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:50.449290 25731 raft_consensus.cc:385] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.449581 25731 raft_consensus.cc:740] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.450793 25731 consensus_queue.cc:260] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:20:50.452647 25425 consensus_peers.cc:597] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 -> Peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Couldn't send request to peer 0a6b07f89a2c437ea29fb7c7e52440ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.461429 25500 leader_election.cc:304] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:50.462697 25976 raft_consensus.cc:2804] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.466315 25985 raft_consensus.cc:493] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.469249 25985 raft_consensus.cc:515] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.471799 25985 leader_election.cc:290] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:50.474758 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:50.474753 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:50.476193 25684 raft_consensus.cc:2468] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
W20260709 13:20:50.477602 25425 leader_election.cc:343] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.478412 25424 leader_election.cc:304] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:20:50.478827 25986 consensus_queue.cc:1048] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.479841 25985 raft_consensus.cc:2804] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.480269 25985 raft_consensus.cc:493] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.480611 25985 raft_consensus.cc:3060] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.481235 25986 consensus_queue.cc:1048] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.492441 25810 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.493001 25810 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:50.498948 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:50.500792 25499 leader_election.cc:343] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.501511 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:20:50.503082 25500 leader_election.cc:343] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.503491 25500 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:50.505309 26004 raft_consensus.cc:2749] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.515962 25976 raft_consensus.cc:697] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:20:50.517446 25976 consensus_queue.cc:237] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:50.497781 25810 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:50.522593 25730 tablet_bootstrap.cc:492] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:50.523138 25730 ts_tablet_manager.cc:1403] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.212s	user 0.016s	sys 0.014s
I20260709 13:20:50.525859 25730 raft_consensus.cc:359] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.526521 25730 raft_consensus.cc:385] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.526783 25730 raft_consensus.cc:740] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.527428 25730 consensus_queue.cc:260] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.529736 25730 ts_tablet_manager.cc:1434] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:50.531876 25730 tablet_bootstrap.cc:492] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:50.540695 25730 tablet_bootstrap.cc:654] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.448427 25682 raft_consensus.cc:2468] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:50.542542 25607 raft_consensus.cc:2468] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:50.547421 25729 tablet_bootstrap.cc:492] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:50.549048 25732 tablet_bootstrap.cc:492] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:50.551082 25729 ts_tablet_manager.cc:1403] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.220s	user 0.020s	sys 0.007s
I20260709 13:20:50.551192 25732 ts_tablet_manager.cc:1403] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.182s	user 0.052s	sys 0.055s
I20260709 13:20:50.551674 25955 raft_consensus.cc:493] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.552188 25955 raft_consensus.cc:515] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.554177 25732 raft_consensus.cc:359] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:50.554306 25729 raft_consensus.cc:359] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:50.554224 25955 leader_election.cc:290] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:50.554900 25732 raft_consensus.cc:385] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.555770 25732 raft_consensus.cc:740] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.555188 25729 raft_consensus.cc:385] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.556600 25729 raft_consensus.cc:740] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.557587 25729 consensus_queue.cc:260] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:50.556465 25732 consensus_queue.cc:260] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:50.559933 25729 ts_tablet_manager.cc:1434] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:50.555896 25500 leader_election.cc:304] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:50.560158 25732 ts_tablet_manager.cc:1434] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:20:50.561170 25732 tablet_bootstrap.cc:492] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:50.561434 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:50.562830 25456 raft_consensus.cc:2468] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:50.563041 26004 raft_consensus.cc:2804] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.570988 26004 raft_consensus.cc:697] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:20:50.572149 25732 tablet_bootstrap.cc:654] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.571924 26004 consensus_queue.cc:237] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:50.567950 25731 ts_tablet_manager.cc:1434] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.144s	user 0.003s	sys 0.008s
I20260709 13:20:50.583774 25731 tablet_bootstrap.cc:492] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:50.586404 25573 leader_election.cc:304] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:50.588882 25729 tablet_bootstrap.cc:492] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:50.589349 25984 raft_consensus.cc:2804] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:50.589764 25984 raft_consensus.cc:493] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.590139 25984 raft_consensus.cc:3060] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:50.595117 26077 raft_consensus.cc:493] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.596297 26077 raft_consensus.cc:515] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.604367 26077 leader_election.cc:290] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:50.606208 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9240e31c174ddab78702a2343b3d64" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
W20260709 13:20:50.610350 25573 leader_election.cc:343] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.614354 25729 tablet_bootstrap.cc:654] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.595314 26092 raft_consensus.cc:493] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.620344 26092 raft_consensus.cc:515] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:50.601295 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:50.623539 25682 raft_consensus.cc:2468] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:50.630889 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9240e31c174ddab78702a2343b3d64" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:50.632161 25573 leader_election.cc:343] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.632336 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:50.632625 25573 leader_election.cc:304] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:50.632925 26092 leader_election.cc:290] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:50.633061 25533 raft_consensus.cc:2468] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:50.633978 26077 raft_consensus.cc:2749] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.634286 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:50.634434 25647 leader_election.cc:304] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:50.635223 26092 raft_consensus.cc:2804] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.635537 26092 raft_consensus.cc:493] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.635861 26092 raft_consensus.cc:3060] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.635937 25985 raft_consensus.cc:515] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.638267 25731 tablet_bootstrap.cc:654] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:50.640736 25648 leader_election.cc:343] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.676708 25358 catalog_manager.cc:5697] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.684654 25985 leader_election.cc:290] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:50.685674 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:50.686326 25610 raft_consensus.cc:3060] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.693346 25730 tablet_bootstrap.cc:492] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:50.694057 25730 ts_tablet_manager.cc:1403] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.162s	user 0.022s	sys 0.006s
I20260709 13:20:50.699627 25610 raft_consensus.cc:2468] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:50.701393 25425 leader_election.cc:304] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:50.702672 25985 raft_consensus.cc:2804] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.703184 25985 raft_consensus.cc:697] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:50.703985 25985 consensus_queue.cc:237] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.704866 25984 raft_consensus.cc:515] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.695580 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:50.707044 25682 raft_consensus.cc:3060] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.717206 26092 raft_consensus.cc:515] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:50.727114 26092 leader_election.cc:290] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:50.723727 25732 tablet_bootstrap.cc:492] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:50.727555 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:50.780378 25732 ts_tablet_manager.cc:1403] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.219s	user 0.017s	sys 0.029s
I20260709 13:20:50.780529 25534 raft_consensus.cc:3060] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.730974 25729 tablet_bootstrap.cc:492] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:50.731613 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:50.781490 25729 ts_tablet_manager.cc:1403] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.193s	user 0.029s	sys 0.042s
I20260709 13:20:50.782220 26091 raft_consensus.cc:493] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:50.793628 25648 leader_election.cc:343] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.789083 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:50.796341 25683 raft_consensus.cc:3060] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:50.795152 25730 raft_consensus.cc:359] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:50.798949 25730 raft_consensus.cc:385] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.806232 25732 raft_consensus.cc:359] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.807052 25732 raft_consensus.cc:385] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.807334 25732 raft_consensus.cc:740] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.807615 25534 raft_consensus.cc:2468] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:50.807994 25732 consensus_queue.cc:260] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.808363 25780 consensus_queue.cc:1048] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.810590 25647 leader_election.cc:304] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:20:50.811647 26092 raft_consensus.cc:2804] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.812160 26092 raft_consensus.cc:697] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:50.812304 25729 raft_consensus.cc:359] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.813032 25729 raft_consensus.cc:385] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.813374 25729 raft_consensus.cc:740] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.794620 26091 raft_consensus.cc:515] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:50.813133 26092 consensus_queue.cc:237] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:50.816443 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:50.817293 25456 raft_consensus.cc:3060] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 2
I20260709 13:20:50.828387 25729 consensus_queue.cc:260] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.829780 25732 ts_tablet_manager.cc:1434] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:20:50.799247 25730 raft_consensus.cc:740] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.832901 25730 consensus_queue.cc:260] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:50.838789 25359 catalog_manager.cc:5697] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.799583 25984 leader_election.cc:290] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:50.830600 26064 raft_consensus.cc:493] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.847129 25731 tablet_bootstrap.cc:492] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:50.849449 25731 ts_tablet_manager.cc:1403] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.266s	user 0.023s	sys 0.016s
I20260709 13:20:50.850438 25732 tablet_bootstrap.cc:492] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:50.852242 25729 ts_tablet_manager.cc:1434] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.001s
I20260709 13:20:50.860167 25730 ts_tablet_manager.cc:1434] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.166s	user 0.015s	sys 0.003s
I20260709 13:20:50.852102 26064 raft_consensus.cc:515] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.866411 26064 leader_election.cc:290] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:50.871876 25682 raft_consensus.cc:2468] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:50.873610 25737 raft_consensus.cc:493] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.874166 25737 raft_consensus.cc:515] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:50.876169 25737 leader_election.cc:290] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:50.874229 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed58b0dbded4dfc9447d9712ff39fea" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:20:50.878100 25425 leader_election.cc:343] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.878026 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:50.881006 26091 leader_election.cc:290] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:50.881134 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:50.882017 25610 raft_consensus.cc:2393] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 812474b88dc54c39bc37428d77dcb7a9 in current term 1: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:20:50.893561 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed58b0dbded4dfc9447d9712ff39fea" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:50.896732 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdda0f89bd34da2ab6e2dcc9f918eb5" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:50.897537 25533 raft_consensus.cc:2468] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:50.898561 25729 tablet_bootstrap.cc:492] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:50.895958 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdda0f89bd34da2ab6e2dcc9f918eb5" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:50.905439 25424 leader_election.cc:343] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:50.905529 25647 leader_election.cc:343] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.905925 25424 leader_election.cc:304] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:50.908758 25737 raft_consensus.cc:2749] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.911005 25779 consensus_queue.cc:1048] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.914744 25425 leader_election.cc:304] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:50.915390 25683 raft_consensus.cc:2468] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:20:50.916536 26055 raft_consensus.cc:3060] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.920089 25647 leader_election.cc:304] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:50.916514 25730 tablet_bootstrap.cc:492] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:50.921054 25573 leader_election.cc:304] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:50.929867 26076 raft_consensus.cc:2804] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:50.932896 26076 raft_consensus.cc:697] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:50.933895 26076 consensus_queue.cc:237] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:50.941324 25955 raft_consensus.cc:493] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.941856 25955 raft_consensus.cc:515] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:50.944801 26055 raft_consensus.cc:2749] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.926754 25780 raft_consensus.cc:2804] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.944952 25955 leader_election.cc:290] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:50.946674 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:50.949431 25531 raft_consensus.cc:2393] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 1: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
I20260709 13:20:50.949151 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:50.951731 25731 raft_consensus.cc:359] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:50.952725 25731 raft_consensus.cc:385] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.953061 25731 raft_consensus.cc:740] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.951776 25573 leader_election.cc:304] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:50.959090 25955 raft_consensus.cc:3060] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.961786 25780 raft_consensus.cc:493] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.962875 25780 raft_consensus.cc:3060] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.966717 25359 catalog_manager.cc:5697] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:50.975070 25358 catalog_manager.cc:5697] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:50.975473 25730 tablet_bootstrap.cc:654] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.003808 25731 consensus_queue.cc:260] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:51.000627 25456 raft_consensus.cc:2468] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:20:51.018206 25729 tablet_bootstrap.cc:654] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.023729 25732 tablet_bootstrap.cc:654] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.028854 25731 ts_tablet_manager.cc:1434] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.179s	user 0.009s	sys 0.000s
I20260709 13:20:51.026643 25780 raft_consensus.cc:515] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:51.040794 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdda0f89bd34da2ab6e2dcc9f918eb5" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
W20260709 13:20:51.042282 25647 leader_election.cc:343] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.052742 25359 catalog_manager.cc:5697] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 2, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 2 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.057547 25731 tablet_bootstrap.cc:492] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:51.056910 25810 raft_consensus.cc:493] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.059273 25810 raft_consensus.cc:515] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:51.100348 25955 raft_consensus.cc:2749] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:51.187841 25731 tablet_bootstrap.cc:654] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.189448 25810 leader_election.cc:290] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:51.196591 25986 raft_consensus.cc:493] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.192090 25729 tablet_bootstrap.cc:492] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:51.198160 25986 raft_consensus.cc:515] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:51.198694 25729 ts_tablet_manager.cc:1403] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.307s	user 0.017s	sys 0.015s
W20260709 13:20:51.191879 25424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 133385us
I20260709 13:20:51.228619 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788ee1912fba47fe8873f543b02189f7" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:51.236768 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 44622us
W20260709 13:20:51.237542 25499 leader_election.cc:343] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.235796 25729 raft_consensus.cc:359] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:51.242022 25729 raft_consensus.cc:385] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.242400 25729 raft_consensus.cc:740] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.215533 25780 leader_election.cc:290] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:51.245412 25729 consensus_queue.cc:260] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:51.249600 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdda0f89bd34da2ab6e2dcc9f918eb5" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:51.250306 25534 raft_consensus.cc:3060] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.274636 25534 raft_consensus.cc:2468] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
W20260709 13:20:51.318063 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 64163.5us
I20260709 13:20:51.304030 25986 leader_election.cc:290] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:51.337543 25729 ts_tablet_manager.cc:1434] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.137s	user 0.019s	sys 0.000s
I20260709 13:20:51.345618 25732 tablet_bootstrap.cc:492] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:51.346544 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9240e31c174ddab78702a2343b3d64" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:51.307086 26004 consensus_queue.cc:1048] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:20:51.351720 25732 ts_tablet_manager.cc:1403] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.503s	user 0.012s	sys 0.016s
W20260709 13:20:51.352980 25647 leader_election.cc:343] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.367781 25737 consensus_queue.cc:1048] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:20:51.347385 25499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 71728.7us
I20260709 13:20:51.371776 25647 leader_election.cc:304] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:51.372793 25779 raft_consensus.cc:2804] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:51.373464 25779 raft_consensus.cc:697] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
W20260709 13:20:51.375931 25573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 103655us
I20260709 13:20:51.377036 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9240e31c174ddab78702a2343b3d64" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:51.374326 25779 consensus_queue.cc:237] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:51.377671 25610 raft_consensus.cc:2468] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:51.390612 25729 tablet_bootstrap.cc:492] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:51.369840 26064 consensus_queue.cc:1048] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:20:51.411677 25730 tablet_bootstrap.cc:492] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:51.412432 25730 ts_tablet_manager.cc:1403] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.516s	user 0.029s	sys 0.012s
I20260709 13:20:51.423184 25731 tablet_bootstrap.cc:492] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:51.423919 25731 ts_tablet_manager.cc:1403] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.368s	user 0.019s	sys 0.027s
I20260709 13:20:51.424336 25732 raft_consensus.cc:359] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:51.425155 25732 raft_consensus.cc:385] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.425449 25732 raft_consensus.cc:740] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.426540 25732 consensus_queue.cc:260] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:51.402827 26092 consensus_queue.cc:1048] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
W20260709 13:20:51.443334 25407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:51.450870 25730 raft_consensus.cc:359] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:51.455341 25730 raft_consensus.cc:385] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.455709 25730 raft_consensus.cc:740] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.456826 25732 ts_tablet_manager.cc:1434] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.002s
W20260709 13:20:51.468734 25424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 68218.3us
I20260709 13:20:51.463290 25730 consensus_queue.cc:260] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:51.479503 25984 raft_consensus.cc:493] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.485545 25731 raft_consensus.cc:359] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:51.496778 25730 ts_tablet_manager.cc:1434] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.084s	user 0.005s	sys 0.003s
I20260709 13:20:51.496876 25731 raft_consensus.cc:385] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.497448 25731 raft_consensus.cc:740] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.501983 25731 consensus_queue.cc:260] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:51.494061 26112 raft_consensus.cc:493] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.511500 25732 tablet_bootstrap.cc:492] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:51.458881 25648 leader_election.cc:304] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:51.525763 25730 tablet_bootstrap.cc:492] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:51.538205 26131 consensus_queue.cc:1048] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:51.546262 25455 raft_consensus.cc:1275] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:20:51.500757 25984 raft_consensus.cc:515] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:20:51.551146 25424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:44609, user_credentials={real_user=slave}} blocked reactor thread for 55208.2us
I20260709 13:20:51.554626 25729 tablet_bootstrap.cc:654] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:51.562857 26126 log.cc:927] Time spent T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:51.553722 26119 raft_consensus.cc:2804] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:20:51.554405 25648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:40853, user_credentials={real_user=slave}} blocked reactor thread for 104044us
W20260709 13:20:51.611760 25573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 58653.1us
I20260709 13:20:51.519227 26112 raft_consensus.cc:515] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:51.595108 26119 raft_consensus.cc:493] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.639578 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788ee1912fba47fe8873f543b02189f7" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:51.640395 25606 raft_consensus.cc:2468] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:51.643704 26112 leader_election.cc:290] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:51.622979 26119 raft_consensus.cc:3060] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.655771 25731 ts_tablet_manager.cc:1434] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.231s	user 0.027s	sys 0.013s
W20260709 13:20:51.663759 25499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 114135us
I20260709 13:20:51.667043 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f8e17e0e2419bb3b63d012776f356" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:51.673739 25730 tablet_bootstrap.cc:654] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.678315 25984 leader_election.cc:290] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:51.690587 25732 tablet_bootstrap.cc:654] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.695137 25731 tablet_bootstrap.cc:492] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:51.703071 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f8e17e0e2419bb3b63d012776f356" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:51.705119 26119 raft_consensus.cc:515] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:51.710963 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9240e31c174ddab78702a2343b3d64" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:51.711596 25459 raft_consensus.cc:3060] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:51.723790 25647 leader_election.cc:343] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.725401 25731 tablet_bootstrap.cc:654] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.740186 25500 leader_election.cc:304] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
W20260709 13:20:51.740878 25647 leader_election.cc:343] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.744470 25647 leader_election.cc:304] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:51.745170 25779 raft_consensus.cc:2749] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:51.738148 26119 leader_election.cc:290] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:51.756004 25810 raft_consensus.cc:2804] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:51.776996 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788ee1912fba47fe8873f543b02189f7" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:51.759891 26131 consensus_queue.cc:1048] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:20:51.776499 25810 raft_consensus.cc:493] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.803012 25810 raft_consensus.cc:3060] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:51.876051 25573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:44609, user_credentials={real_user=slave}} blocked reactor thread for 97253.5us
I20260709 13:20:51.900892 25732 tablet_bootstrap.cc:492] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:51.901619 25732 ts_tablet_manager.cc:1403] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.407s	user 0.016s	sys 0.031s
I20260709 13:20:51.902266 25457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788ee1912fba47fe8873f543b02189f7" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:51.904340 25684 raft_consensus.cc:1275] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:20:51.913843 25358 catalog_manager.cc:5697] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.918891 25729 tablet_bootstrap.cc:492] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:51.919445 25729 ts_tablet_manager.cc:1403] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.548s	user 0.017s	sys 0.014s
I20260709 13:20:51.925472 25730 tablet_bootstrap.cc:492] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:51.926066 25730 ts_tablet_manager.cc:1403] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.408s	user 0.024s	sys 0.011s
I20260709 13:20:51.925844 25732 raft_consensus.cc:359] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:51.926612 25732 raft_consensus.cc:385] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.926875 25732 raft_consensus.cc:740] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.927793 26092 consensus_queue.cc:1048] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.913259 25459 raft_consensus.cc:2468] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:51.942217 26132 raft_consensus.cc:493] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.875674 26108 consensus_queue.cc:1048] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.170s
I20260709 13:20:51.942777 26132 raft_consensus.cc:515] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
W20260709 13:20:51.945516 26144 log.cc:927] Time spent T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:20:51.945251 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9240e31c174ddab78702a2343b3d64" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:51.960909 25609 raft_consensus.cc:3060] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.963660 25732 consensus_queue.cc:260] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:51.965351 25732 ts_tablet_manager.cc:1434] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.062s	user 0.001s	sys 0.005s
I20260709 13:20:51.966924 26132 leader_election.cc:290] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:51.968528 25732 tablet_bootstrap.cc:492] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:51.947816 25731 tablet_bootstrap.cc:492] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:51.971035 25731 ts_tablet_manager.cc:1403] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.306s	user 0.034s	sys 0.025s
I20260709 13:20:51.970939 25729 raft_consensus.cc:359] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:51.971683 25729 raft_consensus.cc:385] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.971968 25729 raft_consensus.cc:740] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.973685 25731 raft_consensus.cc:359] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:51.974457 25731 raft_consensus.cc:385] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.974715 25731 raft_consensus.cc:740] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
W20260709 13:20:51.948333 25500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:40853, user_credentials={real_user=slave}} blocked reactor thread for 43612us
I20260709 13:20:51.873261 26139 consensus_queue.cc:1048] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.165s
I20260709 13:20:51.976445 26141 consensus_queue.cc:1048] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:20:51.976805 25573 leader_election.cc:343] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:51.958465 25647 consensus_peers.cc:597] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:51.980098 25647 leader_election.cc:304] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:51.981053 26112 raft_consensus.cc:2804] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:51.981535 26112 raft_consensus.cc:697] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:51.982338 26112 consensus_queue.cc:237] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:51.992559 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:51.994266 25732 tablet_bootstrap.cc:654] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.997375 25731 consensus_queue.cc:260] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:51.941419 25810 raft_consensus.cc:515] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:52.002682 25533 raft_consensus.cc:2393] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 1: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:20:52.003726 25810 leader_election.cc:290] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:52.017982 25729 consensus_queue.cc:260] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:52.019479 25573 leader_election.cc:304] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:52.020236 25731 ts_tablet_manager.cc:1434] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:20:52.027452 25609 raft_consensus.cc:2468] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:52.033639 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:20:52.035331 25499 leader_election.cc:343] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:52.017454 26119 consensus_queue.cc:1048] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:20:52.043664 26077 raft_consensus.cc:3060] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.019481 25730 raft_consensus.cc:359] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:52.047402 25730 raft_consensus.cc:385] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.047876 25730 raft_consensus.cc:740] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:52.056583 25730 consensus_queue.cc:260] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:52.062628 25730 ts_tablet_manager.cc:1434] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.136s	user 0.006s	sys 0.001s
W20260709 13:20:52.066496 25500 leader_election.cc:343] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:52.067205 25500 leader_election.cc:304] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:52.063349 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788ee1912fba47fe8873f543b02189f7" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:52.073125 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788ee1912fba47fe8873f543b02189f7" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:52.076028 25730 tablet_bootstrap.cc:492] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:52.081169 25729 ts_tablet_manager.cc:1434] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.161s	user 0.007s	sys 0.000s
I20260709 13:20:52.083573 26121 raft_consensus.cc:2749] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:52.084631 25731 tablet_bootstrap.cc:492] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:52.102062 26077 raft_consensus.cc:2749] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:52.107748 25732 tablet_bootstrap.cc:492] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:52.108287 25732 ts_tablet_manager.cc:1403] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.140s	user 0.022s	sys 0.018s
I20260709 13:20:52.111024 25732 raft_consensus.cc:359] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:52.111681 25732 raft_consensus.cc:385] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.111951 25732 raft_consensus.cc:740] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:52.112632 25732 consensus_queue.cc:260] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:52.114701 25732 ts_tablet_manager.cc:1434] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:52.115731 25732 tablet_bootstrap.cc:492] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:52.116371 25729 tablet_bootstrap.cc:492] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:52.128582 25731 tablet_bootstrap.cc:654] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:52.128991 25606 raft_consensus.cc:2468] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:52.139189 25730 tablet_bootstrap.cc:654] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:52.146543 25499 leader_election.cc:343] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:52.149200 25500 leader_election.cc:304] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:52.153946 26113 raft_consensus.cc:2804] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:52.154461 26113 raft_consensus.cc:697] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:20:52.155061 25729 tablet_bootstrap.cc:654] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:52.155366 26113 consensus_queue.cc:237] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:52.174487 26153 raft_consensus.cc:493] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.176498 26125 raft_consensus.cc:493] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.177009 26125 raft_consensus.cc:515] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.179574 26125 leader_election.cc:290] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:52.181048 25732 tablet_bootstrap.cc:654] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:52.184497 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
W20260709 13:20:52.197365 25573 leader_election.cc:343] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:52.197710 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:52.175149 26153 raft_consensus.cc:515] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:52.221623 25810 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.222296 25810 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:52.223682 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f8e17e0e2419bb3b63d012776f356" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:52.224419 25682 raft_consensus.cc:2468] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:52.222318 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f8e17e0e2419bb3b63d012776f356" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:52.226188 25456 raft_consensus.cc:2468] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 0.
I20260709 13:20:52.215976 26153 leader_election.cc:290] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:52.228204 25499 leader_election.cc:304] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:52.224429 25810 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:52.231161 25810 raft_consensus.cc:2804] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:52.231228 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:52.231801 25810 raft_consensus.cc:493] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.232311 25810 raft_consensus.cc:3060] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:52.233573 25499 leader_election.cc:343] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:52.238063 25731 tablet_bootstrap.cc:492] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
W20260709 13:20:52.220947 25573 leader_election.cc:343] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:52.238802 25731 ts_tablet_manager.cc:1403] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.174s	user 0.010s	sys 0.003s
I20260709 13:20:52.238876 25573 leader_election.cc:304] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:52.240052 25955 raft_consensus.cc:2749] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:52.241741 25731 raft_consensus.cc:359] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:52.242456 25731 raft_consensus.cc:385] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.242703 25731 raft_consensus.cc:740] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:52.243474 25731 consensus_queue.cc:260] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:52.245066 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:52.246997 25729 tablet_bootstrap.cc:492] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:52.248011 25732 tablet_bootstrap.cc:492] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:52.248515 25732 ts_tablet_manager.cc:1403] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.133s	user 0.012s	sys 0.000s
I20260709 13:20:52.249606 25737 raft_consensus.cc:493] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.250679 25729 ts_tablet_manager.cc:1403] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.135s	user 0.018s	sys 0.006s
I20260709 13:20:52.250545 25737 raft_consensus.cc:515] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:52.251682 25732 raft_consensus.cc:359] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:52.252415 25732 raft_consensus.cc:385] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.252717 25732 raft_consensus.cc:740] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:52.252426 25737 leader_election.cc:290] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:52.253465 25732 consensus_queue.cc:260] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:52.253641 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdda0f89bd34da2ab6e2dcc9f918eb5" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:52.255685 25732 ts_tablet_manager.cc:1434] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:52.253590 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdda0f89bd34da2ab6e2dcc9f918eb5" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:52.256649 25732 tablet_bootstrap.cc:492] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:52.257238 25730 tablet_bootstrap.cc:492] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:52.257720 25730 ts_tablet_manager.cc:1403] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.182s	user 0.021s	sys 0.003s
I20260709 13:20:52.257638 25424 leader_election.cc:304] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:52.258773 25737 raft_consensus.cc:2749] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:52.261000 25731 ts_tablet_manager.cc:1434] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:20:52.259367 25729 raft_consensus.cc:359] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.262199 25731 tablet_bootstrap.cc:492] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9: Bootstrap starting.
I20260709 13:20:52.263516 25810 raft_consensus.cc:515] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:52.262794 25729 raft_consensus.cc:385] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.266196 25729 raft_consensus.cc:740] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
W20260709 13:20:52.266546 25500 leader_election.cc:343] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:52.267001 25729 consensus_queue.cc:260] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.267023 25500 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:52.271950 26113 raft_consensus.cc:2749] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:52.272119 25730 raft_consensus.cc:359] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:52.272809 25730 raft_consensus.cc:385] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.273072 25730 raft_consensus.cc:740] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:52.280494 25732 tablet_bootstrap.cc:654] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:52.273715 25730 consensus_queue.cc:260] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:52.283128 25810 leader_election.cc:290] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:52.284345 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f8e17e0e2419bb3b63d012776f356" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:52.285030 25730 ts_tablet_manager.cc:1434] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:20:52.285149 25459 raft_consensus.cc:3060] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.288194 25731 tablet_bootstrap.cc:654] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:52.289897 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f8e17e0e2419bb3b63d012776f356" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:52.290603 25681 raft_consensus.cc:3060] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.300328 25730 tablet_bootstrap.cc:492] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:52.303803 25681 raft_consensus.cc:2468] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:52.305948 25459 raft_consensus.cc:2468] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:52.309134 25499 leader_election.cc:304] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:52.306807 25730 tablet_bootstrap.cc:654] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:52.307135 25729 ts_tablet_manager.cc:1434] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:20:52.310822 25729 tablet_bootstrap.cc:492] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:52.311843 26113 raft_consensus.cc:2804] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:52.314260 26113 raft_consensus.cc:697] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:20:52.315122 26113 consensus_queue.cc:237] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:52.342106 25732 tablet_bootstrap.cc:492] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:52.342758 25732 ts_tablet_manager.cc:1403] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.005s
I20260709 13:20:52.343971 25731 tablet_bootstrap.cc:492] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9: No bootstrap required, opened a new log
I20260709 13:20:52.344480 25731 ts_tablet_manager.cc:1403] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.010s
I20260709 13:20:52.346468 25729 tablet_bootstrap.cc:654] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:52.347993 25732 raft_consensus.cc:359] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.348683 25732 raft_consensus.cc:385] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.348618 25731 raft_consensus.cc:359] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:52.349169 25732 raft_consensus.cc:740] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:52.349462 25731 raft_consensus.cc:385] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.349776 25731 raft_consensus.cc:740] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Initialized, Role: FOLLOWER
I20260709 13:20:52.350452 25731 consensus_queue.cc:260] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:52.350019 25732 consensus_queue.cc:260] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.352458 25731 ts_tablet_manager.cc:1434] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:52.355918 25732 ts_tablet_manager.cc:1434] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:20:52.357149 26117 raft_consensus.cc:493] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.357635 25730 tablet_bootstrap.cc:492] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:52.358134 26117 raft_consensus.cc:515] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:52.358613 25459 raft_consensus.cc:3060] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.360246 26117 leader_election.cc:290] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:52.358129 25730 ts_tablet_manager.cc:1403] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.001s
I20260709 13:20:52.361547 25456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:52.362288 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:52.363898 25573 leader_election.cc:304] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:52.363379 25730 raft_consensus.cc:359] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.365357 26117 raft_consensus.cc:2749] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:52.365156 25730 raft_consensus.cc:385] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.366158 25732 tablet_bootstrap.cc:492] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:52.366199 25730 raft_consensus.cc:740] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:52.372205 25730 consensus_queue.cc:260] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.376722 25730 ts_tablet_manager.cc:1434] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:20:52.377599 25730 tablet_bootstrap.cc:492] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:52.379271 25357 catalog_manager.cc:5697] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:52.387591 25732 tablet_bootstrap.cc:654] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:52.393694 25730 tablet_bootstrap.cc:654] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:52.418879 26115 raft_consensus.cc:493] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.419445 26115 raft_consensus.cc:515] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:52.421540 26115 leader_election.cc:290] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:52.424746 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:52.426050 25533 raft_consensus.cc:2468] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:52.427194 25647 leader_election.cc:304] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:52.428369 26115 raft_consensus.cc:2804] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:52.428714 26115 raft_consensus.cc:493] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.429035 26115 raft_consensus.cc:3060] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.441776 26115 raft_consensus.cc:515] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:52.456827 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:52.457736 26115 leader_election.cc:290] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:52.457552 25533 raft_consensus.cc:3060] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.459764 25810 raft_consensus.cc:493] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.460597 25810 raft_consensus.cc:515] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:52.462868 25810 leader_election.cc:290] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:52.465180 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
W20260709 13:20:52.467228 25499 leader_election.cc:343] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:52.467854 26112 consensus_queue.cc:1048] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:52.469491 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:52.474071 25499 leader_election.cc:343] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:52.474488 25499 leader_election.cc:304] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:52.475999 25810 raft_consensus.cc:2749] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:52.488106 26137 raft_consensus.cc:493] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.488691 26137 raft_consensus.cc:515] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.489800 25533 raft_consensus.cc:2468] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:52.491003 26137 leader_election.cc:290] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:52.493472 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed58b0dbded4dfc9447d9712ff39fea" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:52.494164 25610 raft_consensus.cc:2468] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:52.495327 25425 leader_election.cc:304] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:52.495669 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:52.496374 25610 raft_consensus.cc:2468] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:52.496661 25647 leader_election.cc:304] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:52.497503 26112 raft_consensus.cc:2804] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:52.498288 26112 raft_consensus.cc:697] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:52.499171 26137 raft_consensus.cc:2804] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:52.499748 26137 raft_consensus.cc:493] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.499186 26112 consensus_queue.cc:237] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:52.500113 26137 raft_consensus.cc:3060] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.511081 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed58b0dbded4dfc9447d9712ff39fea" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:52.512241 25681 raft_consensus.cc:2468] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:52.514956 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:52.515692 25610 raft_consensus.cc:3060] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.557797 25610 raft_consensus.cc:2468] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:52.557893 25729 tablet_bootstrap.cc:492] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:52.558955 25732 tablet_bootstrap.cc:492] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:52.562685 25729 ts_tablet_manager.cc:1403] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.252s	user 0.029s	sys 0.038s
I20260709 13:20:52.562740 25732 ts_tablet_manager.cc:1403] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.197s	user 0.020s	sys 0.026s
I20260709 13:20:52.564673 26137 raft_consensus.cc:515] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.565850 25729 raft_consensus.cc:359] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.570314 25729 raft_consensus.cc:385] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.570658 25729 raft_consensus.cc:740] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:52.566064 25732 raft_consensus.cc:359] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:52.571473 25729 consensus_queue.cc:260] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.573704 25732 raft_consensus.cc:385] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.576884 25610 raft_consensus.cc:3060] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.588325 25732 raft_consensus.cc:740] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:52.589053 25730 tablet_bootstrap.cc:492] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:52.589546 25730 ts_tablet_manager.cc:1403] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.212s	user 0.027s	sys 0.020s
W20260709 13:20:52.590444 25407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:52.594493 26112 consensus_queue.cc:1048] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:52.577732 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed58b0dbded4dfc9447d9712ff39fea" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:52.595659 25608 raft_consensus.cc:3060] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.579631 25729 ts_tablet_manager.cc:1434] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:20:52.596942 25729 tablet_bootstrap.cc:492] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:52.597477 25737 raft_consensus.cc:493] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.597963 25737 raft_consensus.cc:515] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:52.580910 25357 catalog_manager.cc:5697] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:52.582899 26137 leader_election.cc:290] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:52.586064 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed58b0dbded4dfc9447d9712ff39fea" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:52.605137 25682 raft_consensus.cc:3060] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.605906 25737 leader_election.cc:290] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:52.606806 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788ee1912fba47fe8873f543b02189f7" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:52.607609 25606 raft_consensus.cc:2393] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 812474b88dc54c39bc37428d77dcb7a9 in current term 1: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:20:52.610460 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788ee1912fba47fe8873f543b02189f7" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:52.612293 25424 leader_election.cc:304] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:52.613097 25737 raft_consensus.cc:3060] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.616642 25682 raft_consensus.cc:2468] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:52.624292 25424 leader_election.cc:304] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:52.626328 26137 raft_consensus.cc:2804] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:52.627091 26137 raft_consensus.cc:697] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:52.627564 25608 raft_consensus.cc:2468] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:52.627976 26137 consensus_queue.cc:237] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.643179 25359 catalog_manager.cc:5697] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:52.655263 25729 tablet_bootstrap.cc:654] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:52.639107 25732 consensus_queue.cc:260] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:52.592310 25730 raft_consensus.cc:359] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:52.678206 25730 raft_consensus.cc:385] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.680246 25730 raft_consensus.cc:740] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:52.680604 25737 raft_consensus.cc:2749] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:52.684275 25730 consensus_queue.cc:260] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:52.702558 25730 ts_tablet_manager.cc:1434] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.000s
I20260709 13:20:52.703609 25730 tablet_bootstrap.cc:492] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:52.707844 26121 consensus_queue.cc:1048] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:52.725293 26121 consensus_queue.cc:1048] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:52.740893 25424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:44609, user_credentials={real_user=slave}} blocked reactor thread for 112516us
I20260709 13:20:52.725734 25358 catalog_manager.cc:5697] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 1 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:52.759280 25732 ts_tablet_manager.cc:1434] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.196s	user 0.010s	sys 0.008s
I20260709 13:20:52.761842 25729 tablet_bootstrap.cc:492] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:52.762354 25729 ts_tablet_manager.cc:1403] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.166s	user 0.011s	sys 0.008s
I20260709 13:20:52.748867 26138 consensus_queue.cc:1048] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:20:52.783879 25732 tablet_bootstrap.cc:492] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:52.794896 25730 tablet_bootstrap.cc:654] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:52.808205 25732 tablet_bootstrap.cc:654] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:52.815762 25729 raft_consensus.cc:359] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:52.811743 25359 catalog_manager.cc:5697] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:52.818905 25729 raft_consensus.cc:385] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.822757 26187 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.823331 26187 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:52.827219 26187 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:52.827493 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:52.819284 25729 raft_consensus.cc:740] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:52.828790 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
W20260709 13:20:52.830168 25425 leader_election.cc:343] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:52.830253 25530 raft_consensus.cc:2468] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:52.832083 25424 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:20:52.832943 26187 raft_consensus.cc:2804] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:52.833405 26187 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.833863 26187 raft_consensus.cc:3060] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.835172 25729 consensus_queue.cc:260] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:52.852226 25729 ts_tablet_manager.cc:1434] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.003s
I20260709 13:20:52.854279 25729 tablet_bootstrap.cc:492] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:52.848692 26189 raft_consensus.cc:493] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.861686 26115 raft_consensus.cc:493] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.863205 26115 raft_consensus.cc:515] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.860689 26189 raft_consensus.cc:515] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.875906 26189 leader_election.cc:290] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:52.876838 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:52.877542 25682 raft_consensus.cc:2468] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:52.878621 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:52.879319 26115 leader_election.cc:290] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:52.879385 25609 raft_consensus.cc:2468] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:52.880837 25424 leader_election.cc:304] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:52.880923 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:52.881655 25608 raft_consensus.cc:2468] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:52.883463 25810 consensus_queue.cc:1048] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:52.883476 25648 leader_election.cc:304] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:52.882001 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:52.886121 25459 raft_consensus.cc:2468] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:52.887204 26189 raft_consensus.cc:2804] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:52.887599 26189 raft_consensus.cc:493] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.888156 26189 raft_consensus.cc:3060] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.887657 26115 raft_consensus.cc:2804] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:52.898123 26187 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:52.899314 26115 raft_consensus.cc:493] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.926685 26115 raft_consensus.cc:3060] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.928385 26187 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:52.934844 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
W20260709 13:20:52.944319 25425 leader_election.cc:343] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:52.948086 25729 tablet_bootstrap.cc:654] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:52.954525 25730 tablet_bootstrap.cc:492] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:52.955049 25730 ts_tablet_manager.cc:1403] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.252s	user 0.010s	sys 0.030s
I20260709 13:20:52.959915 25732 tablet_bootstrap.cc:492] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:52.960446 25732 ts_tablet_manager.cc:1403] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.179s	user 0.008s	sys 0.012s
I20260709 13:20:52.962316 26189 raft_consensus.cc:515] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.965373 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:52.965965 25609 raft_consensus.cc:3060] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:52.973807 25732 raft_consensus.cc:359] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:52.975302 25732 raft_consensus.cc:385] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.977371 25732 raft_consensus.cc:740] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:52.978168 25732 consensus_queue.cc:260] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:52.973331 25729 tablet_bootstrap.cc:492] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:52.979743 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:52.980677 25729 ts_tablet_manager.cc:1403] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.001s
I20260709 13:20:52.976609 26189 leader_election.cc:290] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:52.989480 25609 raft_consensus.cc:2468] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:52.969904 26115 raft_consensus.cc:515] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.992342 25681 raft_consensus.cc:2393] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 812474b88dc54c39bc37428d77dcb7a9 in current term 1: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
I20260709 13:20:52.992512 26091 consensus_queue.cc:1048] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:52.994043 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:52.994846 25610 raft_consensus.cc:2393] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 1: Already voted for candidate 812474b88dc54c39bc37428d77dcb7a9 in this term.
I20260709 13:20:52.995067 25425 leader_election.cc:304] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:52.979770 25732 ts_tablet_manager.cc:1434] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:20:52.996184 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:52.997284 25459 raft_consensus.cc:2393] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 1: Already voted for candidate 812474b88dc54c39bc37428d77dcb7a9 in this term.
I20260709 13:20:52.997391 25732 tablet_bootstrap.cc:492] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:52.991135 25730 raft_consensus.cc:359] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.998436 25730 raft_consensus.cc:385] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:52.998513 25647 leader_election.cc:304] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:53.001334 26091 raft_consensus.cc:2749] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:52.999809 26189 raft_consensus.cc:2804] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:53.002043 26115 leader_election.cc:290] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:53.002385 26189 raft_consensus.cc:697] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:53.003383 26189 consensus_queue.cc:237] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:53.003584 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:53.004451 25530 raft_consensus.cc:3060] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:53.005146 25730 raft_consensus.cc:740] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:53.015841 26091 raft_consensus.cc:493] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.023147 26091 raft_consensus.cc:515] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:53.023394 25730 consensus_queue.cc:260] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:52.984475 25729 raft_consensus.cc:359] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:53.024960 25729 raft_consensus.cc:385] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:53.025302 25729 raft_consensus.cc:740] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:53.025871 25732 tablet_bootstrap.cc:654] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:53.026086 25729 consensus_queue.cc:260] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:53.025887 25730 ts_tablet_manager.cc:1434] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.002s
I20260709 13:20:53.030862 25729 ts_tablet_manager.cc:1434] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 13:20:53.022024 26201 raft_consensus.cc:493] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.018759 25530 raft_consensus.cc:2468] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:53.032675 26091 leader_election.cc:290] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:53.034469 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:53.038988 26201 raft_consensus.cc:515] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:53.031164 25730 tablet_bootstrap.cc:492] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba: Bootstrap starting.
I20260709 13:20:53.035844 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:53.040078 25606 raft_consensus.cc:2468] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:53.040151 25424 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:20:53.053547 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:53.079025 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:53.100713 25681 raft_consensus.cc:2468] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 0.
I20260709 13:20:53.101450 26187 raft_consensus.cc:2804] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:53.104516 25573 leader_election.cc:304] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:53.107374 26187 raft_consensus.cc:697] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:53.092458 26115 consensus_queue.cc:1048] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:20:53.109836 26187 consensus_queue.cc:237] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:53.114445 26141 raft_consensus.cc:493] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.114974 26141 raft_consensus.cc:515] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:53.117022 26141 leader_election.cc:290] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:53.118669 25648 leader_election.cc:304] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:53.119681 26115 raft_consensus.cc:2804] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:53.120091 26115 raft_consensus.cc:493] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.120463 26115 raft_consensus.cc:3060] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:53.125736 25730 tablet_bootstrap.cc:654] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:53.127029 26141 raft_consensus.cc:2804] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:53.127447 26141 raft_consensus.cc:493] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.127831 26141 raft_consensus.cc:3060] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:53.136780 26115 raft_consensus.cc:515] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:53.138679 25359 catalog_manager.cc:5697] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.137308 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
W20260709 13:20:53.102077 25424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 61997.1us
I20260709 13:20:53.151424 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:53.151805 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:53.154340 26055 consensus_queue.cc:1048] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:20:53.157359 25573 leader_election.cc:343] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:53.041420 26201 leader_election.cc:290] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
W20260709 13:20:53.166637 25573 leader_election.cc:343] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:53.167194 25730 tablet_bootstrap.cc:492] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba: No bootstrap required, opened a new log
I20260709 13:20:53.167079 25573 leader_election.cc:304] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:53.167773 25730 ts_tablet_manager.cc:1403] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent bootstrapping tablet: real 0.137s	user 0.006s	sys 0.005s
I20260709 13:20:53.167938 26117 raft_consensus.cc:2749] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:53.169004 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:53.140996 26115 leader_election.cc:290] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:53.177146 25732 tablet_bootstrap.cc:492] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9: No bootstrap required, opened a new log
I20260709 13:20:53.177706 25732 ts_tablet_manager.cc:1403] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.181s	user 0.011s	sys 0.004s
I20260709 13:20:53.181143 25732 raft_consensus.cc:359] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:53.181794 25732 raft_consensus.cc:385] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:53.182515 25732 raft_consensus.cc:740] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:53.183246 25732 consensus_queue.cc:260] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:53.184696 25732 ts_tablet_manager.cc:1434] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:53.099990 25533 raft_consensus.cc:2468] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 0.
I20260709 13:20:53.044936 25729 tablet_bootstrap.cc:492] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68: Bootstrap starting.
I20260709 13:20:53.191875 25730 raft_consensus.cc:359] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:53.194845 25730 raft_consensus.cc:385] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:53.195125 25730 raft_consensus.cc:740] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Initialized, Role: FOLLOWER
I20260709 13:20:53.195745 25730 consensus_queue.cc:260] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:53.197635 25730 ts_tablet_manager.cc:1434] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:20:53.198310 25737 raft_consensus.cc:493] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.198797 25737 raft_consensus.cc:515] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:53.200685 25737 leader_election.cc:290] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:53.201944 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:53.202618 25607 raft_consensus.cc:2468] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:53.203732 25425 leader_election.cc:304] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:53.207356 26189 raft_consensus.cc:2804] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:53.207718 26189 raft_consensus.cc:493] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.208036 26189 raft_consensus.cc:3060] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:53.209329 25359 catalog_manager.cc:5697] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:53.212011 26141 raft_consensus.cc:515] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:53.214177 26141 leader_election.cc:290] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:53.217155 25608 raft_consensus.cc:2393] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 1: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
I20260709 13:20:53.223846 25729 tablet_bootstrap.cc:654] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:53.231706 26187 raft_consensus.cc:493] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.232434 26187 raft_consensus.cc:515] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:53.234098 26189 raft_consensus.cc:515] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:53.237033 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:53.237952 25533 raft_consensus.cc:2468] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:53.238029 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:53.240972 25424 leader_election.cc:304] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:53.239823 26189 leader_election.cc:290] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:53.243538 25608 raft_consensus.cc:3060] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:53.244809 26055 raft_consensus.cc:2804] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:53.245224 26055 raft_consensus.cc:493] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.245112 26188 consensus_queue.cc:1048] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:53.245754 26055 raft_consensus.cc:3060] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:53.251868 26187 leader_election.cc:290] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:53.254302 25608 raft_consensus.cc:2468] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:53.255479 25425 leader_election.cc:304] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:53.256261 25737 raft_consensus.cc:2804] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:53.256644 26055 raft_consensus.cc:515] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:53.256934 25737 raft_consensus.cc:697] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:53.258064 25737 consensus_queue.cc:237] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:53.262729 26055 leader_election.cc:290] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:53.263962 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:53.264827 25530 raft_consensus.cc:3060] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:53.265717 25729 tablet_bootstrap.cc:492] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68: No bootstrap required, opened a new log
I20260709 13:20:53.266351 25729 ts_tablet_manager.cc:1403] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68: Time spent bootstrapping tablet: real 0.225s	user 0.023s	sys 0.006s
I20260709 13:20:53.273996 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:53.274806 25533 raft_consensus.cc:3060] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:53.280786 25729 raft_consensus.cc:359] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:53.282452 25729 raft_consensus.cc:385] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:53.282833 25729 raft_consensus.cc:740] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Initialized, Role: FOLLOWER
I20260709 13:20:53.282684 25359 catalog_manager.cc:5697] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.283499 26091 raft_consensus.cc:493] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.283706 25729 consensus_queue.cc:260] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:53.283994 26091 raft_consensus.cc:515] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:53.286441 26091 leader_election.cc:290] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:53.288805 25729 ts_tablet_manager.cc:1434] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:20:53.298101 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:53.298787 25682 raft_consensus.cc:2468] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 0.
I20260709 13:20:53.297605 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:53.303957 25680 raft_consensus.cc:3060] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:53.306141 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:53.322885 25648 leader_election.cc:304] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:53.324434 26091 raft_consensus.cc:2749] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:53.327731 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:53.328954 25683 raft_consensus.cc:2393] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 1: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
I20260709 13:20:53.339989 25533 raft_consensus.cc:2468] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:53.343973 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:53.345010 25459 raft_consensus.cc:2393] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 1: Already voted for candidate 812474b88dc54c39bc37428d77dcb7a9 in this term.
I20260709 13:20:53.350893 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:53.351902 25678 raft_consensus.cc:3060] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:53.350337 25530 raft_consensus.cc:2468] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:53.354524 25424 leader_election.cc:304] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:53.355458 25737 raft_consensus.cc:2804] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:53.355945 25737 raft_consensus.cc:697] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:20:53.356835 25737 consensus_queue.cc:237] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:53.366400 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:53.351135 25680 raft_consensus.cc:2468] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:53.371846 25533 raft_consensus.cc:2393] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 1: Already voted for candidate 812474b88dc54c39bc37428d77dcb7a9 in this term.
I20260709 13:20:53.373648 25573 leader_election.cc:304] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:53.375303 26201 raft_consensus.cc:2804] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:53.375784 26201 raft_consensus.cc:697] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:53.376564 26201 consensus_queue.cc:237] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:20:53.379310 25678 raft_consensus.cc:2468] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:20:53.385704 25647 leader_election.cc:304] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:53.386605 26091 raft_consensus.cc:2749] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:53.416085 25357 catalog_manager.cc:5697] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:53.430022 26214 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.430554 26214 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:53.432783 26214 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:53.434599 25459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:53.434736 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:53.435510 25533 raft_consensus.cc:2393] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 1: Already voted for candidate 812474b88dc54c39bc37428d77dcb7a9 in this term.
I20260709 13:20:53.437031 25573 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:53.437980 26214 raft_consensus.cc:3060] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:53.446601 26214 raft_consensus.cc:2749] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:53.447072 25358 catalog_manager.cc:5697] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:53.510381 25737 consensus_queue.cc:1048] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:53.527566 25737 consensus_queue.cc:1048] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:53.631181 26055 consensus_queue.cc:1048] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:53.646981 26188 consensus_queue.cc:1048] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:53.730389 26188 consensus_queue.cc:1048] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:53.754931 26137 consensus_queue.cc:1048] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:53.763823 26201 consensus_queue.cc:1048] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:53.802858 26214 consensus_queue.cc:1048] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:53.890028 26137 consensus_queue.cc:1048] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:53.907243 26188 consensus_queue.cc:1048] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:54.971030 17228 tablet_server.cc:179] TabletServer@127.16.211.1:0 shutting down...
W20260709 13:20:54.987798 25573 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:55.034472 25647 consensus_peers.cc:597] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.035502 25647 consensus_peers.cc:597] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.040025 25647 consensus_peers.cc:597] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.042109 25573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 54347.9us
W20260709 13:20:55.045945 25647 consensus_peers.cc:597] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.050208 25573 consensus_peers.cc:597] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.058326 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:20:55.059541 25573 consensus_peers.cc:597] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.061646 17228 tablet_replica.cc:333] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.062501 17228 raft_consensus.cc:2243] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.063376 17228 raft_consensus.cc:2272] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.065898 17228 tablet_replica.cc:333] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.066686 17228 raft_consensus.cc:2243] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.067659 17228 raft_consensus.cc:2272] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.069820 17228 tablet_replica.cc:333] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.071875 17228 raft_consensus.cc:2243] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:20:55.072436 25499 consensus_peers.cc:597] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.073009 17228 raft_consensus.cc:2272] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.075443 17228 tablet_replica.cc:333] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.078081 17228 raft_consensus.cc:2243] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.078670 17228 raft_consensus.cc:2272] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:55.079372 25647 consensus_peers.cc:597] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.081446 17228 tablet_replica.cc:333] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.082485 17228 raft_consensus.cc:2243] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.083061 17228 raft_consensus.cc:2272] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.085599 17228 tablet_replica.cc:333] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.086670 17228 raft_consensus.cc:2243] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.087677 17228 raft_consensus.cc:2272] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.090265 17228 tablet_replica.cc:333] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.091064 17228 raft_consensus.cc:2243] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.091578 17228 raft_consensus.cc:2272] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.094022 17228 tablet_replica.cc:333] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.094861 17228 raft_consensus.cc:2243] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.095360 17228 raft_consensus.cc:2272] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.097756 17228 tablet_replica.cc:333] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.098587 17228 raft_consensus.cc:2243] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.099074 17228 raft_consensus.cc:2272] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.101461 17228 tablet_replica.cc:333] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.102278 17228 raft_consensus.cc:2243] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.103250 17228 raft_consensus.cc:2272] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.105722 17228 tablet_replica.cc:333] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.106580 17228 raft_consensus.cc:2243] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.107585 17228 raft_consensus.cc:2272] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.110105 17228 tablet_replica.cc:333] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.110893 17228 raft_consensus.cc:2243] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.111406 17228 raft_consensus.cc:2272] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.113765 17228 tablet_replica.cc:333] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.114583 17228 raft_consensus.cc:2243] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.115087 17228 raft_consensus.cc:2272] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.117662 17228 tablet_replica.cc:333] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.118451 17228 raft_consensus.cc:2243] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.118955 17228 raft_consensus.cc:2272] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.121768 17228 tablet_replica.cc:333] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.123634 17228 raft_consensus.cc:2243] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.124132 17228 raft_consensus.cc:2272] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.126920 17228 tablet_replica.cc:333] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.127697 17228 raft_consensus.cc:2243] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.128608 17228 raft_consensus.cc:2272] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.131189 17228 tablet_replica.cc:333] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.132021 17228 raft_consensus.cc:2243] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.132534 17228 raft_consensus.cc:2272] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.135161 17228 tablet_replica.cc:333] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.135965 17228 raft_consensus.cc:2243] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.137102 17228 raft_consensus.cc:2272] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.140049 17228 tablet_replica.cc:333] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.140872 17228 raft_consensus.cc:2243] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.141377 17228 raft_consensus.cc:2272] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.144148 17228 tablet_replica.cc:333] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.144968 17228 raft_consensus.cc:2243] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.145479 17228 raft_consensus.cc:2272] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.147907 17228 tablet_replica.cc:333] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.148679 17228 raft_consensus.cc:2243] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.149694 17228 raft_consensus.cc:2272] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.152594 17228 tablet_replica.cc:333] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.153419 17228 raft_consensus.cc:2243] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.154388 17228 raft_consensus.cc:2272] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.156755 17228 tablet_replica.cc:333] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.157550 17228 raft_consensus.cc:2243] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.158089 17228 raft_consensus.cc:2272] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.160811 17228 tablet_replica.cc:333] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
W20260709 13:20:55.161293 25499 consensus_peers.cc:597] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.161579 17228 raft_consensus.cc:2243] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.162184 17228 raft_consensus.cc:2272] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.164647 17228 tablet_replica.cc:333] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.165534 17228 raft_consensus.cc:2243] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.166564 17228 raft_consensus.cc:2272] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.169466 17228 tablet_replica.cc:333] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.170295 17228 raft_consensus.cc:2243] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.171247 17228 raft_consensus.cc:2272] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:55.173202 25647 consensus_peers.cc:597] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.173767 17228 tablet_replica.cc:333] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.174801 17228 raft_consensus.cc:2243] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.175424 17228 raft_consensus.cc:2272] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:55.177726 25499 consensus_peers.cc:597] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.178434 17228 tablet_replica.cc:333] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.179342 17228 raft_consensus.cc:2243] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.179878 17228 raft_consensus.cc:2272] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.182807 17228 tablet_replica.cc:333] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.183583 17228 raft_consensus.cc:2243] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.184078 17228 raft_consensus.cc:2272] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.186527 17228 tablet_replica.cc:333] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.187352 17228 raft_consensus.cc:2243] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.187934 17228 raft_consensus.cc:2272] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.190611 17228 tablet_replica.cc:333] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.191445 17228 raft_consensus.cc:2243] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.192431 17228 raft_consensus.cc:2272] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.194993 17228 tablet_replica.cc:333] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
W20260709 13:20:55.195152 25573 consensus_peers.cc:597] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.195842 17228 raft_consensus.cc:2243] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.197000 17228 raft_consensus.cc:2272] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.199831 17228 tablet_replica.cc:333] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.200618 17228 raft_consensus.cc:2243] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.201581 17228 raft_consensus.cc:2272] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.204458 17228 tablet_replica.cc:333] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.205220 17228 raft_consensus.cc:2243] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.205731 17228 raft_consensus.cc:2272] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.208524 17228 tablet_replica.cc:333] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.209290 17228 raft_consensus.cc:2243] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.209762 17228 raft_consensus.cc:2272] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.212579 17228 tablet_replica.cc:333] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.213382 17228 raft_consensus.cc:2243] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.214350 17228 raft_consensus.cc:2272] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.217000 17228 tablet_replica.cc:333] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.217736 17228 raft_consensus.cc:2243] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.218240 17228 raft_consensus.cc:2272] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.220917 17228 tablet_replica.cc:333] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.221678 17228 raft_consensus.cc:2243] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.222191 17228 raft_consensus.cc:2272] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.225065 17228 tablet_replica.cc:333] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.225782 17228 raft_consensus.cc:2243] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.226325 17228 raft_consensus.cc:2272] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:55.228659 25647 consensus_peers.cc:597] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.228922 17228 tablet_replica.cc:333] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.229768 17228 raft_consensus.cc:2243] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.230304 17228 raft_consensus.cc:2272] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.232807 17228 tablet_replica.cc:333] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.233652 17228 raft_consensus.cc:2243] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.234160 17228 raft_consensus.cc:2272] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:55.236311 25499 consensus_peers.cc:597] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.236820 17228 tablet_replica.cc:333] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.237663 17228 raft_consensus.cc:2243] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.238205 17228 raft_consensus.cc:2272] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:55.238819 25499 consensus_peers.cc:597] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.241137 17228 tablet_replica.cc:333] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.241964 17228 raft_consensus.cc:2243] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.242472 17228 raft_consensus.cc:2272] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.245085 17228 tablet_replica.cc:333] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.245746 17228 raft_consensus.cc:2243] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.246268 17228 raft_consensus.cc:2272] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.249044 17228 tablet_replica.cc:333] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9: stopping tablet replica
I20260709 13:20:55.249694 17228 raft_consensus.cc:2243] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.250252 17228 raft_consensus.cc:2272] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:55.263520 25573 consensus_peers.cc:597] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.267575 25573 consensus_peers.cc:597] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.269562 25499 consensus_peers.cc:597] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.301970 25647 consensus_peers.cc:597] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.323978 25573 consensus_peers.cc:597] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.350010 17228 tablet_server.cc:196] TabletServer@127.16.211.1:0 shutdown complete.
W20260709 13:20:55.418725 25647 consensus_peers.cc:597] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.419245 25499 consensus_peers.cc:597] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.437831 25573 consensus_peers.cc:597] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.439316 25573 consensus_peers.cc:597] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.439855 25573 consensus_peers.cc:597] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.443701 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:55.451157 26238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:55.458659 17228 server_base.cc:1061] running on GCE node
W20260709 13:20:55.465322 25647 consensus_peers.cc:597] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.465685 25499 consensus_peers.cc:597] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.466735 26239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:55.469310 26241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:55.473714 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:55.474026 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:55.474278 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603255474256 us; error 0 us; skew 500 ppm
I20260709 13:20:55.475054 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:55.478250 17228 webserver.cc:533] Webserver started at http://127.16.211.1:39125/ using document root <none> and password file <none>
I20260709 13:20:55.478782 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:55.479231 17228 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:20:55.483827 17228 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 13:20:55.495569 26246 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:55.496793 17228 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:20:55.497246 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-0-root
uuid: "812474b88dc54c39bc37428d77dcb7a9"
format_stamp: "Formatted at 2026-07-09 13:20:41 on dist-test-slave-96c3"
I20260709 13:20:55.497843 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602988568269-17228-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:20:55.500352 25499 consensus_peers.cc:597] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.527530 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:55.531719 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:55.537271 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:20:55.550554 25573 consensus_peers.cc:597] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.566982 26253 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:20:55.904112 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:20:55.904450 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.339s	user 0.007s	sys 0.001s
I20260709 13:20:55.904812 17228 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:20:55.913993 26253 tablet_bootstrap.cc:492] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:55.968181 26253 tablet_bootstrap.cc:492] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:55.969476 26253 tablet_bootstrap.cc:492] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:55.970129 26253 ts_tablet_manager.cc:1403] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.010s
I20260709 13:20:55.972988 26253 raft_consensus.cc:359] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:55.973526 26253 raft_consensus.cc:740] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.974160 26253 consensus_queue.cc:260] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:55.978430 26253 ts_tablet_manager.cc:1434] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:20:55.979298 26253 tablet_bootstrap.cc:492] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:55.999444 26253 tablet_bootstrap.cc:492] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:56.000818 26253 tablet_bootstrap.cc:492] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:56.001595 26253 ts_tablet_manager.cc:1403] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 13:20:56.003973 26253 raft_consensus.cc:359] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.004484 26253 raft_consensus.cc:740] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:56.005121 26253 consensus_queue.cc:260] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.006533 26253 ts_tablet_manager.cc:1434] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:56.007225 26253 tablet_bootstrap.cc:492] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:56.034520 26253 tablet_bootstrap.cc:492] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:56.035506 26253 tablet_bootstrap.cc:492] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:56.036192 26253 ts_tablet_manager.cc:1403] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.008s
I20260709 13:20:56.038694 26253 raft_consensus.cc:359] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.039458 26253 raft_consensus.cc:740] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:56.040202 26253 consensus_queue.cc:260] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.042261 26253 ts_tablet_manager.cc:1434] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:56.043076 26253 tablet_bootstrap.cc:492] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:56.048151 26214 raft_consensus.cc:493] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.048707 26214 raft_consensus.cc:515] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.050700 26214 leader_election.cc:290] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.075541 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
W20260709 13:20:56.119109 25573 leader_election.cc:336] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.126541 25573 leader_election.cc:304] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:56.127228 26230 raft_consensus.cc:2749] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.133124 26253 tablet_bootstrap.cc:492] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:56.134186 26253 tablet_bootstrap.cc:492] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:56.134873 26253 ts_tablet_manager.cc:1403] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.092s	user 0.038s	sys 0.037s
I20260709 13:20:56.137879 26253 raft_consensus.cc:359] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.138666 26253 raft_consensus.cc:740] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:56.138924 26230 raft_consensus.cc:493] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.139390 26253 consensus_queue.cc:260] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.139529 26230 raft_consensus.cc:515] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.141582 26253 ts_tablet_manager.cc:1434] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:20:56.142443 26253 tablet_bootstrap.cc:492] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:56.142145 26230 leader_election.cc:290] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.148486 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
W20260709 13:20:56.153263 25573 leader_election.cc:336] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.153762 25573 leader_election.cc:304] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:56.154505 26230 raft_consensus.cc:2749] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.160152 26253 tablet_bootstrap.cc:492] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:56.161114 26253 tablet_bootstrap.cc:492] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:56.161718 26253 ts_tablet_manager.cc:1403] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:20:56.164090 26253 raft_consensus.cc:359] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.164728 26253 raft_consensus.cc:740] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:56.165474 26253 consensus_queue.cc:260] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.167647 26253 ts_tablet_manager.cc:1434] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:56.168452 26253 tablet_bootstrap.cc:492] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:56.170682 26091 raft_consensus.cc:493] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.171187 26091 raft_consensus.cc:515] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.173012 26091 leader_election.cc:290] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.179540 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed58b0dbded4dfc9447d9712ff39fea" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:20:56.184231 25647 leader_election.cc:336] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.184695 25647 leader_election.cc:304] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.186554 26091 raft_consensus.cc:2749] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.195252 26253 tablet_bootstrap.cc:492] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:56.196251 26253 tablet_bootstrap.cc:492] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:56.196887 26253 ts_tablet_manager.cc:1403] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.004s
I20260709 13:20:56.199451 26253 raft_consensus.cc:359] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.200284 26253 raft_consensus.cc:740] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:56.201228 26253 consensus_queue.cc:260] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.203557 26253 ts_tablet_manager.cc:1434] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:56.204326 26253 tablet_bootstrap.cc:492] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:56.215109 26230 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.215656 26230 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.216065 17228 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:20:56.216405 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.312s	user 0.254s	sys 0.000s
I20260709 13:20:56.220477 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:56.225381 26200 raft_consensus.cc:493] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.226063 26253 tablet_bootstrap.cc:492] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:56.226119 26200 raft_consensus.cc:515] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.227176 26253 tablet_bootstrap.cc:492] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:56.227878 26253 ts_tablet_manager.cc:1403] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 13:20:56.228964 26200 leader_election.cc:290] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.230607 26253 raft_consensus.cc:359] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.231438 26253 raft_consensus.cc:740] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:56.232218 26253 consensus_queue.cc:260] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.234431 26253 ts_tablet_manager.cc:1434] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:20:56.235236 26253 tablet_bootstrap.cc:492] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:56.246454 26091 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.246994 26091 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.247308 25986 raft_consensus.cc:493] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.247999 25986 raft_consensus.cc:515] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.248939 26091 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.250239 25986 leader_election.cc:290] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.257493 26253 tablet_bootstrap.cc:492] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:56.257413 26229 raft_consensus.cc:493] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.258242 26229 raft_consensus.cc:515] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.259924 25986 raft_consensus.cc:493] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.260341 26229 leader_election.cc:290] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.260418 25986 raft_consensus.cc:515] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.261724 26253 tablet_bootstrap.cc:492] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:56.262507 25986 leader_election.cc:290] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.262604 26253 ts_tablet_manager.cc:1403] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.008s
I20260709 13:20:56.263118 26138 raft_consensus.cc:493] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.263934 26138 raft_consensus.cc:515] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.265457 26253 raft_consensus.cc:359] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.266211 26253 raft_consensus.cc:740] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:56.266921 26253 consensus_queue.cc:260] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.269117 26253 ts_tablet_manager.cc:1434] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:20:56.269986 26253 tablet_bootstrap.cc:492] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:56.217641 26230 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.279102 26254 raft_consensus.cc:493] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.279975 26254 raft_consensus.cc:515] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.289134 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
W20260709 13:20:56.295904 25647 leader_election.cc:336] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:20:56.296593 25647 leader_election.cc:336] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:20:56.297143 25647 leader_election.cc:336] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.299039 26254 leader_election.cc:290] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.301262 26253 tablet_bootstrap.cc:492] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:56.302228 26253 tablet_bootstrap.cc:492] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:56.302853 26253 ts_tablet_manager.cc:1403] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.016s
I20260709 13:20:56.305339 26253 raft_consensus.cc:359] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.306038 26253 raft_consensus.cc:740] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:56.306820 26253 consensus_queue.cc:260] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.308691 26253 ts_tablet_manager.cc:1434] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:20:56.309468 26253 tablet_bootstrap.cc:492] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
W20260709 13:20:56.310657 25499 leader_election.cc:336] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.313479 26138 leader_election.cc:290] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.314132 26254 raft_consensus.cc:493] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.319027 26254 raft_consensus.cc:515] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.319531 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:56.320472 25609 raft_consensus.cc:2468] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:56.321980 26254 leader_election.cc:290] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.311296 25499 leader_election.cc:304] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:56.322909 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:56.323737 25609 raft_consensus.cc:2468] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:56.324806 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:56.324313 26254 raft_consensus.cc:2749] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:56.326870 25573 leader_election.cc:336] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.329051 25573 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:56.329980 26230 raft_consensus.cc:2749] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.331831 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:56.332130 26253 tablet_bootstrap.cc:492] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:56.332429 25683 raft_consensus.cc:2468] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:56.333082 26253 tablet_bootstrap.cc:492] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:56.333233 26230 raft_consensus.cc:493] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.333761 26253 ts_tablet_manager.cc:1403] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.012s
I20260709 13:20:56.333876 26230 raft_consensus.cc:515] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.336383 26253 raft_consensus.cc:359] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.337071 26253 raft_consensus.cc:740] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:56.337749 26230 leader_election.cc:290] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.338001 26234 raft_consensus.cc:493] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.338543 26234 raft_consensus.cc:515] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.333894 25648 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.340651 26234 leader_election.cc:290] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.341220 26234 raft_consensus.cc:2804] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.341254 25648 leader_election.cc:304] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.341676 26234 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.342140 26234 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.343247 26091 raft_consensus.cc:2804] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.343757 26091 raft_consensus.cc:493] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.344172 26091 raft_consensus.cc:3060] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.345582 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:56.347343 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:56.348006 26253 consensus_queue.cc:260] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:20:56.351485 25499 leader_election.cc:336] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.353726 26230 raft_consensus.cc:493] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.356101 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:56.358206 26230 raft_consensus.cc:515] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:20:56.360250 25647 leader_election.cc:336] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.361343 25499 leader_election.cc:304] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:56.362005 25986 raft_consensus.cc:493] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.350625 26234 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.353122 26259 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.351984 26254 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.362079 26138 raft_consensus.cc:2749] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.363117 26254 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.363021 26259 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.364879 26234 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.365615 26254 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:56.365715 26259 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.366631 25986 raft_consensus.cc:515] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:20:56.367527 25499 leader_election.cc:336] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.368654 25499 leader_election.cc:304] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:56.368992 25986 leader_election.cc:290] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.352977 26253 ts_tablet_manager.cc:1434] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:20:56.369323 26254 raft_consensus.cc:2749] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.370150 26253 tablet_bootstrap.cc:492] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
W20260709 13:20:56.370402 25499 leader_election.cc:336] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.370841 25499 leader_election.cc:304] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:56.372115 26254 raft_consensus.cc:2749] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:56.372233 25647 leader_election.cc:336] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.375572 26230 leader_election.cc:290] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.378350 26091 raft_consensus.cc:515] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.383121 26254 raft_consensus.cc:493] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.383729 26254 raft_consensus.cc:515] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.384075 25648 leader_election.cc:304] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.385056 26234 raft_consensus.cc:2749] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.385766 26254 leader_election.cc:290] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
W20260709 13:20:56.386829 25499 leader_election.cc:336] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.390802 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:56.390902 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:56.391459 25533 raft_consensus.cc:2468] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:56.392204 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c681632e82489da482ce4f96f3a902" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:56.392584 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:56.393118 25609 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.393425 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed58b0dbded4dfc9447d9712ff39fea" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:56.394049 25678 raft_consensus.cc:2468] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:56.395181 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:56.396459 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:56.397046 25605 raft_consensus.cc:3060] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.400602 25609 raft_consensus.cc:2468] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:20:56.402575 26091 leader_election.cc:290] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.393136 25573 leader_election.cc:304] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:56.404197 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:20:56.404510 25573 leader_election.cc:336] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.404834 25608 raft_consensus.cc:2468] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:56.405412 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:56.406276 26253 tablet_bootstrap.cc:492] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:56.407393 26253 tablet_bootstrap.cc:492] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:56.408053 26253 ts_tablet_manager.cc:1403] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.003s
I20260709 13:20:56.409453 26270 raft_consensus.cc:493] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.409660 25648 leader_election.cc:304] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.410017 26270 raft_consensus.cc:515] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.410804 26091 raft_consensus.cc:2749] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.411971 25648 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.412211 25605 raft_consensus.cc:2468] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:20:56.412497 26270 leader_election.cc:290] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.412720 25986 raft_consensus.cc:2804] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.413174 26230 raft_consensus.cc:2764] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:20:56.413249 25986 raft_consensus.cc:697] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
W20260709 13:20:56.413786 25499 leader_election.cc:336] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.414238 25986 consensus_queue.cc:237] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.415589 26254 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.415588 26253 raft_consensus.cc:359] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.416512 26253 raft_consensus.cc:740] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:56.416265 26254 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
W20260709 13:20:56.416814 25647 leader_election.cc:336] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.417399 25647 leader_election.cc:304] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.417337 26253 consensus_queue.cc:260] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.418356 26254 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.419335 26270 raft_consensus.cc:2749] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.420047 26253 ts_tablet_manager.cc:1434] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:20:56.420913 26253 tablet_bootstrap.cc:492] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:56.421757 25573 leader_election.cc:304] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:56.422533 26230 raft_consensus.cc:2804] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.422938 26230 raft_consensus.cc:493] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.423324 26230 raft_consensus.cc:3060] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.427640 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
W20260709 13:20:56.428373 25499 leader_election.cc:336] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.433630 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:56.434442 26229 raft_consensus.cc:493] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.434922 25605 raft_consensus.cc:2468] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:56.435006 26229 raft_consensus.cc:515] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.437024 26229 leader_election.cc:290] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.438795 26270 raft_consensus.cc:493] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.439332 26270 raft_consensus.cc:515] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.441375 26270 leader_election.cc:290] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.441043 26230 raft_consensus.cc:515] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.444715 25358 catalog_manager.cc:5697] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:56.446336 25647 leader_election.cc:336] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:20:56.447760 25647 leader_election.cc:336] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.448662 25573 leader_election.cc:304] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:56.449409 26229 raft_consensus.cc:2804] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.449772 26229 raft_consensus.cc:493] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.446990 25499 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:56.450151 26229 raft_consensus.cc:3060] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.450770 25500 leader_election.cc:304] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.452070 26200 raft_consensus.cc:2749] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.452174 25500 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.452718 26200 raft_consensus.cc:2804] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.453066 26200 raft_consensus.cc:493] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.453424 26200 raft_consensus.cc:3060] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.453063 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:56.454916 25533 raft_consensus.cc:2468] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:56.455075 26138 raft_consensus.cc:2749] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.455469 26230 leader_election.cc:290] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
W20260709 13:20:56.456859 25573 leader_election.cc:336] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:20:56.457578 25573 leader_election.cc:336] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.457967 25573 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
W20260709 13:20:56.459981 25573 leader_election.cc:336] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.460925 26230 raft_consensus.cc:2749] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.466116 25648 leader_election.cc:304] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.470674 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:56.473524 26091 raft_consensus.cc:493] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.474079 25648 leader_election.cc:304] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.474043 26091 raft_consensus.cc:515] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.476603 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:56.477197 25683 raft_consensus.cc:2468] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:56.460966 26229 raft_consensus.cc:515] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.474918 26270 raft_consensus.cc:2804] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.482456 26270 raft_consensus.cc:697] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:56.483551 26270 consensus_queue.cc:237] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.486657 26229 leader_election.cc:290] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.487476 26200 raft_consensus.cc:515] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.488385 26091 leader_election.cc:290] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.489151 25573 leader_election.cc:304] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
W20260709 13:20:56.494860 25573 leader_election.cc:336] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.495473 26091 raft_consensus.cc:493] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
W20260709 13:20:56.495514 25573 leader_election.cc:336] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.496126 26091 raft_consensus.cc:515] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.496770 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed58b0dbded4dfc9447d9712ff39fea" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:56.497525 25683 raft_consensus.cc:3060] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:56.498526 25499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:44609, user_credentials={real_user=slave}} blocked reactor thread for 44933.4us
I20260709 13:20:56.492203 26234 raft_consensus.cc:2804] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.500955 25533 raft_consensus.cc:2393] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 2: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:20:56.494311 26269 raft_consensus.cc:2804] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.503501 26269 raft_consensus.cc:493] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.501663 26091 leader_election.cc:290] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.502588 25647 leader_election.cc:304] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:56.503882 26269 raft_consensus.cc:3060] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.508188 25683 raft_consensus.cc:2468] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:20:56.508621 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:56.508872 25986 raft_consensus.cc:2804] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.509353 25986 raft_consensus.cc:493] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.509508 25573 leader_election.cc:304] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:56.509776 25986 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.509277 25530 raft_consensus.cc:2468] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:56.510429 26214 raft_consensus.cc:2804] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.511157 25647 leader_election.cc:304] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:56.514569 26091 raft_consensus.cc:2804] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.501827 26234 raft_consensus.cc:493] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.514961 26091 raft_consensus.cc:493] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.520092 26091 raft_consensus.cc:3060] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.510106 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:56.523059 25535 raft_consensus.cc:2468] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:20:56.523469 26268 raft_consensus.cc:493] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.523623 25986 raft_consensus.cc:515] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.524003 26268 raft_consensus.cc:515] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.518975 26253 tablet_bootstrap.cc:492] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:56.522485 26214 raft_consensus.cc:697] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:56.527055 26253 tablet_bootstrap.cc:492] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:56.527812 26253 ts_tablet_manager.cc:1403] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.012s
I20260709 13:20:56.527099 26214 consensus_queue.cc:237] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:20:56.531807 25573 leader_election.cc:336] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.527432 26234 raft_consensus.cc:3060] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.535331 25573 leader_election.cc:304] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:56.538132 26230 raft_consensus.cc:2749] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.525708 25986 leader_election.cc:290] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.545296 26091 raft_consensus.cc:515] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.550573 26229 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.551173 26229 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.552748 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:56.553498 25533 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.554668 26091 leader_election.cc:290] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.533516 26268 leader_election.cc:290] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.559638 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:56.560290 25536 raft_consensus.cc:2468] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
W20260709 13:20:56.566586 25573 leader_election.cc:336] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.559067 25647 leader_election.cc:304] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:56.571173 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:56.575162 25536 raft_consensus.cc:2468] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:56.575886 26253 raft_consensus.cc:359] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.578367 26285 raft_consensus.cc:2804] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.579066 26285 raft_consensus.cc:493] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.579224 25573 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.579674 26285 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.578562 26279 raft_consensus.cc:493] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.581030 26279 raft_consensus.cc:515] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.566082 26234 raft_consensus.cc:515] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.586962 26230 raft_consensus.cc:2804] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.587431 26230 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.587798 26230 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.587985 26234 leader_election.cc:290] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.590708 26200 leader_election.cc:290] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
W20260709 13:20:56.592955 25499 leader_election.cc:336] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:20:56.595522 25499 leader_election.cc:336] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.596607 26230 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.597258 26269 raft_consensus.cc:515] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.558889 26229 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.604705 25533 raft_consensus.cc:2468] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:20:56.599426 26269 leader_election.cc:290] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.599516 26279 leader_election.cc:290] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:56.576579 26253 raft_consensus.cc:740] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:56.598819 26230 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.610728 26253 consensus_queue.cc:260] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.624089 26253 ts_tablet_manager.cc:1434] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260709 13:20:56.623389 25357 catalog_manager.cc:5697] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 2 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.626065 26253 tablet_bootstrap.cc:492] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:56.628072 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:56.628376 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:56.628856 25609 raft_consensus.cc:2393] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ae560ddb7e6849f69d0c5f47075d3bf9 in current term 2: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
I20260709 13:20:56.628975 26230 raft_consensus.cc:493] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.628989 25605 raft_consensus.cc:2468] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
W20260709 13:20:56.610920 25647 leader_election.cc:336] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.630044 26230 raft_consensus.cc:515] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.632496 26230 leader_election.cc:290] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.635807 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:56.636454 25536 raft_consensus.cc:3060] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.639916 25358 catalog_manager.cc:5697] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.640522 25647 leader_election.cc:304] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:56.641685 26270 raft_consensus.cc:2804] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.642092 26270 raft_consensus.cc:493] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.642552 26270 raft_consensus.cc:3060] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.643198 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:56.644021 25678 raft_consensus.cc:3060] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.644445 25536 raft_consensus.cc:2468] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:20:56.649997 26214 raft_consensus.cc:493] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.608618 26286 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.650732 26214 raft_consensus.cc:515] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.650918 26286 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.652635 26214 leader_election.cc:290] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.653043 26286 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.654059 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:56.654595 25533 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.661513 26270 raft_consensus.cc:515] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.664197 26270 leader_election.cc:290] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.665057 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:56.665489 25500 leader_election.cc:304] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.665654 25605 raft_consensus.cc:3060] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.666487 26279 raft_consensus.cc:2749] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:56.670472 25500 leader_election.cc:304] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.671284 26200 raft_consensus.cc:2804] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.671808 26200 raft_consensus.cc:493] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.672276 26200 raft_consensus.cc:3060] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.672652 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c681632e82489da482ce4f96f3a902" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:56.673147 25683 raft_consensus.cc:2468] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:56.678735 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:56.679337 25683 raft_consensus.cc:2468] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:56.684521 26277 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.685060 26277 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:20:56.685315 25573 leader_election.cc:336] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:20:56.685966 25573 leader_election.cc:336] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.687161 26277 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:56.687700 25573 leader_election.cc:304] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:56.688561 25573 leader_election.cc:304] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:56.689309 26229 raft_consensus.cc:2804] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.689622 26230 raft_consensus.cc:2804] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.690056 26230 raft_consensus.cc:493] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.690557 26230 raft_consensus.cc:3060] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.677469 25605 raft_consensus.cc:2468] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
W20260709 13:20:56.692019 25499 leader_election.cc:336] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.663910 26285 raft_consensus.cc:515] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
W20260709 13:20:56.696406 25573 leader_election.cc:336] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:20:56.697719 25573 leader_election.cc:336] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.699898 25648 leader_election.cc:304] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:56.700544 26285 leader_election.cc:290] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:56.700886 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:56.701187 26285 raft_consensus.cc:2804] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.701537 25609 raft_consensus.cc:2468] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:20:56.701771 26285 raft_consensus.cc:697] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:56.689661 26229 raft_consensus.cc:493] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.710175 25533 raft_consensus.cc:2468] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:20:56.710584 26229 raft_consensus.cc:3060] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.712007 26200 raft_consensus.cc:515] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.718223 26230 raft_consensus.cc:515] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.641880 25647 leader_election.cc:304] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
W20260709 13:20:56.719620 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 77836.4us
I20260709 13:20:56.720146 26270 raft_consensus.cc:2804] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.720690 26270 raft_consensus.cc:697] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:56.720803 25647 leader_election.cc:304] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:56.704324 25678 raft_consensus.cc:2468] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:20:56.706329 25500 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.723078 26279 raft_consensus.cc:2804] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.722258 26286 raft_consensus.cc:2804] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.723517 26279 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.723709 26286 raft_consensus.cc:697] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:56.724040 26279 raft_consensus.cc:3060] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.724436 26200 leader_election.cc:290] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:56.721552 26270 consensus_queue.cc:237] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.702672 26285 consensus_queue.cc:237] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.724632 26286 consensus_queue.cc:237] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.728932 25573 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
W20260709 13:20:56.729039 25647 leader_election.cc:336] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.730048 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
W20260709 13:20:56.736243 25647 leader_election.cc:336] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.737636 25573 leader_election.cc:304] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.738756 26214 raft_consensus.cc:2804] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.739317 26214 raft_consensus.cc:697] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:56.739982 26214 consensus_queue.cc:237] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.738740 25605 raft_consensus.cc:3060] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.749094 26269 raft_consensus.cc:2804] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:20:56.740152 25647 leader_election.cc:336] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.755463 26269 raft_consensus.cc:697] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
W20260709 13:20:56.755224 25647 leader_election.cc:336] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.771329 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:56.771970 25533 raft_consensus.cc:2468] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
W20260709 13:20:56.773666 25499 leader_election.cc:336] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.776095 26230 leader_election.cc:290] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.777079 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:56.777690 25533 raft_consensus.cc:3060] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.778748 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c681632e82489da482ce4f96f3a902" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:56.779346 25678 raft_consensus.cc:3060] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.785679 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:56.786413 25536 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:56.786027 25647 leader_election.cc:336] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:20:56.789582 25647 leader_election.cc:336] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.790762 25533 raft_consensus.cc:2468] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:20:56.756852 26269 consensus_queue.cc:237] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.797761 25647 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:56.801188 26270 raft_consensus.cc:2804] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:56.802979 25647 leader_election.cc:304] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:20:56.810949 25605 raft_consensus.cc:2468] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:20:56.812956 26234 raft_consensus.cc:2804] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.813812 26234 raft_consensus.cc:697] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:56.818557 25500 leader_election.cc:304] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.815050 26234 consensus_queue.cc:237] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.833370 25678 raft_consensus.cc:2468] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:20:56.831423 25536 raft_consensus.cc:2468] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
W20260709 13:20:56.838300 25573 leader_election.cc:336] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.841678 26200 raft_consensus.cc:2804] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.842504 26200 raft_consensus.cc:697] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:20:56.843329 26200 consensus_queue.cc:237] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.847208 25573 leader_election.cc:304] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:56.802979 26270 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:20:56.858467 26270 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.859405 25358 catalog_manager.cc:5697] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.848328 25647 leader_election.cc:304] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
W20260709 13:20:56.866228 25647 leader_election.cc:336] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:20:56.867084 25647 leader_election.cc:336] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:20:56.867772 25647 leader_election.cc:336] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.869381 26285 raft_consensus.cc:2804] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.869964 26285 raft_consensus.cc:697] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:56.871807 26285 consensus_queue.cc:237] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:56.845119 26229 raft_consensus.cc:515] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.876446 26281 raft_consensus.cc:2804] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.877774 26229 leader_election.cc:290] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:56.879781 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:20:56.880472 25683 raft_consensus.cc:3060] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.894146 26279 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:56.896643 26279 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:56.920576 25683 raft_consensus.cc:2468] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:20:56.920285 25358 catalog_manager.cc:5697] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 2 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:56.926716 25499 leader_election.cc:336] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.929494 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:20:56.930207 25605 raft_consensus.cc:3060] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.930908 25573 leader_election.cc:304] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
W20260709 13:20:56.931806 25573 leader_election.cc:336] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:56.933288 26281 raft_consensus.cc:697] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:56.934437 26281 consensus_queue.cc:237] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.933346 26230 raft_consensus.cc:2804] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.965046 26230 raft_consensus.cc:697] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:56.966133 26230 consensus_queue.cc:237] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:56.977226 25609 raft_consensus.cc:1275] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:56.988745 26253 tablet_bootstrap.cc:492] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:56.989825 26253 tablet_bootstrap.cc:492] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:56.990685 26253 ts_tablet_manager.cc:1403] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.365s	user 0.027s	sys 0.008s
I20260709 13:20:57.008186 25605 raft_consensus.cc:2468] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:20:57.009101 25358 catalog_manager.cc:5697] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.998327 26268 consensus_queue.cc:1048] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:20:57.033675 25500 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
W20260709 13:20:57.042374 25647 consensus_peers.cc:597] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:57.040462 26306 raft_consensus.cc:2804] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:57.050393 25608 raft_consensus.cc:1275] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.051586 26306 raft_consensus.cc:697] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:20:57.052605 26306 consensus_queue.cc:237] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:57.055125 26286 consensus_queue.cc:1048] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:57.059882 25358 catalog_manager.cc:5697] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:57.061355 25358 catalog_manager.cc:5697] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:57.062995 25358 catalog_manager.cc:5697] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:57.063489 26253 raft_consensus.cc:359] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:57.064307 26253 raft_consensus.cc:740] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:57.064741 25358 catalog_manager.cc:5697] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:57.068755 25357 catalog_manager.cc:5697] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 2 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:57.069418 26253 consensus_queue.cc:260] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:57.070982 25357 catalog_manager.cc:5697] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 2 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:57.082921 26253 ts_tablet_manager.cc:1434] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.000s
I20260709 13:20:57.087033 26253 tablet_bootstrap.cc:492] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:57.039213 26270 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:57.091660 26270 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:57.091915 25678 raft_consensus.cc:1275] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.104053 26230 consensus_queue.cc:1048] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:57.108855 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:57.109521 25533 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:57.120146 25573 consensus_peers.cc:597] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:57.125437 25356 catalog_manager.cc:5697] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:57.134205 25647 consensus_peers.cc:597] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.134819 25647 leader_election.cc:336] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:20:57.138337 25533 raft_consensus.cc:2468] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:20:57.141460 25647 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:20:57.142609 26307 raft_consensus.cc:2804] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:57.154587 25357 catalog_manager.cc:5697] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 2 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:57.158555 26307 raft_consensus.cc:697] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:20:57.160073 26307 consensus_queue.cc:237] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
W20260709 13:20:57.227298 25647 consensus_peers.cc:597] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:57.232774 26253 tablet_bootstrap.cc:492] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:57.236572 26253 tablet_bootstrap.cc:492] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
W20260709 13:20:57.238636 25647 consensus_peers.cc:597] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:57.238862 25533 raft_consensus.cc:1275] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.239455 26253 ts_tablet_manager.cc:1403] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.153s	user 0.018s	sys 0.005s
I20260709 13:20:57.239686 25356 catalog_manager.cc:5697] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 1 to 2, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 2 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:57.242830 26253 raft_consensus.cc:359] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:57.243485 26253 raft_consensus.cc:740] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:57.244222 26253 consensus_queue.cc:260] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:57.248960 26270 consensus_queue.cc:1048] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.254571 25683 raft_consensus.cc:1275] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.257330 25536 raft_consensus.cc:1275] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:20:57.257540 25573 consensus_peers.cc:597] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:57.258630 25605 raft_consensus.cc:1275] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.247200 26253 ts_tablet_manager.cc:1434] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:57.259806 26253 tablet_bootstrap.cc:492] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:57.262166 26281 consensus_queue.cc:1048] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.265506 26268 consensus_queue.cc:1048] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.267182 26268 consensus_queue.cc:1048] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.281183 26256 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.281898 26256 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:20:57.287298 25573 consensus_peers.cc:597] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:57.291045 26256 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:57.303440 26256 raft_consensus.cc:493] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.304260 26256 raft_consensus.cc:515] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:57.307423 26256 leader_election.cc:290] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:57.321589 25609 raft_consensus.cc:1275] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:20:57.327828 25647 consensus_peers.cc:597] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.329172 25573 consensus_peers.cc:597] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.352530 26306 consensus_queue.cc:1048] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:57.395681 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:57.396189 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:20:57.415539 25647 consensus_peers.cc:597] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.416111 25647 consensus_peers.cc:597] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.417869 25683 raft_consensus.cc:1275] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.420399 26253 tablet_bootstrap.cc:492] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:57.421476 26253 tablet_bootstrap.cc:492] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:57.422195 26253 ts_tablet_manager.cc:1403] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.163s	user 0.043s	sys 0.052s
I20260709 13:20:57.424821 26253 raft_consensus.cc:359] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:57.425511 26253 raft_consensus.cc:740] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:57.426254 26253 consensus_queue.cc:260] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:57.428603 26253 ts_tablet_manager.cc:1434] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:57.429525 26253 tablet_bootstrap.cc:492] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:57.441046 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:57.441875 25683 raft_consensus.cc:2393] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 812474b88dc54c39bc37428d77dcb7a9 in current term 2: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
I20260709 13:20:57.443442 26247 leader_election.cc:304] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:57.445423 26256 raft_consensus.cc:3060] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:57.451617 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:57.457226 26247 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:57.458792 26256 raft_consensus.cc:2749] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:57.459820 26256 raft_consensus.cc:2749] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:57.468719 26269 consensus_queue.cc:1048] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:20:57.499572 25499 consensus_peers.cc:597] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:57.525820 25533 raft_consensus.cc:1275] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:20:57.550670 25573 consensus_peers.cc:597] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.558876 25533 raft_consensus.cc:1275] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.565371 25536 raft_consensus.cc:1275] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.569311 26346 raft_consensus.cc:493] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.569904 26346 raft_consensus.cc:515] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:57.572189 26346 leader_election.cc:290] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:57.574000 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:57.577358 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:57.581102 26247 leader_election.cc:304] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:57.582198 26346 raft_consensus.cc:2749] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:57.586689 26285 consensus_queue.cc:1048] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.587703 26307 consensus_queue.cc:1048] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:20:57.589804 25647 consensus_peers.cc:597] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:57.590298 25647 consensus_peers.cc:597] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.590925 25647 consensus_peers.cc:597] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.604432 26253 tablet_bootstrap.cc:492] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:57.605206 25608 raft_consensus.cc:1275] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.606587 26214 consensus_queue.cc:1048] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.606920 26253 tablet_bootstrap.cc:492] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:57.607738 26253 ts_tablet_manager.cc:1403] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.178s	user 0.068s	sys 0.051s
W20260709 13:20:57.613306 25573 consensus_peers.cc:597] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.614696 25573 consensus_peers.cc:597] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:57.612144 26253 raft_consensus.cc:359] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:57.616371 26253 raft_consensus.cc:740] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:57.617290 26253 consensus_queue.cc:260] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:57.620271 26253 ts_tablet_manager.cc:1434] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:20:57.621044 26253 tablet_bootstrap.cc:492] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:57.629561 26346 raft_consensus.cc:493] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.630146 26346 raft_consensus.cc:515] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:57.632238 26346 leader_election.cc:290] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
W20260709 13:20:57.633716 25647 consensus_peers.cc:597] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.634109 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:57.634284 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:57.637279 25678 raft_consensus.cc:1275] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.637395 26247 leader_election.cc:304] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:57.638692 26346 raft_consensus.cc:2749] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:57.644115 25499 consensus_peers.cc:597] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:57.645550 25499 consensus_peers.cc:597] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:57.653649 26360 consensus_queue.cc:1048] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 13:20:57.678105 25499 consensus_peers.cc:597] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.717568 26346 raft_consensus.cc:493] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.718331 26346 raft_consensus.cc:515] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:20:57.719430 25647 consensus_peers.cc:597] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.720350 26253 tablet_bootstrap.cc:492] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:57.721064 26346 leader_election.cc:290] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:57.721314 26253 tablet_bootstrap.cc:492] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:57.722150 26253 ts_tablet_manager.cc:1403] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.101s	user 0.029s	sys 0.039s
I20260709 13:20:57.722229 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:57.723152 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:57.724550 26253 raft_consensus.cc:359] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:57.725086 26253 raft_consensus.cc:740] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:57.724874 26247 leader_election.cc:304] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:57.725770 26253 consensus_queue.cc:260] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:57.726588 26346 raft_consensus.cc:2749] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:57.729631 26253 ts_tablet_manager.cc:1434] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:57.731256 26253 tablet_bootstrap.cc:492] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:57.735857 26346 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.736548 26346 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:20:57.738080 25573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:44609, user_credentials={real_user=slave}} blocked reactor thread for 57849.9us
I20260709 13:20:57.738981 26366 consensus_queue.cc:1048] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.739880 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:57.740161 26346 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:57.741904 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:57.743465 26247 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:57.745402 26346 raft_consensus.cc:2749] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:57.777119 25499 consensus_peers.cc:597] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.780637 25533 raft_consensus.cc:1275] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.783943 26307 consensus_queue.cc:1048] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:57.796602 25647 consensus_peers.cc:597] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.797204 25499 consensus_peers.cc:597] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.806542 26253 tablet_bootstrap.cc:492] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:57.807693 26253 tablet_bootstrap.cc:492] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:57.808809 26253 ts_tablet_manager.cc:1403] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.017s
I20260709 13:20:57.811877 26253 raft_consensus.cc:359] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:57.812620 26253 raft_consensus.cc:740] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:57.815598 26253 consensus_queue.cc:260] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:57.817718 26253 ts_tablet_manager.cc:1434] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
W20260709 13:20:57.804538 25499 consensus_peers.cc:597] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.818570 26253 tablet_bootstrap.cc:492] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
W20260709 13:20:57.834108 25499 consensus_peers.cc:597] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.847669 26346 raft_consensus.cc:493] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.848290 26346 raft_consensus.cc:515] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:20:57.850703 25573 consensus_peers.cc:597] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:57.851291 25573 consensus_peers.cc:597] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.855659 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfde4ba996435bb05645af25e1f2c7" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:57.858510 26256 raft_consensus.cc:493] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.859041 26256 raft_consensus.cc:515] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:57.861172 26256 leader_election.cc:290] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:57.869540 26346 leader_election.cc:290] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:20:57.870945 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfde4ba996435bb05645af25e1f2c7" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:57.871762 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:57.872453 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:57.873487 26247 leader_election.cc:304] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:57.877169 26346 raft_consensus.cc:2749] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:57.877303 26247 leader_election.cc:304] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:57.878628 26346 raft_consensus.cc:2749] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:57.883329 25647 consensus_peers.cc:597] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:57.887789 25573 consensus_peers.cc:597] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:57.888331 25573 consensus_peers.cc:597] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.890339 26346 raft_consensus.cc:493] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.890861 26346 raft_consensus.cc:515] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:20:57.895656 25573 consensus_peers.cc:597] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.905155 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4b9518dd674972b99e9595c9b1c686" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:57.907457 26346 leader_election.cc:290] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:57.911162 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4b9518dd674972b99e9595c9b1c686" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:57.915454 26247 leader_election.cc:304] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:57.917629 26346 raft_consensus.cc:2749] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:57.932992 25573 consensus_peers.cc:597] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.936148 26253 tablet_bootstrap.cc:492] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:20:57.936625 25573 consensus_peers.cc:597] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.937018 26253 tablet_bootstrap.cc:492] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:57.937695 26253 ts_tablet_manager.cc:1403] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.119s	user 0.006s	sys 0.007s
W20260709 13:20:57.938019 25647 consensus_peers.cc:597] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:57.940908 26253 raft_consensus.cc:359] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:57.941675 26253 raft_consensus.cc:740] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:57.942538 26253 consensus_queue.cc:260] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:57.944876 26253 ts_tablet_manager.cc:1434] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:57.945719 26253 tablet_bootstrap.cc:492] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:57.954993 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.1:45089
I20260709 13:20:57.955163 26396 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.1:45089 every 8 connection(s)
I20260709 13:20:57.960359 26253 tablet_bootstrap.cc:492] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:57.961401 26253 tablet_bootstrap.cc:492] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:57.962080 26253 ts_tablet_manager.cc:1403] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:20:57.964371 26253 raft_consensus.cc:359] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:57.965011 26253 raft_consensus.cc:740] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:57.965845 26253 consensus_queue.cc:260] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:57.967788 26253 ts_tablet_manager.cc:1434] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:20:57.968468 26253 tablet_bootstrap.cc:492] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:57.970893 26346 raft_consensus.cc:493] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.971426 26346 raft_consensus.cc:515] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:57.973171 26346 leader_election.cc:290] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:20:57.976291 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5001675947e47d284c3bc4729cf9fd9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:20:57.976691 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5001675947e47d284c3bc4729cf9fd9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:57.983166 26248 leader_election.cc:304] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:20:57.984465 26346 raft_consensus.cc:2749] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:57.991425 26346 raft_consensus.cc:493] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.992591 26346 raft_consensus.cc:515] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:57.994812 26346 leader_election.cc:290] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:57.996001 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc39a93c665a491a81bb0925b35ccf33" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:20:57.996568 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc39a93c665a491a81bb0925b35ccf33" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:57.999030 26247 leader_election.cc:304] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:20:58.000386 26346 raft_consensus.cc:2749] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:58.001195 25499 consensus_peers.cc:597] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.005564 25647 consensus_peers.cc:597] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:58.010906 26398 heartbeater.cc:344] Connected to a master server at 127.16.211.62:42373
I20260709 13:20:58.011325 26398 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:58.012194 26398 heartbeater.cc:507] Master 127.16.211.62:42373 requested a full tablet report, sending...
I20260709 13:20:58.013556 26253 tablet_bootstrap.cc:492] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.014616 26253 tablet_bootstrap.cc:492] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.015280 26253 ts_tablet_manager.cc:1403] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.007s
I20260709 13:20:58.018050 26253 raft_consensus.cc:359] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:58.018762 26253 raft_consensus.cc:740] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.019490 26253 consensus_queue.cc:260] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:58.021457 26253 ts_tablet_manager.cc:1434] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:58.022568 26253 tablet_bootstrap.cc:492] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.036846 25357 ts_manager.cc:194] Re-registered known tserver with Master: 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:20:58.040205 26253 tablet_bootstrap.cc:492] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.041339 26253 tablet_bootstrap.cc:492] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.042129 26253 ts_tablet_manager.cc:1403] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.002s
I20260709 13:20:58.044705 26253 raft_consensus.cc:359] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:58.045250 26253 raft_consensus.cc:740] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.045877 26253 consensus_queue.cc:260] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:58.048174 26253 ts_tablet_manager.cc:1434] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:58.048959 26253 tablet_bootstrap.cc:492] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.064155 26253 tablet_bootstrap.cc:492] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.065106 26253 tablet_bootstrap.cc:492] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.065038 26357 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:58.066013 26253 ts_tablet_manager.cc:1403] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.004s
I20260709 13:20:58.068683 26253 raft_consensus.cc:359] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:58.069331 26253 raft_consensus.cc:740] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.070058 26253 consensus_queue.cc:260] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:58.072372 26253 ts_tablet_manager.cc:1434] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:58.073164 26253 tablet_bootstrap.cc:492] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.103025 25357 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33314
I20260709 13:20:58.108777 26398 heartbeater.cc:499] Master 127.16.211.62:42373 was elected leader, sending a full tablet report...
I20260709 13:20:58.122419 26253 tablet_bootstrap.cc:492] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.123432 26253 tablet_bootstrap.cc:492] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.124095 26253 ts_tablet_manager.cc:1403] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.007s
I20260709 13:20:58.126644 26253 raft_consensus.cc:359] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:58.127292 26253 raft_consensus.cc:740] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.128091 26253 consensus_queue.cc:260] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:58.130362 26253 ts_tablet_manager.cc:1434] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:20:58.131232 26253 tablet_bootstrap.cc:492] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.146384 26253 tablet_bootstrap.cc:492] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.147301 26253 tablet_bootstrap.cc:492] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.147976 26253 ts_tablet_manager.cc:1403] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:20:58.150542 26253 raft_consensus.cc:359] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:58.151209 26253 raft_consensus.cc:740] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.152355 26253 consensus_queue.cc:260] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:58.153884 26253 ts_tablet_manager.cc:1434] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:58.154587 26253 tablet_bootstrap.cc:492] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.171453 26253 tablet_bootstrap.cc:492] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.172384 26253 tablet_bootstrap.cc:492] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.172991 26253 ts_tablet_manager.cc:1403] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:20:58.174801 26253 raft_consensus.cc:359] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:58.175323 26253 raft_consensus.cc:740] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.176000 26253 consensus_queue.cc:260] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:58.178007 26253 ts_tablet_manager.cc:1434] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:20:58.178792 26253 tablet_bootstrap.cc:492] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.192688 26253 tablet_bootstrap.cc:492] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.193629 26253 tablet_bootstrap.cc:492] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.194303 26253 ts_tablet_manager.cc:1403] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:20:58.196405 26253 raft_consensus.cc:359] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:58.196951 26253 raft_consensus.cc:740] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.197566 26253 consensus_queue.cc:260] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:58.199600 26253 ts_tablet_manager.cc:1434] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:58.200371 26253 tablet_bootstrap.cc:492] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.207831 26358 raft_consensus.cc:3060] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:58.208889 26357 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:58.219481 26253 tablet_bootstrap.cc:492] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.220312 26253 tablet_bootstrap.cc:492] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.220995 26253 ts_tablet_manager.cc:1403] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.001s
I20260709 13:20:58.223582 26253 raft_consensus.cc:359] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:58.224144 26253 raft_consensus.cc:740] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
W20260709 13:20:58.224601 25573 consensus_peers.cc:597] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:58.224783 26253 consensus_queue.cc:260] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:58.226992 26253 ts_tablet_manager.cc:1434] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:58.227759 26253 tablet_bootstrap.cc:492] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.244946 26253 tablet_bootstrap.cc:492] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.245891 26253 tablet_bootstrap.cc:492] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.246721 26253 ts_tablet_manager.cc:1403] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.006s
I20260709 13:20:58.249013 26253 raft_consensus.cc:359] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:58.249601 26253 raft_consensus.cc:740] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.250254 26253 consensus_queue.cc:260] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:58.251410 26253 ts_tablet_manager.cc:1434] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:20:58.252025 26253 tablet_bootstrap.cc:492] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.266144 26253 tablet_bootstrap.cc:492] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.267059 26253 tablet_bootstrap.cc:492] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.267724 26253 ts_tablet_manager.cc:1403] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:20:58.269198 26366 raft_consensus.cc:493] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.269754 26366 raft_consensus.cc:515] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:58.270287 26253 raft_consensus.cc:359] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:58.270994 26253 raft_consensus.cc:740] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.271664 26253 consensus_queue.cc:260] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:58.272169 26366 leader_election.cc:290] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:58.273003 26358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:20:58.273346 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:20:58.273850 26253 ts_tablet_manager.cc:1434] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:58.273675 26358 raft_consensus.cc:2468] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 1.
I20260709 13:20:58.274017 25536 raft_consensus.cc:2468] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:20:58.274714 26253 tablet_bootstrap.cc:492] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.275075 25573 leader_election.cc:304] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:20:58.276369 26366 raft_consensus.cc:2804] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:58.276753 26366 raft_consensus.cc:493] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.277089 26366 raft_consensus.cc:3060] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:58.287569 26366 raft_consensus.cc:515] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:58.289769 26366 leader_election.cc:290] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:20:58.291795 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:20:58.292371 25536 raft_consensus.cc:3060] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:58.292645 26358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
I20260709 13:20:58.293322 26358 raft_consensus.cc:3060] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:20:58.293710 26253 tablet_bootstrap.cc:492] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.294759 26253 tablet_bootstrap.cc:492] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.295439 26253 ts_tablet_manager.cc:1403] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.001s
I20260709 13:20:58.298206 26253 raft_consensus.cc:359] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:58.298558 25536 raft_consensus.cc:2468] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:20:58.298928 26253 raft_consensus.cc:740] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.299873 26253 consensus_queue.cc:260] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:58.301254 25573 leader_election.cc:304] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:20:58.302430 26367 raft_consensus.cc:2804] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:58.302649 26253 ts_tablet_manager.cc:1434] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:20:58.303020 26367 raft_consensus.cc:697] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:20:58.304242 26367 consensus_queue.cc:237] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:58.305877 26253 tablet_bootstrap.cc:492] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.310957 26358 raft_consensus.cc:2468] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:20:58.319664 25358 catalog_manager.cc:5697] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 1 to 3, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 3 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:58.322723 26253 tablet_bootstrap.cc:492] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.324568 26253 tablet_bootstrap.cc:492] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.325248 26253 ts_tablet_manager.cc:1403] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 13:20:58.329584 26253 raft_consensus.cc:359] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:58.330166 26253 raft_consensus.cc:740] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.330844 26253 consensus_queue.cc:260] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:58.332841 26253 ts_tablet_manager.cc:1434] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:20:58.333655 26253 tablet_bootstrap.cc:492] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.349548 26253 tablet_bootstrap.cc:492] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.350298 26253 tablet_bootstrap.cc:492] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.350872 26253 ts_tablet_manager.cc:1403] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:20:58.352473 26253 raft_consensus.cc:359] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:58.352926 26253 raft_consensus.cc:740] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.353498 26253 consensus_queue.cc:260] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:58.355484 26253 ts_tablet_manager.cc:1434] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:58.356820 26253 tablet_bootstrap.cc:492] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.358907 26358 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:58.390251 26357 raft_consensus.cc:3060] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:58.444334 26253 tablet_bootstrap.cc:492] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.450058 26253 tablet_bootstrap.cc:492] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.456974 26253 ts_tablet_manager.cc:1403] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.100s	user 0.036s	sys 0.028s
I20260709 13:20:58.462088 26253 raft_consensus.cc:359] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:58.462831 26253 raft_consensus.cc:740] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.463538 26253 consensus_queue.cc:260] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:58.476466 26253 ts_tablet_manager.cc:1434] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:20:58.477283 26355 raft_consensus.cc:3060] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:58.521986 25648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:40853, user_credentials={real_user=slave}} blocked reactor thread for 96214.6us
W20260709 13:20:58.522837 25500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:40853, user_credentials={real_user=slave}} blocked reactor thread for 66639.1us
I20260709 13:20:58.550284 26253 tablet_bootstrap.cc:492] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
W20260709 13:20:58.671298 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 91907.6us
I20260709 13:20:58.727289 26354 raft_consensus.cc:3060] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:58.807590 25536 raft_consensus.cc:1275] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:58.807932 26253 tablet_bootstrap.cc:492] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.809140 26253 tablet_bootstrap.cc:492] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:58.817359 26253 ts_tablet_manager.cc:1403] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.270s	user 0.028s	sys 0.026s
I20260709 13:20:58.821091 26356 raft_consensus.cc:1275] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:58.858003 26367 consensus_queue.cc:1048] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:58.865104 26253 raft_consensus.cc:359] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:58.866027 26253 raft_consensus.cc:740] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:58.866772 26253 consensus_queue.cc:260] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:58.871009 26366 consensus_queue.cc:1048] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:58.874783 26355 raft_consensus.cc:3060] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:58.899065 26253 ts_tablet_manager.cc:1434] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:20:58.900260 26253 tablet_bootstrap.cc:492] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:58.991014 26253 tablet_bootstrap.cc:492] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:59.009418 26253 tablet_bootstrap.cc:492] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:59.010129 26253 ts_tablet_manager.cc:1403] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.110s	user 0.014s	sys 0.009s
I20260709 13:20:59.012893 26253 raft_consensus.cc:359] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:59.013511 26253 raft_consensus.cc:740] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:59.014164 26253 consensus_queue.cc:260] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:59.016911 26253 ts_tablet_manager.cc:1434] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:20:59.017838 26253 tablet_bootstrap.cc:492] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:59.053354 26253 tablet_bootstrap.cc:492] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:59.054423 26253 tablet_bootstrap.cc:492] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:59.055107 26253 ts_tablet_manager.cc:1403] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.016s
I20260709 13:20:59.057749 26253 raft_consensus.cc:359] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:59.058429 26253 raft_consensus.cc:740] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:59.059031 26253 consensus_queue.cc:260] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:59.061501 26253 ts_tablet_manager.cc:1434] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:20:59.062381 26253 tablet_bootstrap.cc:492] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:59.080515 26253 tablet_bootstrap.cc:492] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:59.081413 26253 tablet_bootstrap.cc:492] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:59.082044 26253 ts_tablet_manager.cc:1403] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:20:59.083943 26253 raft_consensus.cc:359] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:59.084481 26253 raft_consensus.cc:740] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:59.085018 26253 consensus_queue.cc:260] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:59.087438 26253 ts_tablet_manager.cc:1434] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:59.088948 26253 tablet_bootstrap.cc:492] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:59.104074 26253 tablet_bootstrap.cc:492] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:59.105566 26253 tablet_bootstrap.cc:492] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:59.106149 26253 ts_tablet_manager.cc:1403] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 13:20:59.108546 26253 raft_consensus.cc:359] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:59.109238 26253 raft_consensus.cc:740] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:59.109956 26253 consensus_queue.cc:260] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:59.112145 26253 ts_tablet_manager.cc:1434] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:59.113214 26253 tablet_bootstrap.cc:492] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:59.128741 26356 raft_consensus.cc:3060] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.130220 26253 tablet_bootstrap.cc:492] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:59.131520 26253 tablet_bootstrap.cc:492] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:59.132232 26253 ts_tablet_manager.cc:1403] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.002s
I20260709 13:20:59.134963 26253 raft_consensus.cc:359] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:59.135663 26253 raft_consensus.cc:740] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:59.136330 26253 consensus_queue.cc:260] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:59.138506 26253 ts_tablet_manager.cc:1434] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:20:59.139374 26253 tablet_bootstrap.cc:492] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:59.159538 26253 tablet_bootstrap.cc:492] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:59.160526 26253 tablet_bootstrap.cc:492] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:59.161419 26253 ts_tablet_manager.cc:1403] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:20:59.164052 26253 raft_consensus.cc:359] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:59.164731 26253 raft_consensus.cc:740] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:59.165433 26253 consensus_queue.cc:260] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:59.167680 26253 ts_tablet_manager.cc:1434] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:59.168970 26253 tablet_bootstrap.cc:492] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:59.206648 26253 tablet_bootstrap.cc:492] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:59.207674 26253 tablet_bootstrap.cc:492] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:59.209394 26253 ts_tablet_manager.cc:1403] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.041s	user 0.023s	sys 0.001s
I20260709 13:20:59.212881 26253 raft_consensus.cc:359] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:59.213557 26253 raft_consensus.cc:740] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:59.215808 26253 consensus_queue.cc:260] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:59.217371 26253 ts_tablet_manager.cc:1434] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.004s
I20260709 13:20:59.218192 26253 tablet_bootstrap.cc:492] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:59.227432 26355 raft_consensus.cc:3060] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.230548 26354 raft_consensus.cc:3060] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.257300 26358 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.290485 26253 tablet_bootstrap.cc:492] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:59.291725 26253 tablet_bootstrap.cc:492] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:59.292593 26253 ts_tablet_manager.cc:1403] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.033s
I20260709 13:20:59.301733 26253 raft_consensus.cc:359] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:59.302726 26253 raft_consensus.cc:740] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:59.303603 26253 consensus_queue.cc:260] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:20:59.306694 26253 ts_tablet_manager.cc:1434] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:20:59.307695 26253 tablet_bootstrap.cc:492] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:59.323331 26253 tablet_bootstrap.cc:492] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:59.324242 26253 tablet_bootstrap.cc:492] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:59.324882 26253 ts_tablet_manager.cc:1403] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.002s
I20260709 13:20:59.327585 26253 raft_consensus.cc:359] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:59.328258 26253 raft_consensus.cc:740] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:59.328904 26253 consensus_queue.cc:260] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:20:59.331319 26253 ts_tablet_manager.cc:1434] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:59.332192 26253 tablet_bootstrap.cc:492] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap starting.
I20260709 13:20:59.348533 26253 tablet_bootstrap.cc:492] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:59.349442 26253 tablet_bootstrap.cc:492] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9: Bootstrap complete.
I20260709 13:20:59.350106 26253 ts_tablet_manager.cc:1403] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 13:20:59.352404 26253 raft_consensus.cc:359] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:59.353019 26253 raft_consensus.cc:740] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Initialized, Role: FOLLOWER
I20260709 13:20:59.353627 26253 consensus_queue.cc:260] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:20:59.355567 26253 ts_tablet_manager.cc:1434] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:59.519374 26358 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.669512 26358 raft_consensus.cc:3060] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:07.980065 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:08.032462 25609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562"
dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:21:08.033053 25609 raft_consensus.cc:606] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:08.035473 25609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4"
dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:21:08.035959 25609 raft_consensus.cc:606] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:08.038517 25609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e"
dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:21:08.039103 25609 raft_consensus.cc:606] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:08.041599 25609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3"
dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
mode: GRACEFUL
new_leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:21:08.042099 25609 raft_consensus.cc:606] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Received request to transfer leadership to TS ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:08.056152 25678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6"
dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
mode: GRACEFUL
new_leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
 from {username='slave'} at 127.0.0.1:54326
I20260709 13:21:08.056727 25678 raft_consensus.cc:606] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Received request to transfer leadership to TS ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:08.059610 25609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8168790b26f4632b04441b2780e479a"
dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
mode: GRACEFUL
new_leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:21:08.060209 25609 raft_consensus.cc:606] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Received request to transfer leadership to TS ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:08.061558 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:21:08.063382 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:08.083056 26486 raft_consensus.cc:993] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba: : Instructing follower ae560ddb7e6849f69d0c5f47075d3bf9 to start an election
I20260709 13:21:08.083715 26481 raft_consensus.cc:1081] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Signalling peer ae560ddb7e6849f69d0c5f47075d3bf9 to start an election
I20260709 13:21:08.085685 25534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8168790b26f4632b04441b2780e479a"
dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
 from {username='slave'} at 127.0.0.1:32834
I20260709 13:21:08.086261 25534 raft_consensus.cc:493] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:08.086656 25534 raft_consensus.cc:3060] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.092365 25534 raft_consensus.cc:515] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:08.095646 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8168790b26f4632b04441b2780e479a" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:08.096290 25534 leader_election.cc:290] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:08.096360 25609 raft_consensus.cc:3055] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:08.096942 25609 raft_consensus.cc:740] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:08.097470 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8168790b26f4632b04441b2780e479a" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:08.098006 25678 raft_consensus.cc:3060] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.097797 25609 consensus_queue.cc:260] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:08.099059 25609 raft_consensus.cc:3060] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.103276 25678 raft_consensus.cc:2468] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:08.104610 25499 leader_election.cc:304] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:08.105545 25609 raft_consensus.cc:2468] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:08.105589 26485 raft_consensus.cc:2804] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:08.106333 26485 raft_consensus.cc:697] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:08.107517 26485 consensus_queue.cc:237] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:08.118098 25355 catalog_manager.cc:5697] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 1 to 2, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.244661 26481 raft_consensus.cc:993] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:08.245234 26481 raft_consensus.cc:1081] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:08.246778 26358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42758
I20260709 13:21:08.247210 26358 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:08.247476 26358 raft_consensus.cc:3060] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:08.251766 26358 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:08.253564 26358 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:08.254926 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:08.255542 25534 raft_consensus.cc:3060] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:08.254858 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:08.256527 25609 raft_consensus.cc:3055] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:08.256938 25609 raft_consensus.cc:740] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:08.257782 25609 consensus_queue.cc:260] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:08.259121 25609 raft_consensus.cc:3060] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:08.262290 25534 raft_consensus.cc:2468] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:08.263626 26247 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:08.265322 26495 raft_consensus.cc:2804] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:08.265618 25609 raft_consensus.cc:2468] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:08.266956 26495 raft_consensus.cc:697] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:08.267910 26495 consensus_queue.cc:237] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:08.279098 25355 catalog_manager.cc:5697] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 2 to 3, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.284746 26481 raft_consensus.cc:993] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba: : Instructing follower ae560ddb7e6849f69d0c5f47075d3bf9 to start an election
I20260709 13:21:08.285387 26486 raft_consensus.cc:1081] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Signalling peer ae560ddb7e6849f69d0c5f47075d3bf9 to start an election
I20260709 13:21:08.287029 25534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3"
dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
 from {username='slave'} at 127.0.0.1:32834
I20260709 13:21:08.287494 25534 raft_consensus.cc:493] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:08.287786 25534 raft_consensus.cc:3060] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.293887 25534 raft_consensus.cc:515] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:08.296417 25534 leader_election.cc:290] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:08.296463 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:08.296892 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:08.302826 25609 raft_consensus.cc:3055] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:08.302909 25678 raft_consensus.cc:3060] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.303148 25609 raft_consensus.cc:740] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:08.303961 25609 consensus_queue.cc:260] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:08.305078 25609 raft_consensus.cc:3060] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.310779 25609 raft_consensus.cc:2468] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:08.311342 25678 raft_consensus.cc:2468] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:08.311780 25500 leader_election.cc:304] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:08.312580 26470 raft_consensus.cc:2804] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:08.313041 26470 raft_consensus.cc:697] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:08.313980 26470 consensus_queue.cc:237] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:08.328955 25355 catalog_manager.cc:5697] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 1 to 2, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.341681 26486 raft_consensus.cc:993] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:08.342217 26481 raft_consensus.cc:1081] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:08.343629 26358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42758
I20260709 13:21:08.344103 26358 raft_consensus.cc:493] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:08.344391 26358 raft_consensus.cc:3060] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.349077 26358 raft_consensus.cc:515] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:08.350613 26358 leader_election.cc:290] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:08.351451 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:08.351641 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:08.352046 25534 raft_consensus.cc:3060] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.352293 25609 raft_consensus.cc:3055] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:08.352766 25609 raft_consensus.cc:740] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:08.353551 25609 consensus_queue.cc:260] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:08.354822 25609 raft_consensus.cc:3060] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.359212 25534 raft_consensus.cc:2468] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:08.360616 26247 leader_election.cc:304] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:08.361541 26495 raft_consensus.cc:2804] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:08.361840 25609 raft_consensus.cc:2468] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:08.362100 26495 raft_consensus.cc:697] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:08.363073 26495 consensus_queue.cc:237] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:08.371340 25355 catalog_manager.cc:5697] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 1 to 2, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.426169 26481 raft_consensus.cc:993] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:08.426772 26486 raft_consensus.cc:1081] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:08.428295 26358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42758
I20260709 13:21:08.428864 26358 raft_consensus.cc:493] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:08.429136 26358 raft_consensus.cc:3060] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.433861 26358 raft_consensus.cc:515] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:08.435608 26358 leader_election.cc:290] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:08.436432 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:08.436607 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:08.437029 25609 raft_consensus.cc:3055] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:08.437206 25678 raft_consensus.cc:3060] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.437397 25609 raft_consensus.cc:740] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:08.438390 25609 consensus_queue.cc:260] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:08.439407 25609 raft_consensus.cc:3060] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.442396 25678 raft_consensus.cc:2468] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:08.443514 26247 leader_election.cc:304] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:08.444391 26495 raft_consensus.cc:2804] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:08.444845 26495 raft_consensus.cc:697] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:08.445637 26495 consensus_queue.cc:237] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:08.446249 25609 raft_consensus.cc:2468] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:08.457886 25355 catalog_manager.cc:5697] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 1 to 2, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:08.465667 26469 raft_consensus.cc:993] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68: : Instructing follower ae560ddb7e6849f69d0c5f47075d3bf9 to start an election
I20260709 13:21:08.466243 26483 raft_consensus.cc:1081] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Signalling peer ae560ddb7e6849f69d0c5f47075d3bf9 to start an election
I20260709 13:21:08.467805 25534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6"
dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
 from {username='slave'} at 127.0.0.1:32832
I20260709 13:21:08.468441 25534 raft_consensus.cc:493] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:08.468806 25534 raft_consensus.cc:3060] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.475617 25534 raft_consensus.cc:515] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:08.477209 25534 leader_election.cc:290] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:08.478940 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:08.478762 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:08.479565 25609 raft_consensus.cc:3060] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.479696 25683 raft_consensus.cc:3055] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:08.480121 25683 raft_consensus.cc:740] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:08.480933 25683 consensus_queue.cc:260] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:08.482438 25683 raft_consensus.cc:3060] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:08.487610 25609 raft_consensus.cc:2468] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:08.488940 25500 leader_election.cc:304] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:08.489641 26470 raft_consensus.cc:2804] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:08.489970 25683 raft_consensus.cc:2468] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:08.490089 26470 raft_consensus.cc:697] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:08.491127 26470 consensus_queue.cc:237] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:08.502586 25355 catalog_manager.cc:5697] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 1 to 2, leader changed from f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.658335 25678 raft_consensus.cc:1275] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:08.662669 26509 consensus_queue.cc:1048] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:08.672245 25609 raft_consensus.cc:1275] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:08.675311 26470 consensus_queue.cc:1048] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:08.769016 25609 raft_consensus.cc:1275] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:08.774345 25533 raft_consensus.cc:1275] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:08.780051 25606 raft_consensus.cc:1275] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:08.782469 26495 consensus_queue.cc:1048] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:08.788599 26514 consensus_queue.cc:1048] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:08.794772 26495 consensus_queue.cc:1048] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:08.814616 25606 raft_consensus.cc:1275] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:08.817885 26495 consensus_queue.cc:1048] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:08.837122 25683 raft_consensus.cc:1275] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:08.845726 26514 consensus_queue.cc:1048] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:08.896560 25678 raft_consensus.cc:1275] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:08.899267 26496 consensus_queue.cc:1048] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:08.919006 25533 raft_consensus.cc:1275] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:08.931871 25678 raft_consensus.cc:1275] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:08.934454 26470 consensus_queue.cc:1048] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:21:08.960384 26248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:40853, user_credentials={real_user=slave}} blocked reactor thread for 49672.7us
I20260709 13:21:08.965046 26523 consensus_queue.cc:1048] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:21:09.001473 25606 raft_consensus.cc:1275] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:09.009188 25606 raft_consensus.cc:1275] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:09.010246 26514 consensus_queue.cc:1048] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:09.035487 26526 consensus_queue.cc:1048] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:09.064824 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:09.145538 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:09.191869 25681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16f2f69975c44dceb5130378505518a2"
dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:54326
I20260709 13:21:09.192528 25681 raft_consensus.cc:606] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:09.195158 25681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee"
dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
mode: GRACEFUL
new_leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
 from {username='slave'} at 127.0.0.1:54326
I20260709 13:21:09.195642 25681 raft_consensus.cc:606] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Received request to transfer leadership to TS 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:09.198125 25608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93"
dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:21:09.198586 25608 raft_consensus.cc:606] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:09.203054 25608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d"
dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:21:09.203703 25608 raft_consensus.cc:606] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:09.220613 25534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c"
dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:35220
I20260709 13:21:09.221233 25534 raft_consensus.cc:606] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:09.222623 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:09.224174 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:09.261116 26506 raft_consensus.cc:993] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:09.261781 26507 raft_consensus.cc:1081] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:09.263846 26358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16f2f69975c44dceb5130378505518a2"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42756
I20260709 13:21:09.264622 26358 raft_consensus.cc:493] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:09.265177 26358 raft_consensus.cc:3060] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:09.271056 26358 raft_consensus.cc:515] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:09.272594 26358 leader_election.cc:290] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:09.273658 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:09.273778 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:09.274427 25681 raft_consensus.cc:3055] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:09.274493 25534 raft_consensus.cc:3060] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:09.274739 25681 raft_consensus.cc:740] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:09.275830 25681 consensus_queue.cc:260] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:09.277146 25681 raft_consensus.cc:3060] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:09.280725 25534 raft_consensus.cc:2468] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:09.282266 26247 leader_election.cc:304] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:09.283178 26526 raft_consensus.cc:2804] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:09.283635 26526 raft_consensus.cc:697] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:09.284539 26526 consensus_queue.cc:237] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:09.285115 25681 raft_consensus.cc:2468] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:09.295466 25359 catalog_manager.cc:5697] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 1 to 2, leader changed from f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:09.441691 26500 raft_consensus.cc:993] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:09.442355 26531 raft_consensus.cc:1081] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:09.443885 26355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42758
I20260709 13:21:09.444454 26355 raft_consensus.cc:493] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:09.444814 26355 raft_consensus.cc:3060] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:09.451570 26355 raft_consensus.cc:515] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:09.453469 26355 leader_election.cc:290] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:09.454514 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:09.454552 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:09.455210 25608 raft_consensus.cc:3055] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:09.455328 25534 raft_consensus.cc:3060] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:09.455627 25608 raft_consensus.cc:740] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:09.456625 25608 consensus_queue.cc:260] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:09.457898 25608 raft_consensus.cc:3060] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:09.462361 25534 raft_consensus.cc:2468] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:09.462827 26500 raft_consensus.cc:993] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:09.463356 26500 raft_consensus.cc:1081] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:09.463568 26247 leader_election.cc:304] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:09.464599 26526 raft_consensus.cc:2804] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:09.464972 26355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42758
I20260709 13:21:09.465489 25608 raft_consensus.cc:2468] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:09.465066 26526 raft_consensus.cc:697] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:09.465896 26355 raft_consensus.cc:493] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:09.466415 26355 raft_consensus.cc:3060] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:09.466723 26526 consensus_queue.cc:237] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:09.476630 26355 raft_consensus.cc:515] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:09.479523 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:09.480238 25533 raft_consensus.cc:3060] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:09.486526 26355 leader_election.cc:290] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:09.487548 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:09.488154 25608 raft_consensus.cc:3055] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:09.488302 25533 raft_consensus.cc:2468] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:09.488747 25608 raft_consensus.cc:740] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:09.488063 25359 catalog_manager.cc:5697] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 1 to 2, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.489671 25608 consensus_queue.cc:260] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:09.489887 26247 leader_election.cc:304] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:09.490947 26526 raft_consensus.cc:2804] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:09.491058 25608 raft_consensus.cc:3060] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:09.491494 26526 raft_consensus.cc:697] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:09.492496 26526 consensus_queue.cc:237] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:09.501436 25608 raft_consensus.cc:2468] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:09.507491 25359 catalog_manager.cc:5697] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 1 to 2, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:09.598233 26507 raft_consensus.cc:993] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68: : Instructing follower 0a6b07f89a2c437ea29fb7c7e52440ba to start an election
I20260709 13:21:09.598767 26506 raft_consensus.cc:1081] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Signalling peer 0a6b07f89a2c437ea29fb7c7e52440ba to start an election
I20260709 13:21:09.601199 25608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee"
dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
 from {username='slave'} at 127.0.0.1:49246
I20260709 13:21:09.601733 25608 raft_consensus.cc:493] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:09.602131 25608 raft_consensus.cc:3060] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:09.608248 25608 raft_consensus.cc:515] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:09.610713 25608 leader_election.cc:290] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:09.611425 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:09.612077 25533 raft_consensus.cc:3060] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:09.616643 26514 raft_consensus.cc:993] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:09.617314 26485 raft_consensus.cc:1081] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:09.618847 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:09.619132 26358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42754
I20260709 13:21:09.619258 25533 raft_consensus.cc:2468] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:09.619517 25681 raft_consensus.cc:3055] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:09.619968 25681 raft_consensus.cc:740] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:09.620004 26358 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:09.620523 26358 raft_consensus.cc:3060] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:09.620762 25681 consensus_queue.cc:260] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:09.621268 25573 leader_election.cc:304] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:09.621803 25681 raft_consensus.cc:3060] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:09.622411 26481 raft_consensus.cc:2804] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:09.622900 26481 raft_consensus.cc:697] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:09.623687 26481 consensus_queue.cc:237] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:09.627542 26358 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:09.631063 25681 raft_consensus.cc:2468] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:09.634579 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:09.635246 25533 raft_consensus.cc:3055] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:09.635632 25533 raft_consensus.cc:740] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:09.636485 25533 consensus_queue.cc:260] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:09.642305 25533 raft_consensus.cc:3060] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:09.645597 25359 catalog_manager.cc:5697] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 1 to 2, leader changed from f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 2 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:09.647353 26358 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:09.647921 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:09.648536 25608 raft_consensus.cc:3060] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:09.651775 25533 raft_consensus.cc:2468] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:09.653085 26247 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:09.656143 26526 raft_consensus.cc:2804] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:09.656695 26526 raft_consensus.cc:697] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:09.657624 26526 consensus_queue.cc:237] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:09.658671 25608 raft_consensus.cc:2468] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:09.674969 25359 catalog_manager.cc:5697] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 2 to 3, leader changed from ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:09.713222 25534 raft_consensus.cc:1275] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:09.714789 26526 consensus_queue.cc:1048] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:09.738060 25683 raft_consensus.cc:1275] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:09.739405 26526 consensus_queue.cc:1048] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:09.883872 25534 raft_consensus.cc:1275] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:09.885210 26526 consensus_queue.cc:1048] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:09.895900 25608 raft_consensus.cc:1275] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:09.898164 26525 consensus_queue.cc:1048] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:10.017566 25534 raft_consensus.cc:1275] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:10.019160 26495 consensus_queue.cc:1048] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:10.025794 25608 raft_consensus.cc:1275] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:10.027770 26549 consensus_queue.cc:1048] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:10.088442 25534 raft_consensus.cc:1275] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:10.089818 26549 consensus_queue.cc:1048] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:10.115381 25608 raft_consensus.cc:1275] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:10.121079 26526 consensus_queue.cc:1048] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:10.193694 25681 raft_consensus.cc:1275] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:10.194931 26531 consensus_queue.cc:1048] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:10.206319 25533 raft_consensus.cc:1275] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:10.210614 26557 consensus_queue.cc:1048] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:10.226384 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:10.276279 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:10.311172 25681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2704c533ff304006941c451f2f6d4660"
dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:54326
I20260709 13:21:10.311913 25681 raft_consensus.cc:606] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:10.314879 25609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d"
dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:21:10.315379 25609 raft_consensus.cc:606] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:10.318042 25681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67"
dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
mode: GRACEFUL
new_leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
 from {username='slave'} at 127.0.0.1:54326
I20260709 13:21:10.318522 25681 raft_consensus.cc:606] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Received request to transfer leadership to TS 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:10.321491 25681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66"
dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:54326
I20260709 13:21:10.322111 25681 raft_consensus.cc:606] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:10.324659 25681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de2624a22f2144868a7c62051f58771b"
dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:54326
I20260709 13:21:10.325251 25681 raft_consensus.cc:606] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:10.327649 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:10.329005 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:10.497620 26547 raft_consensus.cc:993] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68: : Instructing follower 0a6b07f89a2c437ea29fb7c7e52440ba to start an election
I20260709 13:21:10.498175 26507 raft_consensus.cc:1081] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Signalling peer 0a6b07f89a2c437ea29fb7c7e52440ba to start an election
I20260709 13:21:10.499851 25608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67"
dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
 from {username='slave'} at 127.0.0.1:49246
I20260709 13:21:10.500391 25608 raft_consensus.cc:493] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:10.500748 25608 raft_consensus.cc:3060] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:10.505759 25608 raft_consensus.cc:515] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:10.507192 25608 leader_election.cc:290] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:10.507951 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:10.508123 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:10.508553 25534 raft_consensus.cc:3060] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:10.508687 25681 raft_consensus.cc:3055] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:10.509079 25681 raft_consensus.cc:740] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:10.509742 25681 consensus_queue.cc:260] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:10.510694 25681 raft_consensus.cc:3060] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:10.514405 25534 raft_consensus.cc:2468] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:10.517050 25681 raft_consensus.cc:2468] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:10.517158 25573 leader_election.cc:304] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:10.518046 26557 raft_consensus.cc:2804] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:10.518463 26557 raft_consensus.cc:697] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:10.519251 26557 consensus_queue.cc:237] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:10.528566 25357 catalog_manager.cc:5697] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 1 to 2, leader changed from f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 2 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.744910 26507 raft_consensus.cc:993] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:10.745433 26547 raft_consensus.cc:1081] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:10.747221 26358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de2624a22f2144868a7c62051f58771b"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42756
I20260709 13:21:10.747640 26358 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:10.748003 26358 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:10.753573 26358 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:10.755847 26358 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:10.756237 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:10.756891 25608 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:10.759944 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:10.760567 25683 raft_consensus.cc:3055] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:10.760872 25683 raft_consensus.cc:740] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:10.761639 25683 consensus_queue.cc:260] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:10.762894 25683 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:10.762885 25608 raft_consensus.cc:2468] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:10.764837 26248 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:21:10.765717 26495 raft_consensus.cc:2804] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:10.766233 26495 raft_consensus.cc:697] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:10.767172 26495 consensus_queue.cc:237] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:10.771661 25683 raft_consensus.cc:2468] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:10.774099 26507 raft_consensus.cc:993] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:10.774729 26507 raft_consensus.cc:1081] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:10.776324 26358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42756
I20260709 13:21:10.776912 26358 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:10.777361 26358 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:10.779857 25357 catalog_manager.cc:5697] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 2 to 3, leader changed from f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.784310 26358 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:10.786988 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:10.787621 25683 raft_consensus.cc:3055] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:10.787937 25683 raft_consensus.cc:740] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:10.786325 26358 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:10.788767 25683 consensus_queue.cc:260] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:10.790026 25683 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:10.791847 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:10.792524 25533 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:10.795580 25683 raft_consensus.cc:2468] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:10.796754 26247 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:10.797633 26495 raft_consensus.cc:2804] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:10.798143 26495 raft_consensus.cc:697] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:10.799372 25533 raft_consensus.cc:2468] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:10.799069 26495 consensus_queue.cc:237] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:10.809736 25357 catalog_manager.cc:5697] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 2 to 3, leader changed from f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.868285 26507 raft_consensus.cc:993] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:10.868745 26547 raft_consensus.cc:1081] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:10.870252 26358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2704c533ff304006941c451f2f6d4660"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42756
I20260709 13:21:10.870882 26358 raft_consensus.cc:493] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:10.871239 26358 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:10.877133 26358 raft_consensus.cc:515] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:10.878873 26358 leader_election.cc:290] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:10.880088 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:10.880209 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:10.880848 25533 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:10.880896 25683 raft_consensus.cc:3055] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:10.881350 25683 raft_consensus.cc:740] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:10.882112 25683 consensus_queue.cc:260] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:10.883098 25683 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:10.888497 25533 raft_consensus.cc:2468] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:10.889680 25683 raft_consensus.cc:2468] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:10.889704 26247 leader_election.cc:304] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:10.890833 26526 raft_consensus.cc:2804] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:10.891304 26526 raft_consensus.cc:697] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:10.892194 26526 consensus_queue.cc:237] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:10.903375 25357 catalog_manager.cc:5697] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 2 to 3, leader changed from f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.916855 25533 raft_consensus.cc:1275] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:10.919647 26557 consensus_queue.cc:1048] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:10.923420 26531 raft_consensus.cc:993] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:10.923936 26531 raft_consensus.cc:1081] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:10.926136 26355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42758
I20260709 13:21:10.926752 26355 raft_consensus.cc:493] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:10.927124 26355 raft_consensus.cc:3060] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:10.933390 26355 raft_consensus.cc:515] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:10.935827 26355 leader_election.cc:290] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:10.936827 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:10.937480 25608 raft_consensus.cc:3055] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:10.938818 25608 raft_consensus.cc:740] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:10.939175 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:10.939780 25683 raft_consensus.cc:3060] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:10.939699 25608 consensus_queue.cc:260] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:10.941280 25608 raft_consensus.cc:3060] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:10.947607 25683 raft_consensus.cc:2468] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:10.950084 26247 leader_election.cc:304] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:10.951498 25608 raft_consensus.cc:2468] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:10.955345 26526 raft_consensus.cc:2804] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:10.955752 25681 raft_consensus.cc:1275] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:10.956110 26526 raft_consensus.cc:697] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:10.957643 26526 consensus_queue.cc:237] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:10.957721 26531 consensus_queue.cc:1048] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:10.980963 25357 catalog_manager.cc:5697] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 1 to 2, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:11.156680 25608 raft_consensus.cc:1275] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:11.158138 26526 consensus_queue.cc:1048] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:11.192813 25681 raft_consensus.cc:1275] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:11.194252 26526 consensus_queue.cc:1048] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:11.247742 25681 raft_consensus.cc:1275] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:11.249563 26495 consensus_queue.cc:1048] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:11.259161 25534 raft_consensus.cc:1275] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:11.260639 26495 consensus_queue.cc:1048] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:11.330008 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:11.338904 25533 raft_consensus.cc:1275] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:11.341236 26525 consensus_queue.cc:1048] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:11.351224 25680 raft_consensus.cc:1275] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:11.352577 26526 consensus_queue.cc:1048] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:11.385962 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:11.425369 25680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6"
dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:54326
I20260709 13:21:11.426142 25680 raft_consensus.cc:606] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:11.428719 25609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079"
dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:60700
I20260709 13:21:11.429320 25609 raft_consensus.cc:606] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:11.432924 25680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe"
dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
mode: GRACEFUL
new_leader_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:54326
I20260709 13:21:11.433590 25680 raft_consensus.cc:606] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Received request to transfer leadership to TS 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:11.435223 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:11.439544 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:11.528731 25680 raft_consensus.cc:1275] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.529238 25608 raft_consensus.cc:1275] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.530277 26495 consensus_queue.cc:1048] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:11.531230 26526 consensus_queue.cc:1048] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:11.560596 26574 raft_consensus.cc:993] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:11.561146 26574 raft_consensus.cc:1081] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:11.562772 26358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42756
I20260709 13:21:11.563345 26358 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:11.563720 26358 raft_consensus.cc:3060] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.571172 26358 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:11.573837 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:11.574460 25681 raft_consensus.cc:3055] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:11.574513 26358 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:11.574806 25681 raft_consensus.cc:740] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:11.574990 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:11.575966 25533 raft_consensus.cc:3060] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.575713 25681 consensus_queue.cc:260] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:11.577587 25681 raft_consensus.cc:3060] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.584079 25533 raft_consensus.cc:2468] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:11.585376 26247 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:11.585896 25681 raft_consensus.cc:2468] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:11.586398 26576 raft_consensus.cc:2804] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:11.587126 26576 raft_consensus.cc:697] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:11.588083 26576 consensus_queue.cc:237] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:11.597537 25357 catalog_manager.cc:5697] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 1 to 2, leader changed from f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:11.622476 26547 raft_consensus.cc:993] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:11.622992 26547 raft_consensus.cc:1081] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:11.624661 26358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42756
I20260709 13:21:11.625202 26358 raft_consensus.cc:493] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:11.625538 26358 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:11.631929 26358 raft_consensus.cc:515] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:11.633735 26358 leader_election.cc:290] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:11.634701 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:11.635330 25681 raft_consensus.cc:3055] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:11.635614 25681 raft_consensus.cc:740] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:11.635890 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:11.636502 25534 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:11.636404 25681 consensus_queue.cc:260] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:11.637847 25681 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:11.642980 25534 raft_consensus.cc:2468] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:11.644116 26247 leader_election.cc:304] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:11.645211 26526 raft_consensus.cc:2804] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:11.645473 25681 raft_consensus.cc:2468] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:11.645643 26526 raft_consensus.cc:697] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:11.646663 26526 consensus_queue.cc:237] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:11.662568 25357 catalog_manager.cc:5697] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 2 to 3, leader changed from f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:11.688923 26531 raft_consensus.cc:993] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba: : Instructing follower 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:11.689461 26531 raft_consensus.cc:1081] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Signalling peer 812474b88dc54c39bc37428d77dcb7a9 to start an election
I20260709 13:21:11.691093 26354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079"
dest_uuid: "812474b88dc54c39bc37428d77dcb7a9"
 from {username='slave'} at 127.0.0.1:42758
I20260709 13:21:11.691596 26354 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:11.691906 26354 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:11.698098 26354 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:11.699901 26354 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:11.700618 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:11.701018 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:11.701313 25534 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:11.701829 25609 raft_consensus.cc:3055] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:11.702183 25609 raft_consensus.cc:740] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:11.703038 25609 consensus_queue.cc:260] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:11.704200 25609 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:11.708331 25534 raft_consensus.cc:2468] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:11.709641 26247 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:11.710669 26526 raft_consensus.cc:2804] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:11.711571 26526 raft_consensus.cc:697] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Becoming Leader. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:11.711901 25609 raft_consensus.cc:2468] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 3.
I20260709 13:21:11.712568 26526 consensus_queue.cc:237] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:11.721627 25357 catalog_manager.cc:5697] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 reported cstate change: term changed from 2 to 3, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1). New cstate: current_term: 3 leader_uuid: "812474b88dc54c39bc37428d77dcb7a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:12.015211 25534 raft_consensus.cc:1275] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:12.016667 26525 consensus_queue.cc:1048] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:12.036986 25681 raft_consensus.cc:1275] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:12.038586 26526 consensus_queue.cc:1048] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:12.062495 25534 raft_consensus.cc:1275] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:12.063817 26495 consensus_queue.cc:1048] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:12.077121 25680 raft_consensus.cc:1275] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:12.080075 26526 consensus_queue.cc:1048] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:12.121973 25609 raft_consensus.cc:1275] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:12.123435 26526 consensus_queue.cc:1048] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:12.139665 25533 raft_consensus.cc:1275] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Refusing update from remote peer 812474b88dc54c39bc37428d77dcb7a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:12.142084 26526 consensus_queue.cc:1048] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:13.327800 26600 raft_consensus.cc:493] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:13.328877 26600 raft_consensus.cc:515] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:13.332448 26600 leader_election.cc:290] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:13.333209 26600 raft_consensus.cc:493] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:13.467960 26599 raft_consensus.cc:493] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:13.679395 26600 raft_consensus.cc:515] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:13.679425 26599 raft_consensus.cc:515] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:13.682468 26600 leader_election.cc:290] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:13.541227 26602 raft_consensus.cc:493] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:13.746939 26602 raft_consensus.cc:515] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:13.749210 26606 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:13.628083 26603 raft_consensus.cc:493] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:13.639390 26598 raft_consensus.cc:493] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:13.749634 26602 leader_election.cc:290] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:13.682729 26599 leader_election.cc:290] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:13.750694 26599 raft_consensus.cc:493] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:13.495481 26601 raft_consensus.cc:493] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:13.751075 26606 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:13.751226 26599 raft_consensus.cc:515] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:13.751384 26601 raft_consensus.cc:515] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:13.711350 26604 raft_consensus.cc:493] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:13.754655 26604 raft_consensus.cc:515] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:13.752099 26602 raft_consensus.cc:493] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:13.755148 26606 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:13.755897 26606 raft_consensus.cc:493] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:13.756434 26606 raft_consensus.cc:515] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:13.754971 26599 leader_election.cc:290] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:13.756855 26604 leader_election.cc:290] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:13.755574 26602 raft_consensus.cc:515] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:13.750381 26598 raft_consensus.cc:515] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:13.753048 26600 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:13.752609 26603 raft_consensus.cc:515] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:13.749742 26605 raft_consensus.cc:493] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:13.757720 26600 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:13.758561 26605 raft_consensus.cc:515] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:13.759476 26603 leader_election.cc:290] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:13.760488 26600 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:13.760644 26605 leader_election.cc:290] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:13.763878 26600 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:13.760758 26602 leader_election.cc:290] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:13.764415 26600 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:13.760792 26601 leader_election.cc:290] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:13.758935 26598 leader_election.cc:290] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:13.761725 26604 raft_consensus.cc:493] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:13.767915 26604 raft_consensus.cc:515] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:13.769035 26600 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:13.762410 26599 raft_consensus.cc:493] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:13.770057 26604 leader_election.cc:290] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:13.766359 26606 leader_election.cc:290] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:13.762861 26603 raft_consensus.cc:493] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:13.774621 26603 raft_consensus.cc:515] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:13.770344 26599 raft_consensus.cc:515] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:13.785772 26599 leader_election.cc:290] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:13.789232 26609 raft_consensus.cc:493] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:13.791373 26603 leader_election.cc:290] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:13.765799 26608 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:13.797437 26609 raft_consensus.cc:515] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:13.797266 26608 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.201265 26608 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:13.803172 26607 raft_consensus.cc:493] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.202239 26607 raft_consensus.cc:515] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:13.995416 26610 raft_consensus.cc:493] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.177497 26616 raft_consensus.cc:493] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.209830 26610 raft_consensus.cc:515] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.211534 26607 leader_election.cc:290] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.194927 26599 raft_consensus.cc:493] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.212957 26616 raft_consensus.cc:515] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.213390 26599 raft_consensus.cc:515] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.195470 26617 raft_consensus.cc:493] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.195638 26600 raft_consensus.cc:493] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.215703 26599 leader_election.cc:290] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.215971 26617 raft_consensus.cc:515] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.196579 26606 raft_consensus.cc:493] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:13.978116 26603 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.217160 26606 raft_consensus.cc:515] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.219645 26606 leader_election.cc:290] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.219856 26617 leader_election.cc:290] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.220723 26617 raft_consensus.cc:493] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.220919 26615 raft_consensus.cc:493] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.217227 26603 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.223910 26603 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.215668 26616 leader_election.cc:290] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.212356 26610 leader_election.cc:290] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.216089 26600 raft_consensus.cc:515] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.228291 26612 raft_consensus.cc:493] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.229030 26610 raft_consensus.cc:493] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.229264 26600 leader_election.cc:290] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.231559 26610 raft_consensus.cc:515] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.189430 26613 raft_consensus.cc:493] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.196125 26604 raft_consensus.cc:493] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.230517 26609 leader_election.cc:290] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.235014 26610 leader_election.cc:290] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.235232 26609 raft_consensus.cc:493] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.245577 26609 raft_consensus.cc:515] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.245895 26624 raft_consensus.cc:493] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.221626 26615 raft_consensus.cc:515] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.250545 26625 raft_consensus.cc:493] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.252044 26614 raft_consensus.cc:493] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.235368 26604 raft_consensus.cc:515] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.228914 26612 raft_consensus.cc:515] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.221463 26617 raft_consensus.cc:515] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.244554 26613 raft_consensus.cc:515] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.268903 26624 raft_consensus.cc:515] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.254570 26606 raft_consensus.cc:493] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.280174 26607 raft_consensus.cc:493] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.281764 26617 leader_election.cc:290] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.283764 26611 raft_consensus.cc:493] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.280503 26629 raft_consensus.cc:493] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.283957 26599 raft_consensus.cc:493] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.283577 26613 leader_election.cc:290] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.288833 26624 leader_election.cc:290] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.326570 26606 raft_consensus.cc:515] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.297756 26612 leader_election.cc:290] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.328501 26607 raft_consensus.cc:515] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.363628 26607 leader_election.cc:290] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.364581 26615 leader_election.cc:290] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.365374 26620 raft_consensus.cc:493] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.365975 26620 raft_consensus.cc:515] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.369045 26604 leader_election.cc:290] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.370726 26609 leader_election.cc:290] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.373270 26606 leader_election.cc:290] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.375321 26634 raft_consensus.cc:493] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.375941 26634 raft_consensus.cc:515] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.376308 26635 raft_consensus.cc:493] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.377032 26635 raft_consensus.cc:515] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.388016 26632 raft_consensus.cc:493] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.351768 26629 raft_consensus.cc:515] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.388651 26632 raft_consensus.cc:515] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.390977 26629 leader_election.cc:290] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.391350 26632 leader_election.cc:290] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.391974 26632 raft_consensus.cc:493] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.352927 26599 raft_consensus.cc:515] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.392437 26632 raft_consensus.cc:515] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.394649 26599 leader_election.cc:290] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.395464 26632 leader_election.cc:290] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.292346 26625 raft_consensus.cc:515] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.354115 26611 raft_consensus.cc:515] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.406738 26625 leader_election.cc:290] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.407370 26615 raft_consensus.cc:493] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.407645 26611 leader_election.cc:290] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.407999 26615 raft_consensus.cc:515] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.410122 26615 leader_election.cc:290] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.386354 26634 leader_election.cc:290] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.410552 26615 raft_consensus.cc:493] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.424090 26620 leader_election.cc:290] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.427872 26631 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.428609 26631 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.419615 26613 raft_consensus.cc:493] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.430171 26607 raft_consensus.cc:493] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.430464 26613 raft_consensus.cc:515] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.430739 26607 raft_consensus.cc:515] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.431778 26631 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.432312 26631 raft_consensus.cc:493] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.432848 26607 leader_election.cc:290] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.432761 26631 raft_consensus.cc:515] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.432917 26613 leader_election.cc:290] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.434765 26618 raft_consensus.cc:493] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.435400 26618 raft_consensus.cc:515] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.436357 26622 raft_consensus.cc:493] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.436894 26622 raft_consensus.cc:515] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.437172 26624 raft_consensus.cc:493] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.437727 26624 raft_consensus.cc:515] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.276626 26614 raft_consensus.cc:515] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.447356 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:14.433650 26613 raft_consensus.cc:493] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.439751 26617 raft_consensus.cc:493] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.439689 26624 leader_election.cc:290] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.444080 26622 leader_election.cc:290] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.434834 26631 leader_election.cc:290] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.442353 26619 raft_consensus.cc:493] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.441140 26616 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.444702 26643 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.441896 26623 raft_consensus.cc:493] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.437906 26618 leader_election.cc:290] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.441510 26621 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.463546 26615 raft_consensus.cc:515] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.444258 26634 raft_consensus.cc:493] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.474469 26639 raft_consensus.cc:493] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.475090 26622 raft_consensus.cc:493] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.482194 26643 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.468472 26613 raft_consensus.cc:515] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.479480 26624 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.474083 26617 raft_consensus.cc:515] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.484230 26629 raft_consensus.cc:493] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.481624 26623 raft_consensus.cc:515] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.479322 26619 raft_consensus.cc:515] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.480881 26616 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.484426 26621 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.490059 26607 raft_consensus.cc:493] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.495581 26629 raft_consensus.cc:515] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.495168 26637 raft_consensus.cc:493] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.516497 26607 raft_consensus.cc:515] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.517293 26637 raft_consensus.cc:515] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.518208 26626 raft_consensus.cc:493] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.518724 26626 raft_consensus.cc:515] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.519155 26607 leader_election.cc:290] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.505160 26636 raft_consensus.cc:493] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.519788 26637 leader_election.cc:290] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.504527 26633 raft_consensus.cc:493] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.520121 26636 raft_consensus.cc:515] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.520864 26626 leader_election.cc:290] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.520807 26633 raft_consensus.cc:515] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.496039 26617 leader_election.cc:290] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.487002 26639 raft_consensus.cc:515] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.522621 26621 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.487097 26642 raft_consensus.cc:493] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.503902 26623 leader_election.cc:290] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.506129 26613 leader_election.cc:290] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.523460 26642 raft_consensus.cc:515] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.507833 26615 leader_election.cc:290] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.487138 26618 raft_consensus.cc:493] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.524511 26639 leader_election.cc:290] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.494293 26624 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.504263 26612 raft_consensus.cc:493] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.525877 26642 leader_election.cc:290] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.492830 26635 leader_election.cc:290] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.527436 26624 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.493052 26641 raft_consensus.cc:493] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.528503 26641 raft_consensus.cc:515] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.526444 26612 raft_consensus.cc:515] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.530265 26624 raft_consensus.cc:493] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.487330 26622 raft_consensus.cc:515] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.508482 26631 raft_consensus.cc:493] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.531121 26646 raft_consensus.cc:493] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.530784 26624 raft_consensus.cc:515] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.532238 26622 leader_election.cc:290] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.532385 26609 raft_consensus.cc:493] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.533006 26645 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.487603 26638 raft_consensus.cc:493] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.534379 26641 leader_election.cc:290] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.516062 26640 raft_consensus.cc:493] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.524999 26618 raft_consensus.cc:515] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.535753 26613 raft_consensus.cc:493] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.506038 26616 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.490366 26644 raft_consensus.cc:493] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.504878 26619 leader_election.cc:290] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.547621 26612 leader_election.cc:290] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.522677 26629 leader_election.cc:290] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.489449 26614 leader_election.cc:290] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.493057 26643 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.555150 26607 raft_consensus.cc:493] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.563577 26626 raft_consensus.cc:493] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.553615 26609 raft_consensus.cc:515] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.567131 26633 leader_election.cc:290] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.560845 26622 raft_consensus.cc:493] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.565567 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.567950 26615 raft_consensus.cc:493] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.568413 26642 raft_consensus.cc:493] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.556565 26625 raft_consensus.cc:493] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.575834 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.557080 26641 raft_consensus.cc:493] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.584512 25533 raft_consensus.cc:2468] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:21:14.550551 26631 raft_consensus.cc:515] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.576004 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15e4fb6800449ceb211a61be3587ecc" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.536021 26646 raft_consensus.cc:515] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.594612 26651 raft_consensus.cc:493] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.560629 26613 raft_consensus.cc:515] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.595187 26651 raft_consensus.cc:515] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.596534 26646 leader_election.cc:290] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.583377 26626 raft_consensus.cc:515] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.597142 26613 leader_election.cc:290] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.597553 26651 leader_election.cc:290] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.582588 26607 raft_consensus.cc:515] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.598819 26626 leader_election.cc:290] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.485152 26634 raft_consensus.cc:515] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.567190 26618 leader_election.cc:290] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.585196 26632 raft_consensus.cc:493] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.588500 26357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015cfc692b904ffb8d66556e17bd9ed1" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.586905 26622 raft_consensus.cc:515] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.558202 26640 raft_consensus.cc:515] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.589131 26354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.587458 26641 raft_consensus.cc:515] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.583443 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.607268 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.607877 25683 raft_consensus.cc:2468] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 3.
I20260709 13:21:14.608618 26648 raft_consensus.cc:493] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.608898 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.609280 26648 raft_consensus.cc:515] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.582616 26630 raft_consensus.cc:493] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.602548 26632 raft_consensus.cc:515] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.610673 26652 raft_consensus.cc:493] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.610771 26630 raft_consensus.cc:515] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.611351 26652 raft_consensus.cc:515] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.611935 26648 leader_election.cc:290] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.612541 26648 raft_consensus.cc:493] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.613000 26648 raft_consensus.cc:515] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.613456 26640 leader_election.cc:290] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.590229 26642 raft_consensus.cc:515] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.590503 26625 raft_consensus.cc:515] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.589169 26624 leader_election.cc:290] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.591368 26636 leader_election.cc:290] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.591279 26615 raft_consensus.cc:515] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.590096 26609 leader_election.cc:290] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.592242 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.556432 26645 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.592110 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f8e17e0e2419bb3b63d012776f356" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.593155 26629 raft_consensus.cc:493] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.592648 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.593673 26614 raft_consensus.cc:493] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.592216 26647 raft_consensus.cc:493] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.593502 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.558948 26638 raft_consensus.cc:515] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.562137 26644 raft_consensus.cc:515] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.600178 26607 leader_election.cc:290] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.586979 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.605675 26357 raft_consensus.cc:2468] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:21:14.583935 26643 raft_consensus.cc:493] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.622239 26645 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.620441 25534 raft_consensus.cc:2468] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:21:14.623378 26647 raft_consensus.cc:515] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.617112 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.617794 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.614022 26640 raft_consensus.cc:493] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.614538 26650 raft_consensus.cc:493] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.616218 26352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.615662 26634 leader_election.cc:290] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.617467 26350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.623059 26614 raft_consensus.cc:515] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.615682 26642 leader_election.cc:290] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.624310 26655 raft_consensus.cc:493] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.626364 26616 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.649179 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.649461 26655 raft_consensus.cc:515] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.649585 26616 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.651798 26655 leader_election.cc:290] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.652004 26616 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.625957 26631 leader_election.cc:290] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.628625 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.618431 26641 leader_election.cc:290] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.616184 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f61b96593545c79c1d08d45ad98dee" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.613456 26630 leader_election.cc:290] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.615274 26622 leader_election.cc:290] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.630642 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.619246 26625 leader_election.cc:290] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.629328 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc39a93c665a491a81bb0925b35ccf33" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.623049 25530 raft_consensus.cc:2468] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:21:14.659503 26625 raft_consensus.cc:493] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.638007 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.660341 26625 raft_consensus.cc:515] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.615753 26353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.615957 26632 leader_election.cc:290] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.660655 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.638463 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea867c357cd4e4d970226215f94bfe7" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.662109 25681 raft_consensus.cc:2468] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 3.
I20260709 13:21:14.663049 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.663127 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.639925 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.664410 26637 raft_consensus.cc:493] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.664534 25681 raft_consensus.cc:2468] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:14.665062 26349 raft_consensus.cc:2468] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:21:14.665134 26637 raft_consensus.cc:515] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.665570 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.613859 26652 leader_election.cc:290] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.661743 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278c9060803541ebb56ccb47687d3d4d" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.663342 26625 leader_election.cc:290] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.657846 25680 raft_consensus.cc:2468] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:21:14.667735 26353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.668187 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.668310 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.668705 26637 leader_election.cc:290] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.664177 26653 raft_consensus.cc:493] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.641566 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.670117 26642 raft_consensus.cc:493] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.642583 26352 raft_consensus.cc:2468] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:21:14.670812 26642 raft_consensus.cc:515] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.671367 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015cfc692b904ffb8d66556e17bd9ed1" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.671423 26352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.672703 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.672844 26642 leader_election.cc:290] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.672935 26352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278c9060803541ebb56ccb47687d3d4d" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.673312 25676 raft_consensus.cc:2468] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 3.
I20260709 13:21:14.644541 25675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278c9060803541ebb56ccb47687d3d4d" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.666236 25681 raft_consensus.cc:2468] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:21:14.640647 26640 raft_consensus.cc:515] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.674376 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.669201 26353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.676236 26640 leader_election.cc:290] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.647614 26614 leader_election.cc:290] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.676879 26353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.644304 26350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.648325 26355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.669550 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.677944 26355 raft_consensus.cc:2468] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:21:14.678012 25680 raft_consensus.cc:2468] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:14.625183 26638 leader_election.cc:290] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.678874 26355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.626529 26651 raft_consensus.cc:493] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.680058 26355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.679970 26651 raft_consensus.cc:515] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.681216 26355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.678411 26350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdda0f89bd34da2ab6e2dcc9f918eb5" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.629226 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.626770 26643 raft_consensus.cc:515] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.683281 26350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.684335 26643 leader_election.cc:290] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.684527 26350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.621905 26629 raft_consensus.cc:515] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.627857 26648 leader_election.cc:290] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.638545 26351 raft_consensus.cc:2468] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:21:14.659302 26659 raft_consensus.cc:493] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.686904 26629 leader_election.cc:290] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.641894 26357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc39a93c665a491a81bb0925b35ccf33" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.626431 26635 raft_consensus.cc:493] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.621085 26615 leader_election.cc:290] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.642009 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdda0f89bd34da2ab6e2dcc9f918eb5" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.625701 25533 raft_consensus.cc:2468] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 3.
I20260709 13:21:14.688345 26635 raft_consensus.cc:515] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.689235 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.689361 26355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.687435 26659 raft_consensus.cc:515] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:14.689831 25677 raft_consensus.cc:2468] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:14.629042 25527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.690703 25527 raft_consensus.cc:2468] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:21:14.690739 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15e4fb6800449ceb211a61be3587ecc" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.691541 25677 raft_consensus.cc:2468] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:21:14.690416 26355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.641176 26650 raft_consensus.cc:515] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.687074 26351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.642024 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9240e31c174ddab78702a2343b3d64" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.646476 17228 tablet_server.cc:179] TabletServer@127.16.211.1:45089 shutting down...
I20260709 13:21:14.693320 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540f940c49e54189a08d7ed4d84f2ac6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.682031 25499 leader_election.cc:304] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:14.697634 26600 raft_consensus.cc:2804] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:14.697868 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e89c6170734a98849f97b6441df9e4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.640872 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc06587e5c544c7a834950d9f45c6c8" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.698063 26600 raft_consensus.cc:493] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:14.699183 26600 raft_consensus.cc:3060] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:14.685863 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e89c6170734a98849f97b6441df9e4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.687834 26357 raft_consensus.cc:2468] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:21:14.659332 25678 raft_consensus.cc:2468] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:21:14.704229 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.704628 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.706918 26635 leader_election.cc:290] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.667225 25679 raft_consensus.cc:2468] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:14.691799 26659 leader_election.cc:290] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.678295 26353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540f940c49e54189a08d7ed4d84f2ac6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.708922 26651 leader_election.cc:290] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.645232 26354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.710093 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.639698 26358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f61b96593545c79c1d08d45ad98dee" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.713771 26358 raft_consensus.cc:2468] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:21:14.719532 25499 leader_election.cc:304] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:14.669359 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e89c6170734a98849f97b6441df9e4" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.657380 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "278c9060803541ebb56ccb47687d3d4d" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.726369 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.627226 26644 leader_election.cc:290] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.730105 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.734251 25499 leader_election.cc:304] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:14.731540 25533 raft_consensus.cc:2468] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:21:14.735775 25499 leader_election.cc:304] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:14.737576 25499 leader_election.cc:304] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:14.685853 26350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5001675947e47d284c3bc4729cf9fd9" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.741726 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.743654 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.744462 25530 raft_consensus.cc:2468] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:14.732916 26606 raft_consensus.cc:2804] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:14.710068 26650 leader_election.cc:290] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:14.666167 26349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.748548 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.640053 26647 leader_election.cc:290] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.755995 26350 raft_consensus.cc:2468] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:21:14.691817 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.764323 25647 leader_election.cc:304] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:14.752753 26620 raft_consensus.cc:2804] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:14.742980 26610 raft_consensus.cc:2804] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:14.743040 26603 raft_consensus.cc:2804] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:14.642918 26356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f8e17e0e2419bb3b63d012776f356" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "812474b88dc54c39bc37428d77dcb7a9" is_pre_election: true
I20260709 13:21:14.759298 26349 raft_consensus.cc:2468] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 3.
I20260709 13:21:14.762713 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.760739 25675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.750669 26606 raft_consensus.cc:493] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.669580 26653 raft_consensus.cc:515] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.771004 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8168790b26f4632b04441b2780e479a" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.766721 25647 leader_election.cc:304] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:14.773983 25647 leader_election.cc:304] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:14.761260 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8168790b26f4632b04441b2780e479a" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.767603 26630 raft_consensus.cc:2804] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:14.765599 26620 raft_consensus.cc:493] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.768891 26610 raft_consensus.cc:493] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.778754 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8168790b26f4632b04441b2780e479a" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.780435 25647 leader_election.cc:304] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:14.768748 26603 raft_consensus.cc:493] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.771962 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.783514 26633 raft_consensus.cc:2804] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:14.783968 26633 raft_consensus.cc:493] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.784373 26633 raft_consensus.cc:3060] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:14.774111 26606 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:14.800010 25601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.800282 25602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.800953 25602 raft_consensus.cc:2468] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:21:14.801477 25601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea867c357cd4e4d970226215f94bfe7" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.801836 25602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.802693 25601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.787204 25527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea867c357cd4e4d970226215f94bfe7" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.812268 25527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd9e5943fb6488091b514fd1aa47162" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.813395 25527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4b9518dd674972b99e9595c9b1c686" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.788002 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.788738 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.814311 25608 raft_consensus.cc:2468] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:14.789237 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015cfc692b904ffb8d66556e17bd9ed1" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.791538 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.791810 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4b9518dd674972b99e9595c9b1c686" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.792160 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.792654 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9240e31c174ddab78702a2343b3d64" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.792959 26653 leader_election.cc:290] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:14.831063 25604 raft_consensus.cc:2468] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:21:14.831195 25605 raft_consensus.cc:2468] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:21:14.831439 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e879da59df949eca2ae0618a4c5ddc2" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.782616 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.794891 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed58b0dbded4dfc9447d9712ff39fea" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.832273 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.833292 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.802800 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.826016 25647 leader_election.cc:304] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:14.832294 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15e4fb6800449ceb211a61be3587ecc" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.834281 25531 raft_consensus.cc:2468] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:14.803191 25602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e89c6170734a98849f97b6441df9e4" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.835223 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15e4fb6800449ceb211a61be3587ecc" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.835536 25602 raft_consensus.cc:2468] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:21:14.836484 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015cfc692b904ffb8d66556e17bd9ed1" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.803551 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.835223 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4b9518dd674972b99e9595c9b1c686" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.838028 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.804064 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.841475 25536 raft_consensus.cc:2468] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:21:14.806283 25532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.778389 26630 raft_consensus.cc:493] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.842636 26630 raft_consensus.cc:3060] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:14.842177 26633 raft_consensus.cc:515] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.843305 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.844600 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.781276 26610 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:14.836510 25602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.784915 26603 raft_consensus.cc:3060] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:14.849931 25602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.851106 25602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.852355 25602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.852946 25602 raft_consensus.cc:2468] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:21:14.780411 26620 raft_consensus.cc:3060] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:14.854480 26633 leader_election.cc:290] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:14.854702 26600 raft_consensus.cc:515] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.855435 26633 raft_consensus.cc:2804] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:14.855947 26633 raft_consensus.cc:493] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.856842 26600 leader_election.cc:290] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.777169 26624 raft_consensus.cc:2804] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:14.776402 26609 raft_consensus.cc:2804] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:14.858129 26609 raft_consensus.cc:493] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.858543 26609 raft_consensus.cc:3060] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:14.786051 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.808157 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.810690 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.804149 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.816303 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9240e31c174ddab78702a2343b3d64" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.857760 26624 raft_consensus.cc:493] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.823251 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.864580 26624 raft_consensus.cc:3060] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:14.865562 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea867c357cd4e4d970226215f94bfe7" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.866252 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.867142 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.868533 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.824231 25610 raft_consensus.cc:2468] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:14.866320 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.870599 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdda0f89bd34da2ab6e2dcc9f918eb5" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.870872 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddcb2168c0d4acaba5e547ac0c03ebb" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.872502 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c681632e82489da482ce4f96f3a902" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.873009 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.841709 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c681632e82489da482ce4f96f3a902" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.873879 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5001675947e47d284c3bc4729cf9fd9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.874993 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.875728 25603 raft_consensus.cc:2468] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 2.
I20260709 13:21:14.874411 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfde4ba996435bb05645af25e1f2c7" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.876668 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04d94e738a343788e9a90a4470dc4c3" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.877969 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.878731 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c681632e82489da482ce4f96f3a902" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.878923 25610 raft_consensus.cc:2468] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 3.
I20260709 13:21:14.880262 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8168790b26f4632b04441b2780e479a" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.880474 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.881157 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.882326 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed58b0dbded4dfc9447d9712ff39fea" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.882653 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfde4ba996435bb05645af25e1f2c7" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.883903 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.884457 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.853755 25602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.885475 25602 raft_consensus.cc:2468] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812474b88dc54c39bc37428d77dcb7a9 in term 1.
I20260709 13:21:14.825620 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b54054e46384e8aa7153f332c5c366f" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.826169 25675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f61b96593545c79c1d08d45ad98dee" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.826804 25601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.824652 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.886504 25602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.887739 25601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.888397 25601 raft_consensus.cc:2468] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 1.
I20260709 13:21:14.889262 25601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:14.827488 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788ee1912fba47fe8873f543b02189f7" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.890900 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc06587e5c544c7a834950d9f45c6c8" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.892078 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5001675947e47d284c3bc4729cf9fd9" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.893175 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.833542 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.835222 25647 leader_election.cc:304] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:14.869863 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed58b0dbded4dfc9447d9712ff39fea" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.803381 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.823233 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:21:14.894392 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 59233.3us
I20260709 13:21:14.894496 26645 raft_consensus.cc:2804] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:14.894237 25605 raft_consensus.cc:2468] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 1.
I20260709 13:21:14.895195 25647 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:14.856395 26633 raft_consensus.cc:3060] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:14.895043 26645 raft_consensus.cc:493] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.896461 25647 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:14.906236 26645 raft_consensus.cc:3060] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:14.896031 26618 raft_consensus.cc:2804] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:14.907836 26618 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.908082 26649 raft_consensus.cc:2804] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:14.908293 26618 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:14.908645 26649 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:14.909154 26649 raft_consensus.cc:3060] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:14.909257 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.913674 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.845723 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.908238 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bfde4ba996435bb05645af25e1f2c7" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.925148 25675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.887256 25602 raft_consensus.cc:2468] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:21:14.881757 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:21:14.903891 26248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:40853, user_credentials={real_user=slave}} blocked reactor thread for 68533.5us
I20260709 13:21:14.943722 26624 raft_consensus.cc:515] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.947418 25647 leader_election.cc:304] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:14.948066 26603 raft_consensus.cc:515] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.901021 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddcb2168c0d4acaba5e547ac0c03ebb" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.878049 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6397caa427af450ca361a53cc74cf838" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:14.951555 26248 leader_election.cc:304] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:21:14.934578 26620 raft_consensus.cc:515] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.924610 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.948429 26628 raft_consensus.cc:2804] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:14.895772 26606 raft_consensus.cc:515] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.959403 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f61b96593545c79c1d08d45ad98dee" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.952744 26248 leader_election.cc:304] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:21:14.960144 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.988050 26628 raft_consensus.cc:493] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:14.988610 26628 raft_consensus.cc:3060] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:14.988664 26661 raft_consensus.cc:2804] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:14.989270 26661 raft_consensus.cc:493] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:14.989660 26661 raft_consensus.cc:3060] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:14.994582 26248 leader_election.cc:304] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:21:14.995291 25500 leader_election.cc:304] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:14.952396 26626 raft_consensus.cc:2804] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:14.962425 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.997386 26248 leader_election.cc:304] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:21:15.000568 25500 leader_election.cc:304] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:14.959986 25675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:14.901980 26610 raft_consensus.cc:515] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.962781 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cdda0f89bd34da2ab6e2dcc9f918eb5" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.963750 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85033b16e63444238f30de7eae6d6634" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:14.963308 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788ee1912fba47fe8873f543b02189f7" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
W20260709 13:21:14.965886 25499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:44609, user_credentials={real_user=slave}} blocked reactor thread for 228448us
I20260709 13:21:14.966737 25527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f052365b064537ba68ac4701e53694" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:15.003576 25499 leader_election.cc:304] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.007076 25499 leader_election.cc:304] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.004565 26248 leader_election.cc:304] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:21:14.952421 26630 raft_consensus.cc:515] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:14.973546 25648 leader_election.cc:304] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:14.975059 25647 leader_election.cc:304] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:14.974372 26618 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.954710 26609 raft_consensus.cc:515] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:14.978044 26624 leader_election.cc:290] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:14.979648 26645 raft_consensus.cc:515] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:14.995544 26653 raft_consensus.cc:2804] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:14.996191 26600 raft_consensus.cc:2804] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:14.956091 26247 leader_election.cc:304] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.006740 25500 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:15.014657 25647 leader_election.cc:304] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.005961 26660 raft_consensus.cc:2804] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:15.018090 26631 raft_consensus.cc:2804] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:15.002307 26626 raft_consensus.cc:493] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:15.019578 26248 leader_election.cc:304] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9; no voters: 
I20260709 13:21:15.005750 26662 raft_consensus.cc:2749] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.009163 26603 leader_election.cc:290] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:15.018277 26599 raft_consensus.cc:2749] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:15.019132 25648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:40853, user_credentials={real_user=slave}} blocked reactor thread for 45820.7us
I20260709 13:21:15.008342 25675 raft_consensus.cc:2468] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:15.017269 25573 leader_election.cc:304] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.032173 25648 leader_election.cc:304] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:15.010063 26604 raft_consensus.cc:2749] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.021253 26646 raft_consensus.cc:2749] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.021512 26600 raft_consensus.cc:493] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:15.025516 25529 raft_consensus.cc:2393] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 4: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:21:15.025395 26631 raft_consensus.cc:493] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:15.041966 26610 leader_election.cc:290] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:15.042130 26631 raft_consensus.cc:3060] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:15.032137 25647 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 245 similar messages]
I20260709 13:21:15.042706 26620 leader_election.cc:290] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:15.043570 26603 raft_consensus.cc:2749] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:15.026343 26660 raft_consensus.cc:493] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:15.044575 26660 raft_consensus.cc:3060] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.025187 25500 leader_election.cc:304] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:15.020090 26653 raft_consensus.cc:493] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:15.023140 26650 raft_consensus.cc:2804] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:21:15.023208 26247 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:44609, user_credentials={real_user=slave}} blocked reactor thread for 67185.1us
I20260709 13:21:15.024658 26647 raft_consensus.cc:2749] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.027892 26658 raft_consensus.cc:2804] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:15.026108 26626 raft_consensus.cc:3060] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.046551 25500 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:15.049137 25648 leader_election.cc:304] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:15.048916 26247 leader_election.cc:304] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:15.059310 26247 leader_election.cc:304] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:15.059939 25648 leader_election.cc:304] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.039067 26644 raft_consensus.cc:2749] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.046494 26600 raft_consensus.cc:3060] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.039925 26643 raft_consensus.cc:2749] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.038343 26624 raft_consensus.cc:2749] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.074046 26247 leader_election.cc:304] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.048305 26650 raft_consensus.cc:493] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:15.055521 26658 raft_consensus.cc:493] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:15.065625 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788ee1912fba47fe8873f543b02189f7" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:15.066316 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:15.053046 26603 raft_consensus.cc:2804] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:15.079993 26247 leader_election.cc:304] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.064116 26612 raft_consensus.cc:2749] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.071833 26640 raft_consensus.cc:2804] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:15.071223 26645 leader_election.cc:290] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:15.048110 26653 raft_consensus.cc:3060] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.078235 26655 raft_consensus.cc:2749] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.080626 26650 raft_consensus.cc:3060] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:21:15.063506 25499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:44609, user_credentials={real_user=slave}} blocked reactor thread for 56502.8us
I20260709 13:21:15.063846 26615 raft_consensus.cc:2804] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:15.071383 26620 raft_consensus.cc:2749] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:15.070706 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:15.084439 26603 raft_consensus.cc:493] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:15.087023 25527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:15.088052 26618 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:15.067793 26613 raft_consensus.cc:2804] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:15.093631 26247 leader_election.cc:304] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.079957 25573 leader_election.cc:304] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.095602 25499 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:15.084986 26658 raft_consensus.cc:3060] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.101958 26613 raft_consensus.cc:493] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:15.103157 25573 leader_election.cc:304] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:15.103524 26655 raft_consensus.cc:2749] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.103610 26620 raft_consensus.cc:2804] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:21:15.099825 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 67721.4us
I20260709 13:21:15.100911 26603 raft_consensus.cc:3060] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.103986 26638 raft_consensus.cc:2804] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:15.104450 26614 raft_consensus.cc:2749] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.104692 26638 raft_consensus.cc:493] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:15.105122 26638 raft_consensus.cc:3060] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.089308 26640 raft_consensus.cc:493] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:15.105826 26640 raft_consensus.cc:3060] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.095870 26615 raft_consensus.cc:493] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:15.106571 26615 raft_consensus.cc:3060] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.103231 25499 leader_election.cc:304] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.111604 26610 raft_consensus.cc:2749] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.096666 26632 raft_consensus.cc:2749] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.114430 25573 leader_election.cc:304] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.103933 26247 leader_election.cc:304] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.115337 25499 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:15.116284 26247 leader_election.cc:304] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.118048 25499 leader_election.cc:304] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:15.104146 26620 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:15.116626 26642 raft_consensus.cc:2749] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.118824 26620 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:15.114063 26613 raft_consensus.cc:3060] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.122334 26662 raft_consensus.cc:2804] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:15.122792 26662 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:15.123147 26662 raft_consensus.cc:3060] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.124794 25499 leader_election.cc:304] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:15.126322 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:15.126978 25527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc39a93c665a491a81bb0925b35ccf33" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:15.127533 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f8e17e0e2419bb3b63d012776f356" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:15.129329 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc06587e5c544c7a834950d9f45c6c8" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:15.119872 26609 leader_election.cc:290] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:15.138191 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc39a93c665a491a81bb0925b35ccf33" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:15.139043 26603 raft_consensus.cc:515] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.139961 26606 leader_election.cc:290] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:15.133481 25573 leader_election.cc:304] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.132056 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5001675947e47d284c3bc4729cf9fd9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:15.132592 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540f940c49e54189a08d7ed4d84f2ac6" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:15.132651 25534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:15.134552 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:15.128728 26614 raft_consensus.cc:2749] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.136087 26610 raft_consensus.cc:2804] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:15.130766 26599 raft_consensus.cc:2804] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:15.136906 25527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f8e17e0e2419bb3b63d012776f356" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:15.145777 25573 leader_election.cc:304] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.130261 25499 leader_election.cc:304] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:15.148319 25573 leader_election.cc:304] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:15.150377 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cddcb2168c0d4acaba5e547ac0c03ebb" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:15.149677 26651 raft_consensus.cc:2749] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.131067 26659 raft_consensus.cc:2749] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.143034 26600 raft_consensus.cc:515] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.145110 26629 raft_consensus.cc:2749] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.116683 26633 raft_consensus.cc:515] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:15.183380 25647 leader_election.cc:304] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:15.154544 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540f940c49e54189a08d7ed4d84f2ac6" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:15.154215 26614 raft_consensus.cc:2804] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:15.195446 26614 raft_consensus.cc:493] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:15.195868 26614 raft_consensus.cc:3060] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.156216 26663 raft_consensus.cc:2804] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:15.185467 26600 leader_election.cc:290] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:15.146812 26599 raft_consensus.cc:493] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:15.198160 26663 raft_consensus.cc:493] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:15.198570 26599 raft_consensus.cc:3060] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.198625 26663 raft_consensus.cc:3060] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.146920 26610 raft_consensus.cc:493] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:15.199880 26610 raft_consensus.cc:3060] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.150118 26613 raft_consensus.cc:515] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.191679 26653 raft_consensus.cc:515] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:15.192593 26609 raft_consensus.cc:2804] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:15.194656 26626 raft_consensus.cc:515] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:15.148566 26638 raft_consensus.cc:515] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:15.155014 25573 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:15.228574 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.230540 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.231274 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.231774 26603 leader_election.cc:290] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:15.231894 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.233392 26613 leader_election.cc:290] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:15.234730 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.229094 26247 leader_election.cc:304] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:21:15.241370 25573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 86413.1us
W20260709 13:21:15.204439 26393 debug-util.cc:398] Leaking SignalData structure 0x7b0800173da0 after lost signal to thread 17231
I20260709 13:21:15.243065 26619 raft_consensus.cc:2804] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:21:15.245852 26393 debug-util.cc:398] Leaking SignalData structure 0x7b080013c840 after lost signal to thread 25393
I20260709 13:21:15.247599 25573 leader_election.cc:304] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.247951 26247 leader_election.cc:304] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.239993 25676 raft_consensus.cc:1240] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Rejecting Update request from peer 812474b88dc54c39bc37428d77dcb7a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:15.246430 26619 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:15.252352 26619 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:15.252528 26625 raft_consensus.cc:2749] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:15.253312 26393 debug-util.cc:398] Leaking SignalData structure 0x7b0800319400 after lost signal to thread 25560
I20260709 13:21:15.250808 26642 raft_consensus.cc:2749] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.236323 26609 raft_consensus.cc:493] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:15.256961 25531 raft_consensus.cc:1240] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Rejecting Update request from peer f8a9e56b2e1e46de810671b2180d8a68 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.257004 26609 raft_consensus.cc:3060] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.257390 26626 leader_election.cc:290] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:15.245872 26638 leader_election.cc:290] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:15.254640 26651 raft_consensus.cc:2749] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.259941 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.261821 26653 leader_election.cc:290] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
W20260709 13:21:15.262532 26393 debug-util.cc:398] Leaking SignalData structure 0x7b080027f8e0 after lost signal to thread 25634
W20260709 13:21:15.263792 26393 debug-util.cc:398] Leaking SignalData structure 0x7b08002d3ac0 after lost signal to thread 25708
I20260709 13:21:15.264322 26630 leader_election.cc:290] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:15.265177 25573 leader_election.cc:304] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.255179 26660 raft_consensus.cc:515] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:15.276921 26660 leader_election.cc:290] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:15.266261 26615 raft_consensus.cc:515] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:15.263836 26633 leader_election.cc:290] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:15.192541 26640 raft_consensus.cc:515] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:15.270716 25606 raft_consensus.cc:1240] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Rejecting Update request from peer 812474b88dc54c39bc37428d77dcb7a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:15.271521 26609 raft_consensus.cc:515] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.271790 26599 raft_consensus.cc:515] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
W20260709 13:21:15.265110 26393 debug-util.cc:398] Leaking SignalData structure 0x7b080003f460 after lost signal to thread 26396
I20260709 13:21:15.273037 26620 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:15.274854 25535 raft_consensus.cc:1240] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Rejecting Update request from peer 812474b88dc54c39bc37428d77dcb7a9 for earlier term 3. Current term is 4. Ops: []
W20260709 13:21:15.254796 25647 leader_election.cc:336] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.279759 26640 leader_election.cc:290] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:15.282181 25533 raft_consensus.cc:1240] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Rejecting Update request from peer f8a9e56b2e1e46de810671b2180d8a68 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.284114 25573 leader_election.cc:304] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.285810 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9240e31c174ddab78702a2343b3d64" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.286279 26638 raft_consensus.cc:2749] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.282692 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.286602 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.286789 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.300289 25531 raft_consensus.cc:1240] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Rejecting Update request from peer f8a9e56b2e1e46de810671b2180d8a68 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.302852 26649 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
W20260709 13:21:15.295781 25647 leader_election.cc:336] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.288230 26650 raft_consensus.cc:515] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:15.303431 26658 raft_consensus.cc:515] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:15.304526 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.304849 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.305226 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.305619 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.295198 26660 consensus_queue.cc:1059] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:21:15.305835 25499 leader_election.cc:304] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.288897 26247 leader_election.cc:304] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.316606 26603 raft_consensus.cc:2749] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:15.307971 25647 leader_election.cc:336] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.319074 25499 leader_election.cc:304] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:21:15.319193 25647 leader_election.cc:336] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.319239 26247 leader_election.cc:304] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.320883 25648 leader_election.cc:304] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.321357 25499 leader_election.cc:304] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.322582 25500 leader_election.cc:304] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:15.320498 25647 leader_election.cc:304] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.327776 25648 leader_election.cc:304] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.336894 26247 leader_election.cc:304] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.339926 25500 leader_election.cc:304] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.340603 26613 raft_consensus.cc:2749] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.340902 26604 raft_consensus.cc:2804] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:15.341185 25500 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:15.326998 26631 raft_consensus.cc:515] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:15.343791 26631 leader_election.cc:290] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:15.346889 25648 leader_election.cc:304] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.347853 25648 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:15.311012 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.344612 26600 raft_consensus.cc:2749] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.338914 26633 raft_consensus.cc:2749] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.339046 26603 raft_consensus.cc:2749] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.338641 26606 raft_consensus.cc:2804] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:15.313850 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.349838 26606 raft_consensus.cc:493] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:15.350313 26606 raft_consensus.cc:3060] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.349193 26600 raft_consensus.cc:2749] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:15.339140 26648 raft_consensus.cc:2749] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.310040 26661 raft_consensus.cc:515] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:15.341360 26604 raft_consensus.cc:493] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:15.354269 26604 raft_consensus.cc:3060] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.358385 26661 leader_election.cc:290] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:15.327375 26657 raft_consensus.cc:2749] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.366953 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4b9518dd674972b99e9595c9b1c686" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.368669 26648 raft_consensus.cc:2749] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.359058 26631 raft_consensus.cc:2749] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.309870 26615 leader_election.cc:290] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:15.371150 26247 leader_election.cc:304] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.308885 26650 leader_election.cc:290] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:15.312680 26649 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:15.310953 26660 raft_consensus.cc:3055] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:15.309743 26658 leader_election.cc:290] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:15.372872 25500 leader_election.cc:304] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:15.328131 26638 raft_consensus.cc:2749] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.382901 26609 leader_election.cc:290] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:15.383332 26620 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:15.374568 25648 leader_election.cc:304] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.314567 26619 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:15.384286 26609 raft_consensus.cc:2749] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.376457 26247 leader_election.cc:304] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.307174 26662 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:15.319083 26628 raft_consensus.cc:515] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:15.318359 26614 raft_consensus.cc:515] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:15.378100 26633 raft_consensus.cc:2749] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:15.308275 26663 raft_consensus.cc:515] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.383690 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e89c6170734a98849f97b6441df9e4" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
W20260709 13:21:15.375815 25499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 47025.1us
I20260709 13:21:15.385320 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
W20260709 13:21:15.376739 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 57565.9us
I20260709 13:21:15.386133 25648 leader_election.cc:304] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.388114 26247 leader_election.cc:304] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.378346 26640 raft_consensus.cc:2749] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.388901 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.375710 26613 raft_consensus.cc:2804] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:15.388760 26649 raft_consensus.cc:2804] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:15.387778 26650 raft_consensus.cc:2749] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.376008 26660 raft_consensus.cc:740] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:15.391523 25602 raft_consensus.cc:1240] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Rejecting Update request from peer 812474b88dc54c39bc37428d77dcb7a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:15.387298 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.390851 26613 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:15.393780 26247 leader_election.cc:304] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.394243 26613 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:15.395633 26604 raft_consensus.cc:515] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.400161 26663 leader_election.cc:290] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:15.400528 26660 consensus_queue.cc:260] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:15.403120 26599 leader_election.cc:290] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:15.403493 25500 leader_election.cc:304] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:15.405476 26628 leader_election.cc:290] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:15.406203 26658 raft_consensus.cc:2749] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.406975 26658 consensus_queue.cc:1059] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:15.407092 26247 leader_election.cc:304] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.409788 26606 raft_consensus.cc:515] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:15.410347 26657 raft_consensus.cc:2749] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:15.407663 26615 raft_consensus.cc:2749] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.415076 26640 raft_consensus.cc:3055] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:15.415460 26640 raft_consensus.cc:740] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:15.416203 26640 consensus_queue.cc:260] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:15.417117 26640 raft_consensus.cc:3060] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.392494 26614 leader_election.cc:290] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:15.392529 26649 raft_consensus.cc:493] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
W20260709 13:21:15.418061 26657 consensus_queue.cc:1175] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:21:15.418529 26649 raft_consensus.cc:3060] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.420934 25499 leader_election.cc:304] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.420959 26662 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:15.422561 26603 raft_consensus.cc:2749] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.423138 26610 raft_consensus.cc:515] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.426473 25648 leader_election.cc:304] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:15.423763 26666 raft_consensus.cc:2749] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:15.388657 25647 leader_election.cc:336] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.425203 26247 leader_election.cc:304] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.430665 25647 leader_election.cc:304] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
W20260709 13:21:15.432564 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 43932.1us
I20260709 13:21:15.387687 26620 raft_consensus.cc:2749] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.449352 25533 raft_consensus.cc:1240] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:15.450323 26247 leader_election.cc:304] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.425172 26604 leader_election.cc:290] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:15.452016 26633 raft_consensus.cc:2749] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.452404 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.453222 26619 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:15.453971 25528 raft_consensus.cc:1240] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.454497 26606 leader_election.cc:290] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:15.454576 26658 raft_consensus.cc:2749] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.453967 25602 raft_consensus.cc:1240] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Rejecting Update request from peer 812474b88dc54c39bc37428d77dcb7a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:21:15.457110 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4b9518dd674972b99e9595c9b1c686" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.442170 26628 raft_consensus.cc:2749] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:15.459331 25573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 81310.9us
I20260709 13:21:15.426087 26660 raft_consensus.cc:3060] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.461900 25499 leader_election.cc:304] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:15.463932 25499 leader_election.cc:304] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:15.463289 26603 raft_consensus.cc:2804] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:15.459933 26658 consensus_queue.cc:1059] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
W20260709 13:21:15.471701 25647 leader_election.cc:336] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.466288 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081346db72a04ea4b600a44f560616ff" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
W20260709 13:21:15.473878 25647 leader_election.cc:336] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.471422 26650 raft_consensus.cc:2749] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.486929 26610 leader_election.cc:290] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:15.469193 26662 raft_consensus.cc:2804] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:15.488660 26247 leader_election.cc:304] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:21:15.490065 25647 consensus_peers.cc:597] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.489702 25602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.491412 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.472644 26613 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:15.490638 25573 leader_election.cc:304] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:15.469305 26603 raft_consensus.cc:493] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:15.496006 26603 raft_consensus.cc:3060] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.496074 26638 raft_consensus.cc:2804] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:15.496558 26638 raft_consensus.cc:493] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:15.496920 26638 raft_consensus.cc:3060] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.498934 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
W20260709 13:21:15.492368 25647 consensus_peers.cc:597] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.495340 25648 leader_election.cc:304] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.492277 26247 leader_election.cc:304] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.522089 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.507004 25648 leader_election.cc:304] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:15.526747 25530 raft_consensus.cc:1240] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 2. Current term is 3. Ops: []
W20260709 13:21:15.528750 25499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 57875.5us
I20260709 13:21:15.530062 26609 raft_consensus.cc:2804] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:15.532979 25679 raft_consensus.cc:1240] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:15.532997 26609 raft_consensus.cc:493] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:15.533736 26609 raft_consensus.cc:3060] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.534353 25529 raft_consensus.cc:1240] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.511688 26247 leader_election.cc:304] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.500274 25527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91ee1848f2435bb3dba61a2370f733" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.535440 25684 raft_consensus.cc:1240] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:15.539664 26661 raft_consensus.cc:2749] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.540500 25533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.494866 26613 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:15.493615 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.493834 25601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015cfc692b904ffb8d66556e17bd9ed1" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.491900 26662 raft_consensus.cc:493] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:15.532235 26628 raft_consensus.cc:2749] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.550177 26662 raft_consensus.cc:3060] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:15.525776 26658 raft_consensus.cc:2749] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.534868 26640 consensus_queue.cc:1059] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:21:15.552398 26640 raft_consensus.cc:3055] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:21:15.552724 26640 raft_consensus.cc:740] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:15.553120 26603 raft_consensus.cc:515] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:15.553499 26640 consensus_queue.cc:260] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:15.554214 25528 raft_consensus.cc:1240] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.554271 26609 raft_consensus.cc:515] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.531755 25648 leader_election.cc:304] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:15.528362 26636 consensus_queue.cc:1059] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:21:15.542366 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:15.544795 25676 raft_consensus.cc:1240] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.544920 25675 raft_consensus.cc:1240] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:15.545511 26615 raft_consensus.cc:3055] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:21:15.547870 26649 raft_consensus.cc:515] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.559330 26649 leader_election.cc:290] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:15.560091 26609 leader_election.cc:290] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:15.555047 26640 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:15.555859 26636 raft_consensus.cc:3055] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:15.572050 26636 raft_consensus.cc:740] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:15.573002 26636 consensus_queue.cc:260] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:15.574349 26636 raft_consensus.cc:3060] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.575615 25675 raft_consensus.cc:1240] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Rejecting Update request from peer 812474b88dc54c39bc37428d77dcb7a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:15.576140 26662 raft_consensus.cc:515] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:15.577605 25675 raft_consensus.cc:1240] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Rejecting Update request from peer 812474b88dc54c39bc37428d77dcb7a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:21:15.578299 25530 raft_consensus.cc:1240] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 3. Current term is 4. Ops: []
I20260709 13:21:15.578646 26662 leader_election.cc:290] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:15.580785 25675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4a5b928a5a4ca3a0959ce95d445c42" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.500577 26648 raft_consensus.cc:2749] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.565054 26628 raft_consensus.cc:2749] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.566009 25676 raft_consensus.cc:1240] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.566179 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:15.562085 26603 leader_election.cc:290] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
W20260709 13:21:15.556777 26247 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 45184.7us
I20260709 13:21:15.582906 17228 raft_consensus.cc:2243] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:15.583429 17228 raft_consensus.cc:2272] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:15.583539 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc9240e31c174ddab78702a2343b3d64" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.556996 26615 raft_consensus.cc:740] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:15.583304 26247 leader_election.cc:304] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.586715 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.586548 26615 consensus_queue.cc:260] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:15.587852 26247 leader_election.cc:304] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.587983 26615 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:15.588285 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9206e4480e54c158fe2a2ecab45efa8" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.588979 26636 raft_consensus.cc:2749] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.589802 26636 raft_consensus.cc:2749] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.590072 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.571440 25499 leader_election.cc:304] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.593868 26658 consensus_queue.cc:1059] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:15.594045 26247 leader_election.cc:304] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.594477 25499 leader_election.cc:304] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.594960 26658 raft_consensus.cc:3055] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:15.594720 26636 consensus_queue.cc:1059] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:21:15.595366 26658 raft_consensus.cc:740] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:15.595431 26657 raft_consensus.cc:2749] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.595628 26662 raft_consensus.cc:2749] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.596067 26650 raft_consensus.cc:3055] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:21:15.596403 26662 raft_consensus.cc:2749] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.596537 26650 raft_consensus.cc:740] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:15.596312 26658 consensus_queue.cc:260] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:15.596942 26247 leader_election.cc:304] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.597960 26657 raft_consensus.cc:2749] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.597656 26650 consensus_queue.cc:260] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:15.598987 26650 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:15.599423 26247 leader_election.cc:304] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.600301 26657 raft_consensus.cc:2749] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:21:15.537778 25647 consensus_peers.cc:597] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.600883 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 95368.9us
I20260709 13:21:15.601755 26247 leader_election.cc:304] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.602759 26657 raft_consensus.cc:2749] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.604122 26247 leader_election.cc:304] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:21:15.601854 25647 consensus_peers.cc:597] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.605294 25647 consensus_peers.cc:597] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.606133 26657 raft_consensus.cc:2749] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.607085 26619 consensus_queue.cc:1059] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:15.607631 26629 consensus_queue.cc:1059] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:15.597760 26658 raft_consensus.cc:3060] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.608520 26635 consensus_queue.cc:1059] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:15.609697 26614 raft_consensus.cc:3055] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:15.610086 26614 raft_consensus.cc:740] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:15.610157 26629 raft_consensus.cc:3055] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:15.610540 26629 raft_consensus.cc:740] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:15.610975 26614 consensus_queue.cc:260] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.611349 26629 consensus_queue.cc:260] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.612515 26629 raft_consensus.cc:3060] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.580698 26638 raft_consensus.cc:515] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:15.617859 26638 leader_election.cc:290] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:15.618573 26638 raft_consensus.cc:3055] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:15.618922 26638 raft_consensus.cc:740] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:15.619817 26638 consensus_queue.cc:260] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.621153 26638 raft_consensus.cc:3060] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.622601 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:15.623675 17228 raft_consensus.cc:2243] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:15.624475 17228 raft_consensus.cc:2272] T 1ed58b0dbded4dfc9447d9712ff39fea P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:15.625483 26614 raft_consensus.cc:3060] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.627506 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:15.628700 17228 raft_consensus.cc:2243] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:15.629233 17228 raft_consensus.cc:2272] T 081346db72a04ea4b600a44f560616ff P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:15.634703 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.640537 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.641078 26635 consensus_queue.cc:1059] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:15.641907 26651 consensus_queue.cc:1059] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:15.642231 26635 raft_consensus.cc:3055] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:15.642630 26635 raft_consensus.cc:740] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:15.643112 26619 raft_consensus.cc:3055] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:15.643499 26619 raft_consensus.cc:740] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:15.643556 26635 consensus_queue.cc:260] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.644776 26635 raft_consensus.cc:3060] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.644438 26619 consensus_queue.cc:260] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:15.646188 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f61b96593545c79c1d08d45ad98dee" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.650321 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.653903 26619 raft_consensus.cc:3060] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.654891 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15e4fb6800449ceb211a61be3587ecc" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.656931 26651 consensus_queue.cc:1059] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:15.658039 26651 raft_consensus.cc:3055] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:21:15.658335 26651 raft_consensus.cc:740] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:15.653807 25601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.659819 26651 consensus_queue.cc:260] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:15.662123 26651 raft_consensus.cc:3060] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:15.662633 25603 raft_consensus.cc:2468] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:15.666980 25528 raft_consensus.cc:1240] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Rejecting Update request from peer 812474b88dc54c39bc37428d77dcb7a9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:21:15.668402 26660 consensus_queue.cc:1059] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:15.669430 26658 raft_consensus.cc:3055] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:21:15.669772 26658 raft_consensus.cc:740] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:15.670081 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.670614 26658 consensus_queue.cc:260] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:15.672923 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:15.673341 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.674932 26658 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:15.679301 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5001675947e47d284c3bc4729cf9fd9" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.681871 25676 raft_consensus.cc:1240] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.682363 25601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f270f0fdf64e0790bc9e2247ab15c3" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.686780 25528 raft_consensus.cc:1240] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 1. Current term is 2. Ops: []
W20260709 13:21:15.691216 25499 leader_election.cc:336] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.693782 25500 leader_election.cc:304] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:15.694511 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.695356 26662 raft_consensus.cc:2804] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:15.695528 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.695920 26662 raft_consensus.cc:697] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:15.696904 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:15.696872 26662 consensus_queue.cc:237] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.699024 25602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.700206 25602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.700812 25608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.701066 25605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.702140 26619 consensus_queue.cc:1059] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:15.703341 26619 raft_consensus.cc:3055] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:15.703653 26619 raft_consensus.cc:740] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:15.700133 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a7192762c540d5aed9ffabc2695f7e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:15.704787 26619 consensus_queue.cc:260] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:15.709796 25604 raft_consensus.cc:2468] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:15.711398 17228 raft_consensus.cc:2243] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:15.712194 26635 consensus_queue.cc:1059] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:15.712888 17228 raft_consensus.cc:2272] T adc7c5727cfc47e2b169253aee4be079 P 812474b88dc54c39bc37428d77dcb7a9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:15.713398 26614 raft_consensus.cc:3055] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:15.713835 26614 raft_consensus.cc:740] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:15.714627 26614 consensus_queue.cc:260] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.716101 26614 raft_consensus.cc:3060] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.721016 25601 raft_consensus.cc:2468] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 4.
I20260709 13:21:15.691679 25499 leader_election.cc:304] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:21:15.722827 25499 leader_election.cc:336] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.723242 25499 leader_election.cc:304] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.723323 26603 raft_consensus.cc:2749] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.723935 26604 raft_consensus.cc:2749] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:21:15.724416 25499 leader_election.cc:336] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.724853 25499 leader_election.cc:304] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.725502 26604 raft_consensus.cc:2749] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:21:15.726652 25499 leader_election.cc:336] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:15.727324 25499 leader_election.cc:336] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:15.727877 25499 leader_election.cc:336] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.728863 26635 consensus_queue.cc:1059] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:15.729595 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:15.729893 26635 consensus_queue.cc:1059] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:15.731797 26635 raft_consensus.cc:3055] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:15.732296 26635 raft_consensus.cc:740] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:15.733520 26635 consensus_queue.cc:260] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:15.735496 26628 consensus_queue.cc:1059] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:15.736917 26609 raft_consensus.cc:3055] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:15.736704 26635 raft_consensus.cc:3060] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.737891 26609 raft_consensus.cc:740] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:15.738736 26614 raft_consensus.cc:3055] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:15.744959 26614 raft_consensus.cc:740] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:15.740175 25647 leader_election.cc:304] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.742024 26619 raft_consensus.cc:3060] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.746238 26614 consensus_queue.cc:260] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:15.748102 26614 raft_consensus.cc:3060] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.750178 26628 raft_consensus.cc:2749] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.752449 25647 leader_election.cc:304] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.739064 26609 consensus_queue.cc:260] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
W20260709 13:21:15.755563 25573 leader_election.cc:336] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.756253 25573 leader_election.cc:304] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
W20260709 13:21:15.757705 25499 leader_election.cc:336] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.743266 25603 raft_consensus.cc:2468] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 3.
W20260709 13:21:15.760839 25573 leader_election.cc:336] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.762413 25573 leader_election.cc:304] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.764125 17228 raft_consensus.cc:2243] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:15.760908 25499 leader_election.cc:336] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.766698 26609 raft_consensus.cc:3060] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.759001 26628 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:15.776471 17228 raft_consensus.cc:2272] T 5866aa38b1814ecfacca55ec773e6562 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:15.759725 26638 raft_consensus.cc:2749] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:15.781216 25573 consensus_peers.cc:597] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.789002 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:15.790339 17228 raft_consensus.cc:2243] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:15.792148 26631 consensus_queue.cc:1059] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:15.793610 26613 raft_consensus.cc:3055] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:15.794071 26613 raft_consensus.cc:740] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:15.795055 26613 consensus_queue.cc:260] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:15.802205 17228 raft_consensus.cc:2272] T 74f6d48dac364e25bcc18c1388db7fb6 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:15.783555 26629 raft_consensus.cc:2749] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.761845 26630 consensus_queue.cc:1059] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:21:15.807124 26630 raft_consensus.cc:3055] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:15.807623 26630 raft_consensus.cc:740] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:15.808517 26630 consensus_queue.cc:260] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
W20260709 13:21:15.813795 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 53313.8us
W20260709 13:21:15.814369 25573 leader_election.cc:336] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.809775 26630 raft_consensus.cc:3060] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.814872 25647 leader_election.cc:304] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.816146 25647 leader_election.cc:304] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
W20260709 13:21:15.813369 25499 consensus_peers.cc:597] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.817301 25676 raft_consensus.cc:1240] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Rejecting Update request from peer 812474b88dc54c39bc37428d77dcb7a9 for earlier term 3. Current term is 4. Ops: []
W20260709 13:21:15.817101 25499 consensus_peers.cc:597] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.815594 25573 consensus_peers.cc:597] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.822165 25499 consensus_peers.cc:597] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.827513 26633 raft_consensus.cc:2749] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.822570 26649 raft_consensus.cc:2749] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.829579 26615 consensus_queue.cc:1059] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:15.830633 26615 raft_consensus.cc:3055] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:21:15.830971 26615 raft_consensus.cc:740] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:15.831776 26615 consensus_queue.cc:260] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:21:15.832669 25573 consensus_peers.cc:597] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.833585 25573 consensus_peers.cc:597] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.834175 25573 leader_election.cc:336] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.834643 25573 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.835582 26619 raft_consensus.cc:2749] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:21:15.835774 25573 leader_election.cc:336] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.836299 25573 leader_election.cc:304] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:21:15.837432 25573 leader_election.cc:336] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.838557 26651 raft_consensus.cc:2749] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.842031 25606 raft_consensus.cc:2468] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 3.
W20260709 13:21:15.838315 25573 leader_election.cc:336] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.844910 26628 raft_consensus.cc:2749] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:15.845630 25573 leader_election.cc:304] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.846462 26614 raft_consensus.cc:2749] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:15.846846 25573 leader_election.cc:336] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.847337 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:15.848383 17228 raft_consensus.cc:2243] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:15.847328 25573 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.849347 17228 raft_consensus.cc:2272] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:15.850395 25573 leader_election.cc:336] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.833052 26615 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:21:15.851291 25573 leader_election.cc:336] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.851713 25573 leader_election.cc:304] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.852471 26619 raft_consensus.cc:2749] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:15.852797 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:15.853134 26619 raft_consensus.cc:2749] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.852916 25355 catalog_manager.cc:5697] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 1 to 2, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:15.853746 17228 raft_consensus.cc:2243] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:15.854349 17228 raft_consensus.cc:2272] T 445f8e17e0e2419bb3b63d012776f356 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:15.854518 25573 leader_election.cc:336] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.854954 25573 leader_election.cc:304] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:21:15.826769 25499 consensus_peers.cc:597] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.859118 25573 leader_election.cc:336] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.859599 25573 leader_election.cc:304] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:21:15.860723 25573 leader_election.cc:336] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.861260 25573 leader_election.cc:304] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
W20260709 13:21:15.858059 25499 consensus_peers.cc:597] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.863878 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:33863, user_credentials={real_user=slave}} blocked reactor thread for 47768.6us
I20260709 13:21:15.862190 26619 raft_consensus.cc:2749] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.865682 25603 raft_consensus.cc:1240] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Rejecting Update request from peer 812474b88dc54c39bc37428d77dcb7a9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:15.866590 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:15.866976 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcc479ee6b94c918ab197a87e9e969a" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.867743 17228 raft_consensus.cc:2243] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:15.867776 26658 consensus_queue.cc:1059] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:15.868556 17228 raft_consensus.cc:2272] T cddcb2168c0d4acaba5e547ac0c03ebb P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:15.869000 26658 raft_consensus.cc:3055] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:15.870214 26619 raft_consensus.cc:2749] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.870389 26658 raft_consensus.cc:740] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 812474b88dc54c39bc37428d77dcb7a9, State: Running, Role: LEADER
I20260709 13:21:15.871152 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e89c6170734a98849f97b6441df9e4" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.871258 26658 consensus_queue.cc:260] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:21:15.872632 25573 leader_election.cc:336] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.882340 25676 raft_consensus.cc:2468] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:15.955107 25573 leader_election.cc:304] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.964088 26635 raft_consensus.cc:2749] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:15.964195 25573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 91588.3us
W20260709 13:21:15.964953 25573 leader_election.cc:336] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.965353 25573 leader_election.cc:304] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:15.965394 25676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.862030 26614 raft_consensus.cc:2749] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.882167 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.966856 25676 raft_consensus.cc:1240] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Rejecting Update request from peer ae560ddb7e6849f69d0c5f47075d3bf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.967166 25684 raft_consensus.cc:1240] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Rejecting Update request from peer ae560ddb7e6849f69d0c5f47075d3bf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.968379 25684 raft_consensus.cc:1240] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Rejecting Update request from peer ae560ddb7e6849f69d0c5f47075d3bf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.878727 25675 raft_consensus.cc:1240] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Rejecting Update request from peer ae560ddb7e6849f69d0c5f47075d3bf9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.873250 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.970786 25680 raft_consensus.cc:2393] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ae560ddb7e6849f69d0c5f47075d3bf9 in current term 4: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
I20260709 13:21:15.881453 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc39a93c665a491a81bb0925b35ccf33" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.940626 17228 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:15.898293 25499 consensus_peers.cc:597] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.971652 25499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 73438.3us
I20260709 13:21:15.972232 17228 raft_consensus.cc:2243] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:15.972553 25573 leader_election.cc:336] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.972908 17228 raft_consensus.cc:2272] T d4f270f0fdf64e0790bc9e2247ab15c3 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:15.973003 25573 leader_election.cc:304] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
W20260709 13:21:15.902699 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:15.880745 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.978164 17228 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:15.933061 25647 consensus_peers.cc:597] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.978559 25647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:45089, user_credentials={real_user=slave}} blocked reactor thread for 61004.9us
I20260709 13:21:15.880076 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aed70992ac24e10943f5bcab0a11d67" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.980723 26635 raft_consensus.cc:2749] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:15.884209 25530 raft_consensus.cc:1240] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Rejecting Update request from peer f8a9e56b2e1e46de810671b2180d8a68 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:15.937580 26658 raft_consensus.cc:3060] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.981505 26635 raft_consensus.cc:2749] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:15.982681 25573 leader_election.cc:336] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.983160 25573 leader_election.cc:304] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.983911 26614 raft_consensus.cc:2749] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.984048 17228 raft_consensus.cc:2243] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:15.985651 17228 raft_consensus.cc:2272] T b4f6b0cbdad040bcb11d809dd492bc8d P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:15.986364 25499 consensus_peers.cc:597] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.938934 26613 raft_consensus.cc:3060] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:15.873258 25682 raft_consensus.cc:1240] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Rejecting Update request from peer ae560ddb7e6849f69d0c5f47075d3bf9 for earlier term 2. Current term is 3. Ops: []
W20260709 13:21:15.985095 25573 leader_election.cc:336] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:15.988633 25574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:15.879778 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15e4fb6800449ceb211a61be3587ecc" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:15.989135 25573 leader_election.cc:304] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:15.989812 26614 raft_consensus.cc:2749] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:15.989812 25499 consensus_peers.cc:597] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:15.990890 25573 leader_election.cc:336] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:15.990978 25499 consensus_peers.cc:597] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.991372 25573 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:21:15.991600 25499 consensus_peers.cc:597] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:15.992038 26614 raft_consensus.cc:2749] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:21:15.992393 25573 leader_election.cc:336] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:15.993505 25573 leader_election.cc:336] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.993824 25573 leader_election.cc:304] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
W20260709 13:21:15.994774 25573 leader_election.cc:336] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:15.995591 26635 raft_consensus.cc:2749] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:15.997845 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.000052 17228 raft_consensus.cc:2243] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.003077 17228 raft_consensus.cc:2272] T dc39a93c665a491a81bb0925b35ccf33 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:16.006343 25647 consensus_peers.cc:597] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:16.007085 25647 leader_election.cc:336] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:16.007515 25647 leader_election.cc:304] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:16.008448 26613 raft_consensus.cc:2749] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:21:16.009773 25647 leader_election.cc:336] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:16.010273 25647 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:16.011063 26613 raft_consensus.cc:2749] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:21:16.012420 25647 leader_election.cc:336] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:16.013084 25647 leader_election.cc:304] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:16.013331 25679 raft_consensus.cc:2468] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:15.995126 25573 leader_election.cc:304] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:16.017561 26614 raft_consensus.cc:2749] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:16.019536 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.020437 17228 raft_consensus.cc:2243] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.020928 26613 raft_consensus.cc:2749] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:16.021390 25648 leader_election.cc:304] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:16.022887 26613 raft_consensus.cc:2749] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:21:16.024351 25647 consensus_peers.cc:597] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:16.024652 17228 raft_consensus.cc:2272] T 36073ec086cc47098e9a796722246728 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.031731 25500 leader_election.cc:304] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:16.033547 26603 raft_consensus.cc:2804] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:16.034096 26603 raft_consensus.cc:697] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:16.035023 26603 consensus_queue.cc:237] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:16.036505 25499 leader_election.cc:304] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:16.037329 26620 raft_consensus.cc:2804] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:16.037849 26620 raft_consensus.cc:697] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:16.038805 26620 consensus_queue.cc:237] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:16.040663 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.042040 17228 raft_consensus.cc:2243] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.042551 17228 raft_consensus.cc:2272] T 278c9060803541ebb56ccb47687d3d4d P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.025162 25648 leader_election.cc:304] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:16.044551 25499 leader_election.cc:304] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:16.045166 26613 raft_consensus.cc:2749] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:16.045931 26600 raft_consensus.cc:2749] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:16.045948 25648 leader_election.cc:304] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:16.047385 26613 raft_consensus.cc:2749] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:16.047564 25499 leader_election.cc:304] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:16.048367 26600 raft_consensus.cc:2749] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:16.049258 26600 consensus_queue.cc:1059] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:16.049767 26606 consensus_queue.cc:1059] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:16.050236 26600 raft_consensus.cc:3055] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:16.050653 26600 raft_consensus.cc:740] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:16.051242 26606 raft_consensus.cc:3055] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:16.051621 26606 raft_consensus.cc:740] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:16.051779 25499 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:16.051618 26662 consensus_queue.cc:1059] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:16.052385 26604 consensus_queue.cc:1059] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:16.056862 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.057085 26600 consensus_queue.cc:260] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:16.060145 26600 raft_consensus.cc:3060] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:16.063113 25500 leader_election.cc:304] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:16.058116 17228 raft_consensus.cc:2243] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.066596 17228 raft_consensus.cc:2272] T 4b54054e46384e8aa7153f332c5c366f P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.055686 26606 consensus_queue.cc:260] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:16.071035 26606 raft_consensus.cc:3060] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:16.076030 26613 consensus_queue.cc:1059] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:16.077432 26672 raft_consensus.cc:3055] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:16.078819 26672 raft_consensus.cc:740] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:16.079763 26672 consensus_queue.cc:260] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:16.078347 26658 raft_consensus.cc:493] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:16.080991 26658 raft_consensus.cc:515] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:16.082757 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.083616 17228 raft_consensus.cc:2243] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.084062 17228 raft_consensus.cc:2272] T acdfccdb823e4badaf6a647eccefcc66 P 812474b88dc54c39bc37428d77dcb7a9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.087353 26603 raft_consensus.cc:2749] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:21:16.090818 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.090984 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e879da59df949eca2ae0618a4c5ddc2" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:16.091768 17228 raft_consensus.cc:2243] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.092295 17228 raft_consensus.cc:2272] T cc9240e31c174ddab78702a2343b3d64 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.092871 26658 leader_election.cc:290] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:16.095288 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.096163 17228 raft_consensus.cc:2243] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:16.096609 25648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:40853, user_credentials={real_user=slave}} blocked reactor thread for 47486.2us
I20260709 13:21:16.095194 26672 raft_consensus.cc:3060] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:16.098739 25648 leader_election.cc:304] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:16.099524 26613 raft_consensus.cc:2804] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:16.100193 26613 raft_consensus.cc:697] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:16.101099 26613 consensus_queue.cc:237] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:16.096727 17228 raft_consensus.cc:2272] T 85033b16e63444238f30de7eae6d6634 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.111217 17228 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:16.111716 25499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.4:44609, user_credentials={real_user=slave}} blocked reactor thread for 60009.7us
I20260709 13:21:16.112155 17228 raft_consensus.cc:2243] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:16.115728 17228 raft_consensus.cc:2272] T b1d018923485454fbcc0dccb5823166e P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.115839 25499 leader_election.cc:304] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:16.117024 25499 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:16.119345 26686 raft_consensus.cc:2804] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:16.121954 26600 raft_consensus.cc:2749] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:16.122327 26687 raft_consensus.cc:2749] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:16.122849 26686 raft_consensus.cc:697] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:16.124926 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.126116 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e879da59df949eca2ae0618a4c5ddc2" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:16.128965 26683 consensus_queue.cc:1059] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:21:16.130549 25500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:40853, user_credentials={real_user=slave}} blocked reactor thread for 67522us
W20260709 13:21:16.132807 25647 leader_election.cc:336] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:16.134837 25499 leader_election.cc:304] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:16.136255 17228 raft_consensus.cc:2243] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.137872 25647 leader_election.cc:304] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:16.147094 26613 raft_consensus.cc:2749] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:16.147924 26603 raft_consensus.cc:3055] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:16.148346 26603 raft_consensus.cc:740] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:16.148159 26686 consensus_queue.cc:237] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:16.138509 25357 catalog_manager.cc:5697] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 2 to 3, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 3 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.146602 25500 leader_election.cc:304] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:21:16.146545 25647 leader_election.cc:336] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:16.149192 26603 consensus_queue.cc:260] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:16.151546 26247 leader_election.cc:304] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:16.156215 26680 raft_consensus.cc:3055] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:16.154383 26600 raft_consensus.cc:2804] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:16.155257 26662 raft_consensus.cc:3055] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:16.158075 17228 raft_consensus.cc:2272] T b9bfde4ba996435bb05645af25e1f2c7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.158281 26662 raft_consensus.cc:740] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:16.159246 26662 consensus_queue.cc:260] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:16.157729 26680 raft_consensus.cc:740] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:16.160509 26662 raft_consensus.cc:3060] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:16.160766 26680 consensus_queue.cc:260] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:16.156769 26681 raft_consensus.cc:2804] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:16.157238 26603 raft_consensus.cc:3060] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:16.156473 26658 raft_consensus.cc:2749] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:16.151997 25647 leader_election.cc:304] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
W20260709 13:21:16.166869 25573 leader_election.cc:336] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:16.167544 25573 leader_election.cc:304] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:16.167974 26672 raft_consensus.cc:2749] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:21:16.168687 25573 leader_election.cc:336] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:16.169132 25573 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:16.169418 26635 raft_consensus.cc:2749] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:16.170060 26614 raft_consensus.cc:2749] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:21:16.170832 25573 leader_election.cc:336] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:16.171764 26681 raft_consensus.cc:697] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:16.171303 25573 leader_election.cc:304] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:16.173292 26614 raft_consensus.cc:2749] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:16.173388 26681 consensus_queue.cc:237] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:16.171046 26600 raft_consensus.cc:697] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:16.174952 26600 consensus_queue.cc:237] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
W20260709 13:21:16.175354 25647 leader_election.cc:336] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:16.175797 25647 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:16.161218 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.179991 26672 raft_consensus.cc:2749] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:16.180644 25603 raft_consensus.cc:1275] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:21:16.181209 25647 leader_election.cc:336] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:16.181692 25647 leader_election.cc:304] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
W20260709 13:21:16.182698 25647 consensus_peers.cc:597] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:16.183187 25647 leader_election.cc:336] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:16.184255 25647 leader_election.cc:336] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:16.184619 25647 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:16.185520 26631 raft_consensus.cc:2749] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:16.177695 17228 raft_consensus.cc:2243] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:16.185736 25647 consensus_peers.cc:597] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:16.187274 17228 raft_consensus.cc:2272] T 0c4b9518dd674972b99e9595c9b1c686 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.188122 26630 raft_consensus.cc:2749] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:21:16.190971 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.191886 17228 raft_consensus.cc:2243] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.192360 17228 raft_consensus.cc:2272] T de2624a22f2144868a7c62051f58771b P 812474b88dc54c39bc37428d77dcb7a9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.171173 26680 raft_consensus.cc:3060] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:16.196296 25530 raft_consensus.cc:1240] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Rejecting Update request from peer f8a9e56b2e1e46de810671b2180d8a68 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:16.202375 25355 catalog_manager.cc:5697] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 1 to 2, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.203987 25355 catalog_manager.cc:5697] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 1 to 2, leader changed from f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.208887 26672 consensus_queue.cc:1059] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:16.210210 26630 raft_consensus.cc:3055] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:16.210594 26630 raft_consensus.cc:740] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:16.211501 26630 consensus_queue.cc:260] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:16.212209 26658 raft_consensus.cc:493] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:16.212857 26658 raft_consensus.cc:515] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:16.212935 26630 raft_consensus.cc:3060] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:16.222939 25601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd9e5943fb6488091b514fd1aa47162" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:16.215215 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.225175 17228 raft_consensus.cc:2243] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.225894 17228 raft_consensus.cc:2272] T b3f61b96593545c79c1d08d45ad98dee P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.237879 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd9e5943fb6488091b514fd1aa47162" candidate_uuid: "812474b88dc54c39bc37428d77dcb7a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:16.239620 26247 leader_election.cc:304] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 812474b88dc54c39bc37428d77dcb7a9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:16.228526 26658 leader_election.cc:290] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:16.241382 26650 raft_consensus.cc:2749] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:16.243166 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.253638 17228 raft_consensus.cc:2243] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.254185 17228 raft_consensus.cc:2272] T 16f2f69975c44dceb5130378505518a2 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.228223 26600 consensus_queue.cc:1048] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:21:16.275576 25679 raft_consensus.cc:3060] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:16.276751 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.277649 17228 raft_consensus.cc:2243] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.278175 17228 raft_consensus.cc:2272] T 540f940c49e54189a08d7ed4d84f2ac6 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.289113 25679 raft_consensus.cc:1275] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:16.250115 25357 catalog_manager.cc:5697] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 3 to 4, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 4 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.294993 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.297971 17228 raft_consensus.cc:2243] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.298543 17228 raft_consensus.cc:2272] T 015cfc692b904ffb8d66556e17bd9ed1 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.298046 25357 catalog_manager.cc:5697] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 1 to 2, leader changed from f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.299968 25357 catalog_manager.cc:5697] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 2 to 3, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.300918 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.301625 17228 raft_consensus.cc:2243] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.302073 17228 raft_consensus.cc:2272] T 2704c533ff304006941c451f2f6d4660 P 812474b88dc54c39bc37428d77dcb7a9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.304530 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.305318 17228 raft_consensus.cc:2243] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.305766 17228 raft_consensus.cc:2272] T 4abab287ccaf44d4a4872b89f3012fa9 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.308494 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.309301 17228 raft_consensus.cc:2243] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.309828 17228 raft_consensus.cc:2272] T c9206e4480e54c158fe2a2ecab45efa8 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.311609 26600 consensus_queue.cc:1048] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:16.312897 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.313732 17228 raft_consensus.cc:2243] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.314299 17228 raft_consensus.cc:2272] T 56a7192762c540d5aed9ffabc2695f7e P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.317183 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.317883 17228 raft_consensus.cc:2243] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:16.318689 17228 raft_consensus.cc:2272] T aa0ee5fc6b56426093f29d36600f7af4 P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.321421 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.322228 17228 raft_consensus.cc:2243] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.322679 17228 raft_consensus.cc:2272] T cc265439c9a64543b0c69805e9131cfe P 812474b88dc54c39bc37428d77dcb7a9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.325708 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.326643 17228 raft_consensus.cc:2243] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.327163 17228 raft_consensus.cc:2272] T f9c681632e82489da482ce4f96f3a902 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.329962 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.330749 17228 raft_consensus.cc:2243] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.331233 17228 raft_consensus.cc:2272] T edc06587e5c544c7a834950d9f45c6c8 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.333863 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.334666 17228 raft_consensus.cc:2243] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.335093 17228 raft_consensus.cc:2272] T d5001675947e47d284c3bc4729cf9fd9 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.338883 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.339603 17228 raft_consensus.cc:2243] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.340139 17228 raft_consensus.cc:2272] T f8f052365b064537ba68ac4701e53694 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.342806 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.343531 17228 raft_consensus.cc:2243] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.344147 17228 raft_consensus.cc:2272] T 6397caa427af450ca361a53cc74cf838 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.346715 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.348241 17228 raft_consensus.cc:2243] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:16.349148 17228 raft_consensus.cc:2272] T e85f98cb5cd14fa9a4a620defb96cb6c P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.351694 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.352504 17228 raft_consensus.cc:2243] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.352991 17228 raft_consensus.cc:2272] T f703b8e7da3f432e95c5d1b9fc735f71 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.355672 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.356367 17228 raft_consensus.cc:2243] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:16.357366 17228 raft_consensus.cc:2272] T 8734a5e02643462e85823bc7afb27b93 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.359932 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.360556 17228 raft_consensus.cc:2243] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.361011 17228 raft_consensus.cc:2272] T 788ee1912fba47fe8873f543b02189f7 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.363427 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.364064 17228 raft_consensus.cc:2243] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.364553 17228 raft_consensus.cc:2272] T afd9e5943fb6488091b514fd1aa47162 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.367177 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.367785 17228 raft_consensus.cc:2243] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.368242 17228 raft_consensus.cc:2272] T 9e879da59df949eca2ae0618a4c5ddc2 P 812474b88dc54c39bc37428d77dcb7a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.371120 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.371718 17228 raft_consensus.cc:2243] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.372153 17228 raft_consensus.cc:2272] T 2be301b0a3ad4513936a33b8c989ab3d P 812474b88dc54c39bc37428d77dcb7a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.374969 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:16.375566 17228 raft_consensus.cc:2243] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.375981 17228 raft_consensus.cc:2272] T 1c91ee1848f2435bb3dba61a2370f733 P 812474b88dc54c39bc37428d77dcb7a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:16.433101 25499 consensus_peers.cc:597] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:16.531806 25601 raft_consensus.cc:1275] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:16.533106 26603 consensus_queue.cc:1048] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:16.554371 25603 raft_consensus.cc:3060] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:16.561861 25601 raft_consensus.cc:1275] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:16.563647 26628 consensus_queue.cc:1048] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:16.571816 25603 raft_consensus.cc:1275] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:16.577489 26603 consensus_queue.cc:1048] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:16.604007 25678 raft_consensus.cc:1275] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:16.606249 25679 raft_consensus.cc:1275] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:21:16.609157 25647 consensus_peers.cc:597] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:16.610539 26600 consensus_queue.cc:1048] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:16.612406 26603 consensus_queue.cc:1048] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:16.630173 26600 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:16.630757 26600 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:16.633841 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:16.634001 26600 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:16.634704 25604 raft_consensus.cc:2393] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae560ddb7e6849f69d0c5f47075d3bf9 in current term 4: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
W20260709 13:21:16.639531 25499 consensus_peers.cc:597] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:16.642354 25604 raft_consensus.cc:3060] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:16.650132 25604 raft_consensus.cc:1275] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:16.654649 26604 consensus_queue.cc:1048] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:16.657799 25499 leader_election.cc:336] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:16.659122 25499 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:16.664428 26604 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:16.673027 26604 raft_consensus.cc:2749] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:16.704063 25604 raft_consensus.cc:1275] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:16.705358 26604 consensus_queue.cc:1048] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:16.729113 25679 raft_consensus.cc:1275] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:16.730659 26604 consensus_queue.cc:1048] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:16.753201 25604 raft_consensus.cc:1275] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:16.754941 26686 consensus_queue.cc:1048] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:16.863600 26604 raft_consensus.cc:493] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:16.864248 26604 raft_consensus.cc:515] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:16.866758 26604 leader_election.cc:290] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:16.868206 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:16.869225 25604 raft_consensus.cc:2393] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae560ddb7e6849f69d0c5f47075d3bf9 in current term 3: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
W20260709 13:21:16.870651 25499 leader_election.cc:336] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:16.871024 25499 leader_election.cc:304] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:16.871795 26604 raft_consensus.cc:3060] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:16.880829 26604 raft_consensus.cc:2749] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:16.944983 26604 raft_consensus.cc:493] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:16.945590 26604 raft_consensus.cc:515] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:16.947983 26709 raft_consensus.cc:493] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.948702 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:16.949055 26709 raft_consensus.cc:515] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:16.949726 25679 raft_consensus.cc:2393] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae560ddb7e6849f69d0c5f47075d3bf9 in current term 3: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
I20260709 13:21:16.951467 26709 leader_election.cc:290] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:16.952737 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:16.953500 25528 raft_consensus.cc:2468] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:21:16.953627 26604 leader_election.cc:290] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:16.954819 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:16.954891 25573 leader_election.cc:304] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:16.956266 26709 raft_consensus.cc:2804] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:16.956646 26709 raft_consensus.cc:493] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.956980 26709 raft_consensus.cc:3060] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:21:16.957794 25499 leader_election.cc:336] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:16.958353 25499 leader_election.cc:304] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:16.959666 26604 raft_consensus.cc:3060] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:16.967794 26604 raft_consensus.cc:2749] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:16.967794 26709 raft_consensus.cc:515] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:16.969972 26709 leader_election.cc:290] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:16.970903 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:16.971729 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:16.971756 25528 raft_consensus.cc:3060] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:16.979465 25528 raft_consensus.cc:2468] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 4.
I20260709 13:21:16.980772 25573 leader_election.cc:304] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:16.981778 26709 raft_consensus.cc:2804] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:16.982334 26709 raft_consensus.cc:697] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:16.983081 26709 consensus_queue.cc:237] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:16.993531 25359 catalog_manager.cc:5697] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.006349 26604 raft_consensus.cc:493] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.007047 26604 raft_consensus.cc:515] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:17.011401 26604 leader_election.cc:290] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:17.012632 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:17.013597 25604 raft_consensus.cc:2393] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae560ddb7e6849f69d0c5f47075d3bf9 in current term 3: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
W20260709 13:21:17.013860 25499 leader_election.cc:336] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.015072 25500 leader_election.cc:304] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.015776 26686 raft_consensus.cc:3060] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.018997 26614 raft_consensus.cc:493] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.019506 26614 raft_consensus.cc:515] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.021517 26614 leader_election.cc:290] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.022799 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.023612 25679 raft_consensus.cc:2468] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:21:17.024668 26686 raft_consensus.cc:2749] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:17.026355 25573 leader_election.cc:304] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:17.027107 26614 raft_consensus.cc:2804] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:21:17.027323 25573 leader_election.cc:336] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.027519 26614 raft_consensus.cc:493] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.027882 26614 raft_consensus.cc:3060] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:17.033460 26614 raft_consensus.cc:515] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.035264 26614 leader_election.cc:290] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.036180 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f703b8e7da3f432e95c5d1b9fc735f71" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:17.036907 25679 raft_consensus.cc:3060] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:21:17.039834 25573 leader_election.cc:336] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.045068 25679 raft_consensus.cc:2468] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 4.
I20260709 13:21:17.046386 25573 leader_election.cc:304] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.047154 26614 raft_consensus.cc:2804] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:17.047668 26614 raft_consensus.cc:697] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:17.048990 26614 consensus_queue.cc:237] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.057607 25359 catalog_manager.cc:5697] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.080495 26628 raft_consensus.cc:493] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.081152 26628 raft_consensus.cc:515] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.083580 26628 leader_election.cc:290] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:17.085150 26614 raft_consensus.cc:493] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.085615 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.087247 25528 raft_consensus.cc:2393] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 4: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:21:17.087023 26614 raft_consensus.cc:515] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.090617 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015cfc692b904ffb8d66556e17bd9ed1" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.090850 26614 leader_election.cc:290] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.091355 25679 raft_consensus.cc:2468] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
W20260709 13:21:17.093626 25647 leader_election.cc:336] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.094110 25647 leader_election.cc:304] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:17.094312 25573 leader_election.cc:304] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:17.096056 26628 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:21:17.097434 25573 leader_election.cc:336] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.100927 26614 raft_consensus.cc:2804] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:17.101496 26614 raft_consensus.cc:493] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.102342 26614 raft_consensus.cc:3060] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.104576 26628 raft_consensus.cc:2749] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:17.112720 26614 raft_consensus.cc:515] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.115168 26614 leader_election.cc:290] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.116110 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015cfc692b904ffb8d66556e17bd9ed1" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:17.116696 26628 raft_consensus.cc:493] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.116829 25679 raft_consensus.cc:3060] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.117319 26628 raft_consensus.cc:515] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
W20260709 13:21:17.120052 25573 leader_election.cc:336] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.124055 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.124791 25528 raft_consensus.cc:2468] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:21:17.121450 26628 leader_election.cc:290] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:17.125509 25679 raft_consensus.cc:2468] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:21:17.126756 25573 leader_election.cc:304] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.127794 25647 leader_election.cc:304] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:17.128173 26614 raft_consensus.cc:2804] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:17.129048 26614 raft_consensus.cc:697] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
W20260709 13:21:17.129175 25647 leader_election.cc:336] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.128861 26628 raft_consensus.cc:2804] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:17.130053 26628 raft_consensus.cc:493] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.130507 26628 raft_consensus.cc:3060] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.130118 26614 consensus_queue.cc:237] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.139199 26628 raft_consensus.cc:515] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.141590 26628 leader_election.cc:290] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:17.145562 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36073ec086cc47098e9a796722246728" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:17.147020 25528 raft_consensus.cc:3060] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.153683 25359 catalog_manager.cc:5697] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.164094 25528 raft_consensus.cc:2468] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 3.
W20260709 13:21:17.164518 25647 leader_election.cc:336] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.165580 25647 leader_election.cc:304] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.166381 26628 raft_consensus.cc:2804] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:17.166932 26628 raft_consensus.cc:697] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:17.167850 26628 consensus_queue.cc:237] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.181849 25359 catalog_manager.cc:5697] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.196184 26628 raft_consensus.cc:493] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0a6b07f89a2c437ea29fb7c7e52440ba)
I20260709 13:21:17.196906 26628 raft_consensus.cc:515] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.199105 26628 leader_election.cc:290] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:17.200713 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.201607 25528 raft_consensus.cc:2368] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 for earlier term 3. Current term is 4.
I20260709 13:21:17.203065 25647 leader_election.cc:400] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863) with higher term. Message: Invalid argument: T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 for earlier term 3. Current term is 4.
I20260709 13:21:17.203377 25647 leader_election.cc:403] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:17.203433 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a4d25643be42a6bf6f0b1d65400bee" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:17.204397 26628 raft_consensus.cc:3060] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:21:17.212423 26628 raft_consensus.cc:2749] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863) with higher term. Message: Invalid argument: T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 for earlier term 3. Current term is 4.
I20260709 13:21:17.218321 26628 raft_consensus.cc:493] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.218881 26628 raft_consensus.cc:515] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.221172 26628 leader_election.cc:290] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.221763 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:17.222630 25604 raft_consensus.cc:2393] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 3: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
W20260709 13:21:17.226019 25647 leader_election.cc:336] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.226575 25647 leader_election.cc:304] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.227351 26628 raft_consensus.cc:3060] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.235446 26628 raft_consensus.cc:2749] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:17.281217 26614 raft_consensus.cc:493] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.281886 26614 raft_consensus.cc:515] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.284077 26614 leader_election.cc:290] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:17.285086 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.285243 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.286080 25682 raft_consensus.cc:2468] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:17.286337 25528 raft_consensus.cc:2468] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:17.287158 25573 leader_election.cc:304] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:17.287952 26614 raft_consensus.cc:2804] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:17.288389 26614 raft_consensus.cc:493] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.288722 26614 raft_consensus.cc:3060] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.294775 26614 raft_consensus.cc:515] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.296327 26614 leader_election.cc:290] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:17.297289 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:17.297437 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2520ae829ce4b3082870ad84db70f7d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:17.298156 25682 raft_consensus.cc:3060] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.298099 25528 raft_consensus.cc:3060] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.305603 25682 raft_consensus.cc:2468] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:21:17.306200 25528 raft_consensus.cc:2468] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:21:17.306890 25573 leader_election.cc:304] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:17.307669 26614 raft_consensus.cc:2804] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:17.308198 26614 raft_consensus.cc:697] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:17.309113 26614 consensus_queue.cc:237] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.319499 26604 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.320144 26604 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:17.321125 25359 catalog_manager.cc:5697] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.323980 26604 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:17.327522 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:21:17.327878 25499 leader_election.cc:336] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.334954 26614 raft_consensus.cc:493] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.335397 25500 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.335551 26614 raft_consensus.cc:515] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.336927 26604 raft_consensus.cc:2749] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:17.338589 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.339278 25530 raft_consensus.cc:2468] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:17.338635 26614 leader_election.cc:290] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:17.340196 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.340838 25682 raft_consensus.cc:2468] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:17.342056 25573 leader_election.cc:304] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:17.342790 26709 raft_consensus.cc:2804] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:17.343148 26709 raft_consensus.cc:493] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.343489 26709 raft_consensus.cc:3060] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.357903 26709 raft_consensus.cc:515] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.359835 26709 leader_election.cc:290] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:17.360878 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:17.361240 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b275ea51fb94eeaac1650d139e43706" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:17.361507 25682 raft_consensus.cc:3060] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.361858 25530 raft_consensus.cc:3060] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.367231 25682 raft_consensus.cc:2468] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:21:17.368377 25530 raft_consensus.cc:2468] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:21:17.368453 25573 leader_election.cc:304] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:17.370605 26709 raft_consensus.cc:2804] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:17.371138 26709 raft_consensus.cc:697] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:17.371912 26709 consensus_queue.cc:237] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.381491 26604 raft_consensus.cc:493] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.382143 26604 raft_consensus.cc:515] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.383849 25682 raft_consensus.cc:1275] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:17.384876 26604 leader_election.cc:290] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:17.385895 26614 consensus_queue.cc:1048] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:17.387172 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:17.386081 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.388407 25682 raft_consensus.cc:2468] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:17.389609 25499 leader_election.cc:304] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:17.390709 26604 raft_consensus.cc:2804] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:17.391132 26604 raft_consensus.cc:493] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.391511 26604 raft_consensus.cc:3060] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.391881 25359 catalog_manager.cc:5697] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.411734 26604 raft_consensus.cc:515] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.416167 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:17.416677 25530 raft_consensus.cc:1275] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:17.418458 26614 consensus_queue.cc:1048] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:17.417135 26604 leader_election.cc:290] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:17.417191 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:17.423450 25682 raft_consensus.cc:3060] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:21:17.450898 17228 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 26393)
I20260709 13:21:17.456363 26609 raft_consensus.cc:493] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.456988 26609 raft_consensus.cc:515] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.460239 26609 leader_election.cc:290] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:17.467672 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.468358 25528 raft_consensus.cc:2468] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 4.
I20260709 13:21:17.471186 25647 leader_election.cc:304] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:17.472842 26628 raft_consensus.cc:2804] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:21:17.473400 26628 raft_consensus.cc:493] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.473836 26628 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:17.435245 25682 raft_consensus.cc:2468] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 3.
I20260709 13:21:17.482398 26606 raft_consensus.cc:493] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.483862 26606 raft_consensus.cc:515] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.486083 26606 leader_election.cc:290] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:17.488361 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:17.494916 25499 leader_election.cc:304] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:17.496846 26606 raft_consensus.cc:2804] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:17.497737 26606 raft_consensus.cc:697] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:17.499001 26606 consensus_queue.cc:237] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
W20260709 13:21:17.507140 25647 leader_election.cc:336] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.509280 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.510126 25682 raft_consensus.cc:2468] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 3.
I20260709 13:21:17.517241 25499 leader_election.cc:304] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:17.520462 26606 raft_consensus.cc:2804] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:17.521080 26606 raft_consensus.cc:493] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.521622 26606 raft_consensus.cc:3060] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:21:17.530247 25573 consensus_peers.cc:597] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.540562 26628 raft_consensus.cc:515] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.545368 26628 leader_election.cc:290] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:17.544778 25359 catalog_manager.cc:5697] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.548121 26606 raft_consensus.cc:515] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.550343 26606 leader_election.cc:290] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:17.553283 26628 raft_consensus.cc:493] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.554100 26628 raft_consensus.cc:515] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.556128 26628 leader_election.cc:290] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:17.557597 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc265439c9a64543b0c69805e9131cfe" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:17.558311 25528 raft_consensus.cc:3060] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:17.560870 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc39a93c665a491a81bb0925b35ccf33" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.561467 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:17.561579 25530 raft_consensus.cc:2468] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:21:17.562167 25679 raft_consensus.cc:3060] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:17.564823 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:17.566277 26723 raft_consensus.cc:493] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.566982 26723 raft_consensus.cc:515] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.569382 26723 leader_election.cc:290] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.569737 25528 raft_consensus.cc:2468] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 5.
I20260709 13:21:17.569737 25679 raft_consensus.cc:2468] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 4.
W20260709 13:21:17.571089 25647 leader_election.cc:336] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.572518 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.574151 25647 leader_election.cc:304] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:17.575055 26628 raft_consensus.cc:2804] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:17.575078 25679 raft_consensus.cc:1275] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:17.575600 26628 raft_consensus.cc:493] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.576079 26628 raft_consensus.cc:3060] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.577208 26723 consensus_queue.cc:1048] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:17.578299 25647 leader_election.cc:304] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.579120 26727 raft_consensus.cc:2804] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:21:17.579370 26606 raft_consensus.cc:493] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.579593 26727 raft_consensus.cc:697] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 5 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:17.580039 26606 raft_consensus.cc:515] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.580483 26727 consensus_queue.cc:237] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.582687 26606 leader_election.cc:290] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.584070 25499 leader_election.cc:304] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba
I20260709 13:21:17.585724 26606 raft_consensus.cc:2804] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:17.586270 26606 raft_consensus.cc:697] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:17.587172 26606 consensus_queue.cc:237] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.588253 26628 raft_consensus.cc:515] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
W20260709 13:21:17.588941 25499 leader_election.cc:336] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.590703 26628 leader_election.cc:290] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:17.592348 26723 raft_consensus.cc:493] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:17.593477 26723 raft_consensus.cc:515] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.594529 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.595441 25679 raft_consensus.cc:2468] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 4.
W20260709 13:21:17.591496 25573 leader_election.cc:336] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.596413 25573 leader_election.cc:304] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:17.595530 26723 leader_election.cc:290] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:17.597352 26614 raft_consensus.cc:2749] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:17.597625 25647 leader_election.cc:336] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.598584 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc39a93c665a491a81bb0925b35ccf33" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:17.599191 25528 raft_consensus.cc:3060] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.600507 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.600868 26723 raft_consensus.cc:493] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
W20260709 13:21:17.601451 25647 leader_election.cc:336] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.601610 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02cdf0754524b77ada52992d6e0b20e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.603830 25682 raft_consensus.cc:2368] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 2. Current term is 3.
I20260709 13:21:17.604347 26723 raft_consensus.cc:515] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.606292 26723 leader_election.cc:290] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:17.601996 25499 leader_election.cc:304] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.607522 26604 raft_consensus.cc:2804] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:21:17.607863 26604 raft_consensus.cc:493] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.608187 26604 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:21:17.611960 25647 consensus_peers.cc:597] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.613593 26686 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.614254 26686 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.616664 26686 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.625063 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.669859 25682 raft_consensus.cc:2468] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 4.
I20260709 13:21:17.626272 26628 raft_consensus.cc:493] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.624131 25528 raft_consensus.cc:2468] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 3.
I20260709 13:21:17.670622 26628 raft_consensus.cc:515] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.672020 25355 catalog_manager.cc:5697] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:17.640286 25499 leader_election.cc:336] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.675698 26628 leader_election.cc:290] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.651520 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.676836 25530 raft_consensus.cc:2468] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:17.654083 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.678843 25679 raft_consensus.cc:2393] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 2: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
I20260709 13:21:17.681329 26709 raft_consensus.cc:493] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:17.681890 26709 raft_consensus.cc:515] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.661322 26614 raft_consensus.cc:493] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.684461 26614 raft_consensus.cc:515] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:17.654129 25359 catalog_manager.cc:5697] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 3 to 5, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 5 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.686215 26614 leader_election.cc:290] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:17.683962 26709 leader_election.cc:290] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:17.661046 26723 raft_consensus.cc:493] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:17.689028 26723 raft_consensus.cc:515] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.690985 26723 leader_election.cc:290] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:17.647925 26604 raft_consensus.cc:515] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.693001 25647 leader_election.cc:304] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.694744 26734 raft_consensus.cc:2804] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:17.695292 25499 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.693722 26604 leader_election.cc:290] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.695353 26734 raft_consensus.cc:697] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:17.698091 26686 raft_consensus.cc:2804] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:21:17.698518 26686 raft_consensus.cc:493] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.698941 26686 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:17.698653 26734 consensus_queue.cc:237] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.702076 26732 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.702664 26732 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:17.703229 26604 raft_consensus.cc:493] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.706046 26604 raft_consensus.cc:515] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.707644 26732 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:17.709081 26604 leader_election.cc:290] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.712071 25573 leader_election.cc:400] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Vote denied by peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609) with higher term. Message: Invalid argument: T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 2. Current term is 3.
I20260709 13:21:17.712476 25573 leader_election.cc:403] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:17.713020 26723 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.713501 26723 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:17.714495 25573 leader_election.cc:304] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:17.715580 26723 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:17.716125 26723 raft_consensus.cc:3060] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.718073 26614 raft_consensus.cc:2804] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:17.718456 26614 raft_consensus.cc:493] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae560ddb7e6849f69d0c5f47075d3bf9)
I20260709 13:21:17.718765 26614 raft_consensus.cc:3060] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:17.722299 26737 raft_consensus.cc:493] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.722852 26737 raft_consensus.cc:515] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.723146 26606 raft_consensus.cc:493] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.723716 26606 raft_consensus.cc:515] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.724958 26737 leader_election.cc:290] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.725668 26606 leader_election.cc:290] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.726230 26606 raft_consensus.cc:493] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.726670 26606 raft_consensus.cc:515] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.728605 26606 leader_election.cc:290] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.730556 26614 raft_consensus.cc:515] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.730901 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2704c533ff304006941c451f2f6d4660" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:17.735469 25679 raft_consensus.cc:3060] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:21:17.731576 25647 leader_election.cc:336] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.736574 25530 raft_consensus.cc:1275] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:17.739333 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f61b96593545c79c1d08d45ad98dee" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.739969 25681 raft_consensus.cc:2468] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:17.743944 25681 raft_consensus.cc:1275] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:17.748891 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.748943 25679 raft_consensus.cc:2468] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 5.
I20260709 13:21:17.753098 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d6387533134a0099e05d485ca902e6" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.754014 25679 raft_consensus.cc:2368] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 3. Current term is 4.
I20260709 13:21:17.757210 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.757637 26614 leader_election.cc:290] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:17.757790 25530 raft_consensus.cc:2468] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:21:17.758230 26614 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.759835 26686 raft_consensus.cc:515] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.760895 26723 raft_consensus.cc:2749] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609) with higher term. Message: Invalid argument: T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 2. Current term is 3.
I20260709 13:21:17.760363 25359 catalog_manager.cc:5697] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.763820 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.764501 25679 raft_consensus.cc:2468] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
W20260709 13:21:17.765324 25499 leader_election.cc:336] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:21:17.766016 25499 leader_election.cc:336] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:21:17.766502 25499 leader_election.cc:336] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.758662 26614 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:17.771028 26614 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:17.772584 26734 consensus_queue.cc:1048] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:17.775175 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.775954 25530 raft_consensus.cc:2393] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 2: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:21:17.775820 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.777225 26686 leader_election.cc:290] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.778017 25679 raft_consensus.cc:2468] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:17.778846 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.779909 25530 raft_consensus.cc:2468] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:21:17.782796 25499 leader_election.cc:304] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:17.784077 26604 raft_consensus.cc:2804] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:17.784466 26604 raft_consensus.cc:493] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.784790 26604 raft_consensus.cc:3060] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.786013 26614 raft_consensus.cc:493] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.786517 26614 raft_consensus.cc:515] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.788237 26614 leader_election.cc:290] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.794963 26734 raft_consensus.cc:493] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.795572 26734 raft_consensus.cc:515] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.799139 26604 raft_consensus.cc:515] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.799996 26734 leader_election.cc:290] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:17.800935 26604 leader_election.cc:290] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.803103 25499 leader_election.cc:304] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.804744 25499 leader_election.cc:304] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:17.805428 26606 raft_consensus.cc:2804] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:21:17.805881 26606 raft_consensus.cc:697] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:17.806034 26732 raft_consensus.cc:2804] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:17.806432 26732 raft_consensus.cc:493] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.806528 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.806821 26606 consensus_queue.cc:237] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.807274 25682 raft_consensus.cc:2468] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:21:17.806831 26732 raft_consensus.cc:3060] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.812717 25601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:17.813480 25601 raft_consensus.cc:2468] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 3.
I20260709 13:21:17.814843 25601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:17.815522 25601 raft_consensus.cc:2468] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
W20260709 13:21:17.820712 25499 leader_election.cc:336] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.822728 26732 raft_consensus.cc:515] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.824937 25601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
W20260709 13:21:17.825155 25499 leader_election.cc:336] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.825860 25601 raft_consensus.cc:2468] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:21:17.827745 26732 leader_election.cc:290] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.829205 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:17.829907 25604 raft_consensus.cc:2468] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:21:17.843937 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:17.844223 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:17.844893 25682 raft_consensus.cc:2393] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 2: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
W20260709 13:21:17.846211 25573 consensus_peers.cc:597] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.847167 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdfccdb823e4badaf6a647eccefcc66" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:17.847714 25682 raft_consensus.cc:3060] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:17.851245 25530 raft_consensus.cc:2468] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:17.854259 26734 raft_consensus.cc:493] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.855335 26734 raft_consensus.cc:515] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.857519 26734 leader_election.cc:290] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
W20260709 13:21:17.858273 25647 consensus_peers.cc:597] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:17.858266 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.860467 25531 raft_consensus.cc:2468] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 2.
I20260709 13:21:17.859546 25682 raft_consensus.cc:2468] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 5.
W20260709 13:21:17.864387 25499 leader_election.cc:336] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.870715 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.870862 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f61b96593545c79c1d08d45ad98dee" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:17.871485 25531 raft_consensus.cc:2468] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:21:17.875268 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:17.875938 25679 raft_consensus.cc:2468] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:17.871728 25682 raft_consensus.cc:3060] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.880365 25648 leader_election.cc:304] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.881780 26734 raft_consensus.cc:2804] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:17.882349 26734 raft_consensus.cc:493] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.882838 26734 raft_consensus.cc:3060] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.882887 25500 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.883875 26732 raft_consensus.cc:2804] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:17.884344 26732 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.885095 26732 raft_consensus.cc:3060] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:17.885583 25359 catalog_manager.cc:5697] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 3 to 5, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 5 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:17.884316 25500 leader_election.cc:304] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.889032 26604 raft_consensus.cc:2804] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:17.889441 26604 raft_consensus.cc:493] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.889811 26604 raft_consensus.cc:3060] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.893465 25682 raft_consensus.cc:2468] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 3.
I20260709 13:21:17.894326 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abab287ccaf44d4a4872b89f3012fa9" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:17.895017 25681 raft_consensus.cc:3060] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.902268 26734 raft_consensus.cc:515] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.903849 25681 raft_consensus.cc:2468] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 3.
I20260709 13:21:17.906098 25573 leader_election.cc:304] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:17.910360 26614 raft_consensus.cc:2804] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:17.907485 25647 leader_election.cc:304] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:17.893494 26732 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:17.910830 26614 raft_consensus.cc:493] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.911389 26733 raft_consensus.cc:2804] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:17.911345 26614 raft_consensus.cc:3060] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:17.911876 26733 raft_consensus.cc:493] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.912668 26733 raft_consensus.cc:3060] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:17.912812 26732 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:17.909842 26604 raft_consensus.cc:515] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:21:17.882035 25499 leader_election.cc:336] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:21:17.916736 25499 leader_election.cc:336] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.918018 26604 leader_election.cc:290] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.919704 26614 raft_consensus.cc:515] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:17.910534 25573 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:17.921226 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:17.922456 25528 raft_consensus.cc:2468] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 3.
I20260709 13:21:17.923229 26723 raft_consensus.cc:2804] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:17.923693 26723 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.923861 25499 leader_election.cc:304] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.924077 26723 raft_consensus.cc:3060] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:17.925220 26606 raft_consensus.cc:2804] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:21:17.925724 26606 raft_consensus.cc:697] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:17.926590 26606 consensus_queue.cc:237] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.931241 25499 leader_election.cc:304] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.932696 26686 raft_consensus.cc:2804] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:21:17.933539 25647 leader_election.cc:336] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.933619 26686 raft_consensus.cc:697] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:17.921692 26614 leader_election.cc:290] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:17.938000 26686 consensus_queue.cc:237] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.932231 25573 leader_election.cc:304] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:17.935075 26723 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:17.942545 25573 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:17.946516 26723 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
W20260709 13:21:17.946470 25499 leader_election.cc:336] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:21:17.948661 25499 leader_election.cc:336] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:17.947232 26614 raft_consensus.cc:2804] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:17.949496 26614 raft_consensus.cc:697] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:17.950856 26614 consensus_queue.cc:237] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.953504 25647 leader_election.cc:304] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:17.951624 25359 catalog_manager.cc:5697] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 3 to 5, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 5 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:17.954622 26734 leader_election.cc:290] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.936229 26733 raft_consensus.cc:515] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:17.956641 26733 leader_election.cc:290] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:17.958117 26727 raft_consensus.cc:2804] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:17.958545 26727 raft_consensus.cc:493] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.958976 26727 raft_consensus.cc:3060] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:17.959523 26723 raft_consensus.cc:2804] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:17.960224 26723 raft_consensus.cc:493] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.960722 26723 raft_consensus.cc:3060] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:17.968286 26735 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:17.968994 26735 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:17.972005 26735 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:17.979604 26727 raft_consensus.cc:515] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:17.982780 25359 catalog_manager.cc:5697] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:17.981650 26727 leader_election.cc:290] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:17.990296 26709 consensus_queue.cc:1048] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:17.990517 25573 leader_election.cc:400] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Vote denied by peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609) with higher term. Message: Invalid argument: T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 3. Current term is 4.
I20260709 13:21:17.997298 25573 leader_election.cc:403] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:21:17.998980 25647 consensus_peers.cc:597] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:17.999435 25682 raft_consensus.cc:1275] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:18.012190 26614 raft_consensus.cc:3060] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:21:18.007283 26723 raft_consensus.cc:515] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:18.012642 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:18.013379 25528 raft_consensus.cc:3060] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:21:18.017956 25647 leader_election.cc:336] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:21:18.018595 25647 leader_election.cc:336] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.022470 26723 leader_election.cc:290] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:18.022671 25528 raft_consensus.cc:2468] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 3.
I20260709 13:21:18.024636 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f2f69975c44dceb5130378505518a2" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:18.025306 25531 raft_consensus.cc:3060] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:21:18.026451 25647 consensus_peers.cc:597] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.021806 25359 catalog_manager.cc:5697] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 1 to 2, leader changed from ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 2 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.028455 26614 raft_consensus.cc:2749] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609) with higher term. Message: Invalid argument: T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 3. Current term is 4.
W20260709 13:21:18.034278 25647 consensus_peers.cc:597] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:18.033664 25531 raft_consensus.cc:2468] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 4.
I20260709 13:21:18.035974 25573 leader_election.cc:304] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: ae560ddb7e6849f69d0c5f47075d3bf9
W20260709 13:21:18.037483 25647 consensus_peers.cc:597] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:18.035012 25499 leader_election.cc:304] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:18.038416 26686 raft_consensus.cc:2804] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:18.038743 26743 raft_consensus.cc:2804] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:18.038914 26686 raft_consensus.cc:697] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:18.039256 26743 raft_consensus.cc:493] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader f8a9e56b2e1e46de810671b2180d8a68)
I20260709 13:21:18.039711 26743 raft_consensus.cc:3060] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:18.039906 26686 consensus_queue.cc:237] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:18.046059 26606 consensus_queue.cc:1048] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:21:18.046190 25647 consensus_peers.cc:597] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:18.049422 25573 leader_election.cc:304] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:18.052978 26743 raft_consensus.cc:515] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:18.054805 25647 leader_election.cc:304] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:18.055604 26733 raft_consensus.cc:2804] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:18.056159 26614 raft_consensus.cc:2804] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:18.056208 26733 raft_consensus.cc:697] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 3 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:18.056785 26614 raft_consensus.cc:493] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.057159 26614 raft_consensus.cc:3060] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:18.057435 26733 consensus_queue.cc:237] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:18.055752 25647 leader_election.cc:304] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:18.062255 26727 raft_consensus.cc:2804] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:21:18.062595 25647 consensus_peers.cc:597] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:18.062755 26727 raft_consensus.cc:697] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:18.063593 26727 consensus_queue.cc:237] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:18.055708 26743 leader_election.cc:290] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Requested vote from peers ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:18.073033 26614 raft_consensus.cc:515] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:18.071165 25573 leader_election.cc:304] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:18.089593 26614 leader_election.cc:290] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:18.094410 26743 raft_consensus.cc:2804] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:18.100664 26743 raft_consensus.cc:493] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 812474b88dc54c39bc37428d77dcb7a9)
I20260709 13:21:18.100961 25682 raft_consensus.cc:1275] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:18.101356 26743 raft_consensus.cc:3060] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:18.100823 25355 catalog_manager.cc:5697] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 2 to 3, leader changed from 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 3 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:18.095551 26609 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.102437 26609 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:18.104393 26609 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:18.095465 25359 catalog_manager.cc:5697] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:18.105468 25499 consensus_peers.cc:597] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:18.107008 25647 consensus_peers.cc:597] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:18.106182 25573 leader_election.cc:336] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.114245 26743 raft_consensus.cc:515] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:21:18.114271 25573 leader_election.cc:336] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:21:18.116039 25573 leader_election.cc:336] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.118256 26743 leader_election.cc:290] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:18.118726 25531 raft_consensus.cc:1275] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:18.119747 26733 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.120251 26733 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:18.121328 25682 raft_consensus.cc:1275] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:18.122267 26733 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:18.123970 25682 raft_consensus.cc:1275] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:18.131336 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5866aa38b1814ecfacca55ec773e6562" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:18.133060 25531 raft_consensus.cc:3060] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:18.134336 25528 raft_consensus.cc:1275] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:21:18.137363 25647 leader_election.cc:336] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:21:18.140570 25647 leader_election.cc:336] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.143008 25531 raft_consensus.cc:2468] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 4.
W20260709 13:21:18.145315 25499 consensus_peers.cc:597] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:18.145491 25359 catalog_manager.cc:5697] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 2 to 4, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 4 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.146780 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:18.147782 25531 raft_consensus.cc:2393] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 4: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:21:18.148528 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:18.149394 25681 raft_consensus.cc:2393] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 4: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
I20260709 13:21:18.150460 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:18.151278 25528 raft_consensus.cc:2393] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 2: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:21:18.152441 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:18.152815 25531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0ee5fc6b56426093f29d36600f7af4" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:18.153242 25604 raft_consensus.cc:2393] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 3: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
I20260709 13:21:18.153626 26614 raft_consensus.cc:493] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.154091 26606 consensus_queue.cc:1048] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:18.154208 26614 raft_consensus.cc:515] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:18.155335 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbddeb15af47cbbe275279293370fa" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:18.156275 26686 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.156430 26614 leader_election.cc:290] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:18.156792 26686 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:18.158169 25604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:18.158778 25604 raft_consensus.cc:2468] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 3.
I20260709 13:21:18.158849 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:18.160349 25528 raft_consensus.cc:1275] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:21:18.153378 25531 raft_consensus.cc:3060] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:18.163383 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:18.163955 25528 raft_consensus.cc:2468] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 3.
I20260709 13:21:18.167801 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:18.168426 25678 raft_consensus.cc:2468] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 3.
I20260709 13:21:18.158860 26686 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:18.170465 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be301b0a3ad4513936a33b8c989ab3d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:18.171070 25683 raft_consensus.cc:3060] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:18.170980 26733 consensus_queue.cc:1048] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:21:18.176957 25531 raft_consensus.cc:2468] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 4.
I20260709 13:21:18.177758 25647 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:18.179401 26733 raft_consensus.cc:2804] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:18.179751 26733 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.180096 26733 raft_consensus.cc:3060] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:21:18.178673 25499 consensus_peers.cc:597] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:18.182729 25499 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:18.183792 26732 raft_consensus.cc:2804] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:18.184199 26732 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.184525 26732 raft_consensus.cc:3060] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:21:18.188385 25499 leader_election.cc:336] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.188279 26733 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:18.190398 26733 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:18.193486 25528 raft_consensus.cc:1275] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:21:18.195559 25647 leader_election.cc:336] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.197867 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:18.198216 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:18.199007 25603 raft_consensus.cc:2393] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ae560ddb7e6849f69d0c5f47075d3bf9 in current term 4: Already voted for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in this term.
I20260709 13:21:18.199126 26733 consensus_queue.cc:1048] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:18.200893 25603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8734a5e02643462e85823bc7afb27b93" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:18.201489 25603 raft_consensus.cc:3060] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:18.210655 25606 raft_consensus.cc:1275] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:18.208415 25603 raft_consensus.cc:2468] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 3.
I20260709 13:21:18.188524 25683 raft_consensus.cc:2468] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 4.
I20260709 13:21:18.216145 25679 raft_consensus.cc:2468] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 2.
I20260709 13:21:18.217471 26732 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:18.218767 25610 raft_consensus.cc:1275] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:18.222882 25528 raft_consensus.cc:2393] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f8a9e56b2e1e46de810671b2180d8a68 in current term 4: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:21:18.219065 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:18.225899 25682 raft_consensus.cc:2393] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 3: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
I20260709 13:21:18.233932 25647 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:18.234876 26609 raft_consensus.cc:2749] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:21:18.241107 26732 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Requested vote from peers f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
W20260709 13:21:18.248171 25647 consensus_peers.cc:597] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.249387 25573 leader_election.cc:336] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:21:18.259354 25573 leader_election.cc:336] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:21:18.250787 25499 consensus_peers.cc:597] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:18.251457 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:18.262748 25679 raft_consensus.cc:2393] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ae560ddb7e6849f69d0c5f47075d3bf9 in current term 4: Already voted for candidate f8a9e56b2e1e46de810671b2180d8a68 in this term.
W20260709 13:21:18.262005 25647 consensus_peers.cc:597] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:18.267434 25499 consensus_peers.cc:597] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:18.267895 25499 leader_election.cc:336] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.268668 25499 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:18.270262 26686 raft_consensus.cc:2749] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:21:18.276505 25648 leader_election.cc:304] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a9e56b2e1e46de810671b2180d8a68; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:18.277293 26609 raft_consensus.cc:2749] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:18.278677 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:18.279392 25530 raft_consensus.cc:2468] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 3.
I20260709 13:21:18.281448 25648 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:18.282246 26609 raft_consensus.cc:2804] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:21:18.282608 26609 raft_consensus.cc:493] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.282889 26609 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:18.288242 26686 raft_consensus.cc:493] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.288527 25500 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 0a6b07f89a2c437ea29fb7c7e52440ba, 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:18.288779 26686 raft_consensus.cc:515] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:18.289368 26606 raft_consensus.cc:2749] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:21:18.290457 26609 raft_consensus.cc:515] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:18.290943 26686 leader_election.cc:290] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:18.292927 26741 consensus_queue.cc:1048] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:18.293663 26743 consensus_queue.cc:1048] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:18.294113 25573 leader_election.cc:304] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:18.295243 26743 consensus_queue.cc:1048] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:18.295433 25573 leader_election.cc:304] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:18.296257 26709 raft_consensus.cc:2804] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:18.296751 26709 raft_consensus.cc:697] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:18.296885 26737 raft_consensus.cc:2804] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:18.297410 26737 raft_consensus.cc:697] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:18.297596 26709 consensus_queue.cc:237] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:18.298285 26737 consensus_queue.cc:237] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:18.300048 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68" is_pre_election: true
I20260709 13:21:18.300668 25679 raft_consensus.cc:2468] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 2.
I20260709 13:21:18.302551 26609 leader_election.cc:290] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
W20260709 13:21:18.303731 25499 consensus_peers.cc:597] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:18.305445 25499 leader_election.cc:304] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:18.307420 26686 raft_consensus.cc:2804] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:18.307804 26686 raft_consensus.cc:493] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.308183 26686 raft_consensus.cc:3060] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:18.308386 25573 leader_election.cc:304] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
W20260709 13:21:18.308954 25647 leader_election.cc:336] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.310068 26743 raft_consensus.cc:2804] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:18.310467 26743 raft_consensus.cc:493] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.310791 26743 raft_consensus.cc:3060] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:18.313287 26614 consensus_queue.cc:1048] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:18.314924 26614 consensus_queue.cc:1048] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:18.316228 26686 raft_consensus.cc:515] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:18.318578 25500 leader_election.cc:304] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:18.319847 26754 raft_consensus.cc:2804] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:18.320365 26754 raft_consensus.cc:697] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:18.322427 26754 consensus_queue.cc:237] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:18.325285 26743 raft_consensus.cc:515] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:18.327046 25573 leader_election.cc:304] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
W20260709 13:21:18.329635 25647 consensus_peers.cc:597] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:18.333235 26743 leader_election.cc:290] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:18.337412 25682 raft_consensus.cc:1275] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:21:18.335038 25573 leader_election.cc:304] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:18.339725 26757 raft_consensus.cc:2804] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:18.340214 26757 raft_consensus.cc:697] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:18.336947 26743 raft_consensus.cc:2804] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:18.341262 26743 raft_consensus.cc:697] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:18.342355 26743 consensus_queue.cc:237] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:18.341277 26757 consensus_queue.cc:237] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:18.343974 26732 consensus_queue.cc:1048] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:21:18.349761 26604 consensus_queue.cc:1048] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:21:18.350729 25573 leader_election.cc:336] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:21:18.351589 25573 consensus_peers.cc:597] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:18.347750 25355 catalog_manager.cc:5697] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 2 to 4, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 4 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:18.351977 25573 leader_election.cc:336] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.348353 26686 leader_election.cc:290] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4:44609)
I20260709 13:21:18.352425 25573 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:18.352686 25355 catalog_manager.cc:5697] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 3 to 4, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 4 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:18.353674 25573 consensus_peers.cc:597] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:18.354226 25573 leader_election.cc:336] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.354895 25573 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
W20260709 13:21:18.356206 25573 consensus_peers.cc:597] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:18.356889 25573 leader_election.cc:336] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.354336 26709 raft_consensus.cc:2749] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:21:18.357872 25573 leader_election.cc:336] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.359095 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8a9e56b2e1e46de810671b2180d8a68"
I20260709 13:21:18.359942 25679 raft_consensus.cc:3060] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:18.356112 26737 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:21:18.360808 25573 leader_election.cc:336] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.365036 25573 leader_election.cc:304] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, f8a9e56b2e1e46de810671b2180d8a68
I20260709 13:21:18.365214 26741 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.365819 26709 raft_consensus.cc:2749] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:21:18.365883 26741 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:18.368546 26741 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:18.372198 25357 catalog_manager.cc:5697] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 2 to 3, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.374538 25679 raft_consensus.cc:2468] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 3.
I20260709 13:21:18.379273 25499 leader_election.cc:304] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:18.380582 25681 raft_consensus.cc:1275] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:18.381871 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2624a22f2144868a7c62051f58771b" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:18.386332 26604 raft_consensus.cc:2804] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:18.387075 26604 raft_consensus.cc:697] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:18.388132 26604 consensus_queue.cc:237] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:18.391598 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
W20260709 13:21:18.397241 25573 leader_election.cc:336] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:21:18.398677 25573 consensus_peers.cc:597] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:18.403863 26732 consensus_queue.cc:1048] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:18.413636 26723 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.424867 26723 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:18.432562 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:18.434057 25610 raft_consensus.cc:2468] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 4.
I20260709 13:21:18.412413 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f6b0cbdad040bcb11d809dd492bc8d" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:18.441537 25529 raft_consensus.cc:3060] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:21:18.451416 17228 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 26393)
I20260709 13:21:18.455440 25529 raft_consensus.cc:2468] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 4.
I20260709 13:21:18.452662 25606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2d62f90435440491da63b1ae0e710e" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:18.491252 26723 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
W20260709 13:21:18.496675 25499 consensus_peers.cc:597] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.501240 25682 raft_consensus.cc:1275] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:21:18.511272 26737 raft_consensus.cc:2749] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:18.512686 25607 raft_consensus.cc:3060] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:18.515710 26741 consensus_queue.cc:1048] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:21:18.519455 25499 consensus_peers.cc:597] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:18.519904 25499 leader_election.cc:336] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
W20260709 13:21:18.531298 25499 consensus_peers.cc:597] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:18.536876 25573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.4:44609, user_credentials={real_user=slave}} blocked reactor thread for 122323us
W20260709 13:21:18.544775 25499 consensus_peers.cc:597] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.551905 25528 raft_consensus.cc:1240] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:18.551903 25500 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:18.553150 26741 raft_consensus.cc:2804] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:21:18.553709 26741 raft_consensus.cc:493] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.555641 26741 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:18.557749 25528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:18.566251 25529 raft_consensus.cc:1275] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:18.570132 25573 leader_election.cc:304] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 
I20260709 13:21:18.570870 26743 raft_consensus.cc:2804] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:18.572160 26757 consensus_queue.cc:1059] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:18.574064 26723 raft_consensus.cc:3055] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:18.574498 26723 raft_consensus.cc:740] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:18.574555 26743 raft_consensus.cc:697] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:18.575392 26723 consensus_queue.cc:260] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:18.575762 26743 consensus_queue.cc:237] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:18.576573 26723 raft_consensus.cc:3060] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:18.580168 25355 catalog_manager.cc:5697] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 1 to 3, leader changed from f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:18.581987 25573 leader_election.cc:336] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.586097 25679 raft_consensus.cc:1240] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 3 LEADER]: Rejecting Update request from peer 0a6b07f89a2c437ea29fb7c7e52440ba for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:18.589886 26628 consensus_queue.cc:1048] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:18.601440 25679 raft_consensus.cc:1275] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:21:18.601640 25573 leader_election.cc:336] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.611500 25607 raft_consensus.cc:2468] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 5.
I20260709 13:21:18.626422 25648 leader_election.cc:304] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:18.628099 26609 raft_consensus.cc:2804] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:21:18.628579 26609 raft_consensus.cc:697] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 5 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:18.629307 26609 consensus_queue.cc:237] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:18.630331 26741 raft_consensus.cc:515] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:18.634305 25528 raft_consensus.cc:2393] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a6b07f89a2c437ea29fb7c7e52440ba in current term 5: Already voted for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in this term.
I20260709 13:21:18.636227 25573 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba; no voters: 812474b88dc54c39bc37428d77dcb7a9, ae560ddb7e6849f69d0c5f47075d3bf9
I20260709 13:21:18.637290 26735 raft_consensus.cc:3060] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:18.642338 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc7c5727cfc47e2b169253aee4be079" candidate_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:18.643498 26741 leader_election.cc:290] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853)
I20260709 13:21:18.649073 26735 raft_consensus.cc:2749] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:21:18.651278 25499 leader_election.cc:336] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:18.651873 25602 raft_consensus.cc:1275] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:21:18.652299 25602 pending_rounds.cc:85] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba: Aborting all ops after (but not including) 1
I20260709 13:21:18.652550 25602 pending_rounds.cc:107] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:21:18.652845 25602 raft_consensus.cc:2889] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:18.654155 26732 consensus_queue.cc:1048] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:18.656343 26628 consensus_queue.cc:1048] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:18.657639 25607 raft_consensus.cc:2468] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae560ddb7e6849f69d0c5f47075d3bf9 in term 5.
W20260709 13:21:18.660089 25647 consensus_peers.cc:597] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.659929 25359 catalog_manager.cc:5697] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 2 to 4, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 4 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.671358 25500 leader_election.cc:304] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
W20260709 13:21:18.675223 25499 consensus_peers.cc:597] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.675635 26604 raft_consensus.cc:2804] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:21:18.676194 26604 raft_consensus.cc:697] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 LEADER]: Becoming Leader. State: Replica: ae560ddb7e6849f69d0c5f47075d3bf9, State: Running, Role: LEADER
I20260709 13:21:18.679527 26604 consensus_queue.cc:237] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:21:18.688211 25647 consensus_peers.cc:597] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:18.771649 25573 consensus_peers.cc:597] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.793474 25601 raft_consensus.cc:1275] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:18.801867 25530 raft_consensus.cc:1275] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:18.807695 25357 catalog_manager.cc:5697] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 2 to 4, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 4 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:18.810894 25573 consensus_peers.cc:597] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.815037 26732 consensus_queue.cc:1048] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:18.820389 25682 raft_consensus.cc:1275] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:18.823817 26757 consensus_queue.cc:1048] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:18.830408 25530 raft_consensus.cc:1275] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:21:18.831879 25499 consensus_peers.cc:597] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:18.833678 26734 consensus_queue.cc:1048] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:18.833703 26735 consensus_queue.cc:1048] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:21:18.850697 25355 catalog_manager.cc:5697] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 3 to 5, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 5 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.853797 25607 raft_consensus.cc:3055] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:18.854241 25607 raft_consensus.cc:740] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:18.855662 25607 consensus_queue.cc:260] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } }
I20260709 13:21:18.857493 25607 raft_consensus.cc:3060] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:21:18.885972 25499 consensus_peers.cc:597] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.884445 25359 catalog_manager.cc:5697] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 reported cstate change: term changed from 3 to 5, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2). New cstate: current_term: 5 leader_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.898590 25681 raft_consensus.cc:1275] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:21:18.913349 25573 consensus_peers.cc:597] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.943471 25531 raft_consensus.cc:1275] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:18.947068 26735 consensus_queue.cc:1048] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:18.956377 26785 consensus_queue.cc:1048] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:18.957728 25607 raft_consensus.cc:1275] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:21:18.958876 25607 pending_rounds.cc:85] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba: Aborting all ops after (but not including) 1
I20260709 13:21:18.965350 25607 pending_rounds.cc:107] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:21:18.965710 25607 raft_consensus.cc:2889] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:18.969798 26604 consensus_queue.cc:1048] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:21:19.027704 25499 consensus_peers.cc:597] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:19.062515 25647 consensus_peers.cc:597] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:19.074698 25647 consensus_peers.cc:597] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:19.087162 25530 raft_consensus.cc:1275] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:19.088613 26735 consensus_queue.cc:1048] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:21:19.138655 25573 consensus_peers.cc:597] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:19.193467 25607 raft_consensus.cc:1275] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 FOLLOWER]: Refusing update from remote peer ae560ddb7e6849f69d0c5f47075d3bf9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:21:19.195189 26606 consensus_queue.cc:1048] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:21:19.223621 25499 consensus_peers.cc:597] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:19.231107 25607 raft_consensus.cc:1275] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:21:19.245080 26733 consensus_queue.cc:1048] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:21:19.452090 17228 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 26393)
W20260709 13:21:19.462239 25499 consensus_peers.cc:597] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:19.995920 26628 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.996569 26628 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:19.998811 26628 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:20.002507 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:20.003533 25530 raft_consensus.cc:2468] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 4.
W20260709 13:21:20.005409 25647 leader_election.cc:336] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:20.006435 25647 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:20.007302 26733 raft_consensus.cc:2804] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:21:20.007699 26733 raft_consensus.cc:493] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.008914 26733 raft_consensus.cc:3060] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:20.020994 26733 raft_consensus.cc:515] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
I20260709 13:21:20.022945 26733 leader_election.cc:290] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:20.024974 26733 raft_consensus.cc:493] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.025043 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f6d48dac364e25bcc18c1388db7fb6" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:20.025821 25529 raft_consensus.cc:3060] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:20.025514 26733 raft_consensus.cc:515] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:20.028505 25607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" is_pre_election: true
I20260709 13:21:20.029187 25607 raft_consensus.cc:2468] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 3.
I20260709 13:21:20.031294 25648 leader_election.cc:304] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 
I20260709 13:21:20.032039 26628 raft_consensus.cc:2804] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:20.032423 26628 raft_consensus.cc:493] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.032727 26628 raft_consensus.cc:3060] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:20.028362 26733 leader_election.cc:290] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:20.055794 26628 raft_consensus.cc:515] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
W20260709 13:21:20.056552 25647 leader_election.cc:336] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:20.061268 25529 raft_consensus.cc:2468] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 5.
W20260709 13:21:20.057133 25647 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111) [suppressed 396 similar messages]
I20260709 13:21:20.064031 25602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d018923485454fbcc0dccb5823166e" candidate_uuid: "f8a9e56b2e1e46de810671b2180d8a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba"
I20260709 13:21:20.064747 25602 raft_consensus.cc:3060] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:21:20.065095 25573 consensus_peers.cc:597] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:20.066618 26628 leader_election.cc:290] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: Requested vote from peers 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853), 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089)
I20260709 13:21:20.068044 25647 leader_election.cc:304] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae560ddb7e6849f69d0c5f47075d3bf9, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:20.072712 26798 raft_consensus.cc:2804] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:21:20.073252 26798 raft_consensus.cc:697] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 5 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:20.074267 26798 consensus_queue.cc:237] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } }
W20260709 13:21:20.076392 25647 consensus_peers.cc:597] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:20.077315 25647 leader_election.cc:336] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:20.080431 25602 raft_consensus.cc:2468] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a9e56b2e1e46de810671b2180d8a68 in term 4.
W20260709 13:21:20.078120 25647 leader_election.cc:336] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:20.083817 25648 leader_election.cc:304] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, f8a9e56b2e1e46de810671b2180d8a68; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:20.085106 26628 raft_consensus.cc:2804] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:20.085630 26628 raft_consensus.cc:697] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 4 LEADER]: Becoming Leader. State: Replica: f8a9e56b2e1e46de810671b2180d8a68, State: Running, Role: LEADER
I20260709 13:21:20.086688 26628 consensus_queue.cc:237] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } }
I20260709 13:21:20.104660 25355 catalog_manager.cc:5697] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 2 to 5, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 5 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.140369 26796 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.141103 26796 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:20.143252 26796 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:20.146723 25529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" is_pre_election: true
I20260709 13:21:20.147432 25529 raft_consensus.cc:2468] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 4.
W20260709 13:21:20.151695 25573 leader_election.cc:336] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:20.151906 25355 catalog_manager.cc:5697] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 reported cstate change: term changed from 2 to 4, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to f8a9e56b2e1e46de810671b2180d8a68 (127.16.211.4). New cstate: current_term: 4 leader_uuid: "f8a9e56b2e1e46de810671b2180d8a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a9e56b2e1e46de810671b2180d8a68" member_type: VOTER last_known_addr { host: "127.16.211.4" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.152611 25573 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:20.153952 26757 raft_consensus.cc:2804] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:21:20.154317 26757 raft_consensus.cc:493] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.154659 26757 raft_consensus.cc:3060] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:20.165242 26757 raft_consensus.cc:515] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
I20260709 13:21:20.167497 26757 leader_election.cc:290] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 5 election: Requested vote from peers 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089), ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863)
I20260709 13:21:20.169718 25530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85f98cb5cd14fa9a4a620defb96cb6c" candidate_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9"
I20260709 13:21:20.170436 25530 raft_consensus.cc:3060] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:21:20.172526 25573 leader_election.cc:336] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111)
I20260709 13:21:20.182706 25530 raft_consensus.cc:2468] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a6b07f89a2c437ea29fb7c7e52440ba in term 5.
I20260709 13:21:20.184974 25573 leader_election.cc:304] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a6b07f89a2c437ea29fb7c7e52440ba, ae560ddb7e6849f69d0c5f47075d3bf9; no voters: 812474b88dc54c39bc37428d77dcb7a9
I20260709 13:21:20.186347 26757 raft_consensus.cc:2804] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:21:20.187549 26757 raft_consensus.cc:697] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 LEADER]: Becoming Leader. State: Replica: 0a6b07f89a2c437ea29fb7c7e52440ba, State: Running, Role: LEADER
I20260709 13:21:20.188549 26757 consensus_queue.cc:237] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } }
W20260709 13:21:20.202214 25647 consensus_peers.cc:597] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:20.218339 25355 catalog_manager.cc:5697] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba reported cstate change: term changed from 3 to 5, leader changed from 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1) to 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3). New cstate: current_term: 5 leader_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "812474b88dc54c39bc37428d77dcb7a9" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:20.231845 25573 consensus_peers.cc:597] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:20.274629 25647 consensus_peers.cc:597] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.452725 17228 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 26393)
I20260709 13:21:20.458066 25530 raft_consensus.cc:1275] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:21:20.459553 26798 consensus_queue.cc:1048] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:21:20.482932 25647 consensus_peers.cc:597] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:20.486124 25647 consensus_peers.cc:597] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:20.522202 25602 raft_consensus.cc:1275] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Refusing update from remote peer f8a9e56b2e1e46de810671b2180d8a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:20.524957 26628 consensus_queue.cc:1048] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a6b07f89a2c437ea29fb7c7e52440ba" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:21:20.526576 25647 consensus_peers.cc:597] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.536036 25573 consensus_peers.cc:597] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.545691 25647 consensus_peers.cc:597] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.567880 25499 consensus_peers.cc:597] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.588544 25573 consensus_peers.cc:597] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.595130 25647 consensus_peers.cc:597] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.660873 25647 consensus_peers.cc:597] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.682349 25573 consensus_peers.cc:597] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:20.687548 25573 consensus_peers.cc:597] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.692320 25573 consensus_peers.cc:597] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.695182 25499 consensus_peers.cc:597] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.740581 25647 consensus_peers.cc:597] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.764333 25499 consensus_peers.cc:597] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:20.775141 25530 raft_consensus.cc:1275] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Refusing update from remote peer 0a6b07f89a2c437ea29fb7c7e52440ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:21:20.776418 26757 consensus_queue.cc:1048] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae560ddb7e6849f69d0c5f47075d3bf9" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:21:20.820878 25647 consensus_peers.cc:597] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.837690 25499 consensus_peers.cc:597] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.847784 25499 consensus_peers.cc:597] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:20.875345 25647 consensus_peers.cc:597] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:20.891775 25499 consensus_peers.cc:597] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:20.892203 25647 consensus_peers.cc:597] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:20.903976 25647 consensus_peers.cc:597] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:20.946866 25499 consensus_peers.cc:597] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:21.019457 25499 consensus_peers.cc:597] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:21.046356 25647 consensus_peers.cc:597] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:21.065320 25499 consensus_peers.cc:597] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:21.081522 25499 consensus_peers.cc:597] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:21.146955 25499 consensus_peers.cc:597] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:21.157334 25499 consensus_peers.cc:597] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:21.182726 17228 tablet_server.cc:196] TabletServer@127.16.211.1:45089 shutdown complete.
W20260709 13:21:21.310714 25573 consensus_peers.cc:597] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:21.325387 17228 tablet_server.cc:179] TabletServer@127.16.211.2:0 shutting down...
W20260709 13:21:21.338631 25499 consensus_peers.cc:597] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:21.351244 25647 consensus_peers.cc:597] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:21.353641 25647 consensus_peers.cc:597] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:21.360172 25573 consensus_peers.cc:597] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.387372 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:21:21.387956 25573 consensus_peers.cc:597] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:21.388513 17228 tablet_replica.cc:333] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.392166 17228 raft_consensus.cc:2243] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.394073 17228 raft_consensus.cc:2272] T 445f8e17e0e2419bb3b63d012776f356 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.397730 17228 tablet_replica.cc:333] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.398985 17228 raft_consensus.cc:2243] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.400272 17228 raft_consensus.cc:2272] T d04d94e738a343788e9a90a4470dc4c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.403507 17228 tablet_replica.cc:333] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.404332 17228 raft_consensus.cc:2243] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.404932 17228 raft_consensus.cc:2272] T e85f98cb5cd14fa9a4a620defb96cb6c P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:21.406575 25647 consensus_peers.cc:597] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.408442 17228 tablet_replica.cc:333] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.409188 17228 raft_consensus.cc:2243] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.409662 17228 raft_consensus.cc:2272] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.411864 17228 tablet_replica.cc:333] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.412468 17228 raft_consensus.cc:2243] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.413255 17228 raft_consensus.cc:2272] T 3bcc479ee6b94c918ab197a87e9e969a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.415994 17228 tablet_replica.cc:333] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.416623 17228 raft_consensus.cc:2243] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.417124 17228 raft_consensus.cc:2272] T 66a4d25643be42a6bf6f0b1d65400bee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:21.417819 25647 consensus_peers.cc:597] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.419878 17228 tablet_replica.cc:333] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.420912 17228 raft_consensus.cc:2243] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.421767 17228 raft_consensus.cc:2272] T 788ee1912fba47fe8873f543b02189f7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:21.423890 25573 consensus_peers.cc:597] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.425000 17228 tablet_replica.cc:333] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.425992 17228 raft_consensus.cc:2243] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.427129 17228 raft_consensus.cc:2272] T afd9e5943fb6488091b514fd1aa47162 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.430156 17228 tablet_replica.cc:333] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.431010 17228 raft_consensus.cc:2243] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:21:21.431481 25647 consensus_peers.cc:597] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.432040 17228 raft_consensus.cc:2272] T ae2d62f90435440491da63b1ae0e710e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:21.433110 25647 consensus_peers.cc:597] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.435328 17228 tablet_replica.cc:333] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.436385 17228 raft_consensus.cc:2243] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.437757 17228 raft_consensus.cc:2272] T 1c91ee1848f2435bb3dba61a2370f733 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.440086 17228 tablet_replica.cc:333] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.440747 17228 raft_consensus.cc:2243] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.441243 17228 raft_consensus.cc:2272] T eea867c357cd4e4d970226215f94bfe7 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.443624 17228 tablet_replica.cc:333] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.444264 17228 raft_consensus.cc:2243] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.444769 17228 raft_consensus.cc:2272] T 278c9060803541ebb56ccb47687d3d4d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.446906 17228 tablet_replica.cc:333] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.447602 17228 raft_consensus.cc:2243] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.448096 17228 raft_consensus.cc:2272] T 85033b16e63444238f30de7eae6d6634 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.450464 17228 tablet_replica.cc:333] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
W20260709 13:21:21.451033 25573 consensus_peers.cc:597] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.451490 17228 raft_consensus.cc:2243] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.452489 17228 raft_consensus.cc:2272] T e0d6387533134a0099e05d485ca902e6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.455057 17228 tablet_replica.cc:333] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.455626 17228 raft_consensus.cc:2243] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.456656 17228 raft_consensus.cc:2272] T d4f270f0fdf64e0790bc9e2247ab15c3 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.459230 17228 tablet_replica.cc:333] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.459827 17228 raft_consensus.cc:2243] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.460628 17228 raft_consensus.cc:2272] T edc06587e5c544c7a834950d9f45c6c8 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.463342 17228 tablet_replica.cc:333] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.464051 17228 raft_consensus.cc:2243] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.464530 17228 raft_consensus.cc:2272] T e2520ae829ce4b3082870ad84db70f7d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.466801 17228 tablet_replica.cc:333] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.467413 17228 raft_consensus.cc:2243] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.467908 17228 raft_consensus.cc:2272] T cc265439c9a64543b0c69805e9131cfe P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.470119 17228 tablet_replica.cc:333] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.470651 17228 raft_consensus.cc:2243] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.471143 17228 raft_consensus.cc:2272] T f8f052365b064537ba68ac4701e53694 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.473194 17228 tablet_replica.cc:333] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.473826 17228 raft_consensus.cc:2243] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.474823 17228 raft_consensus.cc:2272] T c15e4fb6800449ceb211a61be3587ecc P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:21.475793 25499 consensus_peers.cc:597] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:21.477174 17228 tablet_replica.cc:333] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.477830 17228 raft_consensus.cc:2243] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.479040 17228 raft_consensus.cc:2272] T f8168790b26f4632b04441b2780e479a P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.482291 17228 tablet_replica.cc:333] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.483125 17228 raft_consensus.cc:2243] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.484181 17228 raft_consensus.cc:2272] T c02cdf0754524b77ada52992d6e0b20e P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.486621 17228 tablet_replica.cc:333] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.487253 17228 raft_consensus.cc:2243] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.488169 17228 raft_consensus.cc:2272] T 0c4b9518dd674972b99e9595c9b1c686 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.490264 17228 tablet_replica.cc:333] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.490847 17228 raft_consensus.cc:2243] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.491633 17228 raft_consensus.cc:2272] T adc7c5727cfc47e2b169253aee4be079 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.493597 17228 tablet_replica.cc:333] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.494213 17228 raft_consensus.cc:2243] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.494692 17228 raft_consensus.cc:2272] T 5866aa38b1814ecfacca55ec773e6562 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.497104 17228 tablet_replica.cc:333] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.497684 17228 raft_consensus.cc:2243] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.498225 17228 raft_consensus.cc:2272] T 16f2f69975c44dceb5130378505518a2 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:21.499229 25573 consensus_peers.cc:597] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.500612 17228 tablet_replica.cc:333] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.501240 17228 raft_consensus.cc:2243] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.502112 17228 raft_consensus.cc:2272] T b3f61b96593545c79c1d08d45ad98dee P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.504488 17228 tablet_replica.cc:333] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.505322 17228 raft_consensus.cc:2243] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.505910 17228 raft_consensus.cc:2272] T 540f940c49e54189a08d7ed4d84f2ac6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:21.508327 25573 consensus_peers.cc:597] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.508384 17228 tablet_replica.cc:333] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.509186 17228 raft_consensus.cc:2243] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.510366 17228 raft_consensus.cc:2272] T 2704c533ff304006941c451f2f6d4660 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.512864 17228 tablet_replica.cc:333] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.513388 17228 raft_consensus.cc:2243] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.514292 17228 raft_consensus.cc:2272] T 4abab287ccaf44d4a4872b89f3012fa9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.516271 17228 tablet_replica.cc:333] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.516770 17228 raft_consensus.cc:2243] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.517179 17228 raft_consensus.cc:2272] T b4f6b0cbdad040bcb11d809dd492bc8d P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.519260 17228 tablet_replica.cc:333] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.519798 17228 raft_consensus.cc:2243] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.520182 17228 raft_consensus.cc:2272] T aa0ee5fc6b56426093f29d36600f7af4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.522311 17228 tablet_replica.cc:333] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.522794 17228 raft_consensus.cc:2243] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.523799 17228 raft_consensus.cc:2272] T 081346db72a04ea4b600a44f560616ff P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.526605 17228 tablet_replica.cc:333] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.527410 17228 raft_consensus.cc:2243] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.528471 17228 raft_consensus.cc:2272] T 9aed70992ac24e10943f5bcab0a11d67 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:21.528873 25647 consensus_peers.cc:597] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.531468 17228 tablet_replica.cc:333] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.532392 17228 raft_consensus.cc:2243] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.533481 17228 raft_consensus.cc:2272] T c0e89c6170734a98849f97b6441df9e4 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.535655 17228 tablet_replica.cc:333] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.536293 17228 raft_consensus.cc:2243] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.536764 17228 raft_consensus.cc:2272] T 9b275ea51fb94eeaac1650d139e43706 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.538846 17228 tablet_replica.cc:333] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.539418 17228 raft_consensus.cc:2243] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.540372 17228 raft_consensus.cc:2272] T acdfccdb823e4badaf6a647eccefcc66 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.543064 17228 tablet_replica.cc:333] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.543704 17228 raft_consensus.cc:2243] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.544788 17228 raft_consensus.cc:2272] T d5001675947e47d284c3bc4729cf9fd9 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:21.545249 25573 consensus_peers.cc:597] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:21.547255 17228 tablet_replica.cc:333] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.547945 17228 raft_consensus.cc:2243] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.548594 17228 raft_consensus.cc:2272] T 81dbddeb15af47cbbe275279293370fa P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.551343 17228 tablet_replica.cc:333] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.551923 17228 raft_consensus.cc:2243] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:21:21.552598 25573 consensus_peers.cc:597] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.552963 17228 raft_consensus.cc:2272] T 4b54054e46384e8aa7153f332c5c366f P ae560ddb7e6849f69d0c5f47075d3bf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.555292 17228 tablet_replica.cc:333] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.555836 17228 raft_consensus.cc:2243] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.556277 17228 raft_consensus.cc:2272] T dc39a93c665a491a81bb0925b35ccf33 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.558594 17228 tablet_replica.cc:333] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.559288 17228 raft_consensus.cc:2243] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.559689 17228 raft_consensus.cc:2272] T 36073ec086cc47098e9a796722246728 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.562647 17228 tablet_replica.cc:333] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.563210 17228 raft_consensus.cc:2243] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.563669 17228 raft_consensus.cc:2272] T 74f6d48dac364e25bcc18c1388db7fb6 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.566407 17228 tablet_replica.cc:333] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9: stopping tablet replica
I20260709 13:21:21.566949 17228 raft_consensus.cc:2243] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.567971 17228 raft_consensus.cc:2272] T 8734a5e02643462e85823bc7afb27b93 P ae560ddb7e6849f69d0c5f47075d3bf9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:21.585544 25647 consensus_peers.cc:597] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:21.603346 25647 consensus_peers.cc:597] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:21.618036 25647 consensus_peers.cc:597] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:21.624215 25647 consensus_peers.cc:597] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:21.638792 25647 consensus_peers.cc:597] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:33863: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.647251 17228 tablet_server.cc:196] TabletServer@127.16.211.2:0 shutdown complete.
W20260709 13:21:21.655169 25647 consensus_peers.cc:597] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:33863: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:21.685420 25647 consensus_peers.cc:597] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:33863: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:21.690826 25573 consensus_peers.cc:597] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer 812474b88dc54c39bc37428d77dcb7a9 (127.16.211.1:45089): Couldn't send request to peer 812474b88dc54c39bc37428d77dcb7a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:45089: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:21.725425 17228 tablet_server.cc:179] TabletServer@127.16.211.3:0 shutting down...
W20260709 13:21:21.737722 25648 consensus_peers.cc:597] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Couldn't send request to peer 0a6b07f89a2c437ea29fb7c7e52440ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:21.752437 25573 consensus_peers.cc:597] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:33863: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.785342 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:21.786419 17228 tablet_replica.cc:333] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.787583 17228 raft_consensus.cc:2243] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.788203 17228 raft_consensus.cc:2272] T c9206e4480e54c158fe2a2ecab45efa8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.790556 17228 tablet_replica.cc:333] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.791155 17228 raft_consensus.cc:2243] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.791589 17228 raft_consensus.cc:2272] T d04d94e738a343788e9a90a4470dc4c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.793526 17228 tablet_replica.cc:333] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.794191 17228 raft_consensus.cc:2243] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.795011 17228 raft_consensus.cc:2272] T 1ed58b0dbded4dfc9447d9712ff39fea P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.796941 17228 tablet_replica.cc:333] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.797665 17228 raft_consensus.cc:2243] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.798158 17228 raft_consensus.cc:2272] T 7b4a5b928a5a4ca3a0959ce95d445c42 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.801518 17228 tablet_replica.cc:333] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.802481 17228 raft_consensus.cc:2243] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:21.802974 25573 consensus_peers.cc:597] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba -> Peer ae560ddb7e6849f69d0c5f47075d3bf9 (127.16.211.2:33863): Couldn't send request to peer ae560ddb7e6849f69d0c5f47075d3bf9. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:33863: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.803107 17228 raft_consensus.cc:2272] T 3bcc479ee6b94c918ab197a87e9e969a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.805341 17228 tablet_replica.cc:333] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.806070 17228 raft_consensus.cc:2243] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.806535 17228 raft_consensus.cc:2272] T 788ee1912fba47fe8873f543b02189f7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.808449 17228 tablet_replica.cc:333] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.809085 17228 raft_consensus.cc:2243] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.809497 17228 raft_consensus.cc:2272] T afd9e5943fb6488091b514fd1aa47162 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.811620 17228 tablet_replica.cc:333] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.812191 17228 raft_consensus.cc:2243] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.812615 17228 raft_consensus.cc:2272] T e0d6387533134a0099e05d485ca902e6 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.814518 17228 tablet_replica.cc:333] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.815069 17228 raft_consensus.cc:2243] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.815997 17228 raft_consensus.cc:2272] T 6397caa427af450ca361a53cc74cf838 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.818382 17228 tablet_replica.cc:333] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.819180 17228 raft_consensus.cc:2243] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.820240 17228 raft_consensus.cc:2272] T cddcb2168c0d4acaba5e547ac0c03ebb P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.823706 17228 tablet_replica.cc:333] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.824802 17228 raft_consensus.cc:2243] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.825845 17228 raft_consensus.cc:2272] T 9e879da59df949eca2ae0618a4c5ddc2 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.828521 17228 tablet_replica.cc:333] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.829154 17228 raft_consensus.cc:2243] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.829780 17228 raft_consensus.cc:2272] T c15e4fb6800449ceb211a61be3587ecc P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.831719 17228 tablet_replica.cc:333] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.832213 17228 raft_consensus.cc:2243] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.832589 17228 raft_consensus.cc:2272] T f8168790b26f4632b04441b2780e479a P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.834559 17228 tablet_replica.cc:333] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.835068 17228 raft_consensus.cc:2243] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.835430 17228 raft_consensus.cc:2272] T c02cdf0754524b77ada52992d6e0b20e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.837214 17228 tablet_replica.cc:333] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.837716 17228 raft_consensus.cc:2243] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.838223 17228 raft_consensus.cc:2272] T 0c4b9518dd674972b99e9595c9b1c686 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.841080 17228 tablet_replica.cc:333] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.841862 17228 raft_consensus.cc:2243] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.842502 17228 raft_consensus.cc:2272] T b9bfde4ba996435bb05645af25e1f2c7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.845180 17228 tablet_replica.cc:333] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.845695 17228 raft_consensus.cc:2243] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.846164 17228 raft_consensus.cc:2272] T d4f270f0fdf64e0790bc9e2247ab15c3 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.848062 17228 tablet_replica.cc:333] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.848539 17228 raft_consensus.cc:2243] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.849014 17228 raft_consensus.cc:2272] T de2624a22f2144868a7c62051f58771b P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.851560 17228 tablet_replica.cc:333] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.852288 17228 raft_consensus.cc:2243] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.853358 17228 raft_consensus.cc:2272] T 66a4d25643be42a6bf6f0b1d65400bee P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:21.855036 25648 consensus_peers.cc:597] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Couldn't send request to peer 0a6b07f89a2c437ea29fb7c7e52440ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.855996 17228 tablet_replica.cc:333] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.856666 17228 raft_consensus.cc:2243] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.857118 17228 raft_consensus.cc:2272] T ae2d62f90435440491da63b1ae0e710e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.859079 17228 tablet_replica.cc:333] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.859661 17228 raft_consensus.cc:2243] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.860173 17228 raft_consensus.cc:2272] T 1c91ee1848f2435bb3dba61a2370f733 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.862126 17228 tablet_replica.cc:333] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.862712 17228 raft_consensus.cc:2243] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.863576 17228 raft_consensus.cc:2272] T eea867c357cd4e4d970226215f94bfe7 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.865593 17228 tablet_replica.cc:333] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.866221 17228 raft_consensus.cc:2243] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.867074 17228 raft_consensus.cc:2272] T 2be301b0a3ad4513936a33b8c989ab3d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.868966 17228 tablet_replica.cc:333] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.869517 17228 raft_consensus.cc:2243] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.870375 17228 raft_consensus.cc:2272] T e85f98cb5cd14fa9a4a620defb96cb6c P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.872565 17228 tablet_replica.cc:333] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.873364 17228 raft_consensus.cc:2243] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.874475 17228 raft_consensus.cc:2272] T f703b8e7da3f432e95c5d1b9fc735f71 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:21.875216 25648 consensus_peers.cc:597] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Couldn't send request to peer 0a6b07f89a2c437ea29fb7c7e52440ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.876731 17228 tablet_replica.cc:333] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.877473 17228 raft_consensus.cc:2243] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.877991 17228 raft_consensus.cc:2272] T 4b54054e46384e8aa7153f332c5c366f P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.880210 17228 tablet_replica.cc:333] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.880947 17228 raft_consensus.cc:2243] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.881415 17228 raft_consensus.cc:2272] T c0e89c6170734a98849f97b6441df9e4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.883482 17228 tablet_replica.cc:333] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.884044 17228 raft_consensus.cc:2243] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.884488 17228 raft_consensus.cc:2272] T d5001675947e47d284c3bc4729cf9fd9 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.886507 17228 tablet_replica.cc:333] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.887085 17228 raft_consensus.cc:2243] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.887557 17228 raft_consensus.cc:2272] T 81dbddeb15af47cbbe275279293370fa P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.889583 17228 tablet_replica.cc:333] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.890347 17228 raft_consensus.cc:2243] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.890874 17228 raft_consensus.cc:2272] T cc9240e31c174ddab78702a2343b3d64 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.893356 17228 tablet_replica.cc:333] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.894099 17228 raft_consensus.cc:2243] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.895098 17228 raft_consensus.cc:2272] T 9b275ea51fb94eeaac1650d139e43706 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.897723 17228 tablet_replica.cc:333] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.898481 17228 raft_consensus.cc:2243] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.899029 17228 raft_consensus.cc:2272] T edc06587e5c544c7a834950d9f45c6c8 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.901796 17228 tablet_replica.cc:333] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.902565 17228 raft_consensus.cc:2243] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.903497 17228 raft_consensus.cc:2272] T e2520ae829ce4b3082870ad84db70f7d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.906302 17228 tablet_replica.cc:333] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.907105 17228 raft_consensus.cc:2243] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.908912 17228 raft_consensus.cc:2272] T f9c681632e82489da482ce4f96f3a902 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:21.909072 25648 consensus_peers.cc:597] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Couldn't send request to peer 0a6b07f89a2c437ea29fb7c7e52440ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:21.910765 25648 consensus_peers.cc:597] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Couldn't send request to peer 0a6b07f89a2c437ea29fb7c7e52440ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.911972 17228 tablet_replica.cc:333] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.912765 17228 raft_consensus.cc:2243] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.913621 17228 raft_consensus.cc:2272] T b4f6b0cbdad040bcb11d809dd492bc8d P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.916069 17228 tablet_replica.cc:333] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.916821 17228 raft_consensus.cc:2243] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.917891 17228 raft_consensus.cc:2272] T 015cfc692b904ffb8d66556e17bd9ed1 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.920564 17228 tablet_replica.cc:333] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.921258 17228 raft_consensus.cc:2243] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.921824 17228 raft_consensus.cc:2272] T 8734a5e02643462e85823bc7afb27b93 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.924340 17228 tablet_replica.cc:333] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.925028 17228 raft_consensus.cc:2243] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.925576 17228 raft_consensus.cc:2272] T b1d018923485454fbcc0dccb5823166e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.928123 17228 tablet_replica.cc:333] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.928812 17228 raft_consensus.cc:2243] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.929347 17228 raft_consensus.cc:2272] T 56a7192762c540d5aed9ffabc2695f7e P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.932075 17228 tablet_replica.cc:333] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.932789 17228 raft_consensus.cc:2243] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.933854 17228 raft_consensus.cc:2272] T aa0ee5fc6b56426093f29d36600f7af4 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.936538 17228 tablet_replica.cc:333] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.937229 17228 raft_consensus.cc:2243] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.938294 17228 raft_consensus.cc:2272] T 5866aa38b1814ecfacca55ec773e6562 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.940979 17228 tablet_replica.cc:333] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.941443 17228 raft_consensus.cc:2243] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.941860 17228 raft_consensus.cc:2272] T adc7c5727cfc47e2b169253aee4be079 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.943786 17228 tablet_replica.cc:333] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.944206 17228 raft_consensus.cc:2243] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.944679 17228 raft_consensus.cc:2272] T 081346db72a04ea4b600a44f560616ff P 0a6b07f89a2c437ea29fb7c7e52440ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.947173 17228 tablet_replica.cc:333] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba: stopping tablet replica
I20260709 13:21:21.947670 17228 raft_consensus.cc:2243] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:21.948139 17228 raft_consensus.cc:2272] T 9aed70992ac24e10943f5bcab0a11d67 P 0a6b07f89a2c437ea29fb7c7e52440ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.026542 17228 tablet_server.cc:196] TabletServer@127.16.211.3:0 shutdown complete.
W20260709 13:21:22.043119 25648 consensus_peers.cc:597] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Couldn't send request to peer 0a6b07f89a2c437ea29fb7c7e52440ba. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:40853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:22.058540 25648 consensus_peers.cc:597] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Couldn't send request to peer 0a6b07f89a2c437ea29fb7c7e52440ba. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:40853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:22.091464 25648 consensus_peers.cc:597] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Couldn't send request to peer 0a6b07f89a2c437ea29fb7c7e52440ba. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:40853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.121959 17228 tablet_server.cc:179] TabletServer@127.16.211.4:0 shutting down...
W20260709 13:21:22.160409 25648 consensus_peers.cc:597] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 -> Peer 0a6b07f89a2c437ea29fb7c7e52440ba (127.16.211.3:40853): Couldn't send request to peer 0a6b07f89a2c437ea29fb7c7e52440ba. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.3:40853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.177460 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:22.178608 17228 tablet_replica.cc:333] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.179479 17228 raft_consensus.cc:2243] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.180436 17228 raft_consensus.cc:2272] T c9206e4480e54c158fe2a2ecab45efa8 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.183022 17228 tablet_replica.cc:333] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.183754 17228 raft_consensus.cc:2243] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.184298 17228 raft_consensus.cc:2272] T d04d94e738a343788e9a90a4470dc4c3 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.186616 17228 tablet_replica.cc:333] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.187263 17228 raft_consensus.cc:2243] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.187759 17228 raft_consensus.cc:2272] T 1ed58b0dbded4dfc9447d9712ff39fea P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.190008 17228 tablet_replica.cc:333] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.190645 17228 raft_consensus.cc:2243] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.191932 17228 raft_consensus.cc:2272] T 7b4a5b928a5a4ca3a0959ce95d445c42 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.194006 17228 tablet_replica.cc:333] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.195515 17228 raft_consensus.cc:2243] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.196372 17228 raft_consensus.cc:2272] T 445f8e17e0e2419bb3b63d012776f356 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.198659 17228 tablet_replica.cc:333] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.199290 17228 raft_consensus.cc:2243] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.200093 17228 raft_consensus.cc:2272] T 2cdda0f89bd34da2ab6e2dcc9f918eb5 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.202251 17228 tablet_replica.cc:333] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.202787 17228 raft_consensus.cc:2243] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.203346 17228 raft_consensus.cc:2272] T 3bcc479ee6b94c918ab197a87e9e969a P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.205575 17228 tablet_replica.cc:333] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.206293 17228 raft_consensus.cc:2243] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.207190 17228 raft_consensus.cc:2272] T 56a7192762c540d5aed9ffabc2695f7e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.209301 17228 tablet_replica.cc:333] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.209895 17228 raft_consensus.cc:2243] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.210744 17228 raft_consensus.cc:2272] T 278c9060803541ebb56ccb47687d3d4d P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.212597 17228 tablet_replica.cc:333] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.213135 17228 raft_consensus.cc:2243] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.213603 17228 raft_consensus.cc:2272] T c02cdf0754524b77ada52992d6e0b20e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.216001 17228 tablet_replica.cc:333] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.216675 17228 raft_consensus.cc:2243] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.217568 17228 raft_consensus.cc:2272] T de2624a22f2144868a7c62051f58771b P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.220274 17228 tablet_replica.cc:333] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.220960 17228 raft_consensus.cc:2243] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.221460 17228 raft_consensus.cc:2272] T 66a4d25643be42a6bf6f0b1d65400bee P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.224154 17228 tablet_replica.cc:333] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.224852 17228 raft_consensus.cc:2243] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.225322 17228 raft_consensus.cc:2272] T 6397caa427af450ca361a53cc74cf838 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.227500 17228 tablet_replica.cc:333] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.228117 17228 raft_consensus.cc:2243] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.228593 17228 raft_consensus.cc:2272] T e0d6387533134a0099e05d485ca902e6 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.230871 17228 tablet_replica.cc:333] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.231472 17228 raft_consensus.cc:2243] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.231930 17228 raft_consensus.cc:2272] T cddcb2168c0d4acaba5e547ac0c03ebb P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.233819 17228 tablet_replica.cc:333] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.234457 17228 raft_consensus.cc:2243] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.235280 17228 raft_consensus.cc:2272] T 16f2f69975c44dceb5130378505518a2 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.237519 17228 tablet_replica.cc:333] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.238143 17228 raft_consensus.cc:2243] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.238929 17228 raft_consensus.cc:2272] T 540f940c49e54189a08d7ed4d84f2ac6 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.240870 17228 tablet_replica.cc:333] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.241715 17228 raft_consensus.cc:2243] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.242264 17228 raft_consensus.cc:2272] T b3f61b96593545c79c1d08d45ad98dee P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.244166 17228 tablet_replica.cc:333] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.244747 17228 raft_consensus.cc:2243] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.245147 17228 raft_consensus.cc:2272] T e2520ae829ce4b3082870ad84db70f7d P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.247144 17228 tablet_replica.cc:333] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.247641 17228 raft_consensus.cc:2243] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.248441 17228 raft_consensus.cc:2272] T cc265439c9a64543b0c69805e9131cfe P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.250460 17228 tablet_replica.cc:333] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.251008 17228 raft_consensus.cc:2243] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.251441 17228 raft_consensus.cc:2272] T f9c681632e82489da482ce4f96f3a902 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.253350 17228 tablet_replica.cc:333] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.254011 17228 raft_consensus.cc:2243] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.254462 17228 raft_consensus.cc:2272] T ae2d62f90435440491da63b1ae0e710e P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.256268 17228 tablet_replica.cc:333] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.256793 17228 raft_consensus.cc:2243] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.257210 17228 raft_consensus.cc:2272] T 2be301b0a3ad4513936a33b8c989ab3d P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.259169 17228 tablet_replica.cc:333] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.259701 17228 raft_consensus.cc:2243] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.260134 17228 raft_consensus.cc:2272] T eea867c357cd4e4d970226215f94bfe7 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.261977 17228 tablet_replica.cc:333] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.262542 17228 raft_consensus.cc:2243] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.263339 17228 raft_consensus.cc:2272] T 9e879da59df949eca2ae0618a4c5ddc2 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.265146 17228 tablet_replica.cc:333] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.265713 17228 raft_consensus.cc:2243] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.266548 17228 raft_consensus.cc:2272] T f8f052365b064537ba68ac4701e53694 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.268983 17228 tablet_replica.cc:333] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.269500 17228 raft_consensus.cc:2243] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.269906 17228 raft_consensus.cc:2272] T c15e4fb6800449ceb211a61be3587ecc P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.271719 17228 tablet_replica.cc:333] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.272189 17228 raft_consensus.cc:2243] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.272591 17228 raft_consensus.cc:2272] T f8168790b26f4632b04441b2780e479a P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.274329 17228 tablet_replica.cc:333] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.274972 17228 raft_consensus.cc:2243] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.276021 17228 raft_consensus.cc:2272] T b9bfde4ba996435bb05645af25e1f2c7 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.278015 17228 tablet_replica.cc:333] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.278530 17228 raft_consensus.cc:2243] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.278991 17228 raft_consensus.cc:2272] T c0e89c6170734a98849f97b6441df9e4 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.281090 17228 tablet_replica.cc:333] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.281664 17228 raft_consensus.cc:2243] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.282536 17228 raft_consensus.cc:2272] T cc9240e31c174ddab78702a2343b3d64 P f8a9e56b2e1e46de810671b2180d8a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.284412 17228 tablet_replica.cc:333] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.284969 17228 raft_consensus.cc:2243] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.285393 17228 raft_consensus.cc:2272] T 9b275ea51fb94eeaac1650d139e43706 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.287514 17228 tablet_replica.cc:333] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.288398 17228 raft_consensus.cc:2243] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.288957 17228 raft_consensus.cc:2272] T acdfccdb823e4badaf6a647eccefcc66 P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.291880 17228 tablet_replica.cc:333] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.292498 17228 raft_consensus.cc:2243] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.293325 17228 raft_consensus.cc:2272] T 81dbddeb15af47cbbe275279293370fa P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.295428 17228 tablet_replica.cc:333] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.295990 17228 raft_consensus.cc:2243] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.296452 17228 raft_consensus.cc:2272] T f703b8e7da3f432e95c5d1b9fc735f71 P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.298516 17228 tablet_replica.cc:333] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.299070 17228 raft_consensus.cc:2243] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.299547 17228 raft_consensus.cc:2272] T 9aed70992ac24e10943f5bcab0a11d67 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.301615 17228 tablet_replica.cc:333] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.302279 17228 raft_consensus.cc:2243] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.302790 17228 raft_consensus.cc:2272] T 4abab287ccaf44d4a4872b89f3012fa9 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.304994 17228 tablet_replica.cc:333] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.305747 17228 raft_consensus.cc:2243] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.306425 17228 raft_consensus.cc:2272] T 015cfc692b904ffb8d66556e17bd9ed1 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.309247 17228 tablet_replica.cc:333] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.310034 17228 raft_consensus.cc:2243] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.310640 17228 raft_consensus.cc:2272] T 2704c533ff304006941c451f2f6d4660 P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.314723 17228 tablet_replica.cc:333] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.315526 17228 raft_consensus.cc:2243] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.316648 17228 raft_consensus.cc:2272] T 74f6d48dac364e25bcc18c1388db7fb6 P f8a9e56b2e1e46de810671b2180d8a68 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.319526 17228 tablet_replica.cc:333] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.320657 17228 raft_consensus.cc:2243] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.321833 17228 raft_consensus.cc:2272] T dc39a93c665a491a81bb0925b35ccf33 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.325011 17228 tablet_replica.cc:333] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.325704 17228 raft_consensus.cc:2243] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.326778 17228 raft_consensus.cc:2272] T 36073ec086cc47098e9a796722246728 P f8a9e56b2e1e46de810671b2180d8a68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.329583 17228 tablet_replica.cc:333] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.330516 17228 raft_consensus.cc:2243] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.331822 17228 raft_consensus.cc:2272] T 85033b16e63444238f30de7eae6d6634 P f8a9e56b2e1e46de810671b2180d8a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.334741 17228 tablet_replica.cc:333] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68: stopping tablet replica
I20260709 13:21:22.335352 17228 raft_consensus.cc:2243] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.336468 17228 raft_consensus.cc:2272] T b1d018923485454fbcc0dccb5823166e P f8a9e56b2e1e46de810671b2180d8a68 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.421689 17228 tablet_server.cc:196] TabletServer@127.16.211.4:0 shutdown complete.
I20260709 13:21:22.488798 17228 master.cc:562] Master@127.16.211.62:42373 shutting down...
I20260709 13:21:22.518625 17228 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.519476 17228 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.519892 17228 tablet_replica.cc:333] T 00000000000000000000000000000000 P b3ae1c1987214dabbd7971a4f18cb4bc: stopping tablet replica
I20260709 13:21:22.564000 17228 master.cc:584] Master@127.16.211.62:42373 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (41261 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:21:22.662488 17228 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.211.62:43859
I20260709 13:21:22.663713 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:22.669862 26819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:22.671388 26820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:22.671599 26822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:22.672524 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:22.673746 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:22.673991 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:22.674197 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603282674179 us; error 0 us; skew 500 ppm
I20260709 13:21:22.674794 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:22.677626 17228 webserver.cc:533] Webserver started at http://127.16.211.62:38191/ using document root <none> and password file <none>
I20260709 13:21:22.678180 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:22.678349 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:22.679003 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:22.680769 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/master-0-root/instance:
uuid: "bc4037f884814a88968b00292acd6da6"
format_stamp: "Formatted at 2026-07-09 13:21:22 on dist-test-slave-96c3"
I20260709 13:21:22.686152 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.005s
I20260709 13:21:22.690038 26827 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:22.690956 17228 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:21:22.691280 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/master-0-root
uuid: "bc4037f884814a88968b00292acd6da6"
format_stamp: "Formatted at 2026-07-09 13:21:22 on dist-test-slave-96c3"
I20260709 13:21:22.691596 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:22.708323 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:22.709676 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:22.751209 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.62:43859
I20260709 13:21:22.751335 26878 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.62:43859 every 8 connection(s)
I20260709 13:21:22.755340 26879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.768558 26879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6: Bootstrap starting.
I20260709 13:21:22.773561 26879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.778198 26879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6: No bootstrap required, opened a new log
I20260709 13:21:22.780623 26879 raft_consensus.cc:359] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc4037f884814a88968b00292acd6da6" member_type: VOTER }
I20260709 13:21:22.781085 26879 raft_consensus.cc:385] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.781368 26879 raft_consensus.cc:740] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc4037f884814a88968b00292acd6da6, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.782110 26879 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc4037f884814a88968b00292acd6da6" member_type: VOTER }
I20260709 13:21:22.782625 26879 raft_consensus.cc:399] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:22.782874 26879 raft_consensus.cc:493] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:22.783192 26879 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.788480 26879 raft_consensus.cc:515] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc4037f884814a88968b00292acd6da6" member_type: VOTER }
I20260709 13:21:22.789077 26879 leader_election.cc:304] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc4037f884814a88968b00292acd6da6; no voters: 
I20260709 13:21:22.790442 26879 leader_election.cc:290] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:22.790869 26882 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:22.792322 26882 raft_consensus.cc:697] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [term 1 LEADER]: Becoming Leader. State: Replica: bc4037f884814a88968b00292acd6da6, State: Running, Role: LEADER
I20260709 13:21:22.793020 26882 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc4037f884814a88968b00292acd6da6" member_type: VOTER }
I20260709 13:21:22.793905 26879 sys_catalog.cc:565] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:22.798628 26884 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc4037f884814a88968b00292acd6da6. Latest consensus state: current_term: 1 leader_uuid: "bc4037f884814a88968b00292acd6da6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc4037f884814a88968b00292acd6da6" member_type: VOTER } }
I20260709 13:21:22.799513 26884 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:22.801026 26883 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc4037f884814a88968b00292acd6da6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc4037f884814a88968b00292acd6da6" member_type: VOTER } }
I20260709 13:21:22.801654 26890 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:22.801668 26883 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:22.806874 26890 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:22.811932 17228 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:22.816242 26890 catalog_manager.cc:1383] Generated new cluster ID: dc370303c51e4ad8a770610621f4e303
I20260709 13:21:22.816561 26890 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:22.830930 26890 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:22.832386 26890 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:22.847272 26890 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6: Generated new TSK 0
I20260709 13:21:22.847998 26890 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:22.879936 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:22.886974 26900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:22.887768 26901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:22.889381 26903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:22.890480 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:22.891609 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:22.891791 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:22.891993 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603282891960 us; error 0 us; skew 500 ppm
I20260709 13:21:22.892570 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:22.895262 17228 webserver.cc:533] Webserver started at http://127.16.211.1:34339/ using document root <none> and password file <none>
I20260709 13:21:22.895835 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:22.896006 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:22.896358 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:22.897450 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-0-root/instance:
uuid: "a3486fa7720442859851bd70466b33e5"
format_stamp: "Formatted at 2026-07-09 13:21:22 on dist-test-slave-96c3"
I20260709 13:21:22.902361 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:21:22.905962 26908 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:22.906776 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:21:22.907084 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-0-root
uuid: "a3486fa7720442859851bd70466b33e5"
format_stamp: "Formatted at 2026-07-09 13:21:22 on dist-test-slave-96c3"
I20260709 13:21:22.907344 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:22.920368 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:22.921723 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:22.923441 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:22.925829 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:22.926065 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:22.926342 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:22.926529 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:22.972932 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.1:37837
I20260709 13:21:22.973024 26970 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.1:37837 every 8 connection(s)
I20260709 13:21:22.978164 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:22.986192 26975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:22.988931 26976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:22.990872 26978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:22.992123 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:22.993983 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:22.994195 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:22.994321 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603282994309 us; error 0 us; skew 500 ppm
I20260709 13:21:22.994977 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:22.997736 26971 heartbeater.cc:344] Connected to a master server at 127.16.211.62:43859
I20260709 13:21:22.998142 26971 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:22.998180 17228 webserver.cc:533] Webserver started at http://127.16.211.2:33713/ using document root <none> and password file <none>
I20260709 13:21:22.998838 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:22.999055 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:22.999058 26971 heartbeater.cc:507] Master 127.16.211.62:43859 requested a full tablet report, sending...
I20260709 13:21:22.999678 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:23.000831 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-1-root/instance:
uuid: "08095d6ed192460eb036f63f9b683e37"
format_stamp: "Formatted at 2026-07-09 13:21:22 on dist-test-slave-96c3"
I20260709 13:21:23.001694 26844 ts_manager.cc:194] Registered new tserver with Master: a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837)
I20260709 13:21:23.004331 26844 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49760
I20260709 13:21:23.007195 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:21:23.010923 26983 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:23.011757 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:21:23.012105 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-1-root
uuid: "08095d6ed192460eb036f63f9b683e37"
format_stamp: "Formatted at 2026-07-09 13:21:22 on dist-test-slave-96c3"
I20260709 13:21:23.012363 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:23.031975 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:23.033212 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:23.034718 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:23.037022 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:23.037206 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:23.037516 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:23.037676 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:23.079373 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.2:39797
I20260709 13:21:23.079563 27045 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.2:39797 every 8 connection(s)
I20260709 13:21:23.084321 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:23.092495 27049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:23.092880 27050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:23.096071 27052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:23.097280 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:23.098210 27046 heartbeater.cc:344] Connected to a master server at 127.16.211.62:43859
I20260709 13:21:23.098398 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:23.098690 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:23.098703 27046 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:23.098976 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603283098955 us; error 0 us; skew 500 ppm
I20260709 13:21:23.099777 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:23.099711 27046 heartbeater.cc:507] Master 127.16.211.62:43859 requested a full tablet report, sending...
I20260709 13:21:23.102630 26844 ts_manager.cc:194] Registered new tserver with Master: 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:23.102712 17228 webserver.cc:533] Webserver started at http://127.16.211.3:32771/ using document root <none> and password file <none>
I20260709 13:21:23.103484 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:23.103744 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:23.104130 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:23.104584 26844 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49770
I20260709 13:21:23.105405 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-2-root/instance:
uuid: "0212e0ac12a44277983cc8a5250ed83d"
format_stamp: "Formatted at 2026-07-09 13:21:23 on dist-test-slave-96c3"
I20260709 13:21:23.110551 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:21:23.114230 27057 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:23.115119 17228 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:21:23.115454 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-2-root
uuid: "0212e0ac12a44277983cc8a5250ed83d"
format_stamp: "Formatted at 2026-07-09 13:21:23 on dist-test-slave-96c3"
I20260709 13:21:23.115733 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:23.140091 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:23.141309 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:23.142858 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:23.145447 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:23.145686 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:23.145948 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:23.146130 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:23.187570 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.3:38215
I20260709 13:21:23.187700 27119 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.3:38215 every 8 connection(s)
I20260709 13:21:23.201797 27120 heartbeater.cc:344] Connected to a master server at 127.16.211.62:43859
I20260709 13:21:23.202252 27120 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:23.203001 27120 heartbeater.cc:507] Master 127.16.211.62:43859 requested a full tablet report, sending...
I20260709 13:21:23.205195 26844 ts_manager.cc:194] Registered new tserver with Master: 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:23.205413 17228 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014768243s
I20260709 13:21:23.206683 26844 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49786
I20260709 13:21:23.232977 26844 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49796:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:23.235996 26844 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:23.310191 27011 tablet_service.cc:1511] Processing CreateTablet for tablet 030215ab2e584718b14b5f1e0088d06b (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:23.311960 27011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030215ab2e584718b14b5f1e0088d06b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.311679 27010 tablet_service.cc:1511] Processing CreateTablet for tablet f4b96c39550146efb4a917fddb43f6ae (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:23.315521 27010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b96c39550146efb4a917fddb43f6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.318535 27009 tablet_service.cc:1511] Processing CreateTablet for tablet 232335ce7f594d5cbef3c35982d50778 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:23.320737 27009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232335ce7f594d5cbef3c35982d50778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.320618 27008 tablet_service.cc:1511] Processing CreateTablet for tablet 95b52c269985488092ba3dea3efb488f (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:23.322315 27008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b52c269985488092ba3dea3efb488f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.343389 27007 tablet_service.cc:1511] Processing CreateTablet for tablet beea3c2c974b4c1385d4535e06213132 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:23.345098 27007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beea3c2c974b4c1385d4535e06213132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.362308 27006 tablet_service.cc:1511] Processing CreateTablet for tablet c1f59a70f8c54800b763cc59c2a827f2 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:23.363888 27006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f59a70f8c54800b763cc59c2a827f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.370000 27085 tablet_service.cc:1511] Processing CreateTablet for tablet 030215ab2e584718b14b5f1e0088d06b (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:23.369693 27005 tablet_service.cc:1511] Processing CreateTablet for tablet b7b1499ef1ce45338ffdffed28641af6 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:23.371474 27085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030215ab2e584718b14b5f1e0088d06b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.371987 27005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b1499ef1ce45338ffdffed28641af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.375159 27084 tablet_service.cc:1511] Processing CreateTablet for tablet f4b96c39550146efb4a917fddb43f6ae (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:23.376770 27084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b96c39550146efb4a917fddb43f6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.377202 27009 tablet_service.cc:1511] Processing CreateTablet for tablet 200406b4466a4b05a2fc343b1dfce72b (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:23.379000 27009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 200406b4466a4b05a2fc343b1dfce72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.379683 27083 tablet_service.cc:1511] Processing CreateTablet for tablet 232335ce7f594d5cbef3c35982d50778 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:23.381247 27083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232335ce7f594d5cbef3c35982d50778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.383147 27082 tablet_service.cc:1511] Processing CreateTablet for tablet 95b52c269985488092ba3dea3efb488f (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:23.384585 27082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b52c269985488092ba3dea3efb488f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.387213 27080 tablet_service.cc:1511] Processing CreateTablet for tablet c1f59a70f8c54800b763cc59c2a827f2 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:23.388696 27080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f59a70f8c54800b763cc59c2a827f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.391222 27079 tablet_service.cc:1511] Processing CreateTablet for tablet b7b1499ef1ce45338ffdffed28641af6 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:23.392717 27079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b1499ef1ce45338ffdffed28641af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.393801 27077 tablet_service.cc:1511] Processing CreateTablet for tablet e07a4db5beed48d59ffd1638275afd5d (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:23.395170 27078 tablet_service.cc:1511] Processing CreateTablet for tablet 200406b4466a4b05a2fc343b1dfce72b (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:23.397032 27078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 200406b4466a4b05a2fc343b1dfce72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.397107 27081 tablet_service.cc:1511] Processing CreateTablet for tablet beea3c2c974b4c1385d4535e06213132 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:23.398275 27077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e07a4db5beed48d59ffd1638275afd5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.404214 27076 tablet_service.cc:1511] Processing CreateTablet for tablet a55c0fae73774f73a3fbe7994d0c0098 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:23.414458 27081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beea3c2c974b4c1385d4535e06213132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.435089 27076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55c0fae73774f73a3fbe7994d0c0098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.439908 27136 tablet_bootstrap.cc:492] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d: Bootstrap starting.
I20260709 13:21:23.441681 27008 tablet_service.cc:1511] Processing CreateTablet for tablet e07a4db5beed48d59ffd1638275afd5d (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:23.446786 27136 tablet_bootstrap.cc:654] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.448807 27010 tablet_service.cc:1511] Processing CreateTablet for tablet a55c0fae73774f73a3fbe7994d0c0098 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:23.457674 26936 tablet_service.cc:1511] Processing CreateTablet for tablet 030215ab2e584718b14b5f1e0088d06b (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:23.459249 26933 tablet_service.cc:1511] Processing CreateTablet for tablet 95b52c269985488092ba3dea3efb488f (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:23.468679 26933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b52c269985488092ba3dea3efb488f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.459908 26928 tablet_service.cc:1511] Processing CreateTablet for tablet e07a4db5beed48d59ffd1638275afd5d (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:23.457873 26934 tablet_service.cc:1511] Processing CreateTablet for tablet 232335ce7f594d5cbef3c35982d50778 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:23.460129 26927 tablet_service.cc:1511] Processing CreateTablet for tablet a55c0fae73774f73a3fbe7994d0c0098 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:23.461153 26932 tablet_service.cc:1511] Processing CreateTablet for tablet beea3c2c974b4c1385d4535e06213132 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:23.463183 26931 tablet_service.cc:1511] Processing CreateTablet for tablet c1f59a70f8c54800b763cc59c2a827f2 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:23.463398 26930 tablet_service.cc:1511] Processing CreateTablet for tablet b7b1499ef1ce45338ffdffed28641af6 (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:23.465016 26929 tablet_service.cc:1511] Processing CreateTablet for tablet 200406b4466a4b05a2fc343b1dfce72b (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:23.457428 26935 tablet_service.cc:1511] Processing CreateTablet for tablet f4b96c39550146efb4a917fddb43f6ae (DEFAULT_TABLE table=test-workload [id=87379606e66a4b62803b093747f1f522]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:23.476154 26936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030215ab2e584718b14b5f1e0088d06b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.468708 27135 tablet_bootstrap.cc:492] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37: Bootstrap starting.
I20260709 13:21:23.479296 26935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b96c39550146efb4a917fddb43f6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.481148 26929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 200406b4466a4b05a2fc343b1dfce72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.482625 26930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b1499ef1ce45338ffdffed28641af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.484382 26932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beea3c2c974b4c1385d4535e06213132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.486084 26934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232335ce7f594d5cbef3c35982d50778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.487780 26928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e07a4db5beed48d59ffd1638275afd5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.489640 26931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f59a70f8c54800b763cc59c2a827f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.497081 26927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55c0fae73774f73a3fbe7994d0c0098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.518463 27010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55c0fae73774f73a3fbe7994d0c0098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.526597 27008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e07a4db5beed48d59ffd1638275afd5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.557480 27135 tablet_bootstrap.cc:654] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.567821 27136 tablet_bootstrap.cc:492] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d: No bootstrap required, opened a new log
I20260709 13:21:23.568511 27136 ts_tablet_manager.cc:1403] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d: Time spent bootstrapping tablet: real 0.129s	user 0.027s	sys 0.045s
I20260709 13:21:23.572273 27136 raft_consensus.cc:359] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.573055 27136 raft_consensus.cc:385] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.573357 27136 raft_consensus.cc:740] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.574182 27136 consensus_queue.cc:260] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.601313 27140 tablet_bootstrap.cc:492] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:23.615605 27136 ts_tablet_manager.cc:1434] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d: Time spent starting tablet: real 0.047s	user 0.016s	sys 0.032s
I20260709 13:21:23.616461 27120 heartbeater.cc:499] Master 127.16.211.62:43859 was elected leader, sending a full tablet report...
I20260709 13:21:23.621696 27136 tablet_bootstrap.cc:492] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d: Bootstrap starting.
I20260709 13:21:23.628366 27136 tablet_bootstrap.cc:654] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.633178 27135 tablet_bootstrap.cc:492] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37: No bootstrap required, opened a new log
I20260709 13:21:23.633697 27135 ts_tablet_manager.cc:1403] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37: Time spent bootstrapping tablet: real 0.165s	user 0.016s	sys 0.014s
I20260709 13:21:23.636775 27135 raft_consensus.cc:359] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:23.637567 27135 raft_consensus.cc:385] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.637874 27135 raft_consensus.cc:740] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.638818 27135 consensus_queue.cc:260] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:23.646695 27140 tablet_bootstrap.cc:654] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.659219 27046 heartbeater.cc:499] Master 127.16.211.62:43859 was elected leader, sending a full tablet report...
I20260709 13:21:23.659902 27135 ts_tablet_manager.cc:1434] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.015s
I20260709 13:21:23.660979 27135 tablet_bootstrap.cc:492] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37: Bootstrap starting.
I20260709 13:21:23.662225 27140 tablet_bootstrap.cc:492] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5: No bootstrap required, opened a new log
I20260709 13:21:23.662925 27140 ts_tablet_manager.cc:1403] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.007s
I20260709 13:21:23.664073 27136 tablet_bootstrap.cc:492] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d: No bootstrap required, opened a new log
I20260709 13:21:23.664644 27136 ts_tablet_manager.cc:1403] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.021s
I20260709 13:21:23.666289 27140 raft_consensus.cc:359] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.667212 27140 raft_consensus.cc:385] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.667593 27140 raft_consensus.cc:740] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.667651 27136 raft_consensus.cc:359] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.668443 27136 raft_consensus.cc:385] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.668825 27135 tablet_bootstrap.cc:654] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.668766 27136 raft_consensus.cc:740] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.668756 27140 consensus_queue.cc:260] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.670112 27136 consensus_queue.cc:260] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.673501 27136 ts_tablet_manager.cc:1434] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:21:23.674921 27136 tablet_bootstrap.cc:492] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d: Bootstrap starting.
I20260709 13:21:23.684746 27136 tablet_bootstrap.cc:654] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.690056 27135 tablet_bootstrap.cc:492] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37: No bootstrap required, opened a new log
I20260709 13:21:23.690940 27135 ts_tablet_manager.cc:1403] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.007s
W20260709 13:21:23.691687 27121 tablet.cc:2406] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:23.695147 26971 heartbeater.cc:499] Master 127.16.211.62:43859 was elected leader, sending a full tablet report...
I20260709 13:21:23.695664 27135 raft_consensus.cc:359] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.696520 27135 raft_consensus.cc:385] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.696791 27135 raft_consensus.cc:740] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.697548 27135 consensus_queue.cc:260] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.699658 27135 ts_tablet_manager.cc:1434] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:21:23.700649 27135 tablet_bootstrap.cc:492] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37: Bootstrap starting.
I20260709 13:21:23.707381 27135 tablet_bootstrap.cc:654] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.709688 27144 raft_consensus.cc:493] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.710491 27144 raft_consensus.cc:515] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.718175 27140 ts_tablet_manager.cc:1434] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.055s	user 0.013s	sys 0.015s
I20260709 13:21:23.719796 27140 tablet_bootstrap.cc:492] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:23.723276 27144 leader_election.cc:290] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:23.728261 27140 tablet_bootstrap.cc:654] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.728331 27136 tablet_bootstrap.cc:492] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d: No bootstrap required, opened a new log
I20260709 13:21:23.729156 27136 ts_tablet_manager.cc:1403] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d: Time spent bootstrapping tablet: real 0.055s	user 0.033s	sys 0.018s
I20260709 13:21:23.733675 27136 raft_consensus.cc:359] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.734601 27136 raft_consensus.cc:385] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.734928 27136 raft_consensus.cc:740] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.736073 27136 consensus_queue.cc:260] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.739671 27135 tablet_bootstrap.cc:492] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37: No bootstrap required, opened a new log
I20260709 13:21:23.740375 27135 ts_tablet_manager.cc:1403] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.018s
I20260709 13:21:23.743481 27135 raft_consensus.cc:359] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.744311 27135 raft_consensus.cc:385] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.744649 27135 raft_consensus.cc:740] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.745424 27135 consensus_queue.cc:260] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.746867 27136 ts_tablet_manager.cc:1434] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:21:23.748059 27136 tablet_bootstrap.cc:492] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d: Bootstrap starting.
I20260709 13:21:23.750200 27135 ts_tablet_manager.cc:1434] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:23.751392 27135 tablet_bootstrap.cc:492] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37: Bootstrap starting.
I20260709 13:21:23.753523 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d" candidate_uuid: "a3486fa7720442859851bd70466b33e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37" is_pre_election: true
W20260709 13:21:23.755319 26912 leader_election.cc:343] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.750459 27140 tablet_bootstrap.cc:492] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5: No bootstrap required, opened a new log
I20260709 13:21:23.756392 27140 ts_tablet_manager.cc:1403] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.005s
I20260709 13:21:23.756909 27136 tablet_bootstrap.cc:654] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.758575 27135 tablet_bootstrap.cc:654] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.759569 27140 raft_consensus.cc:359] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.760387 27140 raft_consensus.cc:385] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.760712 27140 raft_consensus.cc:740] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.766621 27095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d" candidate_uuid: "a3486fa7720442859851bd70466b33e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d" is_pre_election: true
I20260709 13:21:23.767433 27095 raft_consensus.cc:2468] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3486fa7720442859851bd70466b33e5 in term 0.
I20260709 13:21:23.768764 26912 leader_election.cc:304] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 08095d6ed192460eb036f63f9b683e37
I20260709 13:21:23.770094 27140 consensus_queue.cc:260] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.771134 27144 raft_consensus.cc:493] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.771600 27144 raft_consensus.cc:515] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.771946 27135 tablet_bootstrap.cc:492] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37: No bootstrap required, opened a new log
I20260709 13:21:23.772208 27136 tablet_bootstrap.cc:492] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d: No bootstrap required, opened a new log
I20260709 13:21:23.772718 27135 ts_tablet_manager.cc:1403] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:21:23.773057 27136 ts_tablet_manager.cc:1403] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 13:21:23.776189 27135 raft_consensus.cc:359] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.776834 27144 leader_election.cc:290] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:23.777102 27135 raft_consensus.cc:385] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.777455 27144 raft_consensus.cc:2804] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.777558 27135 raft_consensus.cc:740] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.777971 27144 raft_consensus.cc:493] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.778443 27144 raft_consensus.cc:3060] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.777617 27136 raft_consensus.cc:359] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.778951 27136 raft_consensus.cc:385] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.779390 27136 raft_consensus.cc:740] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.778981 27135 consensus_queue.cc:260] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.780846 27136 consensus_queue.cc:260] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.782029 27140 ts_tablet_manager.cc:1434] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:21:23.783871 27136 ts_tablet_manager.cc:1434] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 13:21:23.785053 27140 tablet_bootstrap.cc:492] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:23.785583 27136 tablet_bootstrap.cc:492] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d: Bootstrap starting.
I20260709 13:21:23.788534 27135 ts_tablet_manager.cc:1434] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:21:23.790920 27135 tablet_bootstrap.cc:492] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37: Bootstrap starting.
I20260709 13:21:23.793320 27144 raft_consensus.cc:515] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.795745 27144 leader_election.cc:290] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 election: Requested vote from peers 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:23.796471 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b96c39550146efb4a917fddb43f6ae" candidate_uuid: "a3486fa7720442859851bd70466b33e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37" is_pre_election: true
I20260709 13:21:23.797248 27021 raft_consensus.cc:2468] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3486fa7720442859851bd70466b33e5 in term 0.
I20260709 13:21:23.798153 27140 tablet_bootstrap.cc:654] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.798409 27095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b96c39550146efb4a917fddb43f6ae" candidate_uuid: "a3486fa7720442859851bd70466b33e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d" is_pre_election: true
I20260709 13:21:23.799140 27095 raft_consensus.cc:2468] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3486fa7720442859851bd70466b33e5 in term 0.
I20260709 13:21:23.801038 27136 tablet_bootstrap.cc:654] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.801645 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d" candidate_uuid: "a3486fa7720442859851bd70466b33e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37"
I20260709 13:21:23.803912 27140 tablet_bootstrap.cc:492] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5: No bootstrap required, opened a new log
I20260709 13:21:23.804474 27140 ts_tablet_manager.cc:1403] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.008s
W20260709 13:21:23.807308 26892 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:23.807997 27135 tablet_bootstrap.cc:654] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.808157 27095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d" candidate_uuid: "a3486fa7720442859851bd70466b33e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
I20260709 13:21:23.808796 27095 raft_consensus.cc:3060] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.807749 27140 raft_consensus.cc:359] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.810014 27140 raft_consensus.cc:385] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.810395 27140 raft_consensus.cc:740] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.811118 27140 consensus_queue.cc:260] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.813336 27140 ts_tablet_manager.cc:1434] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:21:23.815341 27136 tablet_bootstrap.cc:492] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d: No bootstrap required, opened a new log
I20260709 13:21:23.815917 27136 ts_tablet_manager.cc:1403] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.009s
I20260709 13:21:23.817858 27140 tablet_bootstrap.cc:492] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:23.818186 26912 leader_election.cc:304] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:23.819340 27142 raft_consensus.cc:493] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.819870 27142 raft_consensus.cc:515] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:23.819371 27144 raft_consensus.cc:2804] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.822470 27144 raft_consensus.cc:493] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.822822 27144 raft_consensus.cc:3060] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:23.819767 26912 leader_election.cc:343] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.825117 27140 tablet_bootstrap.cc:654] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.826892 27142 leader_election.cc:290] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215), a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837)
I20260709 13:21:23.830197 27136 raft_consensus.cc:359] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.835577 27136 raft_consensus.cc:385] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.836055 27136 raft_consensus.cc:740] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.837194 27136 consensus_queue.cc:260] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.843236 27136 ts_tablet_manager.cc:1434] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 13:21:23.843863 27142 raft_consensus.cc:493] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.844707 27136 tablet_bootstrap.cc:492] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d: Bootstrap starting.
I20260709 13:21:23.844699 27142 raft_consensus.cc:515] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.852458 27136 tablet_bootstrap.cc:654] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.856686 27135 tablet_bootstrap.cc:492] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37: No bootstrap required, opened a new log
I20260709 13:21:23.857406 27135 ts_tablet_manager.cc:1403] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37: Time spent bootstrapping tablet: real 0.067s	user 0.006s	sys 0.040s
I20260709 13:21:23.861593 27135 raft_consensus.cc:359] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.862703 27135 raft_consensus.cc:385] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.863085 27135 raft_consensus.cc:740] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.872546 27138 raft_consensus.cc:493] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.873167 27138 raft_consensus.cc:515] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.880419 27142 leader_election.cc:290] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:23.836711 27095 raft_consensus.cc:2468] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3486fa7720442859851bd70466b33e5 in term 1.
I20260709 13:21:23.887090 27144 raft_consensus.cc:515] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.888289 27138 leader_election.cc:290] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:23.895095 27144 leader_election.cc:290] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 election: Requested vote from peers 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:23.896525 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b96c39550146efb4a917fddb43f6ae" candidate_uuid: "a3486fa7720442859851bd70466b33e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37"
I20260709 13:21:23.897396 27021 raft_consensus.cc:3060] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.898568 27140 tablet_bootstrap.cc:492] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5: No bootstrap required, opened a new log
I20260709 13:21:23.899115 27140 ts_tablet_manager.cc:1403] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.081s	user 0.033s	sys 0.043s
I20260709 13:21:23.901696 27140 raft_consensus.cc:359] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.902406 27140 raft_consensus.cc:385] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.902680 27140 raft_consensus.cc:740] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.873095 27135 consensus_queue.cc:260] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.903340 27140 consensus_queue.cc:260] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.905426 27135 ts_tablet_manager.cc:1434] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.001s
I20260709 13:21:23.906044 27140 ts_tablet_manager.cc:1434] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:21:23.906905 27021 raft_consensus.cc:2468] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3486fa7720442859851bd70466b33e5 in term 1.
I20260709 13:21:23.907096 27140 tablet_bootstrap.cc:492] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:23.908198 26912 leader_election.cc:304] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:23.909250 27144 raft_consensus.cc:2804] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.909827 27144 raft_consensus.cc:697] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 1 LEADER]: Becoming Leader. State: Replica: a3486fa7720442859851bd70466b33e5, State: Running, Role: LEADER
I20260709 13:21:23.910825 27144 consensus_queue.cc:237] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.917846 27140 tablet_bootstrap.cc:654] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.919586 26946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5" is_pre_election: true
I20260709 13:21:23.921229 26945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b52c269985488092ba3dea3efb488f" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5" is_pre_election: true
I20260709 13:21:23.922050 26945 raft_consensus.cc:2468] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 0.
W20260709 13:21:23.923528 26985 leader_election.cc:343] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.924256 26985 leader_election.cc:304] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:23.924521 27095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d" is_pre_election: true
I20260709 13:21:23.924985 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b52c269985488092ba3dea3efb488f" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d" is_pre_election: true
I20260709 13:21:23.925889 27142 raft_consensus.cc:2804] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.926329 27142 raft_consensus.cc:493] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:23.926664 26987 leader_election.cc:343] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.927130 26987 leader_election.cc:304] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37; no voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5
I20260709 13:21:23.928977 26912 leader_election.cc:304] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 08095d6ed192460eb036f63f9b683e37
I20260709 13:21:23.930016 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b96c39550146efb4a917fddb43f6ae" candidate_uuid: "a3486fa7720442859851bd70466b33e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
I20260709 13:21:23.930338 27153 raft_consensus.cc:2804] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.930680 27094 raft_consensus.cc:3060] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.926698 27142 raft_consensus.cc:3060] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.935488 27166 raft_consensus.cc:2749] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:23.939491 27020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f59a70f8c54800b763cc59c2a827f2" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37" is_pre_election: true
I20260709 13:21:23.939981 27094 raft_consensus.cc:2468] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3486fa7720442859851bd70466b33e5 in term 1.
I20260709 13:21:23.940537 27153 raft_consensus.cc:697] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 1 LEADER]: Becoming Leader. State: Replica: a3486fa7720442859851bd70466b33e5, State: Running, Role: LEADER
I20260709 13:21:23.942507 27153 consensus_queue.cc:237] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.943846 27142 raft_consensus.cc:515] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.946753 27140 tablet_bootstrap.cc:492] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5: No bootstrap required, opened a new log
I20260709 13:21:23.947391 27140 ts_tablet_manager.cc:1403] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.013s
W20260709 13:21:23.948793 26987 leader_election.cc:343] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.950784 26945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b52c269985488092ba3dea3efb488f" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:23.951401 26945 raft_consensus.cc:3060] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:23.947391 27061 leader_election.cc:343] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.952076 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b52c269985488092ba3dea3efb488f" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
I20260709 13:21:23.950081 27142 leader_election.cc:290] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:23.954265 26946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f59a70f8c54800b763cc59c2a827f2" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5" is_pre_election: true
I20260709 13:21:23.954964 26946 raft_consensus.cc:2468] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 0.
W20260709 13:21:23.955451 26987 leader_election.cc:343] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.956111 27136 tablet_bootstrap.cc:492] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d: No bootstrap required, opened a new log
I20260709 13:21:23.955560 26842 catalog_manager.cc:5697] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3486fa7720442859851bd70466b33e5 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "a3486fa7720442859851bd70466b33e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:23.956729 27136 ts_tablet_manager.cc:1403] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d: Time spent bootstrapping tablet: real 0.112s	user 0.027s	sys 0.032s
I20260709 13:21:23.956290 27140 raft_consensus.cc:359] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.959914 27140 raft_consensus.cc:385] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.960517 27059 leader_election.cc:304] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 08095d6ed192460eb036f63f9b683e37
I20260709 13:21:23.961048 27135 tablet_bootstrap.cc:492] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37: Bootstrap starting.
I20260709 13:21:23.960577 27140 raft_consensus.cc:740] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.962247 27138 raft_consensus.cc:2804] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.960795 27136 raft_consensus.cc:359] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.963284 27138 raft_consensus.cc:493] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.963680 27138 raft_consensus.cc:3060] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.964048 27140 consensus_queue.cc:260] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.968715 27140 ts_tablet_manager.cc:1434] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:21:23.970329 27136 raft_consensus.cc:385] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.971056 27140 tablet_bootstrap.cc:492] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:23.973183 27138 raft_consensus.cc:515] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.970836 27135 tablet_bootstrap.cc:654] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.975760 27136 raft_consensus.cc:740] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.976966 27136 consensus_queue.cc:260] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.978756 26945 raft_consensus.cc:2468] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 1.
I20260709 13:21:23.980415 26946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f59a70f8c54800b763cc59c2a827f2" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:23.981052 26946 raft_consensus.cc:3060] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.981055 26985 leader_election.cc:304] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5; no voters: 0212e0ac12a44277983cc8a5250ed83d
I20260709 13:21:23.982476 27142 raft_consensus.cc:2804] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.982952 27142 raft_consensus.cc:697] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 1 LEADER]: Becoming Leader. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:23.983754 27142 consensus_queue.cc:237] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.985550 27140 tablet_bootstrap.cc:654] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.987102 27138 leader_election.cc:290] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:23.987783 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f59a70f8c54800b763cc59c2a827f2" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37"
W20260709 13:21:23.989259 27061 leader_election.cc:343] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.992815 27135 tablet_bootstrap.cc:492] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37: No bootstrap required, opened a new log
I20260709 13:21:23.993400 27135 ts_tablet_manager.cc:1403] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.006s
I20260709 13:21:23.994732 26946 raft_consensus.cc:2468] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 1.
I20260709 13:21:23.997162 27135 raft_consensus.cc:359] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:23.998199 27135 raft_consensus.cc:385] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.998535 27135 raft_consensus.cc:740] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.999356 27135 consensus_queue.cc:260] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.003053 27059 leader_election.cc:304] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 08095d6ed192460eb036f63f9b683e37
I20260709 13:21:24.004717 27135 ts_tablet_manager.cc:1434] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:21:24.005811 27135 tablet_bootstrap.cc:492] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37: Bootstrap starting.
I20260709 13:21:24.010903 27136 ts_tablet_manager.cc:1434] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d: Time spent starting tablet: real 0.054s	user 0.015s	sys 0.013s
I20260709 13:21:24.015192 27171 raft_consensus.cc:2804] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.015988 27171 raft_consensus.cc:697] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Becoming Leader. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:24.019395 27140 tablet_bootstrap.cc:492] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5: No bootstrap required, opened a new log
I20260709 13:21:24.018679 26844 catalog_manager.cc:5697] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3486fa7720442859851bd70466b33e5 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "a3486fa7720442859851bd70466b33e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.019937 27140 ts_tablet_manager.cc:1403] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.007s
I20260709 13:21:24.017262 27171 consensus_queue.cc:237] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.023033 27140 raft_consensus.cc:359] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.023864 27140 raft_consensus.cc:385] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.024171 27140 raft_consensus.cc:740] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.024919 27140 consensus_queue.cc:260] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.027264 27136 tablet_bootstrap.cc:492] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d: Bootstrap starting.
I20260709 13:21:24.029639 27135 tablet_bootstrap.cc:654] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.034894 27140 ts_tablet_manager.cc:1434] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 13:21:24.036460 27140 tablet_bootstrap.cc:492] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:24.042490 27136 tablet_bootstrap.cc:654] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.053668 27140 tablet_bootstrap.cc:654] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.054075 26844 catalog_manager.cc:5697] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08095d6ed192460eb036f63f9b683e37 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "08095d6ed192460eb036f63f9b683e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.054140 27135 tablet_bootstrap.cc:492] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37: No bootstrap required, opened a new log
I20260709 13:21:24.057891 27135 ts_tablet_manager.cc:1403] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.007s
I20260709 13:21:24.061012 27135 raft_consensus.cc:359] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.061749 27135 raft_consensus.cc:385] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.062100 27135 raft_consensus.cc:740] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.062911 27135 consensus_queue.cc:260] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.065246 27135 ts_tablet_manager.cc:1434] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:21:24.066299 27135 tablet_bootstrap.cc:492] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37: Bootstrap starting.
I20260709 13:21:24.070786 26842 catalog_manager.cc:5697] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0212e0ac12a44277983cc8a5250ed83d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:24.072517 27135 tablet_bootstrap.cc:654] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.077121 27136 tablet_bootstrap.cc:492] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d: No bootstrap required, opened a new log
I20260709 13:21:24.077907 27136 ts_tablet_manager.cc:1403] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d: Time spent bootstrapping tablet: real 0.051s	user 0.029s	sys 0.008s
I20260709 13:21:24.082211 27136 raft_consensus.cc:359] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.083217 27136 raft_consensus.cc:385] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.083586 27136 raft_consensus.cc:740] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.084659 27136 consensus_queue.cc:260] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.090173 27140 tablet_bootstrap.cc:492] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: No bootstrap required, opened a new log
I20260709 13:21:24.091087 27140 ts_tablet_manager.cc:1403] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.055s	user 0.022s	sys 0.023s
I20260709 13:21:24.091702 27136 ts_tablet_manager.cc:1434] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:21:24.092859 27136 tablet_bootstrap.cc:492] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d: Bootstrap starting.
I20260709 13:21:24.095000 27140 raft_consensus.cc:359] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.095650 27135 tablet_bootstrap.cc:492] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37: No bootstrap required, opened a new log
I20260709 13:21:24.095770 27140 raft_consensus.cc:385] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.096235 27135 ts_tablet_manager.cc:1403] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.006s
I20260709 13:21:24.096262 27140 raft_consensus.cc:740] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.097340 27140 consensus_queue.cc:260] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.099746 27140 ts_tablet_manager.cc:1434] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:24.100090 27142 raft_consensus.cc:493] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.100909 27142 raft_consensus.cc:515] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.101526 27140 tablet_bootstrap.cc:492] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:24.099773 27136 tablet_bootstrap.cc:654] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.102912 27142 leader_election.cc:290] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:24.102392 27135 raft_consensus.cc:359] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.104532 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232335ce7f594d5cbef3c35982d50778" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d" is_pre_election: true
I20260709 13:21:24.104794 27135 raft_consensus.cc:385] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.105141 27135 raft_consensus.cc:740] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.103632 26946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232335ce7f594d5cbef3c35982d50778" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5" is_pre_election: true
I20260709 13:21:24.105489 27094 raft_consensus.cc:2468] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 0.
I20260709 13:21:24.106201 26946 raft_consensus.cc:2468] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 0.
I20260709 13:21:24.106076 27135 consensus_queue.cc:260] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.107061 26987 leader_election.cc:304] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, 08095d6ed192460eb036f63f9b683e37; no voters: 
I20260709 13:21:24.109578 27142 raft_consensus.cc:2804] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.109967 27142 raft_consensus.cc:493] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.110324 27142 raft_consensus.cc:3060] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.112382 27140 tablet_bootstrap.cc:654] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.115340 27135 ts_tablet_manager.cc:1434] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:21:24.116416 27135 tablet_bootstrap.cc:492] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37: Bootstrap starting.
I20260709 13:21:24.117604 27142 raft_consensus.cc:515] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.119825 27142 leader_election.cc:290] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:24.122289 27135 tablet_bootstrap.cc:654] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.122844 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232335ce7f594d5cbef3c35982d50778" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
I20260709 13:21:24.123265 26946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232335ce7f594d5cbef3c35982d50778" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:24.123463 27094 raft_consensus.cc:3060] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.123864 27136 tablet_bootstrap.cc:492] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d: No bootstrap required, opened a new log
I20260709 13:21:24.123881 26946 raft_consensus.cc:3060] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.124563 27136 ts_tablet_manager.cc:1403] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.005s
I20260709 13:21:24.126626 27140 tablet_bootstrap.cc:492] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5: No bootstrap required, opened a new log
I20260709 13:21:24.127113 27140 ts_tablet_manager.cc:1403] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 13:21:24.127825 27136 raft_consensus.cc:359] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.128559 27136 raft_consensus.cc:385] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.128829 27136 raft_consensus.cc:740] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.129558 27136 consensus_queue.cc:260] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.129703 27140 raft_consensus.cc:359] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:24.130800 27140 raft_consensus.cc:385] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.131081 27140 raft_consensus.cc:740] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.131668 27136 ts_tablet_manager.cc:1434] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:24.132134 27140 consensus_queue.cc:260] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:24.132750 27136 tablet_bootstrap.cc:492] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d: Bootstrap starting.
I20260709 13:21:24.133486 26946 raft_consensus.cc:2468] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 1.
I20260709 13:21:24.135176 26985 leader_election.cc:304] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:24.136467 27140 ts_tablet_manager.cc:1434] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:21:24.136430 27142 raft_consensus.cc:2804] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.137035 27142 raft_consensus.cc:697] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 1 LEADER]: Becoming Leader. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:24.137900 27142 consensus_queue.cc:237] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.140229 27136 tablet_bootstrap.cc:654] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.153191 27136 tablet_bootstrap.cc:492] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d: No bootstrap required, opened a new log
I20260709 13:21:24.153901 27136 ts_tablet_manager.cc:1403] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:21:24.156836 27094 raft_consensus.cc:2468] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 1.
I20260709 13:21:24.157776 27136 raft_consensus.cc:359] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:24.158912 27136 raft_consensus.cc:385] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.159296 27136 raft_consensus.cc:740] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.160480 27136 consensus_queue.cc:260] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:24.165266 27140 tablet_bootstrap.cc:492] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:24.168229 27136 ts_tablet_manager.cc:1434] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:21:24.169622 27136 tablet_bootstrap.cc:492] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d: Bootstrap starting.
I20260709 13:21:24.177889 27136 tablet_bootstrap.cc:654] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.181644 27140 tablet_bootstrap.cc:654] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.182332 27135 tablet_bootstrap.cc:492] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37: No bootstrap required, opened a new log
I20260709 13:21:24.183077 27135 ts_tablet_manager.cc:1403] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37: Time spent bootstrapping tablet: real 0.067s	user 0.026s	sys 0.025s
I20260709 13:21:24.183919 27166 raft_consensus.cc:493] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.184581 27166 raft_consensus.cc:515] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.188623 26946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f59a70f8c54800b763cc59c2a827f2" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5" is_pre_election: true
I20260709 13:21:24.189666 26946 raft_consensus.cc:2393] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08095d6ed192460eb036f63f9b683e37 in current term 1: Already voted for candidate 0212e0ac12a44277983cc8a5250ed83d in this term.
I20260709 13:21:24.189863 27166 leader_election.cc:290] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:24.190101 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f59a70f8c54800b763cc59c2a827f2" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d" is_pre_election: true
I20260709 13:21:24.193504 27135 raft_consensus.cc:359] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.194489 27135 raft_consensus.cc:385] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.194823 27135 raft_consensus.cc:740] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.195472 26987 leader_election.cc:304] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37; no voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5
I20260709 13:21:24.195842 27135 consensus_queue.cc:260] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.200356 27140 tablet_bootstrap.cc:492] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5: No bootstrap required, opened a new log
I20260709 13:21:24.200896 27140 ts_tablet_manager.cc:1403] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.008s
I20260709 13:21:24.201212 27136 tablet_bootstrap.cc:492] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d: No bootstrap required, opened a new log
I20260709 13:21:24.201728 27136 ts_tablet_manager.cc:1403] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.011s
I20260709 13:21:24.203935 27188 raft_consensus.cc:3060] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.203620 27140 raft_consensus.cc:359] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.203639 27136 raft_consensus.cc:359] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.204501 27140 raft_consensus.cc:385] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.204690 27136 raft_consensus.cc:385] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.204823 27140 raft_consensus.cc:740] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.204262 26844 catalog_manager.cc:5697] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08095d6ed192460eb036f63f9b683e37 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "08095d6ed192460eb036f63f9b683e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.201260 27135 ts_tablet_manager.cc:1434] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:21:24.206606 27135 tablet_bootstrap.cc:492] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37: Bootstrap starting.
I20260709 13:21:24.205341 27136 raft_consensus.cc:740] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.207592 27171 raft_consensus.cc:493] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.208047 27140 consensus_queue.cc:260] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.208177 27171 raft_consensus.cc:515] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.210628 27171 leader_election.cc:290] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:24.212134 27136 consensus_queue.cc:260] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.212783 27135 tablet_bootstrap.cc:654] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.213059 26946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b1499ef1ce45338ffdffed28641af6" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5" is_pre_election: true
I20260709 13:21:24.215220 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b1499ef1ce45338ffdffed28641af6" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37" is_pre_election: true
I20260709 13:21:24.216141 27021 raft_consensus.cc:2468] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 0.
I20260709 13:21:24.217890 27061 leader_election.cc:304] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, 08095d6ed192460eb036f63f9b683e37; no voters: 
I20260709 13:21:24.219406 27136 ts_tablet_manager.cc:1434] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
W20260709 13:21:24.219741 27059 leader_election.cc:343] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.221102 27171 raft_consensus.cc:2804] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.221658 27171 raft_consensus.cc:493] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.222152 27171 raft_consensus.cc:3060] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.223500 27140 ts_tablet_manager.cc:1434] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:21:24.227955 27140 tablet_bootstrap.cc:492] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:24.230264 27188 raft_consensus.cc:2749] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.231765 27153 raft_consensus.cc:493] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.232357 27153 raft_consensus.cc:515] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.234467 27153 leader_election.cc:290] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:24.234639 27140 tablet_bootstrap.cc:654] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.236479 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea3c2c974b4c1385d4535e06213132" candidate_uuid: "a3486fa7720442859851bd70466b33e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37" is_pre_election: true
I20260709 13:21:24.236882 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea3c2c974b4c1385d4535e06213132" candidate_uuid: "a3486fa7720442859851bd70466b33e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d" is_pre_election: true
I20260709 13:21:24.237255 27021 raft_consensus.cc:2468] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3486fa7720442859851bd70466b33e5 in term 0.
I20260709 13:21:24.237624 27094 raft_consensus.cc:2468] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3486fa7720442859851bd70466b33e5 in term 0.
I20260709 13:21:24.239014 26912 leader_election.cc:304] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:24.239902 27135 tablet_bootstrap.cc:492] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37: No bootstrap required, opened a new log
I20260709 13:21:24.240404 27135 ts_tablet_manager.cc:1403] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.017s
I20260709 13:21:24.243207 27135 raft_consensus.cc:359] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.243887 27135 raft_consensus.cc:385] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.244150 27135 raft_consensus.cc:740] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.244824 27153 raft_consensus.cc:2804] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.245265 27153 raft_consensus.cc:493] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.245632 27153 raft_consensus.cc:3060] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.246894 27140 tablet_bootstrap.cc:492] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5: No bootstrap required, opened a new log
I20260709 13:21:24.244891 27135 consensus_queue.cc:260] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.247958 27140 ts_tablet_manager.cc:1403] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.003s
I20260709 13:21:24.248809 27135 ts_tablet_manager.cc:1434] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:21:24.250949 27140 raft_consensus.cc:359] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.244867 27171 raft_consensus.cc:515] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.251756 27140 raft_consensus.cc:385] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.252691 27140 raft_consensus.cc:740] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.253757 27171 leader_election.cc:290] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:24.253440 27140 consensus_queue.cc:260] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.254667 26946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b1499ef1ce45338ffdffed28641af6" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:24.255304 26946 raft_consensus.cc:3060] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.255826 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b1499ef1ce45338ffdffed28641af6" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37"
I20260709 13:21:24.256204 27140 ts_tablet_manager.cc:1434] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:24.256405 27021 raft_consensus.cc:3060] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.253455 27153 raft_consensus.cc:515] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.262684 26946 raft_consensus.cc:2468] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 1.
I20260709 13:21:24.263810 27153 leader_election.cc:290] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 election: Requested vote from peers 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:24.264071 27059 leader_election.cc:304] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:24.264954 27171 raft_consensus.cc:2804] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.264904 27020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea3c2c974b4c1385d4535e06213132" candidate_uuid: "a3486fa7720442859851bd70466b33e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37"
I20260709 13:21:24.265818 27020 raft_consensus.cc:3060] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.266448 27021 raft_consensus.cc:2468] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 1.
I20260709 13:21:24.265573 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea3c2c974b4c1385d4535e06213132" candidate_uuid: "a3486fa7720442859851bd70466b33e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
I20260709 13:21:24.267102 27094 raft_consensus.cc:3060] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.266639 27171 raft_consensus.cc:697] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Becoming Leader. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:24.268805 27171 consensus_queue.cc:237] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.275375 27094 raft_consensus.cc:2468] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3486fa7720442859851bd70466b33e5 in term 1.
I20260709 13:21:24.275276 27020 raft_consensus.cc:2468] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3486fa7720442859851bd70466b33e5 in term 1.
I20260709 13:21:24.276815 26912 leader_election.cc:304] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:24.277510 27153 raft_consensus.cc:2804] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.278048 27153 raft_consensus.cc:697] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 1 LEADER]: Becoming Leader. State: Replica: a3486fa7720442859851bd70466b33e5, State: Running, Role: LEADER
I20260709 13:21:24.279129 27153 consensus_queue.cc:237] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.287298 26844 catalog_manager.cc:5697] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3486fa7720442859851bd70466b33e5 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "a3486fa7720442859851bd70466b33e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.287400 26843 catalog_manager.cc:5697] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0212e0ac12a44277983cc8a5250ed83d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:24.337462 27153 consensus_queue.cc:1048] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.339529 27171 raft_consensus.cc:493] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.340148 27171 raft_consensus.cc:515] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.341485 27188 raft_consensus.cc:493] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.342015 27188 raft_consensus.cc:515] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.342473 27171 leader_election.cc:290] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:24.343231 26946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200406b4466a4b05a2fc343b1dfce72b" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5" is_pre_election: true
I20260709 13:21:24.343906 26946 raft_consensus.cc:2468] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 0.
I20260709 13:21:24.344080 27188 leader_election.cc:290] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:24.345253 27059 leader_election.cc:304] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:24.344367 27020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200406b4466a4b05a2fc343b1dfce72b" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37" is_pre_election: true
I20260709 13:21:24.346807 27020 raft_consensus.cc:2468] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 0.
I20260709 13:21:24.346876 26946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c0fae73774f73a3fbe7994d0c0098" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5" is_pre_election: true
I20260709 13:21:24.346272 27171 raft_consensus.cc:2804] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.347491 27171 raft_consensus.cc:493] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.348074 27171 raft_consensus.cc:3060] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.347527 26946 raft_consensus.cc:2468] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 0.
I20260709 13:21:24.350346 26985 leader_election.cc:304] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:24.351222 27188 raft_consensus.cc:2804] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.351586 27188 raft_consensus.cc:493] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.351922 27188 raft_consensus.cc:3060] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.355967 27171 raft_consensus.cc:515] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.356336 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c0fae73774f73a3fbe7994d0c0098" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d" is_pre_election: true
I20260709 13:21:24.357120 27094 raft_consensus.cc:2468] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 0.
I20260709 13:21:24.361058 26946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200406b4466a4b05a2fc343b1dfce72b" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:24.361949 26946 raft_consensus.cc:3060] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.362728 27188 raft_consensus.cc:515] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.365772 27188 leader_election.cc:290] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:24.366380 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c0fae73774f73a3fbe7994d0c0098" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
I20260709 13:21:24.366333 26945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a55c0fae73774f73a3fbe7994d0c0098" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:24.366775 27144 consensus_queue.cc:1048] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:24.367275 26945 raft_consensus.cc:3060] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.371709 26946 raft_consensus.cc:2468] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 1.
I20260709 13:21:24.374207 27094 raft_consensus.cc:3060] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.374598 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200406b4466a4b05a2fc343b1dfce72b" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37"
I20260709 13:21:24.375276 27021 raft_consensus.cc:3060] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.378245 26945 raft_consensus.cc:2468] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 1.
I20260709 13:21:24.381557 26985 leader_election.cc:304] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:24.382432 27188 raft_consensus.cc:2804] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.382905 27188 raft_consensus.cc:697] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [term 1 LEADER]: Becoming Leader. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:24.383702 27188 consensus_queue.cc:237] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.386931 27144 consensus_queue.cc:1048] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:24.387669 27095 raft_consensus.cc:3060] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.391395 27171 leader_election.cc:290] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:24.391770 27138 raft_consensus.cc:493] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.392457 27138 raft_consensus.cc:515] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:24.396809 27059 leader_election.cc:304] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:24.398097 27138 leader_election.cc:290] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797), a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837)
I20260709 13:21:24.399052 27138 raft_consensus.cc:2804] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.399694 27138 raft_consensus.cc:697] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Becoming Leader. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:24.405153 27021 raft_consensus.cc:2468] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 1.
I20260709 13:21:24.387733 27094 raft_consensus.cc:2468] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 1.
I20260709 13:21:24.406224 26946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5" is_pre_election: true
I20260709 13:21:24.409734 26946 raft_consensus.cc:2468] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 0.
I20260709 13:21:24.409667 27166 consensus_queue.cc:1048] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:24.411545 27020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37" is_pre_election: true
I20260709 13:21:24.400913 27138 consensus_queue.cc:237] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:24.414031 27059 leader_election.cc:304] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:24.415012 27200 raft_consensus.cc:2804] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.415402 27200 raft_consensus.cc:493] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.415736 27200 raft_consensus.cc:3060] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.413578 27020 raft_consensus.cc:2468] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 0.
I20260709 13:21:24.421634 26844 catalog_manager.cc:5697] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08095d6ed192460eb036f63f9b683e37 (127.16.211.2). New cstate: current_term: 1 leader_uuid: "08095d6ed192460eb036f63f9b683e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.424556 27200 raft_consensus.cc:515] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:24.429220 27020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37"
I20260709 13:21:24.429899 27020 raft_consensus.cc:3060] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.432963 26945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:24.433691 26945 raft_consensus.cc:3060] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.434870 27166 consensus_queue.cc:1048] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.444464 27200 leader_election.cc:290] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 election: Requested vote from peers 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797), a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837)
I20260709 13:21:24.445554 27021 raft_consensus.cc:3060] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.447099 26945 raft_consensus.cc:2468] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 1.
I20260709 13:21:24.446767 26843 catalog_manager.cc:5697] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0212e0ac12a44277983cc8a5250ed83d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:24.448189 27059 leader_election.cc:304] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:24.449041 27200 raft_consensus.cc:2804] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.449529 27200 raft_consensus.cc:697] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Becoming Leader. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:24.450470 27200 consensus_queue.cc:237] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:24.455044 27020 raft_consensus.cc:2468] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 1.
I20260709 13:21:24.459874 27167 consensus_queue.cc:1048] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.470664 26841 catalog_manager.cc:5697] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3). New cstate: current_term: 1 leader_uuid: "0212e0ac12a44277983cc8a5250ed83d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.530278 27200 consensus_queue.cc:1048] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.534363 27188 consensus_queue.cc:1048] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.543033 27208 consensus_queue.cc:1048] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:24.553110 27166 consensus_queue.cc:1048] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.712977 17228 ts_manager.cc:295] Set tserver state for a3486fa7720442859851bd70466b33e5 to MAINTENANCE_MODE
I20260709 13:21:24.713800 17228 tablet_server.cc:179] TabletServer@127.16.211.1:0 shutting down...
I20260709 13:21:24.732801 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:24.733651 17228 tablet_replica.cc:333] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5: stopping tablet replica
I20260709 13:21:24.734287 17228 raft_consensus.cc:2243] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.734715 17228 raft_consensus.cc:2272] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.736606 17228 tablet_replica.cc:333] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: stopping tablet replica
I20260709 13:21:24.737183 17228 raft_consensus.cc:2243] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.737788 17228 pending_rounds.cc:70] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: Trying to abort 1 pending ops.
I20260709 13:21:24.738040 17228 pending_rounds.cc:77] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305639052418265088 op_type: NO_OP noop_request { }
I20260709 13:21:24.738297 17228 raft_consensus.cc:2889] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:24.738600 17228 raft_consensus.cc:2272] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.740712 17228 tablet_replica.cc:333] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5: stopping tablet replica
I20260709 13:21:24.741261 17228 raft_consensus.cc:2243] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.741683 17228 raft_consensus.cc:2272] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.743913 17228 tablet_replica.cc:333] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5: stopping tablet replica
I20260709 13:21:24.744407 17228 raft_consensus.cc:2243] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.744709 17228 raft_consensus.cc:2272] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.746718 17228 tablet_replica.cc:333] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5: stopping tablet replica
I20260709 13:21:24.747248 17228 raft_consensus.cc:2243] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.747709 17228 raft_consensus.cc:2272] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.749612 17228 tablet_replica.cc:333] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5: stopping tablet replica
I20260709 13:21:24.749532 27171 consensus_queue.cc:1048] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:24.750576 17228 raft_consensus.cc:2243] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.750984 17228 raft_consensus.cc:2272] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.753038 17228 tablet_replica.cc:333] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5: stopping tablet replica
I20260709 13:21:24.753621 17228 raft_consensus.cc:2243] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.754122 17228 raft_consensus.cc:2272] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.757160 17228 tablet_replica.cc:333] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5: stopping tablet replica
I20260709 13:21:24.757901 17228 raft_consensus.cc:2243] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.758958 17228 raft_consensus.cc:2272] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.761592 17228 tablet_replica.cc:333] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5: stopping tablet replica
I20260709 13:21:24.762415 17228 raft_consensus.cc:2243] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.762924 17228 raft_consensus.cc:2272] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:24.765251 27059 consensus_peers.cc:597] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.765813 17228 tablet_replica.cc:333] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5: stopping tablet replica
I20260709 13:21:24.766816 17228 raft_consensus.cc:2243] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.767791 17228 raft_consensus.cc:2272] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:24.775040 26985 consensus_peers.cc:597] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.803660 17228 tablet_server.cc:196] TabletServer@127.16.211.1:0 shutdown complete.
W20260709 13:21:24.808554 26892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:24.830360 27208 consensus_queue.cc:1048] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.843235 27200 consensus_queue.cc:1048] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:24.848462 27059 consensus_peers.cc:597] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.863559 27059 consensus_peers.cc:597] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.882622 27166 consensus_queue.cc:1048] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:24.941406 26985 consensus_peers.cc:597] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:25.062207 26985 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111) [suppressed 216 similar messages]
W20260709 13:21:25.065845 26985 consensus_peers.cc:597] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:25.162604 27059 consensus_peers.cc:597] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:25.809758 26892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:25.859339 27221 raft_consensus.cc:493] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3486fa7720442859851bd70466b33e5)
I20260709 13:21:25.860019 27221 raft_consensus.cc:515] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:25.861735 27221 leader_election.cc:290] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:25.863252 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b96c39550146efb4a917fddb43f6ae" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37" is_pre_election: true
W20260709 13:21:25.866041 27059 leader_election.cc:336] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111)
I20260709 13:21:25.866593 27059 leader_election.cc:304] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d; no voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5
I20260709 13:21:25.867393 27221 raft_consensus.cc:2749] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:25.871399 27142 raft_consensus.cc:493] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3486fa7720442859851bd70466b33e5)
I20260709 13:21:25.871898 27142 raft_consensus.cc:515] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:25.873791 27142 leader_election.cc:290] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:25.875118 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b96c39550146efb4a917fddb43f6ae" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d" is_pre_election: true
I20260709 13:21:25.876041 27094 raft_consensus.cc:2468] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 1.
I20260709 13:21:25.877343 26987 leader_election.cc:304] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, 08095d6ed192460eb036f63f9b683e37; no voters: 
W20260709 13:21:25.878050 26985 leader_election.cc:336] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111)
I20260709 13:21:25.878260 27142 raft_consensus.cc:2804] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:25.878774 27142 raft_consensus.cc:493] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3486fa7720442859851bd70466b33e5)
I20260709 13:21:25.879171 27142 raft_consensus.cc:3060] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:25.884902 27142 raft_consensus.cc:515] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:25.886871 27142 leader_election.cc:290] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:25.888173 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b96c39550146efb4a917fddb43f6ae" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
I20260709 13:21:25.888875 27094 raft_consensus.cc:3060] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:25.890758 26985 leader_election.cc:336] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111)
I20260709 13:21:25.895190 27094 raft_consensus.cc:2468] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 2.
I20260709 13:21:25.896386 26987 leader_election.cc:304] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, 08095d6ed192460eb036f63f9b683e37; no voters: a3486fa7720442859851bd70466b33e5
I20260709 13:21:25.897130 27142 raft_consensus.cc:2804] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:25.897573 27142 raft_consensus.cc:697] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Becoming Leader. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:25.898278 27142 consensus_queue.cc:237] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:25.906216 26844 catalog_manager.cc:5697] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 reported cstate change: term changed from 1 to 2, leader changed from a3486fa7720442859851bd70466b33e5 (127.16.211.1) to 08095d6ed192460eb036f63f9b683e37 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "08095d6ed192460eb036f63f9b683e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:25.940673 27221 raft_consensus.cc:493] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3486fa7720442859851bd70466b33e5)
I20260709 13:21:25.941394 27221 raft_consensus.cc:515] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:25.943495 27221 leader_election.cc:290] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:25.944717 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "08095d6ed192460eb036f63f9b683e37" is_pre_election: true
W20260709 13:21:25.947206 27059 leader_election.cc:336] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111)
I20260709 13:21:25.947643 27059 leader_election.cc:304] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d; no voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5
I20260709 13:21:25.948421 27221 raft_consensus.cc:2749] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:25.964175 27142 raft_consensus.cc:493] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3486fa7720442859851bd70466b33e5)
I20260709 13:21:25.964766 27142 raft_consensus.cc:515] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:25.966897 27142 leader_election.cc:290] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:25.968104 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d" is_pre_election: true
I20260709 13:21:25.968809 27094 raft_consensus.cc:2468] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 1.
I20260709 13:21:25.969846 26987 leader_election.cc:304] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, 08095d6ed192460eb036f63f9b683e37; no voters: 
I20260709 13:21:25.970688 27142 raft_consensus.cc:2804] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:21:25.971040 26985 leader_election.cc:336] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111)
I20260709 13:21:25.971235 27142 raft_consensus.cc:493] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3486fa7720442859851bd70466b33e5)
I20260709 13:21:25.971686 27142 raft_consensus.cc:3060] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:25.979646 27142 raft_consensus.cc:515] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:25.981521 27142 leader_election.cc:290] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:25.983049 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
I20260709 13:21:25.983810 27094 raft_consensus.cc:3060] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:25.985652 26985 leader_election.cc:336] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111)
I20260709 13:21:25.989869 27094 raft_consensus.cc:2468] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 2.
I20260709 13:21:25.991214 26987 leader_election.cc:304] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, 08095d6ed192460eb036f63f9b683e37; no voters: a3486fa7720442859851bd70466b33e5
I20260709 13:21:25.991956 27142 raft_consensus.cc:2804] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:25.992419 27142 raft_consensus.cc:697] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Becoming Leader. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:25.993062 27142 consensus_queue.cc:237] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:25.998414 27142 raft_consensus.cc:493] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.998893 27142 raft_consensus.cc:515] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:26.000684 27142 leader_election.cc:290] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:26.001839 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea3c2c974b4c1385d4535e06213132" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d" is_pre_election: true
I20260709 13:21:26.001313 26844 catalog_manager.cc:5697] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 reported cstate change: term changed from 1 to 2, leader changed from a3486fa7720442859851bd70466b33e5 (127.16.211.1) to 08095d6ed192460eb036f63f9b683e37 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "08095d6ed192460eb036f63f9b683e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.002640 27094 raft_consensus.cc:2468] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 1.
I20260709 13:21:26.004402 26987 leader_election.cc:304] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, 08095d6ed192460eb036f63f9b683e37; no voters: 
W20260709 13:21:26.005313 26985 leader_election.cc:336] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111)
I20260709 13:21:26.005486 27142 raft_consensus.cc:2804] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:26.005991 27142 raft_consensus.cc:493] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:26.006276 27142 raft_consensus.cc:3060] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.014600 27142 raft_consensus.cc:515] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:26.016328 27142 leader_election.cc:290] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:26.017467 27094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea3c2c974b4c1385d4535e06213132" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
I20260709 13:21:26.018200 27094 raft_consensus.cc:3060] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:26.021257 26985 leader_election.cc:336] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111)
I20260709 13:21:26.024719 27094 raft_consensus.cc:2468] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 2.
I20260709 13:21:26.026217 26987 leader_election.cc:304] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, 08095d6ed192460eb036f63f9b683e37; no voters: a3486fa7720442859851bd70466b33e5
I20260709 13:21:26.027302 27142 raft_consensus.cc:2804] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.027940 27142 raft_consensus.cc:697] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Becoming Leader. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:26.028803 27142 consensus_queue.cc:237] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:26.037688 26844 catalog_manager.cc:5697] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 reported cstate change: term changed from 1 to 2, leader changed from a3486fa7720442859851bd70466b33e5 (127.16.211.1) to 08095d6ed192460eb036f63f9b683e37 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "08095d6ed192460eb036f63f9b683e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.393018 27094 raft_consensus.cc:1275] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Refusing update from remote peer 08095d6ed192460eb036f63f9b683e37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:26.394651 27142 consensus_queue.cc:1048] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:26.408900 26985 consensus_peers.cc:597] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:26.449757 27094 raft_consensus.cc:1275] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Refusing update from remote peer 08095d6ed192460eb036f63f9b683e37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:26.451296 27231 consensus_queue.cc:1048] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:26.464748 26985 consensus_peers.cc:597] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:26.497579 27094 raft_consensus.cc:1275] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Refusing update from remote peer 08095d6ed192460eb036f63f9b683e37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:26.499191 27166 consensus_queue.cc:1048] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:26.512871 26985 consensus_peers.cc:597] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:26.810801 26892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:27.341696 26985 consensus_peers.cc:597] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:27.396956 26985 consensus_peers.cc:597] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:27.501621 27059 consensus_peers.cc:597] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:27.541216 27059 consensus_peers.cc:597] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:27.562206 27059 consensus_peers.cc:597] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:27.654397 27059 consensus_peers.cc:597] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:27.740641 26985 consensus_peers.cc:597] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:27.811906 26892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:28.813768 26892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:28.963081 26985 consensus_peers.cc:597] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:28.965051 26985 consensus_peers.cc:597] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:29.075659 26985 consensus_peers.cc:597] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:29.709681 26985 consensus_peers.cc:597] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:29.798069 26985 consensus_peers.cc:597] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:29.815462 26892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:29.823652 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:29.833253 27238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:29.833564 27239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:29.833779 27241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:29.837698 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:29.839730 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:29.839982 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:29.840130 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603289840117 us; error 0 us; skew 500 ppm
I20260709 13:21:29.840741 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:29.844421 17228 webserver.cc:533] Webserver started at http://127.16.211.1:34339/ using document root <none> and password file <none>
I20260709 13:21:29.844959 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:29.845112 17228 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:21:29.849524 17228 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:21:29.854658 27246 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:29.855553 17228 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:21:29.856005 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-0-root
uuid: "a3486fa7720442859851bd70466b33e5"
format_stamp: "Formatted at 2026-07-09 13:21:22 on dist-test-slave-96c3"
I20260709 13:21:29.856432 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602988568269-17228-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:29.879671 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:29.881022 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:29.882668 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:29.886538 27253 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:21:29.897284 27059 consensus_peers.cc:597] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:29.947104 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:21:29.947448 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.062s	user 0.000s	sys 0.003s
I20260709 13:21:29.947872 17228 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:21:29.954028 27253 tablet_bootstrap.cc:492] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:29.971071 27253 tablet_bootstrap.cc:492] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.972060 27253 tablet_bootstrap.cc:492] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5: Bootstrap complete.
I20260709 13:21:29.972815 27253 ts_tablet_manager.cc:1403] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.001s
I20260709 13:21:29.975986 27253 raft_consensus.cc:359] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:29.977255 27253 raft_consensus.cc:740] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.978225 27253 consensus_queue.cc:260] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:29.981817 27253 ts_tablet_manager.cc:1434] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.002s
I20260709 13:21:29.982686 27253 tablet_bootstrap.cc:492] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:29.996076 27253 tablet_bootstrap.cc:492] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.996874 27253 tablet_bootstrap.cc:492] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5: Bootstrap complete.
I20260709 13:21:29.997514 27253 ts_tablet_manager.cc:1403] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:21:29.999959 27253 raft_consensus.cc:359] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.000633 27253 raft_consensus.cc:740] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.001469 27253 consensus_queue.cc:260] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.003336 27253 ts_tablet_manager.cc:1434] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:21:30.004133 27253 tablet_bootstrap.cc:492] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
W20260709 13:21:30.010967 27059 consensus_peers.cc:597] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:30.016422 17228 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:21:30.016829 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.069s	user 0.062s	sys 0.005s
I20260709 13:21:30.025815 27253 tablet_bootstrap.cc:492] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:30.027043 27253 tablet_bootstrap.cc:492] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5: Bootstrap complete.
I20260709 13:21:30.027688 27253 ts_tablet_manager.cc:1403] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 13:21:30.030155 27253 raft_consensus.cc:359] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.031870 27253 raft_consensus.cc:740] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.032895 27253 consensus_queue.cc:260] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.035560 27253 ts_tablet_manager.cc:1434] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:21:30.036415 27253 tablet_bootstrap.cc:492] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:30.050143 27253 tablet_bootstrap.cc:492] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:30.050921 27253 tablet_bootstrap.cc:492] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5: Bootstrap complete.
I20260709 13:21:30.051445 27253 ts_tablet_manager.cc:1403] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 13:21:30.053349 27253 raft_consensus.cc:359] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.053985 27253 raft_consensus.cc:740] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.054883 27253 consensus_queue.cc:260] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.056955 27253 ts_tablet_manager.cc:1434] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:21:30.057822 27253 tablet_bootstrap.cc:492] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
W20260709 13:21:30.069381 26985 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111) [suppressed 99 similar messages]
I20260709 13:21:30.079097 27253 tablet_bootstrap.cc:492] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:30.080006 27253 tablet_bootstrap.cc:492] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5: Bootstrap complete.
I20260709 13:21:30.080559 27253 ts_tablet_manager.cc:1403] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.005s
I20260709 13:21:30.083045 27253 raft_consensus.cc:359] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.083575 27253 raft_consensus.cc:740] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.084282 27253 consensus_queue.cc:260] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.085889 27253 ts_tablet_manager.cc:1434] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.000s
I20260709 13:21:30.086650 27253 tablet_bootstrap.cc:492] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:30.090849 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.1:37837
I20260709 13:21:30.091033 27315 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.1:37837 every 8 connection(s)
I20260709 13:21:30.096823 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:30.104849 27253 tablet_bootstrap.cc:492] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:30.106117 27253 tablet_bootstrap.cc:492] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5: Bootstrap complete.
I20260709 13:21:30.106904 27253 ts_tablet_manager.cc:1403] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 13:21:30.109174 27253 raft_consensus.cc:359] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.109946 27253 raft_consensus.cc:740] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.110895 27253 consensus_queue.cc:260] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.114151 27253 ts_tablet_manager.cc:1434] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:21:30.115378 27253 tablet_bootstrap.cc:492] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:30.126911 27316 heartbeater.cc:344] Connected to a master server at 127.16.211.62:43859
I20260709 13:21:30.127497 27316 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:30.128227 27021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "232335ce7f594d5cbef3c35982d50778"
dest_uuid: "08095d6ed192460eb036f63f9b683e37"
mode: GRACEFUL
new_leader_uuid: "0212e0ac12a44277983cc8a5250ed83d"
 from {username='slave'} at 127.0.0.1:56238
I20260709 13:21:30.128593 27316 heartbeater.cc:507] Master 127.16.211.62:43859 requested a full tablet report, sending...
I20260709 13:21:30.129153 27021 raft_consensus.cc:606] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 1 LEADER]: Received request to transfer leadership to TS 0212e0ac12a44277983cc8a5250ed83d
I20260709 13:21:30.133080 27021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95b52c269985488092ba3dea3efb488f"
dest_uuid: "08095d6ed192460eb036f63f9b683e37"
mode: GRACEFUL
new_leader_uuid: "0212e0ac12a44277983cc8a5250ed83d"
 from {username='slave'} at 127.0.0.1:56238
I20260709 13:21:30.133683 27021 raft_consensus.cc:606] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 1 LEADER]: Received request to transfer leadership to TS 0212e0ac12a44277983cc8a5250ed83d
I20260709 13:21:30.134476 27253 tablet_bootstrap.cc:492] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:21:30.135149 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:30.135660 27253 tablet_bootstrap.cc:492] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: Bootstrap complete.
I20260709 13:21:30.135879 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:30.136178 26843 ts_manager.cc:194] Re-registered known tserver with Master: a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837)
I20260709 13:21:30.136360 27253 ts_tablet_manager.cc:1403] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 13:21:30.136828 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:30.138850 27253 raft_consensus.cc:359] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.139667 27253 raft_consensus.cc:740] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.140425 27253 consensus_queue.cc:260] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.142035 27253 ts_tablet_manager.cc:1434] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:21:30.142753 27253 tablet_bootstrap.cc:492] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:30.148749 26843 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59748
I20260709 13:21:30.153594 27316 heartbeater.cc:499] Master 127.16.211.62:43859 was elected leader, sending a full tablet report...
I20260709 13:21:30.156941 27253 tablet_bootstrap.cc:492] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:30.158105 27253 tablet_bootstrap.cc:492] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5: Bootstrap complete.
I20260709 13:21:30.158779 27253 ts_tablet_manager.cc:1403] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:21:30.161365 27253 raft_consensus.cc:359] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.162235 27253 raft_consensus.cc:740] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.163039 27253 consensus_queue.cc:260] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.165551 27253 ts_tablet_manager.cc:1434] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:30.166558 27253 tablet_bootstrap.cc:492] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
W20260709 13:21:30.178414 27059 consensus_peers.cc:597] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:30.181381 27253 tablet_bootstrap.cc:492] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:30.182147 27253 tablet_bootstrap.cc:492] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5: Bootstrap complete.
I20260709 13:21:30.182664 27253 ts_tablet_manager.cc:1403] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.002s
I20260709 13:21:30.184544 27253 raft_consensus.cc:359] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:30.185051 27253 raft_consensus.cc:740] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.185678 27253 consensus_queue.cc:260] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:30.187225 27253 ts_tablet_manager.cc:1434] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:21:30.188424 27253 tablet_bootstrap.cc:492] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5: Bootstrap starting.
I20260709 13:21:30.202404 27253 tablet_bootstrap.cc:492] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:30.203163 27253 tablet_bootstrap.cc:492] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5: Bootstrap complete.
I20260709 13:21:30.203747 27253 ts_tablet_manager.cc:1403] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:21:30.206063 27253 raft_consensus.cc:359] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.206585 27253 raft_consensus.cc:740] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3486fa7720442859851bd70466b33e5, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.207302 27253 consensus_queue.cc:260] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.211117 27253 ts_tablet_manager.cc:1434] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:21:30.232234 27328 raft_consensus.cc:993] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37: : Instructing follower 0212e0ac12a44277983cc8a5250ed83d to start an election
I20260709 13:21:30.233172 27329 raft_consensus.cc:1081] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 1 LEADER]: Signalling peer 0212e0ac12a44277983cc8a5250ed83d to start an election
I20260709 13:21:30.235781 27093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95b52c269985488092ba3dea3efb488f"
dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
 from {username='slave'} at 127.0.0.1:52030
I20260709 13:21:30.236415 27093 raft_consensus.cc:493] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:30.236739 27093 raft_consensus.cc:3060] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.243827 27093 raft_consensus.cc:515] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.245770 27093 leader_election.cc:290] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 2 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:30.247042 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b52c269985488092ba3dea3efb488f" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:30.247411 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b52c269985488092ba3dea3efb488f" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08095d6ed192460eb036f63f9b683e37"
I20260709 13:21:30.247872 27290 raft_consensus.cc:3060] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.248072 27021 raft_consensus.cc:3055] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:30.248476 27021 raft_consensus.cc:740] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:30.249383 27021 consensus_queue.cc:260] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.250553 27021 raft_consensus.cc:3060] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.254212 27290 raft_consensus.cc:2468] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 2.
I20260709 13:21:30.255484 27059 leader_election.cc:304] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:30.256609 27221 raft_consensus.cc:2804] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.258508 27021 raft_consensus.cc:2468] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 2.
I20260709 13:21:30.258634 27221 raft_consensus.cc:697] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 2 LEADER]: Becoming Leader. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:30.260215 27221 consensus_queue.cc:237] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.269119 26843 catalog_manager.cc:5697] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d reported cstate change: term changed from 1 to 2, leader changed from 08095d6ed192460eb036f63f9b683e37 (127.16.211.2) to 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3). New cstate: current_term: 2 leader_uuid: "0212e0ac12a44277983cc8a5250ed83d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.307468 27290 raft_consensus.cc:3060] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.380441 27328 raft_consensus.cc:993] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37: : Instructing follower 0212e0ac12a44277983cc8a5250ed83d to start an election
I20260709 13:21:30.380940 27329 raft_consensus.cc:1081] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 1 LEADER]: Signalling peer 0212e0ac12a44277983cc8a5250ed83d to start an election
I20260709 13:21:30.382398 27093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "232335ce7f594d5cbef3c35982d50778"
dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
 from {username='slave'} at 127.0.0.1:52030
I20260709 13:21:30.382884 27093 raft_consensus.cc:493] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:30.383203 27093 raft_consensus.cc:3060] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.389171 27093 raft_consensus.cc:515] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.390973 27093 leader_election.cc:290] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 2 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:30.392009 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232335ce7f594d5cbef3c35982d50778" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:30.392195 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232335ce7f594d5cbef3c35982d50778" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08095d6ed192460eb036f63f9b683e37"
I20260709 13:21:30.392653 27289 raft_consensus.cc:3060] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.392779 27021 raft_consensus.cc:3055] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:30.393519 27021 raft_consensus.cc:740] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:30.394383 27021 consensus_queue.cc:260] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.395493 27021 raft_consensus.cc:3060] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.399282 27289 raft_consensus.cc:2468] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 2.
I20260709 13:21:30.400557 27059 leader_election.cc:304] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:30.401422 27221 raft_consensus.cc:2804] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.401547 27021 raft_consensus.cc:2468] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 2.
I20260709 13:21:30.402058 27221 raft_consensus.cc:697] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [term 2 LEADER]: Becoming Leader. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:30.403164 27221 consensus_queue.cc:237] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:30.411401 26843 catalog_manager.cc:5697] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d reported cstate change: term changed from 1 to 2, leader changed from 08095d6ed192460eb036f63f9b683e37 (127.16.211.2) to 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3). New cstate: current_term: 2 leader_uuid: "0212e0ac12a44277983cc8a5250ed83d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.547618 27289 raft_consensus.cc:3060] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.555312 27289 pending_rounds.cc:85] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: Aborting all ops after (but not including) 0
I20260709 13:21:30.555538 27289 pending_rounds.cc:107] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:21:30.555737 27289 raft_consensus.cc:2889] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:30.647753 27021 raft_consensus.cc:1275] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Refusing update from remote peer 0212e0ac12a44277983cc8a5250ed83d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:30.649196 27221 consensus_queue.cc:1048] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:30.654978 27289 raft_consensus.cc:3060] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.662701 27290 raft_consensus.cc:1275] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Refusing update from remote peer 0212e0ac12a44277983cc8a5250ed83d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:30.665697 27330 consensus_queue.cc:1048] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:21:30.816483 26892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:30.948798 27290 raft_consensus.cc:1275] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Refusing update from remote peer 0212e0ac12a44277983cc8a5250ed83d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:30.950518 27330 consensus_queue.cc:1048] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:30.960695 27021 raft_consensus.cc:1275] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Refusing update from remote peer 0212e0ac12a44277983cc8a5250ed83d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:30.962589 27221 consensus_queue.cc:1048] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:31.148492 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:31.166796 27093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b"
dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
mode: GRACEFUL
new_leader_uuid: "08095d6ed192460eb036f63f9b683e37"
 from {username='slave'} at 127.0.0.1:52036
I20260709 13:21:31.167428 27093 raft_consensus.cc:606] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Received request to transfer leadership to TS 08095d6ed192460eb036f63f9b683e37
I20260709 13:21:31.170763 27093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "200406b4466a4b05a2fc343b1dfce72b"
dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
mode: GRACEFUL
new_leader_uuid: "08095d6ed192460eb036f63f9b683e37"
 from {username='slave'} at 127.0.0.1:52036
I20260709 13:21:31.171340 27093 raft_consensus.cc:606] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Received request to transfer leadership to TS 08095d6ed192460eb036f63f9b683e37
I20260709 13:21:31.172408 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:31.172924 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:31.173564 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:31.198239 27330 raft_consensus.cc:993] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d: : Instructing follower 08095d6ed192460eb036f63f9b683e37 to start an election
I20260709 13:21:31.198843 27350 raft_consensus.cc:1081] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Signalling peer 08095d6ed192460eb036f63f9b683e37 to start an election
I20260709 13:21:31.200451 27021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "200406b4466a4b05a2fc343b1dfce72b"
dest_uuid: "08095d6ed192460eb036f63f9b683e37"
 from {username='slave'} at 127.0.0.1:56228
I20260709 13:21:31.200990 27021 raft_consensus.cc:493] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:31.201249 27021 raft_consensus.cc:3060] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.206512 27021 raft_consensus.cc:515] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:31.208123 27021 leader_election.cc:290] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:31.209419 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200406b4466a4b05a2fc343b1dfce72b" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:31.209456 27093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200406b4466a4b05a2fc343b1dfce72b" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
I20260709 13:21:31.210261 27290 raft_consensus.cc:3060] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.210435 27093 raft_consensus.cc:3055] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:31.210907 27093 raft_consensus.cc:740] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:31.212159 27093 consensus_queue.cc:260] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:31.213222 27093 raft_consensus.cc:3060] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.216183 27290 raft_consensus.cc:2468] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 2.
I20260709 13:21:31.217363 26985 leader_election.cc:304] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:31.218617 27235 raft_consensus.cc:2804] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:31.219136 27093 raft_consensus.cc:2468] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 2.
I20260709 13:21:31.219239 27235 raft_consensus.cc:697] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Becoming Leader. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:31.220803 27235 consensus_queue.cc:237] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:31.228288 26843 catalog_manager.cc:5697] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 reported cstate change: term changed from 1 to 2, leader changed from 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3) to 08095d6ed192460eb036f63f9b683e37 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "08095d6ed192460eb036f63f9b683e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:31.348565 27330 raft_consensus.cc:993] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d: : Instructing follower 08095d6ed192460eb036f63f9b683e37 to start an election
I20260709 13:21:31.349092 27350 raft_consensus.cc:1081] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Signalling peer 08095d6ed192460eb036f63f9b683e37 to start an election
I20260709 13:21:31.350713 27021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b"
dest_uuid: "08095d6ed192460eb036f63f9b683e37"
 from {username='slave'} at 127.0.0.1:56228
I20260709 13:21:31.351282 27021 raft_consensus.cc:493] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:31.351593 27021 raft_consensus.cc:3060] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.356587 27021 raft_consensus.cc:515] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:31.358111 27021 leader_election.cc:290] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 election: Requested vote from peers 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215), a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837)
I20260709 13:21:31.359220 27093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
I20260709 13:21:31.359220 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:31.359994 27093 raft_consensus.cc:3055] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:31.360369 27290 raft_consensus.cc:3060] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.360318 27093 raft_consensus.cc:740] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:31.361508 27093 consensus_queue.cc:260] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:31.362823 27093 raft_consensus.cc:3060] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:31.370368 27093 raft_consensus.cc:2468] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 2.
I20260709 13:21:31.372107 27290 raft_consensus.cc:2468] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 2.
I20260709 13:21:31.372476 26987 leader_election.cc:304] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, 08095d6ed192460eb036f63f9b683e37; no voters: 
I20260709 13:21:31.373507 27235 raft_consensus.cc:2804] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:31.374068 27235 raft_consensus.cc:697] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Becoming Leader. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:31.374954 27235 consensus_queue.cc:237] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:31.381369 26843 catalog_manager.cc:5697] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 reported cstate change: term changed from 1 to 2, leader changed from 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3) to 08095d6ed192460eb036f63f9b683e37 (127.16.211.2). New cstate: current_term: 2 leader_uuid: "08095d6ed192460eb036f63f9b683e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:31.635562 27093 raft_consensus.cc:1275] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Refusing update from remote peer 08095d6ed192460eb036f63f9b683e37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:31.636770 27328 consensus_queue.cc:1048] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:31.647224 27290 raft_consensus.cc:1275] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Refusing update from remote peer 08095d6ed192460eb036f63f9b683e37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:31.649108 27328 consensus_queue.cc:1048] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:31.810494 27093 raft_consensus.cc:1275] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Refusing update from remote peer 08095d6ed192460eb036f63f9b683e37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:31.812458 27235 consensus_queue.cc:1048] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:31.817564 26892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:31.822721 27290 raft_consensus.cc:1275] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Refusing update from remote peer 08095d6ed192460eb036f63f9b683e37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:31.824131 27329 consensus_queue.cc:1048] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:32.179946 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:32.187642 27021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d"
dest_uuid: "08095d6ed192460eb036f63f9b683e37"
mode: GRACEFUL
new_leader_uuid: "0212e0ac12a44277983cc8a5250ed83d"
 from {username='slave'} at 127.0.0.1:56238
I20260709 13:21:32.188256 27021 raft_consensus.cc:606] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Received request to transfer leadership to TS 0212e0ac12a44277983cc8a5250ed83d
I20260709 13:21:32.190769 27021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4b96c39550146efb4a917fddb43f6ae"
dest_uuid: "08095d6ed192460eb036f63f9b683e37"
mode: GRACEFUL
new_leader_uuid: "0212e0ac12a44277983cc8a5250ed83d"
 from {username='slave'} at 127.0.0.1:56238
I20260709 13:21:32.191226 27021 raft_consensus.cc:606] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Received request to transfer leadership to TS 0212e0ac12a44277983cc8a5250ed83d
I20260709 13:21:32.192266 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:32.192958 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:32.193600 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:32.485455 27367 raft_consensus.cc:993] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37: : Instructing follower 0212e0ac12a44277983cc8a5250ed83d to start an election
I20260709 13:21:32.486008 27329 raft_consensus.cc:1081] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Signalling peer 0212e0ac12a44277983cc8a5250ed83d to start an election
I20260709 13:21:32.487469 27093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d"
dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
 from {username='slave'} at 127.0.0.1:52030
I20260709 13:21:32.488021 27093 raft_consensus.cc:493] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:32.488337 27093 raft_consensus.cc:3060] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:32.493620 27093 raft_consensus.cc:515] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:32.495431 27093 leader_election.cc:290] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 3 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:32.496477 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08095d6ed192460eb036f63f9b683e37"
I20260709 13:21:32.497026 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:32.497087 27021 raft_consensus.cc:3055] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:32.497525 27021 raft_consensus.cc:740] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:32.497534 27290 raft_consensus.cc:3060] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:32.498414 27021 consensus_queue.cc:260] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:32.499383 27021 raft_consensus.cc:3060] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:32.503489 27290 raft_consensus.cc:2468] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 3.
I20260709 13:21:32.504173 27021 raft_consensus.cc:2468] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 3.
I20260709 13:21:32.504772 27059 leader_election.cc:304] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:32.505661 27350 raft_consensus.cc:2804] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:32.506598 27350 raft_consensus.cc:697] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 3 LEADER]: Becoming Leader. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:32.507596 27350 consensus_queue.cc:237] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:32.515102 26843 catalog_manager.cc:5697] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d reported cstate change: term changed from 2 to 3, leader changed from 08095d6ed192460eb036f63f9b683e37 (127.16.211.2) to 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3). New cstate: current_term: 3 leader_uuid: "0212e0ac12a44277983cc8a5250ed83d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:32.758832 27328 raft_consensus.cc:993] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37: : Instructing follower 0212e0ac12a44277983cc8a5250ed83d to start an election
I20260709 13:21:32.759339 27367 raft_consensus.cc:1081] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Signalling peer 0212e0ac12a44277983cc8a5250ed83d to start an election
I20260709 13:21:32.761189 27093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4b96c39550146efb4a917fddb43f6ae"
dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
 from {username='slave'} at 127.0.0.1:52030
I20260709 13:21:32.761723 27093 raft_consensus.cc:493] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:32.762089 27093 raft_consensus.cc:3060] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:32.767135 27093 raft_consensus.cc:515] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:32.768947 27093 leader_election.cc:290] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 3 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:32.769824 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b96c39550146efb4a917fddb43f6ae" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:32.770052 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b96c39550146efb4a917fddb43f6ae" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08095d6ed192460eb036f63f9b683e37"
I20260709 13:21:32.770669 27289 raft_consensus.cc:3060] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:32.770789 27021 raft_consensus.cc:3055] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:32.771183 27021 raft_consensus.cc:740] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:32.771831 27021 consensus_queue.cc:260] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:32.772774 27021 raft_consensus.cc:3060] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:32.776558 27289 raft_consensus.cc:2468] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 3.
I20260709 13:21:32.777660 27021 raft_consensus.cc:2468] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 3.
I20260709 13:21:32.777784 27059 leader_election.cc:304] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:32.778713 27350 raft_consensus.cc:2804] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:32.779192 27350 raft_consensus.cc:697] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 3 LEADER]: Becoming Leader. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:32.780006 27350 consensus_queue.cc:237] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:32.786934 26843 catalog_manager.cc:5697] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d reported cstate change: term changed from 2 to 3, leader changed from 08095d6ed192460eb036f63f9b683e37 (127.16.211.2) to 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3). New cstate: current_term: 3 leader_uuid: "0212e0ac12a44277983cc8a5250ed83d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:32.818688 26892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:32.943620 27021 raft_consensus.cc:1275] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Refusing update from remote peer 0212e0ac12a44277983cc8a5250ed83d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:32.945215 27350 consensus_queue.cc:1048] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:32.957051 27289 raft_consensus.cc:1275] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Refusing update from remote peer 0212e0ac12a44277983cc8a5250ed83d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:32.959534 27350 consensus_queue.cc:1048] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:33.160174 27021 raft_consensus.cc:1275] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Refusing update from remote peer 0212e0ac12a44277983cc8a5250ed83d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:33.161514 27350 consensus_queue.cc:1048] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:33.172421 27289 raft_consensus.cc:1275] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Refusing update from remote peer 0212e0ac12a44277983cc8a5250ed83d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:33.174247 27378 consensus_queue.cc:1048] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:33.200830 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:33.208213 27093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95b52c269985488092ba3dea3efb488f"
dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
mode: GRACEFUL
new_leader_uuid: "08095d6ed192460eb036f63f9b683e37"
 from {username='slave'} at 127.0.0.1:52036
I20260709 13:21:33.208840 27093 raft_consensus.cc:606] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 2 LEADER]: Received request to transfer leadership to TS 08095d6ed192460eb036f63f9b683e37
I20260709 13:21:33.211585 27093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d"
dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
mode: GRACEFUL
new_leader_uuid: "08095d6ed192460eb036f63f9b683e37"
 from {username='slave'} at 127.0.0.1:52036
I20260709 13:21:33.212157 27093 raft_consensus.cc:606] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 3 LEADER]: Received request to transfer leadership to TS 08095d6ed192460eb036f63f9b683e37
I20260709 13:21:33.213207 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:33.213737 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:33.214394 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:33.414076 27378 raft_consensus.cc:993] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d: : Instructing follower 08095d6ed192460eb036f63f9b683e37 to start an election
I20260709 13:21:33.414659 27378 raft_consensus.cc:1081] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 3 LEADER]: Signalling peer 08095d6ed192460eb036f63f9b683e37 to start an election
I20260709 13:21:33.416131 27021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d"
dest_uuid: "08095d6ed192460eb036f63f9b683e37"
 from {username='slave'} at 127.0.0.1:56228
I20260709 13:21:33.416539 27021 raft_consensus.cc:493] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:33.416795 27021 raft_consensus.cc:3060] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:33.422703 27021 raft_consensus.cc:515] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:33.425061 27021 leader_election.cc:290] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 4 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:33.426230 27093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
I20260709 13:21:33.426606 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e07a4db5beed48d59ffd1638275afd5d" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:33.426862 27093 raft_consensus.cc:3055] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:21:33.427227 27289 raft_consensus.cc:3060] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:33.427232 27093 raft_consensus.cc:740] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:33.428220 27093 consensus_queue.cc:260] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:33.430049 27093 raft_consensus.cc:3060] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:33.436746 27289 raft_consensus.cc:2468] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 4.
I20260709 13:21:33.437054 27093 raft_consensus.cc:2468] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 4.
I20260709 13:21:33.438180 26985 leader_election.cc:304] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:33.439056 27367 raft_consensus.cc:2804] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:33.440042 27367 raft_consensus.cc:697] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 4 LEADER]: Becoming Leader. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:33.440793 27367 consensus_queue.cc:237] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:33.447465 26844 catalog_manager.cc:5697] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 reported cstate change: term changed from 3 to 4, leader changed from 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3) to 08095d6ed192460eb036f63f9b683e37 (127.16.211.2). New cstate: current_term: 4 leader_uuid: "08095d6ed192460eb036f63f9b683e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:33.487715 27384 raft_consensus.cc:993] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d: : Instructing follower 08095d6ed192460eb036f63f9b683e37 to start an election
I20260709 13:21:33.488413 27378 raft_consensus.cc:1081] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 2 LEADER]: Signalling peer 08095d6ed192460eb036f63f9b683e37 to start an election
I20260709 13:21:33.490015 27021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95b52c269985488092ba3dea3efb488f"
dest_uuid: "08095d6ed192460eb036f63f9b683e37"
 from {username='slave'} at 127.0.0.1:56228
I20260709 13:21:33.490515 27021 raft_consensus.cc:493] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:33.490748 27021 raft_consensus.cc:3060] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:33.496512 27021 raft_consensus.cc:515] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:33.498137 27021 leader_election.cc:290] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 3 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3:38215)
I20260709 13:21:33.498940 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b52c269985488092ba3dea3efb488f" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:33.499125 27093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b52c269985488092ba3dea3efb488f" candidate_uuid: "08095d6ed192460eb036f63f9b683e37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
I20260709 13:21:33.499560 27289 raft_consensus.cc:3060] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:33.499712 27093 raft_consensus.cc:3055] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:33.500136 27093 raft_consensus.cc:740] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:33.500828 27093 consensus_queue.cc:260] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:33.501719 27093 raft_consensus.cc:3060] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:33.505098 27289 raft_consensus.cc:2468] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 3.
I20260709 13:21:33.506713 27093 raft_consensus.cc:2468] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08095d6ed192460eb036f63f9b683e37 in term 3.
I20260709 13:21:33.506747 26985 leader_election.cc:304] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08095d6ed192460eb036f63f9b683e37, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:33.507858 27386 raft_consensus.cc:2804] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:33.508364 27386 raft_consensus.cc:697] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 3 LEADER]: Becoming Leader. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:33.509238 27386 consensus_queue.cc:237] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:33.517643 26844 catalog_manager.cc:5697] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 reported cstate change: term changed from 2 to 3, leader changed from 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3) to 08095d6ed192460eb036f63f9b683e37 (127.16.211.2). New cstate: current_term: 3 leader_uuid: "08095d6ed192460eb036f63f9b683e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:33.819679 26892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:33.846037 27289 raft_consensus.cc:1275] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 4 FOLLOWER]: Refusing update from remote peer 08095d6ed192460eb036f63f9b683e37: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:21:33.847393 27386 consensus_queue.cc:1048] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:33.854044 27093 raft_consensus.cc:1275] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 4 FOLLOWER]: Refusing update from remote peer 08095d6ed192460eb036f63f9b683e37: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:21:33.855636 27393 consensus_queue.cc:1048] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:34.010679 27290 raft_consensus.cc:1275] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Refusing update from remote peer 08095d6ed192460eb036f63f9b683e37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:34.012185 27367 consensus_queue.cc:1048] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:34.021230 27093 raft_consensus.cc:1275] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Refusing update from remote peer 08095d6ed192460eb036f63f9b683e37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:34.023141 27386 consensus_queue.cc:1048] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:34.221421 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:34.228552 27021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b"
dest_uuid: "08095d6ed192460eb036f63f9b683e37"
mode: GRACEFUL
new_leader_uuid: "0212e0ac12a44277983cc8a5250ed83d"
 from {username='slave'} at 127.0.0.1:56238
I20260709 13:21:34.229064 27021 raft_consensus.cc:606] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Received request to transfer leadership to TS 0212e0ac12a44277983cc8a5250ed83d
I20260709 13:21:34.231518 27021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "beea3c2c974b4c1385d4535e06213132"
dest_uuid: "08095d6ed192460eb036f63f9b683e37"
mode: GRACEFUL
new_leader_uuid: "0212e0ac12a44277983cc8a5250ed83d"
 from {username='slave'} at 127.0.0.1:56238
I20260709 13:21:34.231963 27021 raft_consensus.cc:606] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Received request to transfer leadership to TS 0212e0ac12a44277983cc8a5250ed83d
I20260709 13:21:34.233031 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:34.233503 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:34.234129 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:34.576452 27386 raft_consensus.cc:993] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37: : Instructing follower 0212e0ac12a44277983cc8a5250ed83d to start an election
I20260709 13:21:34.576951 27386 raft_consensus.cc:1081] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Signalling peer 0212e0ac12a44277983cc8a5250ed83d to start an election
I20260709 13:21:34.578328 27093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "beea3c2c974b4c1385d4535e06213132"
dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
 from {username='slave'} at 127.0.0.1:52030
I20260709 13:21:34.578837 27093 raft_consensus.cc:493] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:34.579133 27093 raft_consensus.cc:3060] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:34.585121 27386 raft_consensus.cc:993] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37: : Instructing follower 0212e0ac12a44277983cc8a5250ed83d to start an election
I20260709 13:21:34.585108 27093 raft_consensus.cc:515] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:34.585769 27367 raft_consensus.cc:1081] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Signalling peer 0212e0ac12a44277983cc8a5250ed83d to start an election
I20260709 13:21:34.587112 27093 leader_election.cc:290] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 3 election: Requested vote from peers a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837), 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797)
I20260709 13:21:34.587656 27094 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b"
dest_uuid: "0212e0ac12a44277983cc8a5250ed83d"
 from {username='slave'} at 127.0.0.1:52030
I20260709 13:21:34.588068 27021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea3c2c974b4c1385d4535e06213132" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "08095d6ed192460eb036f63f9b683e37"
I20260709 13:21:34.587721 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beea3c2c974b4c1385d4535e06213132" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:34.588330 27094 raft_consensus.cc:493] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:34.588660 27021 raft_consensus.cc:3055] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:34.588727 27290 raft_consensus.cc:3060] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:34.588753 27094 raft_consensus.cc:3060] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:34.589048 27021 raft_consensus.cc:740] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:34.590061 27021 consensus_queue.cc:260] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:34.591424 27021 raft_consensus.cc:3060] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:34.595007 27290 raft_consensus.cc:2468] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 3.
I20260709 13:21:34.596268 27059 leader_election.cc:304] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:34.596995 27391 raft_consensus.cc:2804] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:34.597437 27391 raft_consensus.cc:697] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 3 LEADER]: Becoming Leader. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:34.597363 27094 raft_consensus.cc:515] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:34.598604 27021 raft_consensus.cc:2468] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 3.
I20260709 13:21:34.598554 27391 consensus_queue.cc:237] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } }
I20260709 13:21:34.599910 27094 leader_election.cc:290] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 3 election: Requested vote from peers 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797), a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837)
I20260709 13:21:34.600524 27020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08095d6ed192460eb036f63f9b683e37"
I20260709 13:21:34.601178 27020 raft_consensus.cc:3055] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:34.601320 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030215ab2e584718b14b5f1e0088d06b" candidate_uuid: "0212e0ac12a44277983cc8a5250ed83d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a3486fa7720442859851bd70466b33e5"
I20260709 13:21:34.601567 27020 raft_consensus.cc:740] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08095d6ed192460eb036f63f9b683e37, State: Running, Role: LEADER
I20260709 13:21:34.602006 27290 raft_consensus.cc:3060] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:34.602566 27020 consensus_queue.cc:260] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:34.604024 27020 raft_consensus.cc:3060] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:34.608332 27290 raft_consensus.cc:2468] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 3.
I20260709 13:21:34.607854 26841 catalog_manager.cc:5697] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d reported cstate change: term changed from 2 to 3, leader changed from 08095d6ed192460eb036f63f9b683e37 (127.16.211.2) to 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3). New cstate: current_term: 3 leader_uuid: "0212e0ac12a44277983cc8a5250ed83d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:34.609342 27059 leader_election.cc:304] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0212e0ac12a44277983cc8a5250ed83d, a3486fa7720442859851bd70466b33e5; no voters: 
I20260709 13:21:34.610224 27391 raft_consensus.cc:2804] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:34.610705 27391 raft_consensus.cc:697] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 3 LEADER]: Becoming Leader. State: Replica: 0212e0ac12a44277983cc8a5250ed83d, State: Running, Role: LEADER
I20260709 13:21:34.611426 27391 consensus_queue.cc:237] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } }
I20260709 13:21:34.612625 27020 raft_consensus.cc:2468] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0212e0ac12a44277983cc8a5250ed83d in term 3.
I20260709 13:21:34.628573 26841 catalog_manager.cc:5697] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d reported cstate change: term changed from 2 to 3, leader changed from 08095d6ed192460eb036f63f9b683e37 (127.16.211.2) to 0212e0ac12a44277983cc8a5250ed83d (127.16.211.3). New cstate: current_term: 3 leader_uuid: "0212e0ac12a44277983cc8a5250ed83d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0212e0ac12a44277983cc8a5250ed83d" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 38215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:34.820801 26892 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:35.013275 27020 raft_consensus.cc:1275] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Refusing update from remote peer 0212e0ac12a44277983cc8a5250ed83d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:35.015049 27391 consensus_queue.cc:1048] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:35.022873 27021 raft_consensus.cc:1275] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Refusing update from remote peer 0212e0ac12a44277983cc8a5250ed83d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:35.027395 27399 consensus_queue.cc:1048] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08095d6ed192460eb036f63f9b683e37" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 39797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:35.028944 27290 raft_consensus.cc:1275] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Refusing update from remote peer 0212e0ac12a44277983cc8a5250ed83d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:35.030814 27409 consensus_queue.cc:1048] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:35.044308 27289 raft_consensus.cc:1275] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Refusing update from remote peer 0212e0ac12a44277983cc8a5250ed83d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:35.046957 27409 consensus_queue.cc:1048] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3486fa7720442859851bd70466b33e5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:35.240617 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:35.270730 17228 tablet_server.cc:179] TabletServer@127.16.211.1:37837 shutting down...
I20260709 13:21:35.291934 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:35.292781 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.293401 17228 raft_consensus.cc:2243] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.293902 17228 raft_consensus.cc:2272] T 95b52c269985488092ba3dea3efb488f P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.296078 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.296700 17228 raft_consensus.cc:2243] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.297140 17228 raft_consensus.cc:2272] T e07a4db5beed48d59ffd1638275afd5d P a3486fa7720442859851bd70466b33e5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.298949 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.299487 17228 raft_consensus.cc:2243] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.299883 17228 raft_consensus.cc:2272] T beea3c2c974b4c1385d4535e06213132 P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.302229 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.302752 17228 raft_consensus.cc:2243] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.303154 17228 raft_consensus.cc:2272] T 232335ce7f594d5cbef3c35982d50778 P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.304946 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.305466 17228 raft_consensus.cc:2243] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.305891 17228 raft_consensus.cc:2272] T f4b96c39550146efb4a917fddb43f6ae P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.307659 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.308173 17228 raft_consensus.cc:2243] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.308537 17228 raft_consensus.cc:2272] T c1f59a70f8c54800b763cc59c2a827f2 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.310375 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.310901 17228 raft_consensus.cc:2243] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.311316 17228 raft_consensus.cc:2272] T 200406b4466a4b05a2fc343b1dfce72b P a3486fa7720442859851bd70466b33e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.313027 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.313526 17228 raft_consensus.cc:2243] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.313995 17228 raft_consensus.cc:2272] T b7b1499ef1ce45338ffdffed28641af6 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.315735 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.316234 17228 raft_consensus.cc:2243] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.316648 17228 raft_consensus.cc:2272] T 030215ab2e584718b14b5f1e0088d06b P a3486fa7720442859851bd70466b33e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.319391 17228 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:35.319921 17228 raft_consensus.cc:2243] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.320333 17228 raft_consensus.cc:2272] T a55c0fae73774f73a3fbe7994d0c0098 P a3486fa7720442859851bd70466b33e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.321228 26985 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:35.325124 26985 consensus_peers.cc:597] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.349032 17228 tablet_server.cc:196] TabletServer@127.16.211.1:37837 shutdown complete.
I20260709 13:21:35.368492 17228 tablet_server.cc:179] TabletServer@127.16.211.2:0 shutting down...
W20260709 13:21:35.372334 27059 consensus_peers.cc:597] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.399724 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:35.400588 17228 tablet_replica.cc:333] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37: stopping tablet replica
I20260709 13:21:35.401332 17228 raft_consensus.cc:2243] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.401830 17228 raft_consensus.cc:2272] T c1f59a70f8c54800b763cc59c2a827f2 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.404196 17228 tablet_replica.cc:333] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37: stopping tablet replica
I20260709 13:21:35.404812 17228 raft_consensus.cc:2243] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.405992 17228 raft_consensus.cc:2272] T 200406b4466a4b05a2fc343b1dfce72b P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.409098 17228 tablet_replica.cc:333] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37: stopping tablet replica
I20260709 13:21:35.409811 17228 raft_consensus.cc:2243] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.410490 17228 raft_consensus.cc:2272] T 232335ce7f594d5cbef3c35982d50778 P 08095d6ed192460eb036f63f9b683e37 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.410861 27059 consensus_peers.cc:597] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.412999 17228 tablet_replica.cc:333] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37: stopping tablet replica
I20260709 13:21:35.413785 17228 raft_consensus.cc:2243] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.414310 17228 raft_consensus.cc:2272] T beea3c2c974b4c1385d4535e06213132 P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.417173 17228 tablet_replica.cc:333] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37: stopping tablet replica
I20260709 13:21:35.417722 17228 raft_consensus.cc:2243] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.418192 17228 raft_consensus.cc:2272] T f4b96c39550146efb4a917fddb43f6ae P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.420238 17228 tablet_replica.cc:333] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37: stopping tablet replica
I20260709 13:21:35.420724 17228 raft_consensus.cc:2243] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.421439 17228 raft_consensus.cc:2272] T e07a4db5beed48d59ffd1638275afd5d P 08095d6ed192460eb036f63f9b683e37 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.423797 17228 tablet_replica.cc:333] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37: stopping tablet replica
I20260709 13:21:35.424530 17228 raft_consensus.cc:2243] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.425423 17228 raft_consensus.cc:2272] T 95b52c269985488092ba3dea3efb488f P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.426920 27061 consensus_peers.cc:597] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d -> Peer 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797): Couldn't send request to peer 08095d6ed192460eb036f63f9b683e37. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.428097 17228 tablet_replica.cc:333] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37: stopping tablet replica
I20260709 13:21:35.428848 17228 raft_consensus.cc:2243] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.430166 17228 raft_consensus.cc:2272] T a55c0fae73774f73a3fbe7994d0c0098 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.433732 17228 tablet_replica.cc:333] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37: stopping tablet replica
I20260709 13:21:35.434564 17228 raft_consensus.cc:2243] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.435223 17228 raft_consensus.cc:2272] T b7b1499ef1ce45338ffdffed28641af6 P 08095d6ed192460eb036f63f9b683e37 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.436924 27059 consensus_peers.cc:597] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.438360 17228 tablet_replica.cc:333] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37: stopping tablet replica
I20260709 13:21:35.438910 17228 raft_consensus.cc:2243] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.439280 17228 raft_consensus.cc:2272] T 030215ab2e584718b14b5f1e0088d06b P 08095d6ed192460eb036f63f9b683e37 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.472239 17228 tablet_server.cc:196] TabletServer@127.16.211.2:0 shutdown complete.
W20260709 13:21:35.478713 27061 consensus_peers.cc:597] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d -> Peer 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797): Couldn't send request to peer 08095d6ed192460eb036f63f9b683e37. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:39797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.497581 17228 tablet_server.cc:179] TabletServer@127.16.211.3:0 shutting down...
W20260709 13:21:35.516048 27059 consensus_peers.cc:597] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.516619 27059 consensus_peers.cc:597] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d -> Peer a3486fa7720442859851bd70466b33e5 (127.16.211.1:37837): Couldn't send request to peer a3486fa7720442859851bd70466b33e5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:37837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.521435 27061 consensus_peers.cc:597] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d -> Peer 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797): Couldn't send request to peer 08095d6ed192460eb036f63f9b683e37. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:39797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.531337 27061 consensus_peers.cc:597] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d -> Peer 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797): Couldn't send request to peer 08095d6ed192460eb036f63f9b683e37. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:39797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.538933 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:35.539727 17228 tablet_replica.cc:333] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d: stopping tablet replica
I20260709 13:21:35.540362 17228 raft_consensus.cc:2243] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.540838 17228 raft_consensus.cc:2272] T 200406b4466a4b05a2fc343b1dfce72b P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.543063 17228 tablet_replica.cc:333] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d: stopping tablet replica
I20260709 13:21:35.543635 17228 raft_consensus.cc:2243] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.544442 17228 raft_consensus.cc:2272] T 030215ab2e584718b14b5f1e0088d06b P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.546797 17228 tablet_replica.cc:333] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d: stopping tablet replica
I20260709 13:21:35.547346 17228 raft_consensus.cc:2243] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.547812 17228 raft_consensus.cc:2272] T a55c0fae73774f73a3fbe7994d0c0098 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.550122 17228 tablet_replica.cc:333] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d: stopping tablet replica
I20260709 13:21:35.550671 17228 raft_consensus.cc:2243] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.551501 17228 raft_consensus.cc:2272] T b7b1499ef1ce45338ffdffed28641af6 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.553666 17228 tablet_replica.cc:333] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d: stopping tablet replica
I20260709 13:21:35.554292 17228 raft_consensus.cc:2243] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.555099 17228 raft_consensus.cc:2272] T c1f59a70f8c54800b763cc59c2a827f2 P 0212e0ac12a44277983cc8a5250ed83d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.557242 17228 tablet_replica.cc:333] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d: stopping tablet replica
I20260709 13:21:35.557780 17228 raft_consensus.cc:2243] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.560464 17228 raft_consensus.cc:2272] T beea3c2c974b4c1385d4535e06213132 P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.562979 17228 tablet_replica.cc:333] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d: stopping tablet replica
I20260709 13:21:35.563526 17228 raft_consensus.cc:2243] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.564257 17228 raft_consensus.cc:2272] T 232335ce7f594d5cbef3c35982d50778 P 0212e0ac12a44277983cc8a5250ed83d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.566792 17228 tablet_replica.cc:333] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d: stopping tablet replica
I20260709 13:21:35.567327 17228 raft_consensus.cc:2243] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.567765 17228 raft_consensus.cc:2272] T 95b52c269985488092ba3dea3efb488f P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:35.569326 27061 consensus_peers.cc:597] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d -> Peer 08095d6ed192460eb036f63f9b683e37 (127.16.211.2:39797): Couldn't send request to peer 08095d6ed192460eb036f63f9b683e37. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:39797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.570024 17228 tablet_replica.cc:333] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d: stopping tablet replica
I20260709 13:21:35.570622 17228 raft_consensus.cc:2243] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:35.571097 17228 raft_consensus.cc:2272] T e07a4db5beed48d59ffd1638275afd5d P 0212e0ac12a44277983cc8a5250ed83d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.573240 17228 tablet_replica.cc:333] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d: stopping tablet replica
I20260709 13:21:35.573750 17228 raft_consensus.cc:2243] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.574523 17228 raft_consensus.cc:2272] T f4b96c39550146efb4a917fddb43f6ae P 0212e0ac12a44277983cc8a5250ed83d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.604796 17228 tablet_server.cc:196] TabletServer@127.16.211.3:0 shutdown complete.
I20260709 13:21:35.627943 17228 master.cc:562] Master@127.16.211.62:43859 shutting down...
I20260709 13:21:35.655308 17228 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:35.655828 17228 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:35.656106 17228 tablet_replica.cc:333] T 00000000000000000000000000000000 P bc4037f884814a88968b00292acd6da6: stopping tablet replica
I20260709 13:21:35.676551 17228 master.cc:584] Master@127.16.211.62:43859 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13059 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:21:35.721843 17228 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.211.62:39701
I20260709 13:21:35.723006 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:35.728642 27423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:35.728957 27424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:35.729624 27426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:35.730186 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:35.731096 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:35.731264 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:35.731468 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603295731433 us; error 0 us; skew 500 ppm
I20260709 13:21:35.732079 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:35.734534 17228 webserver.cc:533] Webserver started at http://127.16.211.62:35181/ using document root <none> and password file <none>
I20260709 13:21:35.735052 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:35.735256 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:35.735558 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:35.736665 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/master-0-root/instance:
uuid: "288bb6ce0c8f4895a531d082cdf961fb"
format_stamp: "Formatted at 2026-07-09 13:21:35 on dist-test-slave-96c3"
I20260709 13:21:35.741358 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:35.745173 27431 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:35.746126 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:21:35.746388 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/master-0-root
uuid: "288bb6ce0c8f4895a531d082cdf961fb"
format_stamp: "Formatted at 2026-07-09 13:21:35 on dist-test-slave-96c3"
I20260709 13:21:35.746629 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:35.755816 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:35.756888 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:35.795047 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.62:39701
I20260709 13:21:35.795149 27482 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.62:39701 every 8 connection(s)
I20260709 13:21:35.798821 27483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:35.809868 27483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb: Bootstrap starting.
I20260709 13:21:35.816111 27483 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:35.820502 27483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb: No bootstrap required, opened a new log
I20260709 13:21:35.822822 27483 raft_consensus.cc:359] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288bb6ce0c8f4895a531d082cdf961fb" member_type: VOTER }
I20260709 13:21:35.823205 27483 raft_consensus.cc:385] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:35.823453 27483 raft_consensus.cc:740] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288bb6ce0c8f4895a531d082cdf961fb, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.824074 27483 consensus_queue.cc:260] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288bb6ce0c8f4895a531d082cdf961fb" member_type: VOTER }
I20260709 13:21:35.824555 27483 raft_consensus.cc:399] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:35.824782 27483 raft_consensus.cc:493] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:35.825088 27483 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.830143 27483 raft_consensus.cc:515] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288bb6ce0c8f4895a531d082cdf961fb" member_type: VOTER }
I20260709 13:21:35.830726 27483 leader_election.cc:304] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 288bb6ce0c8f4895a531d082cdf961fb; no voters: 
I20260709 13:21:35.831959 27483 leader_election.cc:290] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:35.832429 27486 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:35.833945 27486 raft_consensus.cc:697] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [term 1 LEADER]: Becoming Leader. State: Replica: 288bb6ce0c8f4895a531d082cdf961fb, State: Running, Role: LEADER
I20260709 13:21:35.834645 27486 consensus_queue.cc:237] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288bb6ce0c8f4895a531d082cdf961fb" member_type: VOTER }
I20260709 13:21:35.834954 27483 sys_catalog.cc:565] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:35.839332 27488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 288bb6ce0c8f4895a531d082cdf961fb. Latest consensus state: current_term: 1 leader_uuid: "288bb6ce0c8f4895a531d082cdf961fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288bb6ce0c8f4895a531d082cdf961fb" member_type: VOTER } }
I20260709 13:21:35.841058 27488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:35.840282 27487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "288bb6ce0c8f4895a531d082cdf961fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288bb6ce0c8f4895a531d082cdf961fb" member_type: VOTER } }
I20260709 13:21:35.842242 27487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:35.843940 27494 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:35.852020 27494 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:35.852983 17228 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:35.861169 27494 catalog_manager.cc:1383] Generated new cluster ID: b8469175ee6f46c681f565dc452f6a33
I20260709 13:21:35.861554 27494 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:35.908685 27494 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:35.910130 27494 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:35.926855 27494 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb: Generated new TSK 0
I20260709 13:21:35.927569 27494 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:35.984505 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:35.990972 27504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:35.992133 27505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:35.993824 27507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:35.994781 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:35.996464 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:35.996639 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:35.996759 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603295996748 us; error 0 us; skew 500 ppm
I20260709 13:21:35.997211 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:35.999598 17228 webserver.cc:533] Webserver started at http://127.16.211.1:46533/ using document root <none> and password file <none>
I20260709 13:21:36.000037 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:36.000200 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:36.000416 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:36.001458 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-0-root/instance:
uuid: "b716d300b4ad4466aa8477d72578f7e0"
format_stamp: "Formatted at 2026-07-09 13:21:35 on dist-test-slave-96c3"
I20260709 13:21:36.006098 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:21:36.009859 27512 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:36.011350 17228 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:21:36.011786 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-0-root
uuid: "b716d300b4ad4466aa8477d72578f7e0"
format_stamp: "Formatted at 2026-07-09 13:21:35 on dist-test-slave-96c3"
I20260709 13:21:36.012095 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:36.031611 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:36.032847 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:36.034472 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:36.037086 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:36.037314 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:36.037571 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:36.037740 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:36.079267 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.1:42893
I20260709 13:21:36.079378 27574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.1:42893 every 8 connection(s)
I20260709 13:21:36.084316 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:36.091626 27579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:36.093429 27580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:36.095005 27582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:36.095449 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:36.096762 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:36.097038 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:36.097235 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603296097216 us; error 0 us; skew 500 ppm
I20260709 13:21:36.097966 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:36.098440 27575 heartbeater.cc:344] Connected to a master server at 127.16.211.62:39701
I20260709 13:21:36.098924 27575 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:36.099686 27575 heartbeater.cc:507] Master 127.16.211.62:39701 requested a full tablet report, sending...
I20260709 13:21:36.100937 17228 webserver.cc:533] Webserver started at http://127.16.211.2:42503/ using document root <none> and password file <none>
I20260709 13:21:36.101665 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:36.101946 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:36.101809 27448 ts_manager.cc:194] Registered new tserver with Master: b716d300b4ad4466aa8477d72578f7e0 (127.16.211.1:42893)
I20260709 13:21:36.102392 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:36.103880 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-1-root/instance:
uuid: "9a44f4a1953e4823a92190ffe48ac18e"
format_stamp: "Formatted at 2026-07-09 13:21:36 on dist-test-slave-96c3"
I20260709 13:21:36.104344 27448 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52732
I20260709 13:21:36.108835 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:36.112658 27587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:36.113521 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:36.113850 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-1-root
uuid: "9a44f4a1953e4823a92190ffe48ac18e"
format_stamp: "Formatted at 2026-07-09 13:21:36 on dist-test-slave-96c3"
I20260709 13:21:36.114173 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:36.124572 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:36.125825 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:36.127417 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:36.129652 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:36.129829 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:36.130151 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:36.130291 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:36.173702 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.2:34451
I20260709 13:21:36.173837 27649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.2:34451 every 8 connection(s)
I20260709 13:21:36.178642 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:36.186846 27653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:36.187942 27654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:36.191720 27656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:36.191748 27650 heartbeater.cc:344] Connected to a master server at 127.16.211.62:39701
I20260709 13:21:36.191951 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:36.192619 27650 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:36.193344 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:36.193691 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:36.193584 27650 heartbeater.cc:507] Master 127.16.211.62:39701 requested a full tablet report, sending...
I20260709 13:21:36.194023 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603296194001 us; error 0 us; skew 500 ppm
I20260709 13:21:36.194808 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:36.196282 27448 ts_manager.cc:194] Registered new tserver with Master: 9a44f4a1953e4823a92190ffe48ac18e (127.16.211.2:34451)
I20260709 13:21:36.197551 17228 webserver.cc:533] Webserver started at http://127.16.211.3:45853/ using document root <none> and password file <none>
I20260709 13:21:36.198264 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:36.198190 27448 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52734
I20260709 13:21:36.198647 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:36.199085 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:36.200495 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-2-root/instance:
uuid: "d0a7564cd86e4e3888a15c22a89161a1"
format_stamp: "Formatted at 2026-07-09 13:21:36 on dist-test-slave-96c3"
I20260709 13:21:36.205147 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:36.208775 27661 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:36.209641 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:36.210070 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-2-root
uuid: "d0a7564cd86e4e3888a15c22a89161a1"
format_stamp: "Formatted at 2026-07-09 13:21:36 on dist-test-slave-96c3"
I20260709 13:21:36.210373 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602988568269-17228-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:36.221069 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:36.222522 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:36.224049 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:36.226399 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:36.226641 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:36.226887 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:36.227061 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:36.270356 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.3:39627
I20260709 13:21:36.270470 27723 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.3:39627 every 8 connection(s)
I20260709 13:21:36.285367 27724 heartbeater.cc:344] Connected to a master server at 127.16.211.62:39701
I20260709 13:21:36.286027 27724 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:36.286870 27724 heartbeater.cc:507] Master 127.16.211.62:39701 requested a full tablet report, sending...
I20260709 13:21:36.289021 27448 ts_manager.cc:194] Registered new tserver with Master: d0a7564cd86e4e3888a15c22a89161a1 (127.16.211.3:39627)
I20260709 13:21:36.289707 17228 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016173921s
I20260709 13:21:36.290525 27448 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52750
I20260709 13:21:36.316686 27448 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52766:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:36.319129 27448 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:36.403823 27615 tablet_service.cc:1511] Processing CreateTablet for tablet aca4076ea0a748ac914ffcf7e3f2cda2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e55a1212369348f39da1390028918819]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:36.403823 27614 tablet_service.cc:1511] Processing CreateTablet for tablet 52c05aee94e24becb7e1b874fbb085da (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e55a1212369348f39da1390028918819]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:36.405356 27615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca4076ea0a748ac914ffcf7e3f2cda2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:36.406558 27689 tablet_service.cc:1511] Processing CreateTablet for tablet aca4076ea0a748ac914ffcf7e3f2cda2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e55a1212369348f39da1390028918819]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:36.407155 27688 tablet_service.cc:1511] Processing CreateTablet for tablet 52c05aee94e24becb7e1b874fbb085da (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e55a1212369348f39da1390028918819]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:36.408007 27689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca4076ea0a748ac914ffcf7e3f2cda2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:36.407591 27540 tablet_service.cc:1511] Processing CreateTablet for tablet aca4076ea0a748ac914ffcf7e3f2cda2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e55a1212369348f39da1390028918819]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:36.408207 27539 tablet_service.cc:1511] Processing CreateTablet for tablet 52c05aee94e24becb7e1b874fbb085da (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e55a1212369348f39da1390028918819]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:36.408672 27614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c05aee94e24becb7e1b874fbb085da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:36.409078 27540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca4076ea0a748ac914ffcf7e3f2cda2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:36.411226 27539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c05aee94e24becb7e1b874fbb085da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:36.411777 27688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c05aee94e24becb7e1b874fbb085da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:36.434834 27739 tablet_bootstrap.cc:492] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1: Bootstrap starting.
I20260709 13:21:36.443154 27739 tablet_bootstrap.cc:654] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:36.452584 27739 tablet_bootstrap.cc:492] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1: No bootstrap required, opened a new log
I20260709 13:21:36.453106 27739 ts_tablet_manager.cc:1403] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.008s
I20260709 13:21:36.456275 27739 raft_consensus.cc:359] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } } peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } }
I20260709 13:21:36.457064 27739 raft_consensus.cc:385] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:36.457412 27739 raft_consensus.cc:740] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a7564cd86e4e3888a15c22a89161a1, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.458345 27739 consensus_queue.cc:260] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } } peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } }
I20260709 13:21:36.458232 27740 tablet_bootstrap.cc:492] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e: Bootstrap starting.
I20260709 13:21:36.462880 27742 tablet_bootstrap.cc:492] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0: Bootstrap starting.
I20260709 13:21:36.464183 27724 heartbeater.cc:499] Master 127.16.211.62:39701 was elected leader, sending a full tablet report...
I20260709 13:21:36.464625 27739 ts_tablet_manager.cc:1434] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:21:36.465776 27739 tablet_bootstrap.cc:492] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1: Bootstrap starting.
I20260709 13:21:36.468032 27740 tablet_bootstrap.cc:654] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:36.473088 27739 tablet_bootstrap.cc:654] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:36.476552 27742 tablet_bootstrap.cc:654] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:36.482929 27739 tablet_bootstrap.cc:492] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1: No bootstrap required, opened a new log
I20260709 13:21:36.483493 27739 ts_tablet_manager.cc:1403] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:21:36.483515 27740 tablet_bootstrap.cc:492] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e: No bootstrap required, opened a new log
I20260709 13:21:36.483824 27742 tablet_bootstrap.cc:492] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0: No bootstrap required, opened a new log
I20260709 13:21:36.484221 27740 ts_tablet_manager.cc:1403] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.011s
I20260709 13:21:36.484439 27742 ts_tablet_manager.cc:1403] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 13:21:36.486867 27740 raft_consensus.cc:359] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } } peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } }
I20260709 13:21:36.486845 27739 raft_consensus.cc:359] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:36.487833 27740 raft_consensus.cc:385] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:36.487443 27742 raft_consensus.cc:359] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:36.487896 27739 raft_consensus.cc:385] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:36.488193 27740 raft_consensus.cc:740] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a44f4a1953e4823a92190ffe48ac18e, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.488296 27742 raft_consensus.cc:385] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:36.488365 27739 raft_consensus.cc:740] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a7564cd86e4e3888a15c22a89161a1, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.488782 27742 raft_consensus.cc:740] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b716d300b4ad4466aa8477d72578f7e0, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.489100 27740 consensus_queue.cc:260] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } } peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } }
I20260709 13:21:36.489461 27739 consensus_queue.cc:260] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:36.489749 27742 consensus_queue.cc:260] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:36.491789 27739 ts_tablet_manager.cc:1434] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:36.494637 27575 heartbeater.cc:499] Master 127.16.211.62:39701 was elected leader, sending a full tablet report...
I20260709 13:21:36.494764 27650 heartbeater.cc:499] Master 127.16.211.62:39701 was elected leader, sending a full tablet report...
I20260709 13:21:36.495252 27742 ts_tablet_manager.cc:1434] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:21:36.496361 27742 tablet_bootstrap.cc:492] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0: Bootstrap starting.
I20260709 13:21:36.499430 27740 ts_tablet_manager.cc:1434] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 13:21:36.500787 27740 tablet_bootstrap.cc:492] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e: Bootstrap starting.
I20260709 13:21:36.505878 27742 tablet_bootstrap.cc:654] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:36.512167 27740 tablet_bootstrap.cc:654] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:36.516865 27742 tablet_bootstrap.cc:492] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0: No bootstrap required, opened a new log
I20260709 13:21:36.517429 27742 ts_tablet_manager.cc:1403] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.004s
I20260709 13:21:36.518019 27740 tablet_bootstrap.cc:492] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e: No bootstrap required, opened a new log
I20260709 13:21:36.518566 27740 ts_tablet_manager.cc:1403] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 13:21:36.520586 27742 raft_consensus.cc:359] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } } peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } }
I20260709 13:21:36.521454 27742 raft_consensus.cc:385] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:36.521427 27740 raft_consensus.cc:359] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:36.522037 27742 raft_consensus.cc:740] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b716d300b4ad4466aa8477d72578f7e0, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.522411 27740 raft_consensus.cc:385] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:36.522744 27740 raft_consensus.cc:740] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a44f4a1953e4823a92190ffe48ac18e, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.522953 27742 consensus_queue.cc:260] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } } peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } }
I20260709 13:21:36.523522 27740 consensus_queue.cc:260] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:36.525348 27742 ts_tablet_manager.cc:1434] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:36.525620 27740 ts_tablet_manager.cc:1434] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:36.713891 27748 raft_consensus.cc:493] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.714577 27748 raft_consensus.cc:515] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:36.716862 27748 leader_election.cc:290] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a44f4a1953e4823a92190ffe48ac18e (127.16.211.2:34451), d0a7564cd86e4e3888a15c22a89161a1 (127.16.211.3:39627)
I20260709 13:21:36.728134 27625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52c05aee94e24becb7e1b874fbb085da" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a44f4a1953e4823a92190ffe48ac18e" is_pre_election: true
I20260709 13:21:36.728399 27699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52c05aee94e24becb7e1b874fbb085da" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a7564cd86e4e3888a15c22a89161a1" is_pre_election: true
I20260709 13:21:36.729091 27699 raft_consensus.cc:2468] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 0.
I20260709 13:21:36.729084 27625 raft_consensus.cc:2468] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 0.
I20260709 13:21:36.730710 27514 leader_election.cc:304] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a44f4a1953e4823a92190ffe48ac18e, b716d300b4ad4466aa8477d72578f7e0; no voters: 
I20260709 13:21:36.731470 27748 raft_consensus.cc:2804] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:36.731787 27748 raft_consensus.cc:493] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:36.732097 27748 raft_consensus.cc:3060] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:36.738157 27748 raft_consensus.cc:515] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:36.740064 27748 leader_election.cc:290] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 election: Requested vote from peers 9a44f4a1953e4823a92190ffe48ac18e (127.16.211.2:34451), d0a7564cd86e4e3888a15c22a89161a1 (127.16.211.3:39627)
I20260709 13:21:36.741070 27625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52c05aee94e24becb7e1b874fbb085da" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a44f4a1953e4823a92190ffe48ac18e"
I20260709 13:21:36.741183 27699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52c05aee94e24becb7e1b874fbb085da" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a7564cd86e4e3888a15c22a89161a1"
I20260709 13:21:36.741659 27625 raft_consensus.cc:3060] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:36.741858 27699 raft_consensus.cc:3060] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:36.747932 27625 raft_consensus.cc:2468] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 1.
I20260709 13:21:36.748060 27699 raft_consensus.cc:2468] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 1.
I20260709 13:21:36.749733 27514 leader_election.cc:304] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a44f4a1953e4823a92190ffe48ac18e, b716d300b4ad4466aa8477d72578f7e0; no voters: 
I20260709 13:21:36.750556 27748 raft_consensus.cc:2804] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:36.751544 27748 raft_consensus.cc:697] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Becoming Leader. State: Replica: b716d300b4ad4466aa8477d72578f7e0, State: Running, Role: LEADER
I20260709 13:21:36.752372 27748 consensus_queue.cc:237] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:36.759006 27447 catalog_manager.cc:5697] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b716d300b4ad4466aa8477d72578f7e0 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "b716d300b4ad4466aa8477d72578f7e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:36.846158 27496 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:36.890619 27748 raft_consensus.cc:493] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.891386 27748 raft_consensus.cc:515] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } } peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } }
I20260709 13:21:36.893148 27748 leader_election.cc:290] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a44f4a1953e4823a92190ffe48ac18e (127.16.211.2:34451), d0a7564cd86e4e3888a15c22a89161a1 (127.16.211.3:39627)
I20260709 13:21:36.894260 27625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca4076ea0a748ac914ffcf7e3f2cda2" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a44f4a1953e4823a92190ffe48ac18e" is_pre_election: true
I20260709 13:21:36.894250 27699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca4076ea0a748ac914ffcf7e3f2cda2" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a7564cd86e4e3888a15c22a89161a1" is_pre_election: true
I20260709 13:21:36.895052 27625 raft_consensus.cc:2468] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 0.
I20260709 13:21:36.895134 27699 raft_consensus.cc:2468] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 0.
I20260709 13:21:36.896245 27514 leader_election.cc:304] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a44f4a1953e4823a92190ffe48ac18e, b716d300b4ad4466aa8477d72578f7e0; no voters: 
I20260709 13:21:36.897051 27748 raft_consensus.cc:2804] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:36.897400 27748 raft_consensus.cc:493] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:36.897655 27748 raft_consensus.cc:3060] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:36.903396 27748 raft_consensus.cc:515] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } } peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } }
I20260709 13:21:36.905332 27748 leader_election.cc:290] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 election: Requested vote from peers 9a44f4a1953e4823a92190ffe48ac18e (127.16.211.2:34451), d0a7564cd86e4e3888a15c22a89161a1 (127.16.211.3:39627)
I20260709 13:21:36.906257 27625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca4076ea0a748ac914ffcf7e3f2cda2" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a44f4a1953e4823a92190ffe48ac18e"
I20260709 13:21:36.906512 27699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca4076ea0a748ac914ffcf7e3f2cda2" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a7564cd86e4e3888a15c22a89161a1"
I20260709 13:21:36.906879 27625 raft_consensus.cc:3060] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:36.907111 27699 raft_consensus.cc:3060] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:36.913084 27625 raft_consensus.cc:2468] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 1.
I20260709 13:21:36.913267 27699 raft_consensus.cc:2468] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 1.
I20260709 13:21:36.914279 27514 leader_election.cc:304] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a44f4a1953e4823a92190ffe48ac18e, b716d300b4ad4466aa8477d72578f7e0; no voters: 
I20260709 13:21:36.915586 27748 raft_consensus.cc:2804] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:36.916132 27748 raft_consensus.cc:697] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Becoming Leader. State: Replica: b716d300b4ad4466aa8477d72578f7e0, State: Running, Role: LEADER
I20260709 13:21:36.916919 27748 consensus_queue.cc:237] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } } peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } }
I20260709 13:21:36.923849 27447 catalog_manager.cc:5697] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b716d300b4ad4466aa8477d72578f7e0 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "b716d300b4ad4466aa8477d72578f7e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:37.011121 27447 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52768:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:37.013614 27447 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:37.041514 27539 tablet_service.cc:1511] Processing CreateTablet for tablet f311783b21994075b8433b0b0164df0c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=152361a184094ae6a8f4c266f3badf11]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:37.042889 27539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f311783b21994075b8433b0b0164df0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:37.043006 27615 tablet_service.cc:1511] Processing CreateTablet for tablet f311783b21994075b8433b0b0164df0c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=152361a184094ae6a8f4c266f3badf11]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:37.044512 27615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f311783b21994075b8433b0b0164df0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:37.044260 27688 tablet_service.cc:1511] Processing CreateTablet for tablet f311783b21994075b8433b0b0164df0c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=152361a184094ae6a8f4c266f3badf11]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:37.045989 27688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f311783b21994075b8433b0b0164df0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:37.046780 27540 tablet_service.cc:1511] Processing CreateTablet for tablet c2d3cac996944e509c39c7d11d33e947 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=152361a184094ae6a8f4c266f3badf11]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:37.048235 27540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d3cac996944e509c39c7d11d33e947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:37.059935 27614 tablet_service.cc:1511] Processing CreateTablet for tablet c2d3cac996944e509c39c7d11d33e947 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=152361a184094ae6a8f4c266f3badf11]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:37.061345 27614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d3cac996944e509c39c7d11d33e947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:37.061184 27689 tablet_service.cc:1511] Processing CreateTablet for tablet c2d3cac996944e509c39c7d11d33e947 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=152361a184094ae6a8f4c266f3badf11]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:37.062507 27689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d3cac996944e509c39c7d11d33e947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:37.079028 27763 tablet_bootstrap.cc:492] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0: Bootstrap starting.
I20260709 13:21:37.082584 27764 tablet_bootstrap.cc:492] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1: Bootstrap starting.
I20260709 13:21:37.087738 27762 tablet_bootstrap.cc:492] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e: Bootstrap starting.
I20260709 13:21:37.091027 27763 tablet_bootstrap.cc:654] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:37.093991 27764 tablet_bootstrap.cc:654] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:37.094908 27762 tablet_bootstrap.cc:654] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:37.096316 27763 tablet_bootstrap.cc:492] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0: No bootstrap required, opened a new log
I20260709 13:21:37.096913 27763 ts_tablet_manager.cc:1403] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 13:21:37.100150 27763 raft_consensus.cc:359] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.100924 27764 tablet_bootstrap.cc:492] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1: No bootstrap required, opened a new log
I20260709 13:21:37.100920 27763 raft_consensus.cc:385] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:37.101495 27763 raft_consensus.cc:740] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b716d300b4ad4466aa8477d72578f7e0, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.101518 27764 ts_tablet_manager.cc:1403] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.006s
I20260709 13:21:37.101640 27762 tablet_bootstrap.cc:492] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e: No bootstrap required, opened a new log
I20260709 13:21:37.102381 27762 ts_tablet_manager.cc:1403] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:21:37.102478 27763 consensus_queue.cc:260] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.104705 27763 ts_tablet_manager.cc:1434] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:21:37.105672 27763 tablet_bootstrap.cc:492] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0: Bootstrap starting.
I20260709 13:21:37.105903 27764 raft_consensus.cc:359] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.106194 27762 raft_consensus.cc:359] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.106776 27764 raft_consensus.cc:385] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:37.106931 27762 raft_consensus.cc:385] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:37.107230 27764 raft_consensus.cc:740] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a7564cd86e4e3888a15c22a89161a1, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.107290 27762 raft_consensus.cc:740] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a44f4a1953e4823a92190ffe48ac18e, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.108331 27764 consensus_queue.cc:260] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.108320 27762 consensus_queue.cc:260] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.112938 27763 tablet_bootstrap.cc:654] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:37.121312 27764 ts_tablet_manager.cc:1434] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.007s
I20260709 13:21:37.122611 27764 tablet_bootstrap.cc:492] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1: Bootstrap starting.
I20260709 13:21:37.123024 27762 ts_tablet_manager.cc:1434] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.010s
I20260709 13:21:37.126950 27762 tablet_bootstrap.cc:492] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e: Bootstrap starting.
I20260709 13:21:37.128835 27764 tablet_bootstrap.cc:654] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:37.133872 27762 tablet_bootstrap.cc:654] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:37.123404 27763 tablet_bootstrap.cc:492] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0: No bootstrap required, opened a new log
I20260709 13:21:37.134636 27763 ts_tablet_manager.cc:1403] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.008s
I20260709 13:21:37.136348 27764 tablet_bootstrap.cc:492] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1: No bootstrap required, opened a new log
I20260709 13:21:37.136907 27764 ts_tablet_manager.cc:1403] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 13:21:37.137662 27763 raft_consensus.cc:359] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.138633 27763 raft_consensus.cc:385] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:37.138950 27763 raft_consensus.cc:740] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b716d300b4ad4466aa8477d72578f7e0, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.139892 27764 raft_consensus.cc:359] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.139719 27763 consensus_queue.cc:260] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.140853 27764 raft_consensus.cc:385] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:37.142571 27763 ts_tablet_manager.cc:1434] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:37.147716 27764 raft_consensus.cc:740] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a7564cd86e4e3888a15c22a89161a1, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.139706 27748 consensus_queue.cc:1048] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:21:37.148664 27764 consensus_queue.cc:260] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.151643 27762 tablet_bootstrap.cc:492] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e: No bootstrap required, opened a new log
I20260709 13:21:37.152274 27762 ts_tablet_manager.cc:1403] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 13:21:37.153995 27764 ts_tablet_manager.cc:1434] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.002s
I20260709 13:21:37.155418 27762 raft_consensus.cc:359] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.156064 27762 raft_consensus.cc:385] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:37.156308 27762 raft_consensus.cc:740] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a44f4a1953e4823a92190ffe48ac18e, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.156917 27762 consensus_queue.cc:260] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.158710 27762 ts_tablet_manager.cc:1434] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:37.174547 27753 consensus_queue.cc:1048] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:37.207231 27776 raft_consensus.cc:493] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:37.207778 27776 raft_consensus.cc:515] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.209512 27776 leader_election.cc:290] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a44f4a1953e4823a92190ffe48ac18e (127.16.211.2:34451), d0a7564cd86e4e3888a15c22a89161a1 (127.16.211.3:39627)
I20260709 13:21:37.210420 27625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f311783b21994075b8433b0b0164df0c" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a44f4a1953e4823a92190ffe48ac18e" is_pre_election: true
I20260709 13:21:37.210604 27699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f311783b21994075b8433b0b0164df0c" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a7564cd86e4e3888a15c22a89161a1" is_pre_election: true
I20260709 13:21:37.211123 27625 raft_consensus.cc:2468] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 0.
I20260709 13:21:37.211249 27699 raft_consensus.cc:2468] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 0.
I20260709 13:21:37.212162 27514 leader_election.cc:304] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a44f4a1953e4823a92190ffe48ac18e, b716d300b4ad4466aa8477d72578f7e0; no voters: 
I20260709 13:21:37.212904 27776 raft_consensus.cc:2804] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:37.213274 27776 raft_consensus.cc:493] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:37.213560 27776 raft_consensus.cc:3060] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:37.219218 27776 raft_consensus.cc:515] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.221004 27776 leader_election.cc:290] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 election: Requested vote from peers 9a44f4a1953e4823a92190ffe48ac18e (127.16.211.2:34451), d0a7564cd86e4e3888a15c22a89161a1 (127.16.211.3:39627)
I20260709 13:21:37.221822 27625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f311783b21994075b8433b0b0164df0c" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a44f4a1953e4823a92190ffe48ac18e"
I20260709 13:21:37.222225 27699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f311783b21994075b8433b0b0164df0c" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a7564cd86e4e3888a15c22a89161a1"
I20260709 13:21:37.222568 27625 raft_consensus.cc:3060] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:37.222800 27699 raft_consensus.cc:3060] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:37.229852 27699 raft_consensus.cc:2468] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 1.
I20260709 13:21:37.230022 27625 raft_consensus.cc:2468] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 1.
I20260709 13:21:37.231276 27513 leader_election.cc:304] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b716d300b4ad4466aa8477d72578f7e0, d0a7564cd86e4e3888a15c22a89161a1; no voters: 
I20260709 13:21:37.232141 27776 raft_consensus.cc:2804] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:37.232600 27776 raft_consensus.cc:697] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Becoming Leader. State: Replica: b716d300b4ad4466aa8477d72578f7e0, State: Running, Role: LEADER
I20260709 13:21:37.233289 27776 consensus_queue.cc:237] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.240298 27446 catalog_manager.cc:5697] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b716d300b4ad4466aa8477d72578f7e0 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "b716d300b4ad4466aa8477d72578f7e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:37.308997 27776 raft_consensus.cc:493] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:37.309505 27776 raft_consensus.cc:515] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.311952 27776 leader_election.cc:290] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a44f4a1953e4823a92190ffe48ac18e (127.16.211.2:34451), d0a7564cd86e4e3888a15c22a89161a1 (127.16.211.3:39627)
I20260709 13:21:37.312152 27625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d3cac996944e509c39c7d11d33e947" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a44f4a1953e4823a92190ffe48ac18e" is_pre_election: true
I20260709 13:21:37.312611 27699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d3cac996944e509c39c7d11d33e947" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a7564cd86e4e3888a15c22a89161a1" is_pre_election: true
I20260709 13:21:37.313050 27625 raft_consensus.cc:2468] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 0.
I20260709 13:21:37.313306 27699 raft_consensus.cc:2468] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 0.
I20260709 13:21:37.314255 27514 leader_election.cc:304] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a44f4a1953e4823a92190ffe48ac18e, b716d300b4ad4466aa8477d72578f7e0; no voters: 
I20260709 13:21:37.314953 27776 raft_consensus.cc:2804] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:37.315299 27776 raft_consensus.cc:493] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:37.315528 27776 raft_consensus.cc:3060] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:37.320664 27776 raft_consensus.cc:515] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.322458 27776 leader_election.cc:290] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 election: Requested vote from peers 9a44f4a1953e4823a92190ffe48ac18e (127.16.211.2:34451), d0a7564cd86e4e3888a15c22a89161a1 (127.16.211.3:39627)
I20260709 13:21:37.323412 27625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d3cac996944e509c39c7d11d33e947" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a44f4a1953e4823a92190ffe48ac18e"
I20260709 13:21:37.323491 27699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d3cac996944e509c39c7d11d33e947" candidate_uuid: "b716d300b4ad4466aa8477d72578f7e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0a7564cd86e4e3888a15c22a89161a1"
I20260709 13:21:37.324070 27625 raft_consensus.cc:3060] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:37.324144 27699 raft_consensus.cc:3060] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:37.329496 27625 raft_consensus.cc:2468] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 1.
I20260709 13:21:37.329638 27699 raft_consensus.cc:2468] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716d300b4ad4466aa8477d72578f7e0 in term 1.
I20260709 13:21:37.330770 27514 leader_election.cc:304] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a44f4a1953e4823a92190ffe48ac18e, b716d300b4ad4466aa8477d72578f7e0; no voters: 
I20260709 13:21:37.331550 27776 raft_consensus.cc:2804] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:37.331967 27776 raft_consensus.cc:697] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Becoming Leader. State: Replica: b716d300b4ad4466aa8477d72578f7e0, State: Running, Role: LEADER
I20260709 13:21:37.332749 27776 consensus_queue.cc:237] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.339737 27446 catalog_manager.cc:5697] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b716d300b4ad4466aa8477d72578f7e0 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "b716d300b4ad4466aa8477d72578f7e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:37.346769 27776 consensus_queue.cc:1048] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:37.357792 27753 consensus_queue.cc:1048] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:37.387084 27550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52c05aee94e24becb7e1b874fbb085da"
dest_uuid: "b716d300b4ad4466aa8477d72578f7e0"
mode: GRACEFUL
new_leader_uuid: "9a44f4a1953e4823a92190ffe48ac18e"
 from {username='slave'} at 127.0.0.1:41538
I20260709 13:21:37.387588 27550 raft_consensus.cc:606] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Received request to transfer leadership to TS 9a44f4a1953e4823a92190ffe48ac18e
I20260709 13:21:37.544813 27748 raft_consensus.cc:993] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0: : Instructing follower 9a44f4a1953e4823a92190ffe48ac18e to start an election
I20260709 13:21:37.545367 27753 raft_consensus.cc:1081] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Signalling peer 9a44f4a1953e4823a92190ffe48ac18e to start an election
I20260709 13:21:37.547050 27625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52c05aee94e24becb7e1b874fbb085da"
dest_uuid: "9a44f4a1953e4823a92190ffe48ac18e"
 from {username='slave'} at 127.0.0.1:59290
I20260709 13:21:37.547683 27625 raft_consensus.cc:493] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:37.548017 27625 raft_consensus.cc:3060] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.553325 27625 raft_consensus.cc:515] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.555487 27625 leader_election.cc:290] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [CANDIDATE]: Term 2 election: Requested vote from peers b716d300b4ad4466aa8477d72578f7e0 (127.16.211.1:42893), d0a7564cd86e4e3888a15c22a89161a1 (127.16.211.3:39627)
I20260709 13:21:37.567937 27550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52c05aee94e24becb7e1b874fbb085da" candidate_uuid: "9a44f4a1953e4823a92190ffe48ac18e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b716d300b4ad4466aa8477d72578f7e0"
I20260709 13:21:37.568720 27550 raft_consensus.cc:3055] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:37.568991 27550 raft_consensus.cc:740] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b716d300b4ad4466aa8477d72578f7e0, State: Running, Role: LEADER
I20260709 13:21:37.569784 27550 consensus_queue.cc:260] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.571269 27550 raft_consensus.cc:3060] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.572497 27699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52c05aee94e24becb7e1b874fbb085da" candidate_uuid: "9a44f4a1953e4823a92190ffe48ac18e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0a7564cd86e4e3888a15c22a89161a1"
I20260709 13:21:37.573097 27699 raft_consensus.cc:3060] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.577621 27550 raft_consensus.cc:2468] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a44f4a1953e4823a92190ffe48ac18e in term 2.
I20260709 13:21:37.577958 27699 raft_consensus.cc:2468] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a44f4a1953e4823a92190ffe48ac18e in term 2.
I20260709 13:21:37.579082 27591 leader_election.cc:304] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a44f4a1953e4823a92190ffe48ac18e, b716d300b4ad4466aa8477d72578f7e0; no voters: 
I20260709 13:21:37.580101 27769 raft_consensus.cc:2804] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:37.581183 27769 raft_consensus.cc:697] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [term 2 LEADER]: Becoming Leader. State: Replica: 9a44f4a1953e4823a92190ffe48ac18e, State: Running, Role: LEADER
I20260709 13:21:37.581857 27769 consensus_queue.cc:237] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.588205 27446 catalog_manager.cc:5697] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e reported cstate change: term changed from 1 to 2, leader changed from b716d300b4ad4466aa8477d72578f7e0 (127.16.211.1) to 9a44f4a1953e4823a92190ffe48ac18e (127.16.211.2). New cstate: current_term: 2 leader_uuid: "9a44f4a1953e4823a92190ffe48ac18e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:37.608738 17228 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:21:37.610438 17228 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:21:37.610829 17228 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:21:37.623136 27550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2d3cac996944e509c39c7d11d33e947"
dest_uuid: "b716d300b4ad4466aa8477d72578f7e0"
mode: GRACEFUL
new_leader_uuid: "d0a7564cd86e4e3888a15c22a89161a1"
 from {username='slave'} at 127.0.0.1:41562
I20260709 13:21:37.623644 27550 raft_consensus.cc:606] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Received request to transfer leadership to TS d0a7564cd86e4e3888a15c22a89161a1
I20260709 13:21:37.625075 17228 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:21:37.770133 27753 consensus_queue.cc:1048] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:37.780835 27753 consensus_queue.cc:1048] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:37.788756 27776 raft_consensus.cc:993] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0: : Instructing follower d0a7564cd86e4e3888a15c22a89161a1 to start an election
I20260709 13:21:37.789247 27753 raft_consensus.cc:1081] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Signalling peer d0a7564cd86e4e3888a15c22a89161a1 to start an election
I20260709 13:21:37.790867 27699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2d3cac996944e509c39c7d11d33e947"
dest_uuid: "d0a7564cd86e4e3888a15c22a89161a1"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:21:37.791462 27699 raft_consensus.cc:493] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:37.791842 27699 raft_consensus.cc:3060] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.797829 27699 raft_consensus.cc:515] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.800556 27699 leader_election.cc:290] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [CANDIDATE]: Term 2 election: Requested vote from peers b716d300b4ad4466aa8477d72578f7e0 (127.16.211.1:42893), 9a44f4a1953e4823a92190ffe48ac18e (127.16.211.2:34451)
I20260709 13:21:37.809405 27753 consensus_queue.cc:1048] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:37.816035 27550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d3cac996944e509c39c7d11d33e947" candidate_uuid: "d0a7564cd86e4e3888a15c22a89161a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b716d300b4ad4466aa8477d72578f7e0"
I20260709 13:21:37.817456 27550 raft_consensus.cc:3055] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:37.817808 27550 raft_consensus.cc:740] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b716d300b4ad4466aa8477d72578f7e0, State: Running, Role: LEADER
I20260709 13:21:37.820927 27625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d3cac996944e509c39c7d11d33e947" candidate_uuid: "d0a7564cd86e4e3888a15c22a89161a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a44f4a1953e4823a92190ffe48ac18e"
I20260709 13:21:37.821667 27625 raft_consensus.cc:3060] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.824437 27550 consensus_queue.cc:260] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.825898 27550 raft_consensus.cc:3060] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.832952 27753 consensus_queue.cc:1048] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:37.830101 27625 raft_consensus.cc:2468] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0a7564cd86e4e3888a15c22a89161a1 in term 2.
I20260709 13:21:37.835556 27663 leader_election.cc:304] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a44f4a1953e4823a92190ffe48ac18e, d0a7564cd86e4e3888a15c22a89161a1; no voters: 
I20260709 13:21:37.836511 27768 raft_consensus.cc:2804] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:37.844563 27768 raft_consensus.cc:697] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 2 LEADER]: Becoming Leader. State: Replica: d0a7564cd86e4e3888a15c22a89161a1, State: Running, Role: LEADER
I20260709 13:21:37.845852 27768 consensus_queue.cc:237] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } }
I20260709 13:21:37.854621 27550 raft_consensus.cc:2468] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0a7564cd86e4e3888a15c22a89161a1 in term 2.
I20260709 13:21:37.858320 27447 catalog_manager.cc:5697] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 reported cstate change: term changed from 1 to 2, leader changed from b716d300b4ad4466aa8477d72578f7e0 (127.16.211.1) to d0a7564cd86e4e3888a15c22a89161a1 (127.16.211.3). New cstate: current_term: 2 leader_uuid: "d0a7564cd86e4e3888a15c22a89161a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b716d300b4ad4466aa8477d72578f7e0" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a44f4a1953e4823a92190ffe48ac18e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:37.986553 17228 tablet_server.cc:179] TabletServer@127.16.211.1:0 shutting down...
I20260709 13:21:38.006587 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:38.007192 17228 tablet_replica.cc:333] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0: stopping tablet replica
I20260709 13:21:38.007742 17228 raft_consensus.cc:2243] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.008148 17228 raft_consensus.cc:2272] T c2d3cac996944e509c39c7d11d33e947 P b716d300b4ad4466aa8477d72578f7e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.010262 17228 tablet_replica.cc:333] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0: stopping tablet replica
I20260709 13:21:38.010758 17228 raft_consensus.cc:2243] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.011499 17228 raft_consensus.cc:2272] T f311783b21994075b8433b0b0164df0c P b716d300b4ad4466aa8477d72578f7e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.013828 17228 tablet_replica.cc:333] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0: stopping tablet replica
I20260709 13:21:38.014401 17228 raft_consensus.cc:2243] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.015273 17228 raft_consensus.cc:2272] T aca4076ea0a748ac914ffcf7e3f2cda2 P b716d300b4ad4466aa8477d72578f7e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.017027 27699 raft_consensus.cc:1275] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1 [term 2 FOLLOWER]: Refusing update from remote peer 9a44f4a1953e4823a92190ffe48ac18e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:38.017702 17228 tablet_replica.cc:333] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0: stopping tablet replica
I20260709 13:21:38.018455 17228 raft_consensus.cc:2243] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.018519 27769 consensus_queue.cc:1048] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0a7564cd86e4e3888a15c22a89161a1" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 39627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:38.018942 17228 raft_consensus.cc:2272] T 52c05aee94e24becb7e1b874fbb085da P b716d300b4ad4466aa8477d72578f7e0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.033743 27591 consensus_peers.cc:597] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e -> Peer b716d300b4ad4466aa8477d72578f7e0 (127.16.211.1:42893): Couldn't send request to peer b716d300b4ad4466aa8477d72578f7e0. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:42893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.051008 17228 tablet_server.cc:196] TabletServer@127.16.211.1:0 shutdown complete.
I20260709 13:21:38.063023 17228 tablet_server.cc:179] TabletServer@127.16.211.2:0 shutting down...
I20260709 13:21:38.085032 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:38.085697 17228 tablet_replica.cc:333] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e: stopping tablet replica
I20260709 13:21:38.086360 17228 raft_consensus.cc:2243] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.086843 17228 raft_consensus.cc:2272] T c2d3cac996944e509c39c7d11d33e947 P 9a44f4a1953e4823a92190ffe48ac18e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.089341 17228 tablet_replica.cc:333] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e: stopping tablet replica
I20260709 13:21:38.089864 17228 raft_consensus.cc:2243] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.090349 17228 raft_consensus.cc:2272] T f311783b21994075b8433b0b0164df0c P 9a44f4a1953e4823a92190ffe48ac18e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.092633 17228 tablet_replica.cc:333] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e: stopping tablet replica
I20260709 13:21:38.093259 17228 raft_consensus.cc:2243] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.094149 17228 raft_consensus.cc:2272] T 52c05aee94e24becb7e1b874fbb085da P 9a44f4a1953e4823a92190ffe48ac18e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.096376 17228 tablet_replica.cc:333] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e: stopping tablet replica
I20260709 13:21:38.096967 17228 raft_consensus.cc:2243] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.097380 17228 raft_consensus.cc:2272] T aca4076ea0a748ac914ffcf7e3f2cda2 P 9a44f4a1953e4823a92190ffe48ac18e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.110893 17228 tablet_server.cc:196] TabletServer@127.16.211.2:0 shutdown complete.
I20260709 13:21:38.124260 17228 tablet_server.cc:179] TabletServer@127.16.211.3:0 shutting down...
I20260709 13:21:38.142251 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:38.142942 17228 tablet_replica.cc:333] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1: stopping tablet replica
I20260709 13:21:38.143543 17228 raft_consensus.cc:2243] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.144220 17228 pending_rounds.cc:70] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1: Trying to abort 1 pending ops.
I20260709 13:21:38.144430 17228 pending_rounds.cc:77] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639107988324352 op_type: NO_OP noop_request { }
I20260709 13:21:38.144723 17228 raft_consensus.cc:2889] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:38.145054 17228 raft_consensus.cc:2272] T c2d3cac996944e509c39c7d11d33e947 P d0a7564cd86e4e3888a15c22a89161a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.147751 17228 tablet_replica.cc:333] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1: stopping tablet replica
I20260709 13:21:38.148314 17228 raft_consensus.cc:2243] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.148842 17228 raft_consensus.cc:2272] T f311783b21994075b8433b0b0164df0c P d0a7564cd86e4e3888a15c22a89161a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.151760 17228 tablet_replica.cc:333] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1: stopping tablet replica
I20260709 13:21:38.152325 17228 raft_consensus.cc:2243] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.152778 17228 raft_consensus.cc:2272] T 52c05aee94e24becb7e1b874fbb085da P d0a7564cd86e4e3888a15c22a89161a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.155208 17228 tablet_replica.cc:333] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1: stopping tablet replica
I20260709 13:21:38.155766 17228 raft_consensus.cc:2243] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.156209 17228 raft_consensus.cc:2272] T aca4076ea0a748ac914ffcf7e3f2cda2 P d0a7564cd86e4e3888a15c22a89161a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.179644 17228 tablet_server.cc:196] TabletServer@127.16.211.3:0 shutdown complete.
I20260709 13:21:38.192814 17228 master.cc:562] Master@127.16.211.62:39701 shutting down...
I20260709 13:21:38.209995 17228 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.210601 17228 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.210947 17228 tablet_replica.cc:333] T 00000000000000000000000000000000 P 288bb6ce0c8f4895a531d082cdf961fb: stopping tablet replica
I20260709 13:21:38.231503 17228 master.cc:584] Master@127.16.211.62:39701 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2539 ms)
[----------] 6 tests from LeaderRebalancerTest (309532 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:21:38.262188 17228 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.211.62:34433
I20260709 13:21:38.263347 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:38.269006 27800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:38.271592 27801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:38.271749 27803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:38.272221 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:38.273162 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:38.273376 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:38.273535 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603298273520 us; error 0 us; skew 500 ppm
I20260709 13:21:38.274269 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:38.276610 17228 webserver.cc:533] Webserver started at http://127.16.211.62:39687/ using document root <none> and password file <none>
I20260709 13:21:38.277112 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:38.277314 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:38.277571 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:38.278728 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/master-0-root/instance:
uuid: "b9273b06274e482ca25a599f10cec7eb"
format_stamp: "Formatted at 2026-07-09 13:21:38 on dist-test-slave-96c3"
I20260709 13:21:38.283667 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:21:38.287623 27808 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.288648 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:21:38.289011 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/master-0-root
uuid: "b9273b06274e482ca25a599f10cec7eb"
format_stamp: "Formatted at 2026-07-09 13:21:38 on dist-test-slave-96c3"
I20260709 13:21:38.289316 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:38.303172 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:38.304242 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:38.343276 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.62:34433
I20260709 13:21:38.343365 27859 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.62:34433 every 8 connection(s)
I20260709 13:21:38.347237 27860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.358296 27860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb: Bootstrap starting.
I20260709 13:21:38.362699 27860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:38.366760 27860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb: No bootstrap required, opened a new log
I20260709 13:21:38.368837 27860 raft_consensus.cc:359] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9273b06274e482ca25a599f10cec7eb" member_type: VOTER }
I20260709 13:21:38.369238 27860 raft_consensus.cc:385] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:38.369486 27860 raft_consensus.cc:740] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9273b06274e482ca25a599f10cec7eb, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.370146 27860 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9273b06274e482ca25a599f10cec7eb" member_type: VOTER }
I20260709 13:21:38.370610 27860 raft_consensus.cc:399] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:38.370827 27860 raft_consensus.cc:493] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:38.371090 27860 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:38.376116 27860 raft_consensus.cc:515] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9273b06274e482ca25a599f10cec7eb" member_type: VOTER }
I20260709 13:21:38.376688 27860 leader_election.cc:304] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b9273b06274e482ca25a599f10cec7eb; no voters: 
I20260709 13:21:38.377823 27860 leader_election.cc:290] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:38.378226 27863 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:38.379602 27863 raft_consensus.cc:697] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [term 1 LEADER]: Becoming Leader. State: Replica: b9273b06274e482ca25a599f10cec7eb, State: Running, Role: LEADER
I20260709 13:21:38.380339 27863 consensus_queue.cc:237] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9273b06274e482ca25a599f10cec7eb" member_type: VOTER }
I20260709 13:21:38.380904 27860 sys_catalog.cc:565] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:38.383208 27864 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b9273b06274e482ca25a599f10cec7eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9273b06274e482ca25a599f10cec7eb" member_type: VOTER } }
I20260709 13:21:38.383962 27864 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:38.383219 27865 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9273b06274e482ca25a599f10cec7eb. Latest consensus state: current_term: 1 leader_uuid: "b9273b06274e482ca25a599f10cec7eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9273b06274e482ca25a599f10cec7eb" member_type: VOTER } }
I20260709 13:21:38.384980 27865 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:38.389317 27868 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:38.394174 27868 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:38.396658 17228 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:38.403174 27868 catalog_manager.cc:1383] Generated new cluster ID: 55b256f20b5e4ee69049022745252ec1
I20260709 13:21:38.403486 27868 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:38.417124 27868 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:38.418495 27868 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:38.433102 27868 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb: Generated new TSK 0
I20260709 13:21:38.433734 27868 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:38.463238 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:38.469231 27881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:38.470242 27882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:38.472427 17228 server_base.cc:1061] running on GCE node
W20260709 13:21:38.472716 27884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:38.473822 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:38.474098 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:38.474282 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603298474265 us; error 0 us; skew 500 ppm
I20260709 13:21:38.474876 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:38.477222 17228 webserver.cc:533] Webserver started at http://127.16.211.1:40345/ using document root <none> and password file <none>
I20260709 13:21:38.477730 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:38.477926 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:38.478258 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:38.479363 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-0-root/instance:
uuid: "523d4bfd13fa41c78693e670e7919bd5"
format_stamp: "Formatted at 2026-07-09 13:21:38 on dist-test-slave-96c3"
I20260709 13:21:38.484395 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:38.488065 27889 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.488950 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:38.489359 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-0-root
uuid: "523d4bfd13fa41c78693e670e7919bd5"
format_stamp: "Formatted at 2026-07-09 13:21:38 on dist-test-slave-96c3"
I20260709 13:21:38.489668 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:38.503204 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:38.504364 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:38.505793 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:38.508183 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:38.508410 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.508659 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:38.508834 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.550066 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.1:35235
I20260709 13:21:38.550203 27951 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.1:35235 every 8 connection(s)
I20260709 13:21:38.555104 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:38.563588 27956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:38.564913 27957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:38.567422 27959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:38.568162 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:38.569769 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:38.570062 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:38.570271 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603298570251 us; error 0 us; skew 500 ppm
I20260709 13:21:38.570724 27952 heartbeater.cc:344] Connected to a master server at 127.16.211.62:34433
I20260709 13:21:38.570990 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:38.571164 27952 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:38.572206 27952 heartbeater.cc:507] Master 127.16.211.62:34433 requested a full tablet report, sending...
I20260709 13:21:38.574332 17228 webserver.cc:533] Webserver started at http://127.16.211.2:45989/ using document root <none> and password file <none>
I20260709 13:21:38.574852 27825 ts_manager.cc:194] Registered new tserver with Master: 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235)
I20260709 13:21:38.575057 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:38.575363 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:38.575685 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:38.577140 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-1-root/instance:
uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
format_stamp: "Formatted at 2026-07-09 13:21:38 on dist-test-slave-96c3"
I20260709 13:21:38.577296 27825 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56204
I20260709 13:21:38.584293 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.002s
I20260709 13:21:38.588732 27964 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.589617 17228 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:21:38.590095 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-1-root
uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
format_stamp: "Formatted at 2026-07-09 13:21:38 on dist-test-slave-96c3"
I20260709 13:21:38.590442 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:38.603633 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:38.604709 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:38.606178 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:38.608387 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:38.608619 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.608862 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:38.609045 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.650748 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.2:42797
I20260709 13:21:38.650867 28027 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.2:42797 every 8 connection(s)
I20260709 13:21:38.655862 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:38.663214 28031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:38.664776 28032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:38.666879 17228 server_base.cc:1061] running on GCE node
W20260709 13:21:38.667621 28034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:38.668605 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:38.668848 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:38.669046 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603298669028 us; error 0 us; skew 500 ppm
I20260709 13:21:38.669188 28028 heartbeater.cc:344] Connected to a master server at 127.16.211.62:34433
I20260709 13:21:38.669627 28028 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:38.669847 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:38.670571 28028 heartbeater.cc:507] Master 127.16.211.62:34433 requested a full tablet report, sending...
I20260709 13:21:38.672724 17228 webserver.cc:533] Webserver started at http://127.16.211.3:41725/ using document root <none> and password file <none>
I20260709 13:21:38.673071 27825 ts_manager.cc:194] Registered new tserver with Master: da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:38.673271 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:38.673633 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:38.673985 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:38.674695 27825 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56216
I20260709 13:21:38.675148 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-2-root/instance:
uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
format_stamp: "Formatted at 2026-07-09 13:21:38 on dist-test-slave-96c3"
I20260709 13:21:38.680140 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:38.684059 28039 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.684897 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:38.685156 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-2-root
uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
format_stamp: "Formatted at 2026-07-09 13:21:38 on dist-test-slave-96c3"
I20260709 13:21:38.685429 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602988568269-17228-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:38.697446 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:38.698516 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:38.699935 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:38.702375 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:38.702555 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.702860 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:38.703002 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:38.742273 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.3:40625
I20260709 13:21:38.742450 28101 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.3:40625 every 8 connection(s)
I20260709 13:21:38.756117 28102 heartbeater.cc:344] Connected to a master server at 127.16.211.62:34433
I20260709 13:21:38.756590 28102 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:38.757299 28102 heartbeater.cc:507] Master 127.16.211.62:34433 requested a full tablet report, sending...
I20260709 13:21:38.759203 27825 ts_manager.cc:194] Registered new tserver with Master: 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:38.759785 17228 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013796025s
I20260709 13:21:38.760697 27825 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56218
I20260709 13:21:38.785250 27825 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56228:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:38.787938 27825 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:38.909981 28067 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0b89dd50814f41998d31e52b1abc34 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:38.912343 28067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0b89dd50814f41998d31e52b1abc34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.915335 28066 tablet_service.cc:1511] Processing CreateTablet for tablet aac2bab3b09549f59154d01a18d812f3 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:38.917007 28066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac2bab3b09549f59154d01a18d812f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.916712 27917 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0b89dd50814f41998d31e52b1abc34 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:38.918356 27917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0b89dd50814f41998d31e52b1abc34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.919269 28065 tablet_service.cc:1511] Processing CreateTablet for tablet b757cffb0fe44b94af9cee6d46ada58a (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:38.920861 28065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b757cffb0fe44b94af9cee6d46ada58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.923334 28064 tablet_service.cc:1511] Processing CreateTablet for tablet 3dd3361a0c254f75aad14e00ef207660 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:38.924969 28064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dd3361a0c254f75aad14e00ef207660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.927834 28063 tablet_service.cc:1511] Processing CreateTablet for tablet 23fbb2d99216479a9dfe735d0d347e49 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:38.929318 28063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23fbb2d99216479a9dfe735d0d347e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.935918 28062 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6c916e6ebe4597ac8ded882e7d6812 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:38.937671 28062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6c916e6ebe4597ac8ded882e7d6812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.938881 28061 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0fe1cb57654d61b395f64563344da7 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:38.940388 28061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0fe1cb57654d61b395f64563344da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.944169 27916 tablet_service.cc:1511] Processing CreateTablet for tablet aac2bab3b09549f59154d01a18d812f3 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:38.945803 27916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac2bab3b09549f59154d01a18d812f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.952227 27915 tablet_service.cc:1511] Processing CreateTablet for tablet b757cffb0fe44b94af9cee6d46ada58a (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:38.953796 27915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b757cffb0fe44b94af9cee6d46ada58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.954316 28060 tablet_service.cc:1511] Processing CreateTablet for tablet 1429996568da4007a81b14fdef35f952 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:38.955724 28060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1429996568da4007a81b14fdef35f952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.963917 27914 tablet_service.cc:1511] Processing CreateTablet for tablet 3dd3361a0c254f75aad14e00ef207660 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:38.965467 27914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dd3361a0c254f75aad14e00ef207660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.975939 27913 tablet_service.cc:1511] Processing CreateTablet for tablet 23fbb2d99216479a9dfe735d0d347e49 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:38.977497 27913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23fbb2d99216479a9dfe735d0d347e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.979372 28067 tablet_service.cc:1511] Processing CreateTablet for tablet 7d594e25aaf04d41ba68d5abb14f73c3 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:38.982657 28067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d594e25aaf04d41ba68d5abb14f73c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:38.988315 27912 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6c916e6ebe4597ac8ded882e7d6812 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:38.989755 27912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6c916e6ebe4597ac8ded882e7d6812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:39.008903 27911 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0fe1cb57654d61b395f64563344da7 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:39.010635 27911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0fe1cb57654d61b395f64563344da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:39.011813 27910 tablet_service.cc:1511] Processing CreateTablet for tablet 1429996568da4007a81b14fdef35f952 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:39.013818 27910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1429996568da4007a81b14fdef35f952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:39.021088 27917 tablet_service.cc:1511] Processing CreateTablet for tablet 7d594e25aaf04d41ba68d5abb14f73c3 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:39.023339 28118 tablet_bootstrap.cc:492] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:39.035002 27992 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0b89dd50814f41998d31e52b1abc34 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:39.043767 27991 tablet_service.cc:1511] Processing CreateTablet for tablet aac2bab3b09549f59154d01a18d812f3 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:39.047557 27991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac2bab3b09549f59154d01a18d812f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:39.047634 27990 tablet_service.cc:1511] Processing CreateTablet for tablet b757cffb0fe44b94af9cee6d46ada58a (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:39.049099 27990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b757cffb0fe44b94af9cee6d46ada58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:39.050755 27992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0b89dd50814f41998d31e52b1abc34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:39.061846 28119 tablet_bootstrap.cc:492] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:39.063311 27989 tablet_service.cc:1511] Processing CreateTablet for tablet 3dd3361a0c254f75aad14e00ef207660 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:39.064848 27989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dd3361a0c254f75aad14e00ef207660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:39.067240 27988 tablet_service.cc:1511] Processing CreateTablet for tablet 23fbb2d99216479a9dfe735d0d347e49 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:39.068701 27988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23fbb2d99216479a9dfe735d0d347e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:39.072096 27986 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0fe1cb57654d61b395f64563344da7 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:39.072449 27985 tablet_service.cc:1511] Processing CreateTablet for tablet 1429996568da4007a81b14fdef35f952 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:39.072642 27987 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6c916e6ebe4597ac8ded882e7d6812 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:39.073385 27984 tablet_service.cc:1511] Processing CreateTablet for tablet 7d594e25aaf04d41ba68d5abb14f73c3 (DEFAULT_TABLE table=test-workload [id=34ad8af6bf8b47bebefc5d13a73d87c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:39.073801 27986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0fe1cb57654d61b395f64563344da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:39.074652 27985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1429996568da4007a81b14fdef35f952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:39.075244 27987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6c916e6ebe4597ac8ded882e7d6812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:39.076061 27984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d594e25aaf04d41ba68d5abb14f73c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:39.082764 28118 tablet_bootstrap.cc:654] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.086513 27917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d594e25aaf04d41ba68d5abb14f73c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:39.106071 28119 tablet_bootstrap.cc:654] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.118659 28120 tablet_bootstrap.cc:492] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:39.121197 28118 tablet_bootstrap.cc:492] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:39.121884 28118 ts_tablet_manager.cc:1403] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.007s
I20260709 13:21:39.125480 28118 raft_consensus.cc:359] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.126668 28118 raft_consensus.cc:385] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.127039 28118 raft_consensus.cc:740] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.127971 28118 consensus_queue.cc:260] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.135638 28118 ts_tablet_manager.cc:1434] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.009s
I20260709 13:21:39.135519 28102 heartbeater.cc:499] Master 127.16.211.62:34433 was elected leader, sending a full tablet report...
I20260709 13:21:39.136647 28118 tablet_bootstrap.cc:492] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:39.138079 28120 tablet_bootstrap.cc:654] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.142661 28119 tablet_bootstrap.cc:492] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:39.143208 28119 ts_tablet_manager.cc:1403] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.005s
I20260709 13:21:39.143405 28118 tablet_bootstrap.cc:654] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.144672 28120 tablet_bootstrap.cc:492] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:39.145218 28120 ts_tablet_manager.cc:1403] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.007s
I20260709 13:21:39.146726 28119 raft_consensus.cc:359] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.147579 28119 raft_consensus.cc:385] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.147876 28119 raft_consensus.cc:740] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.148429 28118 tablet_bootstrap.cc:492] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:39.148432 28120 raft_consensus.cc:359] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.149112 28118 ts_tablet_manager.cc:1403] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:21:39.148716 28119 consensus_queue.cc:260] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.149367 28120 raft_consensus.cc:385] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.149693 28120 raft_consensus.cc:740] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.150900 28120 consensus_queue.cc:260] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.152549 28118 raft_consensus.cc:359] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } } peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } }
I20260709 13:21:39.153373 28118 raft_consensus.cc:385] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.153707 28118 raft_consensus.cc:740] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.154546 28118 consensus_queue.cc:260] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } } peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } }
I20260709 13:21:39.156930 28118 ts_tablet_manager.cc:1434] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:21:39.158026 28118 tablet_bootstrap.cc:492] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:39.158046 28123 raft_consensus.cc:493] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.158914 28123 raft_consensus.cc:515] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } } peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } }
I20260709 13:21:39.161075 28120 ts_tablet_manager.cc:1434] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.012s
I20260709 13:21:39.162139 28028 heartbeater.cc:499] Master 127.16.211.62:34433 was elected leader, sending a full tablet report...
I20260709 13:21:39.166358 28118 tablet_bootstrap.cc:654] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.166949 28123 leader_election.cc:290] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:39.172309 28119 ts_tablet_manager.cc:1434] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.008s
I20260709 13:21:39.180258 27952 heartbeater.cc:499] Master 127.16.211.62:34433 was elected leader, sending a full tablet report...
I20260709 13:21:39.181460 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0b89dd50814f41998d31e52b1abc34" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
W20260709 13:21:39.185346 28040 leader_election.cc:343] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.185837 28119 tablet_bootstrap.cc:492] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:39.186749 28120 tablet_bootstrap.cc:492] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:39.194238 28119 tablet_bootstrap.cc:654] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.202346 28120 tablet_bootstrap.cc:654] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.206156 28119 tablet_bootstrap.cc:492] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:39.206696 28119 ts_tablet_manager.cc:1403] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.013s
I20260709 13:21:39.210682 28002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0b89dd50814f41998d31e52b1abc34" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:39.211400 28119 raft_consensus.cc:359] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } } peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } }
I20260709 13:21:39.212489 28119 raft_consensus.cc:385] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:39.212560 28040 leader_election.cc:343] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.213014 28119 raft_consensus.cc:740] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.213218 28040 leader_election.cc:304] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:39.214233 28123 raft_consensus.cc:2749] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:39.215503 28119 consensus_queue.cc:260] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } } peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } }
I20260709 13:21:39.216892 28118 tablet_bootstrap.cc:492] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:39.217429 28118 ts_tablet_manager.cc:1403] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.034s
I20260709 13:21:39.219035 28119 ts_tablet_manager.cc:1434] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:21:39.220489 28119 tablet_bootstrap.cc:492] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:39.220662 28118 raft_consensus.cc:359] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.221535 28118 raft_consensus.cc:385] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.221830 28118 raft_consensus.cc:740] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.222687 28118 consensus_queue.cc:260] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.225136 28118 ts_tablet_manager.cc:1434] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:39.226251 28118 tablet_bootstrap.cc:492] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:39.230541 28120 tablet_bootstrap.cc:492] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:39.231192 28120 ts_tablet_manager.cc:1403] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.017s
I20260709 13:21:39.233208 28118 tablet_bootstrap.cc:654] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.233819 28119 tablet_bootstrap.cc:654] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.234551 28120 raft_consensus.cc:359] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.235410 28120 raft_consensus.cc:385] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.235746 28120 raft_consensus.cc:740] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.236721 28120 consensus_queue.cc:260] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.240166 28120 ts_tablet_manager.cc:1434] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:39.241504 28120 tablet_bootstrap.cc:492] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:39.245254 28118 tablet_bootstrap.cc:492] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:39.245638 28119 tablet_bootstrap.cc:492] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:39.245867 28118 ts_tablet_manager.cc:1403] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:21:39.246290 28119 ts_tablet_manager.cc:1403] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.006s
I20260709 13:21:39.248997 28120 tablet_bootstrap.cc:654] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.249617 28119 raft_consensus.cc:359] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.250476 28119 raft_consensus.cc:385] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.250770 28119 raft_consensus.cc:740] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.250864 28118 raft_consensus.cc:359] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.251639 28118 raft_consensus.cc:385] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.252043 28118 raft_consensus.cc:740] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.251582 28119 consensus_queue.cc:260] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.252763 28118 consensus_queue.cc:260] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.254359 28119 ts_tablet_manager.cc:1434] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:39.255494 28118 ts_tablet_manager.cc:1434] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:21:39.258821 28119 tablet_bootstrap.cc:492] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:39.259025 28118 tablet_bootstrap.cc:492] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:39.264333 28120 tablet_bootstrap.cc:492] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:39.264974 28120 ts_tablet_manager.cc:1403] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.002s
I20260709 13:21:39.266722 28118 tablet_bootstrap.cc:654] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.266739 28119 tablet_bootstrap.cc:654] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.268115 28120 raft_consensus.cc:359] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.268947 28120 raft_consensus.cc:385] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.269248 28120 raft_consensus.cc:740] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.270435 28120 consensus_queue.cc:260] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.273850 28120 ts_tablet_manager.cc:1434] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:21:39.275241 28120 tablet_bootstrap.cc:492] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:39.283941 28118 tablet_bootstrap.cc:492] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:39.284377 28120 tablet_bootstrap.cc:654] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.284561 28118 ts_tablet_manager.cc:1403] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.009s
I20260709 13:21:39.288076 28118 raft_consensus.cc:359] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.288745 28119 tablet_bootstrap.cc:492] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:39.288964 28118 raft_consensus.cc:385] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.289453 28119 ts_tablet_manager.cc:1403] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.006s
I20260709 13:21:39.289474 28118 raft_consensus.cc:740] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.291224 28118 consensus_queue.cc:260] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.292727 28119 raft_consensus.cc:359] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.293498 28119 raft_consensus.cc:385] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.293777 28119 raft_consensus.cc:740] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.294917 28118 ts_tablet_manager.cc:1434] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.001s
I20260709 13:21:39.294731 28119 consensus_queue.cc:260] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.296082 28118 tablet_bootstrap.cc:492] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:39.297607 28120 tablet_bootstrap.cc:492] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:39.298218 28120 ts_tablet_manager.cc:1403] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 13:21:39.300033 28119 ts_tablet_manager.cc:1434] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:39.301236 28119 tablet_bootstrap.cc:492] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:39.301506 28120 raft_consensus.cc:359] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.302511 28120 raft_consensus.cc:385] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.302785 28120 raft_consensus.cc:740] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.303673 28120 consensus_queue.cc:260] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.304137 28118 tablet_bootstrap.cc:654] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.308065 28120 ts_tablet_manager.cc:1434] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:21:39.309202 28120 tablet_bootstrap.cc:492] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:39.315291 28119 tablet_bootstrap.cc:654] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.317888 28118 tablet_bootstrap.cc:492] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:39.318058 28127 raft_consensus.cc:493] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.318584 28118 ts_tablet_manager.cc:1403] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 13:21:39.318619 28127 raft_consensus.cc:515] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.322157 28118 raft_consensus.cc:359] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.322937 28118 raft_consensus.cc:385] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.323244 28118 raft_consensus.cc:740] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.324445 28127 leader_election.cc:290] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:39.324309 28118 consensus_queue.cc:260] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.331225 28120 tablet_bootstrap.cc:654] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.332425 28118 ts_tablet_manager.cc:1434] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:21:39.333635 28118 tablet_bootstrap.cc:492] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:39.344630 28119 tablet_bootstrap.cc:492] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:39.345237 28119 ts_tablet_manager.cc:1403] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.044s	user 0.023s	sys 0.011s
I20260709 13:21:39.346971 28118 tablet_bootstrap.cc:654] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.348609 28119 raft_consensus.cc:359] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.349452 28119 raft_consensus.cc:385] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.349776 28119 raft_consensus.cc:740] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.351598 28119 consensus_queue.cc:260] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.356863 28119 ts_tablet_manager.cc:1434] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:21:39.358143 28119 tablet_bootstrap.cc:492] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:39.358886 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1429996568da4007a81b14fdef35f952" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:39.360209 28127 raft_consensus.cc:493] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.360895 28127 raft_consensus.cc:515] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.363590 28127 leader_election.cc:290] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:39.365185 28119 tablet_bootstrap.cc:654] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.365228 28126 raft_consensus.cc:493] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:39.365470 27965 leader_election.cc:343] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.365953 28126 raft_consensus.cc:515] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.367349 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac2bab3b09549f59154d01a18d812f3" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:39.368185 27927 raft_consensus.cc:2468] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 0.
I20260709 13:21:39.370376 27965 leader_election.cc:304] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:39.371423 28126 leader_election.cc:290] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:39.372093 28127 raft_consensus.cc:2804] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.372664 28127 raft_consensus.cc:493] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.373171 28127 raft_consensus.cc:3060] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.386511 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac2bab3b09549f59154d01a18d812f3" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:39.387737 28123 raft_consensus.cc:493] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.388435 28123 raft_consensus.cc:515] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.385883 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1429996568da4007a81b14fdef35f952" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
W20260709 13:21:39.391996 27873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:21:39.392117 27966 leader_election.cc:343] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.387753 28076 raft_consensus.cc:2468] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 0.
I20260709 13:21:39.393998 28118 tablet_bootstrap.cc:492] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:39.392716 27966 leader_election.cc:304] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b
I20260709 13:21:39.394742 28118 ts_tablet_manager.cc:1403] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.061s	user 0.027s	sys 0.005s
I20260709 13:21:39.396003 28148 raft_consensus.cc:2749] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:39.397765 28123 leader_election.cc:290] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:39.398727 28118 raft_consensus.cc:359] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.399619 28118 raft_consensus.cc:385] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.400030 28118 raft_consensus.cc:740] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.401329 28126 raft_consensus.cc:493] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.401067 28118 consensus_queue.cc:260] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.402034 28126 raft_consensus.cc:515] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } } peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } }
I20260709 13:21:39.403838 28118 ts_tablet_manager.cc:1434] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:39.404240 28126 leader_election.cc:290] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:39.404484 28120 tablet_bootstrap.cc:492] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:39.404973 28120 ts_tablet_manager.cc:1403] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.096s	user 0.022s	sys 0.022s
I20260709 13:21:39.406143 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d594e25aaf04d41ba68d5abb14f73c3" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
W20260709 13:21:39.407552 28040 leader_election.cc:343] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.408547 28002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d594e25aaf04d41ba68d5abb14f73c3" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:39.408243 28120 raft_consensus.cc:359] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.409169 28120 raft_consensus.cc:385] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.409557 28120 raft_consensus.cc:740] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.410467 28126 raft_consensus.cc:493] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.410523 28120 consensus_queue.cc:260] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.411809 28002 raft_consensus.cc:2468] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:39.412773 28148 raft_consensus.cc:493] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.413425 28148 raft_consensus.cc:515] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.416188 28148 leader_election.cc:290] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:39.411156 28126 raft_consensus.cc:515] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.418785 28126 leader_election.cc:290] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:39.419567 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c916e6ebe4597ac8ded882e7d6812" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:39.422909 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c916e6ebe4597ac8ded882e7d6812" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:39.423465 28076 raft_consensus.cc:2468] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 0.
I20260709 13:21:39.423635 27927 raft_consensus.cc:2468] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 0.
I20260709 13:21:39.424576 28126 raft_consensus.cc:493] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.421986 28040 leader_election.cc:304] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d5fd999cbc342118c1d3dc8068bd99b, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 523d4bfd13fa41c78693e670e7919bd5
I20260709 13:21:39.424113 28120 ts_tablet_manager.cc:1434] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:21:39.420069 28118 tablet_bootstrap.cc:492] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:39.425828 28126 raft_consensus.cc:515] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.426071 28123 raft_consensus.cc:2804] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.427837 28123 raft_consensus.cc:493] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.428268 28123 raft_consensus.cc:3060] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.429632 28120 tablet_bootstrap.cc:492] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:39.424988 27965 leader_election.cc:304] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:39.434096 28148 raft_consensus.cc:2804] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.434516 28148 raft_consensus.cc:493] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.434831 28148 raft_consensus.cc:3060] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.435212 28118 tablet_bootstrap.cc:654] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.438943 28126 leader_election.cc:290] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:39.442209 28119 tablet_bootstrap.cc:492] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:39.442855 28119 ts_tablet_manager.cc:1403] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.009s
I20260709 13:21:39.443048 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0b89dd50814f41998d31e52b1abc34" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:39.446381 28119 raft_consensus.cc:359] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.447796 28000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd3361a0c254f75aad14e00ef207660" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:39.448890 28119 raft_consensus.cc:385] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.449275 28119 raft_consensus.cc:740] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.385102 28127 raft_consensus.cc:515] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.448884 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c916e6ebe4597ac8ded882e7d6812" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:39.451637 28002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fbb2d99216479a9dfe735d0d347e49" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:39.452272 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac2bab3b09549f59154d01a18d812f3" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:39.453133 28119 consensus_queue.cc:260] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.455565 28120 tablet_bootstrap.cc:654] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.453603 27927 raft_consensus.cc:3060] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:39.452795 27890 leader_election.cc:343] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:39.474385 27890 leader_election.cc:343] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:39.475055 27890 leader_election.cc:343] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.455582 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac2bab3b09549f59154d01a18d812f3" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:39.448113 28123 raft_consensus.cc:515] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.475821 28076 raft_consensus.cc:3060] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.479043 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d594e25aaf04d41ba68d5abb14f73c3" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
W20260709 13:21:39.481014 28040 leader_election.cc:343] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.461808 28127 leader_election.cc:290] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:39.468140 28119 ts_tablet_manager.cc:1434] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
I20260709 13:21:39.469614 28075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0b89dd50814f41998d31e52b1abc34" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:39.482725 28075 raft_consensus.cc:2468] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 0.
I20260709 13:21:39.470602 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fbb2d99216479a9dfe735d0d347e49" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:39.471853 28074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd3361a0c254f75aad14e00ef207660" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:39.484236 28151 raft_consensus.cc:493] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.483901 28077 raft_consensus.cc:2468] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 0.
I20260709 13:21:39.473074 28073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c916e6ebe4597ac8ded882e7d6812" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:39.443143 28148 raft_consensus.cc:515] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.482012 27927 raft_consensus.cc:2468] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 1.
I20260709 13:21:39.483788 28002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d594e25aaf04d41ba68d5abb14f73c3" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:39.484521 28074 raft_consensus.cc:2468] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 0.
I20260709 13:21:39.486331 28002 raft_consensus.cc:3060] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.484877 28151 raft_consensus.cc:515] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.485342 28073 raft_consensus.cc:2468] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 0.
I20260709 13:21:39.487185 28001 raft_consensus.cc:2393] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 523d4bfd13fa41c78693e670e7919bd5 in current term 1: Already voted for candidate da9ab0ed7bc14bbf938be2cffaaf778e in this term.
I20260709 13:21:39.488960 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c916e6ebe4597ac8ded882e7d6812" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:39.488998 28151 leader_election.cc:290] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:39.485006 27891 leader_election.cc:304] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:39.491972 27891 leader_election.cc:304] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:39.492765 27925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b757cffb0fe44b94af9cee6d46ada58a" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:39.494364 28126 raft_consensus.cc:2804] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.494822 28126 raft_consensus.cc:493] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.495170 28126 raft_consensus.cc:3060] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.494445 27965 leader_election.cc:304] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:39.493872 27925 raft_consensus.cc:2468] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:39.498332 28149 raft_consensus.cc:2804] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.498725 28149 raft_consensus.cc:493] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.498687 28040 leader_election.cc:304] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:39.499500 28149 raft_consensus.cc:3060] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.500077 28151 raft_consensus.cc:2804] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.500428 28151 raft_consensus.cc:493] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.501044 28151 raft_consensus.cc:3060] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.489822 27926 raft_consensus.cc:3060] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.498023 28002 raft_consensus.cc:2468] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 1.
I20260709 13:21:39.500392 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b757cffb0fe44b94af9cee6d46ada58a" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:39.504776 28001 raft_consensus.cc:2468] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:39.493779 27891 leader_election.cc:304] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:39.506230 28040 leader_election.cc:304] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d5fd999cbc342118c1d3dc8068bd99b, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 523d4bfd13fa41c78693e670e7919bd5
I20260709 13:21:39.506844 28127 raft_consensus.cc:2804] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.509428 28120 tablet_bootstrap.cc:492] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:39.510252 28120 ts_tablet_manager.cc:1403] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.013s
I20260709 13:21:39.511107 28127 raft_consensus.cc:697] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Becoming Leader. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Running, Role: LEADER
I20260709 13:21:39.509510 28151 raft_consensus.cc:515] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.512158 28127 consensus_queue.cc:237] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.514062 28123 leader_election.cc:290] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:39.514406 28151 leader_election.cc:290] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:39.514868 28123 raft_consensus.cc:2804] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.513845 28120 raft_consensus.cc:359] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.516855 28123 raft_consensus.cc:697] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Becoming Leader. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:39.518090 28123 consensus_queue.cc:237] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.520102 28149 raft_consensus.cc:515] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.515280 28119 tablet_bootstrap.cc:492] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:39.524673 28076 raft_consensus.cc:2468] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 1.
I20260709 13:21:39.515717 27926 raft_consensus.cc:2468] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 1.
I20260709 13:21:39.526216 27965 leader_election.cc:304] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:39.507798 28148 leader_election.cc:290] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:39.527271 28155 raft_consensus.cc:2804] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.527930 28155 raft_consensus.cc:697] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Becoming Leader. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Running, Role: LEADER
I20260709 13:21:39.528919 28155 consensus_queue.cc:237] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.529902 28126 raft_consensus.cc:515] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } } peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } }
I20260709 13:21:39.516894 28120 raft_consensus.cc:385] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.530987 28120 raft_consensus.cc:740] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.531832 28120 consensus_queue.cc:260] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.532968 28119 tablet_bootstrap.cc:654] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.534669 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0b89dd50814f41998d31e52b1abc34" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:39.534246 27823 catalog_manager.cc:5697] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3). New cstate: current_term: 1 leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:39.536378 28149 leader_election.cc:290] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Requested vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
W20260709 13:21:39.536736 27890 leader_election.cc:343] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.550635 27825 catalog_manager.cc:5697] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e reported cstate change: term changed from 0 to 1, leader changed from <none> to da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2). New cstate: current_term: 1 leader_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:39.537649 27891 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.3:40625, user_credentials={real_user=slave}} blocked reactor thread for 44016.5us
I20260709 13:21:39.554667 27891 leader_election.cc:304] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:39.555830 28149 raft_consensus.cc:2764] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:21:39.561299 28073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0b89dd50814f41998d31e52b1abc34" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:39.562155 28073 raft_consensus.cc:3060] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.532148 28126 leader_election.cc:290] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Requested vote from peers 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:39.538074 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fbb2d99216479a9dfe735d0d347e49" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:39.540411 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b757cffb0fe44b94af9cee6d46ada58a" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:39.567355 27926 raft_consensus.cc:3060] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.542294 28002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b757cffb0fe44b94af9cee6d46ada58a" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:39.543162 28120 ts_tablet_manager.cc:1434] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.005s
I20260709 13:21:39.568493 28002 raft_consensus.cc:3060] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.569466 28120 tablet_bootstrap.cc:492] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:39.568516 28074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fbb2d99216479a9dfe735d0d347e49" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:39.570619 28074 raft_consensus.cc:3060] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.573206 27926 raft_consensus.cc:2468] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 1.
W20260709 13:21:39.574177 27890 leader_election.cc:343] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.574476 28040 leader_election.cc:304] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:39.575554 28154 raft_consensus.cc:2804] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.576102 28154 raft_consensus.cc:697] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Becoming Leader. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:39.577044 28154 consensus_queue.cc:237] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.543881 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e6c916e6ebe4597ac8ded882e7d6812" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:39.545571 28118 tablet_bootstrap.cc:492] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:39.546581 28153 raft_consensus.cc:2804] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.578127 28120 tablet_bootstrap.cc:654] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.578337 28153 raft_consensus.cc:493] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.578719 28153 raft_consensus.cc:3060] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.578177 28118 ts_tablet_manager.cc:1403] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.159s	user 0.037s	sys 0.029s
I20260709 13:21:39.581974 27825 catalog_manager.cc:5697] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e reported cstate change: term changed from 0 to 1, leader changed from <none> to da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2). New cstate: current_term: 1 leader_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.585035 28118 raft_consensus.cc:359] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.586858 28073 raft_consensus.cc:2468] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 1.
I20260709 13:21:39.588289 27891 leader_election.cc:304] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:39.589501 28126 raft_consensus.cc:2804] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.585718 28118 raft_consensus.cc:385] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.589987 28126 raft_consensus.cc:697] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Becoming Leader. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:39.590045 28118 raft_consensus.cc:740] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.590912 28126 consensus_queue.cc:237] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } } peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } }
I20260709 13:21:39.591823 28076 raft_consensus.cc:3060] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.591042 28118 consensus_queue.cc:260] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.596808 28118 ts_tablet_manager.cc:1434] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:21:39.597848 28118 tablet_bootstrap.cc:492] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:39.607498 28118 tablet_bootstrap.cc:654] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.610867 28127 raft_consensus.cc:493] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.611614 28127 raft_consensus.cc:515] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.612439 28153 raft_consensus.cc:515] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.615271 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0fe1cb57654d61b395f64563344da7" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:39.615733 28119 tablet_bootstrap.cc:492] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:39.615904 28073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0fe1cb57654d61b395f64563344da7" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:39.616410 28119 ts_tablet_manager.cc:1403] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.019s
W20260709 13:21:39.616899 27965 leader_election.cc:343] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.617063 28127 leader_election.cc:290] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:39.616952 28073 raft_consensus.cc:2468] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 0.
I20260709 13:21:39.619189 27966 leader_election.cc:304] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d5fd999cbc342118c1d3dc8068bd99b, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 523d4bfd13fa41c78693e670e7919bd5
I20260709 13:21:39.620577 28074 raft_consensus.cc:2468] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 1.
I20260709 13:21:39.620801 28127 raft_consensus.cc:2804] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.621589 28127 raft_consensus.cc:493] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.622141 28127 raft_consensus.cc:3060] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.622385 27891 leader_election.cc:304] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:39.605549 28002 raft_consensus.cc:2468] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 1.
I20260709 13:21:39.628173 28076 raft_consensus.cc:2468] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 1.
I20260709 13:21:39.631333 28153 leader_election.cc:290] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Requested vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:39.632102 28002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd3361a0c254f75aad14e00ef207660" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
W20260709 13:21:39.633595 27890 leader_election.cc:343] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.637290 28127 raft_consensus.cc:515] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.641485 28120 tablet_bootstrap.cc:492] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:39.641593 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0fe1cb57654d61b395f64563344da7" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:39.642484 28120 ts_tablet_manager.cc:1403] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.019s
W20260709 13:21:39.644034 27965 leader_election.cc:343] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:39.646962 28127 leader_election.cc:290] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:39.648298 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0fe1cb57654d61b395f64563344da7" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:39.649364 28076 raft_consensus.cc:3060] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.651546 27825 catalog_manager.cc:5697] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "523d4bfd13fa41c78693e670e7919bd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.662057 28074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd3361a0c254f75aad14e00ef207660" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:39.663069 28074 raft_consensus.cc:3060] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.664270 28076 raft_consensus.cc:2468] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 1.
I20260709 13:21:39.665887 27966 leader_election.cc:304] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d5fd999cbc342118c1d3dc8068bd99b, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 523d4bfd13fa41c78693e670e7919bd5
I20260709 13:21:39.667068 28153 raft_consensus.cc:2804] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.667392 28127 raft_consensus.cc:2804] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.667876 28153 raft_consensus.cc:697] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Becoming Leader. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:39.668286 28127 raft_consensus.cc:697] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Becoming Leader. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Running, Role: LEADER
I20260709 13:21:39.668931 28153 consensus_queue.cc:237] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.669597 28127 consensus_queue.cc:237] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.675143 28119 raft_consensus.cc:359] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.676282 28119 raft_consensus.cc:385] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.677222 28119 raft_consensus.cc:740] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.678602 28119 consensus_queue.cc:260] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.684648 28118 tablet_bootstrap.cc:492] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:39.686378 28118 ts_tablet_manager.cc:1403] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.089s	user 0.028s	sys 0.040s
I20260709 13:21:39.686796 27825 catalog_manager.cc:5697] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3). New cstate: current_term: 1 leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:39.687984 27822 catalog_manager.cc:5697] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e reported cstate change: term changed from 0 to 1, leader changed from <none> to da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2). New cstate: current_term: 1 leader_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.690265 28120 raft_consensus.cc:359] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.690564 28118 raft_consensus.cc:359] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.691447 28118 raft_consensus.cc:385] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.691761 28118 raft_consensus.cc:740] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.687934 28119 ts_tablet_manager.cc:1434] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 13:21:39.692771 28118 consensus_queue.cc:260] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.695153 28118 ts_tablet_manager.cc:1434] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:21:39.691073 28120 raft_consensus.cc:385] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.696483 28119 tablet_bootstrap.cc:492] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:39.696738 28120 raft_consensus.cc:740] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.697950 28074 raft_consensus.cc:2468] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 1.
I20260709 13:21:39.698369 27823 catalog_manager.cc:5697] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "523d4bfd13fa41c78693e670e7919bd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.700558 27891 leader_election.cc:304] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:39.704262 28119 tablet_bootstrap.cc:654] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.705112 28153 raft_consensus.cc:2804] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.705974 28153 raft_consensus.cc:697] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Becoming Leader. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:39.706874 28153 consensus_queue.cc:237] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.698729 28120 consensus_queue.cc:260] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.711141 28120 ts_tablet_manager.cc:1434] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 13:21:39.712440 28120 tablet_bootstrap.cc:492] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:39.721138 28120 tablet_bootstrap.cc:654] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.729710 28119 tablet_bootstrap.cc:492] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:39.730343 28119 ts_tablet_manager.cc:1403] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.000s
I20260709 13:21:39.732219 28120 tablet_bootstrap.cc:492] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:39.732714 28120 ts_tablet_manager.cc:1403] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:21:39.733285 28119 raft_consensus.cc:359] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.734089 28119 raft_consensus.cc:385] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.734373 28119 raft_consensus.cc:740] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.735067 28120 raft_consensus.cc:359] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } } peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } }
I20260709 13:21:39.735658 28120 raft_consensus.cc:385] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.735091 28119 consensus_queue.cc:260] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.734905 27825 catalog_manager.cc:5697] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "523d4bfd13fa41c78693e670e7919bd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.735932 28120 raft_consensus.cc:740] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.736756 28120 consensus_queue.cc:260] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } } peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } }
I20260709 13:21:39.737473 28119 ts_tablet_manager.cc:1434] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:39.738507 28119 tablet_bootstrap.cc:492] T 7d594e25aaf04d41ba68d5abb14f73c3 P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:39.738647 28120 ts_tablet_manager.cc:1434] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:39.739625 28120 tablet_bootstrap.cc:492] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:39.745236 28119 tablet_bootstrap.cc:654] T 7d594e25aaf04d41ba68d5abb14f73c3 P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.745544 28120 tablet_bootstrap.cc:654] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:39.758646 28119 tablet_bootstrap.cc:492] T 7d594e25aaf04d41ba68d5abb14f73c3 P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:39.759075 28120 tablet_bootstrap.cc:492] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:39.759101 28119 ts_tablet_manager.cc:1403] T 7d594e25aaf04d41ba68d5abb14f73c3 P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:21:39.759608 28120 ts_tablet_manager.cc:1403] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.002s
I20260709 13:21:39.761716 28119 raft_consensus.cc:359] T 7d594e25aaf04d41ba68d5abb14f73c3 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.761967 28120 raft_consensus.cc:359] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.762480 28119 raft_consensus.cc:385] T 7d594e25aaf04d41ba68d5abb14f73c3 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.762633 28120 raft_consensus.cc:385] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:39.762809 28119 raft_consensus.cc:740] T 7d594e25aaf04d41ba68d5abb14f73c3 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.762992 28120 raft_consensus.cc:740] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.763528 28119 consensus_queue.cc:260] T 7d594e25aaf04d41ba68d5abb14f73c3 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.763772 28120 consensus_queue.cc:260] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.765293 28119 ts_tablet_manager.cc:1434] T 7d594e25aaf04d41ba68d5abb14f73c3 P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:39.765810 28120 ts_tablet_manager.cc:1434] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:39.802203 28154 raft_consensus.cc:493] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.802896 28154 raft_consensus.cc:515] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.804631 28154 leader_election.cc:290] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:39.805588 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1429996568da4007a81b14fdef35f952" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:39.805846 28002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1429996568da4007a81b14fdef35f952" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:39.806372 27926 raft_consensus.cc:2468] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:39.806600 28002 raft_consensus.cc:2468] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:39.807420 28040 leader_election.cc:304] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:39.808212 28154 raft_consensus.cc:2804] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:39.808509 28154 raft_consensus.cc:493] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.808772 28154 raft_consensus.cc:3060] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.814427 28154 raft_consensus.cc:515] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.816085 28154 leader_election.cc:290] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:39.817026 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1429996568da4007a81b14fdef35f952" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:39.817376 28002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1429996568da4007a81b14fdef35f952" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:39.817658 27926 raft_consensus.cc:3060] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.818039 28002 raft_consensus.cc:3060] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.823272 28002 raft_consensus.cc:2468] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 1.
I20260709 13:21:39.823272 27926 raft_consensus.cc:2468] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 1.
I20260709 13:21:39.824577 28040 leader_election.cc:304] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5fd999cbc342118c1d3dc8068bd99b, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:39.825299 28154 raft_consensus.cc:2804] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:39.825766 28154 raft_consensus.cc:697] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Becoming Leader. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:39.826634 28154 consensus_queue.cc:237] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.835424 27822 catalog_manager.cc:5697] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3). New cstate: current_term: 1 leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:39.839181 28127 raft_consensus.cc:493] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.839848 28127 raft_consensus.cc:515] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:39.841727 28127 leader_election.cc:290] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:39.842952 28074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd3361a0c254f75aad14e00ef207660" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:39.842478 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd3361a0c254f75aad14e00ef207660" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:39.843936 28074 raft_consensus.cc:2393] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da9ab0ed7bc14bbf938be2cffaaf778e in current term 1: Already voted for candidate 523d4bfd13fa41c78693e670e7919bd5 in this term.
I20260709 13:21:39.845023 27966 leader_election.cc:304] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b
I20260709 13:21:39.845630 28127 raft_consensus.cc:3060] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:39.850972 28127 raft_consensus.cc:2749] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:39.944028 28127 consensus_queue.cc:1048] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:39.957566 28127 consensus_queue.cc:1048] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:40.013361 28002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aac2bab3b09549f59154d01a18d812f3"
dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
mode: GRACEFUL
new_leader_uuid: "523d4bfd13fa41c78693e670e7919bd5"
 from {username='slave'} at 127.0.0.1:55652
I20260709 13:21:40.014122 28002 raft_consensus.cc:606] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Received request to transfer leadership to TS 523d4bfd13fa41c78693e670e7919bd5
I20260709 13:21:40.032377 28074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b757cffb0fe44b94af9cee6d46ada58a"
dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
mode: GRACEFUL
new_leader_uuid: "523d4bfd13fa41c78693e670e7919bd5"
 from {username='slave'} at 127.0.0.1:40014
I20260709 13:21:40.033656 28074 raft_consensus.cc:606] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Received request to transfer leadership to TS 523d4bfd13fa41c78693e670e7919bd5
I20260709 13:21:40.037437 28127 consensus_queue.cc:1048] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:40.041270 28154 consensus_queue.cc:1048] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:40.057133 28155 consensus_queue.cc:1048] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:40.058283 28123 raft_consensus.cc:993] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b: : Instructing follower 523d4bfd13fa41c78693e670e7919bd5 to start an election
I20260709 13:21:40.059301 28153 consensus_queue.cc:1048] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:40.069998 28002 raft_consensus.cc:3060] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:40.080642 28123 raft_consensus.cc:1081] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Signalling peer 523d4bfd13fa41c78693e670e7919bd5 to start an election
I20260709 13:21:40.090494 27925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23fbb2d99216479a9dfe735d0d347e49"
dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
mode: GRACEFUL
new_leader_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
 from {username='slave'} at 127.0.0.1:41840
I20260709 13:21:40.091275 27925 raft_consensus.cc:606] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Received request to transfer leadership to TS da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:40.096423 27927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b757cffb0fe44b94af9cee6d46ada58a"
dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
 from {username='slave'} at 127.0.0.1:41826
I20260709 13:21:40.097071 27927 raft_consensus.cc:493] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:40.097411 27927 raft_consensus.cc:3060] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.101317 28123 consensus_queue.cc:1048] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:40.102955 28123 consensus_queue.cc:1048] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:40.104900 27927 raft_consensus.cc:515] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:40.106365 27925 raft_consensus.cc:1240] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Rejecting Update request from peer 5d5fd999cbc342118c1d3dc8068bd99b for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:40.111783 27927 leader_election.cc:290] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 2 election: Requested vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:40.114147 28002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b757cffb0fe44b94af9cee6d46ada58a" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:40.113935 28191 consensus_queue.cc:1059] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:40.114872 28002 raft_consensus.cc:3060] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.115343 28189 raft_consensus.cc:3055] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:40.115758 28189 raft_consensus.cc:740] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:40.116644 28189 consensus_queue.cc:260] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:40.117865 28074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b757cffb0fe44b94af9cee6d46ada58a" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:40.118062 28153 consensus_queue.cc:1048] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:40.117873 28189 raft_consensus.cc:3060] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.134656 28073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1429996568da4007a81b14fdef35f952"
dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
mode: GRACEFUL
new_leader_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
 from {username='slave'} at 127.0.0.1:40014
I20260709 13:21:40.135390 28073 raft_consensus.cc:606] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Received request to transfer leadership to TS da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:40.140972 28153 consensus_queue.cc:1048] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:40.146384 28002 raft_consensus.cc:2468] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 2.
I20260709 13:21:40.147462 28001 raft_consensus.cc:1240] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Rejecting Update request from peer 5d5fd999cbc342118c1d3dc8068bd99b for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:21:40.147655 27926 raft_consensus.cc:3060] T 7d594e25aaf04d41ba68d5abb14f73c3 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:40.154373 27890 leader_election.cc:304] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:40.157392 28149 raft_consensus.cc:2804] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.157948 28149 raft_consensus.cc:697] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 2 LEADER]: Becoming Leader. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:40.158808 28149 consensus_queue.cc:237] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:40.161386 28191 consensus_queue.cc:1048] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:40.161687 28153 raft_consensus.cc:493] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:40.162329 28153 raft_consensus.cc:515] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:40.164474 28153 leader_election.cc:290] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:40.165191 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0fe1cb57654d61b395f64563344da7" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:40.167486 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0fe1cb57654d61b395f64563344da7" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:40.165793 28074 raft_consensus.cc:2468] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 2.
I20260709 13:21:40.168357 28077 raft_consensus.cc:2393] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 523d4bfd13fa41c78693e670e7919bd5 in current term 1: Already voted for candidate da9ab0ed7bc14bbf938be2cffaaf778e in this term.
I20260709 13:21:40.170545 27891 leader_election.cc:304] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5; no voters: 5d5fd999cbc342118c1d3dc8068bd99b, da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:40.172528 28158 consensus_queue.cc:1048] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:40.172926 28126 raft_consensus.cc:993] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5: : Instructing follower da9ab0ed7bc14bbf938be2cffaaf778e to start an election
I20260709 13:21:40.173671 28126 raft_consensus.cc:1081] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Signalling peer da9ab0ed7bc14bbf938be2cffaaf778e to start an election
I20260709 13:21:40.172595 28149 raft_consensus.cc:3060] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:40.176561 28001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23fbb2d99216479a9dfe735d0d347e49"
dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
 from {username='slave'} at 127.0.0.1:55640
I20260709 13:21:40.177202 28001 raft_consensus.cc:493] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:40.177626 28001 raft_consensus.cc:3060] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.179046 27823 catalog_manager.cc:5697] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 reported cstate change: term changed from 1 to 2, leader changed from 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3) to 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "523d4bfd13fa41c78693e670e7919bd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:40.184599 28149 raft_consensus.cc:2749] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:40.195444 28153 consensus_queue.cc:1048] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:21:40.188932 28001 raft_consensus.cc:515] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:40.199592 27999 raft_consensus.cc:1240] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Rejecting Update request from peer 523d4bfd13fa41c78693e670e7919bd5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:40.202836 28001 leader_election.cc:290] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 2 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:40.204260 27925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fbb2d99216479a9dfe735d0d347e49" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:40.204965 27925 raft_consensus.cc:3055] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:40.205323 27925 raft_consensus.cc:740] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:40.205890 28149 consensus_queue.cc:1059] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:40.206871 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fbb2d99216479a9dfe735d0d347e49" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:40.207165 27925 consensus_queue.cc:260] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:40.207603 28076 raft_consensus.cc:3060] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.210613 28158 consensus_queue.cc:1048] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:40.212404 27925 raft_consensus.cc:3060] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.210958 28001 raft_consensus.cc:3060] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:40.221273 28155 raft_consensus.cc:493] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:40.221951 28155 raft_consensus.cc:515] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } } peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } }
I20260709 13:21:40.223012 28153 consensus_queue.cc:1048] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:40.225811 28153 consensus_queue.cc:1048] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:40.230206 28073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0b89dd50814f41998d31e52b1abc34" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:40.228716 27925 raft_consensus.cc:2468] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 2.
I20260709 13:21:40.234300 28155 leader_election.cc:290] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625), 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235)
I20260709 13:21:40.235644 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0b89dd50814f41998d31e52b1abc34" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:40.237561 27965 leader_election.cc:304] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b
I20260709 13:21:40.240144 27965 leader_election.cc:304] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:40.241169 28127 raft_consensus.cc:2804] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.241811 28127 raft_consensus.cc:697] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 LEADER]: Becoming Leader. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Running, Role: LEADER
I20260709 13:21:40.242700 28127 consensus_queue.cc:237] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:40.248504 28155 raft_consensus.cc:2749] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:40.249428 28076 raft_consensus.cc:2468] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 2.
I20260709 13:21:40.270344 27825 catalog_manager.cc:5697] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e reported cstate change: term changed from 1 to 2, leader changed from 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1) to da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2). New cstate: current_term: 2 leader_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:40.279048 28191 consensus_queue.cc:1048] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:40.291311 28123 consensus_queue.cc:1048] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:40.299185 28189 raft_consensus.cc:993] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b: : Instructing follower da9ab0ed7bc14bbf938be2cffaaf778e to start an election
I20260709 13:21:40.299678 28123 raft_consensus.cc:1081] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Signalling peer da9ab0ed7bc14bbf938be2cffaaf778e to start an election
I20260709 13:21:40.301205 28000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1429996568da4007a81b14fdef35f952"
dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
 from {username='slave'} at 127.0.0.1:55632
I20260709 13:21:40.301714 28000 raft_consensus.cc:493] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:40.302067 28000 raft_consensus.cc:3060] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.307724 28000 raft_consensus.cc:515] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:40.309856 28000 leader_election.cc:290] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 2 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:40.311023 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1429996568da4007a81b14fdef35f952" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:40.311015 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1429996568da4007a81b14fdef35f952" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:40.311666 27926 raft_consensus.cc:3060] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.311847 28076 raft_consensus.cc:3055] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:40.312322 28076 raft_consensus.cc:740] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:40.313174 28076 consensus_queue.cc:260] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:40.314513 28076 raft_consensus.cc:3060] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.317622 27926 raft_consensus.cc:2468] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 2.
I20260709 13:21:40.318770 27965 leader_election.cc:304] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:40.319482 28127 raft_consensus.cc:2804] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.319934 28127 raft_consensus.cc:697] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 LEADER]: Becoming Leader. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Running, Role: LEADER
I20260709 13:21:40.320672 28127 consensus_queue.cc:237] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:40.321579 28076 raft_consensus.cc:2468] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 2.
I20260709 13:21:40.327363 27822 catalog_manager.cc:5697] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e reported cstate change: term changed from 1 to 2, leader changed from 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3) to da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2). New cstate: current_term: 2 leader_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:40.565357 28158 raft_consensus.cc:993] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e: : Instructing follower 523d4bfd13fa41c78693e670e7919bd5 to start an election
I20260709 13:21:40.565963 28127 raft_consensus.cc:1081] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Signalling peer 523d4bfd13fa41c78693e670e7919bd5 to start an election
I20260709 13:21:40.567636 27926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aac2bab3b09549f59154d01a18d812f3"
dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
 from {username='slave'} at 127.0.0.1:41830
I20260709 13:21:40.568194 27926 raft_consensus.cc:493] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:40.568570 27926 raft_consensus.cc:3060] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.575699 27926 raft_consensus.cc:515] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:40.577731 27926 leader_election.cc:290] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 2 election: Requested vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:40.578720 28000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac2bab3b09549f59154d01a18d812f3" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:40.579030 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac2bab3b09549f59154d01a18d812f3" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:40.579438 28000 raft_consensus.cc:3055] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:40.579789 28076 raft_consensus.cc:3060] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.579849 28000 raft_consensus.cc:740] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Running, Role: LEADER
I20260709 13:21:40.580989 28000 consensus_queue.cc:260] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:40.582558 28000 raft_consensus.cc:3060] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.589200 28076 raft_consensus.cc:2468] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 2.
I20260709 13:21:40.589399 28000 raft_consensus.cc:2468] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 2.
I20260709 13:21:40.590595 27891 leader_election.cc:304] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:40.591408 28149 raft_consensus.cc:2804] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.591893 28149 raft_consensus.cc:697] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 LEADER]: Becoming Leader. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:40.592760 28149 consensus_queue.cc:237] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:40.599076 27822 catalog_manager.cc:5697] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 reported cstate change: term changed from 1 to 2, leader changed from da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2) to 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "523d4bfd13fa41c78693e670e7919bd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:40.601495 28076 raft_consensus.cc:1275] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Refusing update from remote peer 523d4bfd13fa41c78693e670e7919bd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:40.603029 28149 consensus_queue.cc:1048] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:40.618606 28000 raft_consensus.cc:1275] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Refusing update from remote peer 523d4bfd13fa41c78693e670e7919bd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:40.620232 28149 consensus_queue.cc:1048] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:40.638015 27926 raft_consensus.cc:1275] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Refusing update from remote peer da9ab0ed7bc14bbf938be2cffaaf778e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:40.639461 28127 consensus_queue.cc:1048] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:40.647781 28076 raft_consensus.cc:1275] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Refusing update from remote peer da9ab0ed7bc14bbf938be2cffaaf778e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:40.650168 28155 consensus_queue.cc:1048] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:40.772282 28076 raft_consensus.cc:1275] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Refusing update from remote peer da9ab0ed7bc14bbf938be2cffaaf778e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:40.773679 28127 consensus_queue.cc:1048] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:40.785285 27926 raft_consensus.cc:1275] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Refusing update from remote peer da9ab0ed7bc14bbf938be2cffaaf778e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:40.786772 28127 consensus_queue.cc:1048] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:41.090096 28074 raft_consensus.cc:1275] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Refusing update from remote peer 523d4bfd13fa41c78693e670e7919bd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:41.091670 28204 consensus_queue.cc:1048] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:41.100831 28000 raft_consensus.cc:1275] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Refusing update from remote peer 523d4bfd13fa41c78693e670e7919bd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:41.102852 28153 consensus_queue.cc:1048] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:43.181365 27825 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56238:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:43.183967 27825 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:43.239931 27917 tablet_service.cc:1511] Processing CreateTablet for tablet 3f8000fe8a7340039e63a3ecf8c23b70 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:43.241333 27917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8000fe8a7340039e63a3ecf8c23b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.241194 27988 tablet_service.cc:1511] Processing CreateTablet for tablet 3f8000fe8a7340039e63a3ecf8c23b70 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:43.242561 27988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8000fe8a7340039e63a3ecf8c23b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.242676 28060 tablet_service.cc:1511] Processing CreateTablet for tablet 3f8000fe8a7340039e63a3ecf8c23b70 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:43.243952 28060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8000fe8a7340039e63a3ecf8c23b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.246784 28061 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac97a86640e48d6b1ddf90ea3fa5bec (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:43.248185 28061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac97a86640e48d6b1ddf90ea3fa5bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.256263 27992 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac97a86640e48d6b1ddf90ea3fa5bec (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:43.257748 27992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac97a86640e48d6b1ddf90ea3fa5bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.256261 27910 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac97a86640e48d6b1ddf90ea3fa5bec (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:43.263075 27910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac97a86640e48d6b1ddf90ea3fa5bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.266780 28225 tablet_bootstrap.cc:492] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:43.269588 27911 tablet_service.cc:1511] Processing CreateTablet for tablet 7dca9b4020f7467e8f4e3d95a24fd613 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:43.271004 27911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dca9b4020f7467e8f4e3d95a24fd613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.272624 27988 tablet_service.cc:1511] Processing CreateTablet for tablet 7dca9b4020f7467e8f4e3d95a24fd613 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:43.273967 27988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dca9b4020f7467e8f4e3d95a24fd613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.275079 28064 tablet_service.cc:1511] Processing CreateTablet for tablet 7dca9b4020f7467e8f4e3d95a24fd613 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:43.276356 28064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dca9b4020f7467e8f4e3d95a24fd613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.286037 28225 tablet_bootstrap.cc:654] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.286540 27915 tablet_service.cc:1511] Processing CreateTablet for tablet cdafd5f072464128a332213104fd0d2f (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:43.287949 27915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdafd5f072464128a332213104fd0d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.296096 27989 tablet_service.cc:1511] Processing CreateTablet for tablet cdafd5f072464128a332213104fd0d2f (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:43.297519 27989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdafd5f072464128a332213104fd0d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.308459 28063 tablet_service.cc:1511] Processing CreateTablet for tablet cdafd5f072464128a332213104fd0d2f (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:43.309978 28063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdafd5f072464128a332213104fd0d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.333851 27911 tablet_service.cc:1511] Processing CreateTablet for tablet fc4c95b026d5428ab161fe1fade2581e (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:43.335501 27911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4c95b026d5428ab161fe1fade2581e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.345407 28062 tablet_service.cc:1511] Processing CreateTablet for tablet b4ca1d03b56f4dc6a248416590f3a74a (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:43.346203 27917 tablet_service.cc:1511] Processing CreateTablet for tablet b4ca1d03b56f4dc6a248416590f3a74a (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:43.347019 28062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ca1d03b56f4dc6a248416590f3a74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.347606 27917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ca1d03b56f4dc6a248416590f3a74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.348819 28224 tablet_bootstrap.cc:492] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:43.349237 27986 tablet_service.cc:1511] Processing CreateTablet for tablet d97dafff4fb74bd89626cedfcb6101f1 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:43.350760 27986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97dafff4fb74bd89626cedfcb6101f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.350961 28060 tablet_service.cc:1511] Processing CreateTablet for tablet fc4c95b026d5428ab161fe1fade2581e (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:43.352408 28060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4c95b026d5428ab161fe1fade2581e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.355664 27992 tablet_service.cc:1511] Processing CreateTablet for tablet fc4c95b026d5428ab161fe1fade2581e (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:43.357236 27992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4c95b026d5428ab161fe1fade2581e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.359092 27988 tablet_service.cc:1511] Processing CreateTablet for tablet b4ca1d03b56f4dc6a248416590f3a74a (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:43.359086 27913 tablet_service.cc:1511] Processing CreateTablet for tablet d97dafff4fb74bd89626cedfcb6101f1 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:43.360615 27988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ca1d03b56f4dc6a248416590f3a74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.361099 27913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97dafff4fb74bd89626cedfcb6101f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.369313 28061 tablet_service.cc:1511] Processing CreateTablet for tablet d97dafff4fb74bd89626cedfcb6101f1 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:43.372505 28061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97dafff4fb74bd89626cedfcb6101f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.372210 27915 tablet_service.cc:1511] Processing CreateTablet for tablet fd12c61ad8c246bdb1d9566248940b25 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:43.372720 27984 tablet_service.cc:1511] Processing CreateTablet for tablet fd12c61ad8c246bdb1d9566248940b25 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:43.387254 27984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd12c61ad8c246bdb1d9566248940b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.388000 28225 tablet_bootstrap.cc:492] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:43.388586 28225 ts_tablet_manager.cc:1403] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.122s	user 0.028s	sys 0.008s
I20260709 13:21:43.370744 28226 tablet_bootstrap.cc:492] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:43.392092 28225 raft_consensus.cc:359] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.392979 28225 raft_consensus.cc:385] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.393306 28225 raft_consensus.cc:740] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.405143 28067 tablet_service.cc:1511] Processing CreateTablet for tablet fd12c61ad8c246bdb1d9566248940b25 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:43.407624 27912 tablet_service.cc:1511] Processing CreateTablet for tablet 1529d5eb47504b29a6ad007fc5c9ee54 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:43.409734 28067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd12c61ad8c246bdb1d9566248940b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.412397 27912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1529d5eb47504b29a6ad007fc5c9ee54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.414211 28225 consensus_queue.cc:260] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.415700 28226 tablet_bootstrap.cc:654] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.420275 28225 ts_tablet_manager.cc:1434] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.002s
I20260709 13:21:43.421417 28225 tablet_bootstrap.cc:492] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:43.422353 27915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd12c61ad8c246bdb1d9566248940b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.427153 28064 tablet_service.cc:1511] Processing CreateTablet for tablet 1529d5eb47504b29a6ad007fc5c9ee54 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:43.427601 27986 tablet_service.cc:1511] Processing CreateTablet for tablet 1529d5eb47504b29a6ad007fc5c9ee54 (DEFAULT_TABLE table=soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:43.431188 27986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1529d5eb47504b29a6ad007fc5c9ee54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.444183 28224 tablet_bootstrap.cc:654] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:43.455137 27873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:43.465498 28225 tablet_bootstrap.cc:654] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.480325 28064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1529d5eb47504b29a6ad007fc5c9ee54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:43.485622 28210 raft_consensus.cc:493] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:43.486581 28210 raft_consensus.cc:515] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.492452 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8000fe8a7340039e63a3ecf8c23b70" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
W20260709 13:21:43.494457 27965 leader_election.cc:343] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:43.495172 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8000fe8a7340039e63a3ecf8c23b70" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
W20260709 13:21:43.497004 27966 leader_election.cc:343] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:43.497838 28226 tablet_bootstrap.cc:492] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:43.502447 28226 ts_tablet_manager.cc:1403] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.132s	user 0.010s	sys 0.006s
I20260709 13:21:43.492764 28210 leader_election.cc:290] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:43.497679 27966 leader_election.cc:304] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b
I20260709 13:21:43.504809 28221 raft_consensus.cc:2749] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:43.519246 28224 tablet_bootstrap.cc:492] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:43.520048 28224 ts_tablet_manager.cc:1403] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.171s	user 0.017s	sys 0.012s
I20260709 13:21:43.521183 28226 raft_consensus.cc:359] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.523792 28224 raft_consensus.cc:359] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.526641 28226 raft_consensus.cc:385] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.526770 28224 raft_consensus.cc:385] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.527083 28226 raft_consensus.cc:740] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.527348 28224 raft_consensus.cc:740] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.528365 28224 consensus_queue.cc:260] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.530946 28225 tablet_bootstrap.cc:492] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:43.531001 28224 ts_tablet_manager.cc:1434] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:21:43.529330 28226 consensus_queue.cc:260] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.533552 28225 ts_tablet_manager.cc:1403] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.112s	user 0.019s	sys 0.017s
I20260709 13:21:43.534395 28224 tablet_bootstrap.cc:492] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:43.535569 28226 ts_tablet_manager.cc:1434] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.004s
I20260709 13:21:43.536751 28226 tablet_bootstrap.cc:492] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:43.542636 28224 tablet_bootstrap.cc:654] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.544628 28226 tablet_bootstrap.cc:654] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.555503 28224 tablet_bootstrap.cc:492] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:43.555800 28226 tablet_bootstrap.cc:492] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:43.556087 28224 ts_tablet_manager.cc:1403] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 13:21:43.556421 28226 ts_tablet_manager.cc:1403] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:21:43.556640 28225 raft_consensus.cc:359] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.557541 28225 raft_consensus.cc:385] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.557860 28225 raft_consensus.cc:740] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.558862 28225 consensus_queue.cc:260] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.559396 28224 raft_consensus.cc:359] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.560235 28224 raft_consensus.cc:385] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.560047 28226 raft_consensus.cc:359] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.560652 28224 raft_consensus.cc:740] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.560935 28226 raft_consensus.cc:385] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.561326 28226 raft_consensus.cc:740] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.561559 28224 consensus_queue.cc:260] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.562207 28226 consensus_queue.cc:260] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.564462 28224 ts_tablet_manager.cc:1434] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:21:43.564706 28225 ts_tablet_manager.cc:1434] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:21:43.565045 28226 ts_tablet_manager.cc:1434] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:21:43.565701 28224 tablet_bootstrap.cc:492] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:43.566393 28225 tablet_bootstrap.cc:492] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:43.566531 28226 tablet_bootstrap.cc:492] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:43.574326 28224 tablet_bootstrap.cc:654] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.575084 28225 tablet_bootstrap.cc:654] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.575084 28226 tablet_bootstrap.cc:654] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.589355 28226 tablet_bootstrap.cc:492] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:43.589591 28224 tablet_bootstrap.cc:492] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:43.590346 28226 ts_tablet_manager.cc:1403] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.003s
I20260709 13:21:43.590699 28224 ts_tablet_manager.cc:1403] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.016s
I20260709 13:21:43.594363 28224 raft_consensus.cc:359] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.595345 28224 raft_consensus.cc:385] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.595947 28224 raft_consensus.cc:740] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.595062 28226 raft_consensus.cc:359] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.596880 28226 raft_consensus.cc:385] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.596812 28224 consensus_queue.cc:260] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.597618 28226 raft_consensus.cc:740] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.599421 28224 ts_tablet_manager.cc:1434] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:43.599031 28226 consensus_queue.cc:260] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.600656 28224 tablet_bootstrap.cc:492] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:43.603189 28226 ts_tablet_manager.cc:1434] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:21:43.604779 28226 tablet_bootstrap.cc:492] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:43.609192 28224 tablet_bootstrap.cc:654] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.616628 28211 raft_consensus.cc:493] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:43.617239 28226 tablet_bootstrap.cc:654] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.617558 28211 raft_consensus.cc:515] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.619238 28149 raft_consensus.cc:493] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:43.619987 28149 raft_consensus.cc:515] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.623047 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca9b4020f7467e8f4e3d95a24fd613" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:43.623745 28149 leader_election.cc:290] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:43.623987 27926 raft_consensus.cc:2468] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:43.626793 28224 tablet_bootstrap.cc:492] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:43.626654 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca9b4020f7467e8f4e3d95a24fd613" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:43.627830 28224 ts_tablet_manager.cc:1403] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 13:21:43.628930 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca9b4020f7467e8f4e3d95a24fd613" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:43.629755 28076 raft_consensus.cc:2468] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 0.
I20260709 13:21:43.632112 28226 tablet_bootstrap.cc:492] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:43.632061 28224 raft_consensus.cc:359] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.633275 28224 raft_consensus.cc:385] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.633558 28226 ts_tablet_manager.cc:1403] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.007s
I20260709 13:21:43.633704 28224 raft_consensus.cc:740] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.635120 28224 consensus_queue.cc:260] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.637449 28040 leader_election.cc:304] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:43.639525 28224 ts_tablet_manager.cc:1434] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:21:43.639459 27891 leader_election.cc:304] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:43.640614 28226 raft_consensus.cc:359] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.641291 28149 raft_consensus.cc:2804] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:43.641779 28224 tablet_bootstrap.cc:492] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:43.641878 28226 raft_consensus.cc:385] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.643404 28226 raft_consensus.cc:740] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.627833 28001 raft_consensus.cc:2468] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 0.
I20260709 13:21:43.642696 28149 raft_consensus.cc:493] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:43.645581 28149 raft_consensus.cc:3060] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:43.645689 28226 consensus_queue.cc:260] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.653330 28224 tablet_bootstrap.cc:654] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.655731 28239 raft_consensus.cc:2804] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:43.656350 28211 leader_election.cc:290] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:43.658809 28226 ts_tablet_manager.cc:1434] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.009s
I20260709 13:21:43.660063 28239 raft_consensus.cc:493] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:43.660811 28239 raft_consensus.cc:3060] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:43.664556 28225 tablet_bootstrap.cc:492] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:43.667948 28225 ts_tablet_manager.cc:1403] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.102s	user 0.030s	sys 0.043s
I20260709 13:21:43.672984 28225 raft_consensus.cc:359] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.678705 28225 raft_consensus.cc:385] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.673457 28239 raft_consensus.cc:515] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.679710 28225 raft_consensus.cc:740] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.681259 28225 consensus_queue.cc:260] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.681938 28239 leader_election.cc:290] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:43.685608 28225 ts_tablet_manager.cc:1434] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 13:21:43.688143 28226 tablet_bootstrap.cc:492] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:43.690886 28225 tablet_bootstrap.cc:492] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:43.694995 28219 raft_consensus.cc:493] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:43.695778 28219 raft_consensus.cc:515] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.697060 28226 tablet_bootstrap.cc:654] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.699218 28000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8000fe8a7340039e63a3ecf8c23b70" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:43.699985 28000 raft_consensus.cc:2468] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 0.
I20260709 13:21:43.702135 27890 leader_election.cc:304] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:43.703895 28225 tablet_bootstrap.cc:654] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.722304 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8000fe8a7340039e63a3ecf8c23b70" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:43.723088 28076 raft_consensus.cc:2468] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 0.
I20260709 13:21:43.724208 28225 tablet_bootstrap.cc:492] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:43.724785 28225 ts_tablet_manager.cc:1403] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.000s
I20260709 13:21:43.726341 28244 raft_consensus.cc:2804] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:43.727874 28244 raft_consensus.cc:493] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:43.728967 28244 raft_consensus.cc:3060] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:43.731096 28225 raft_consensus.cc:359] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.731923 28225 raft_consensus.cc:385] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.732221 28225 raft_consensus.cc:740] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.732424 28219 leader_election.cc:290] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:43.733091 28225 consensus_queue.cc:260] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.735659 28225 ts_tablet_manager.cc:1434] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:21:43.736781 28225 tablet_bootstrap.cc:492] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:43.748567 28149 raft_consensus.cc:515] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.753051 28225 tablet_bootstrap.cc:654] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.749686 28244 raft_consensus.cc:515] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
W20260709 13:21:43.761638 27890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.2:42797, user_credentials={real_user=slave}} blocked reactor thread for 59695.7us
W20260709 13:21:43.762732 28040 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.211.1:35235, user_credentials={real_user=slave}} blocked reactor thread for 125367us
I20260709 13:21:43.765101 28244 leader_election.cc:290] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Requested vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:43.765748 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca9b4020f7467e8f4e3d95a24fd613" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:43.766000 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca9b4020f7467e8f4e3d95a24fd613" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:43.766724 28001 raft_consensus.cc:2468] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:43.767058 28076 raft_consensus.cc:2393] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 523d4bfd13fa41c78693e670e7919bd5 in current term 1: Already voted for candidate 5d5fd999cbc342118c1d3dc8068bd99b in this term.
I20260709 13:21:43.769546 28074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8000fe8a7340039e63a3ecf8c23b70" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:43.770392 28074 raft_consensus.cc:3060] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:43.769637 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca9b4020f7467e8f4e3d95a24fd613" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:43.772442 28001 raft_consensus.cc:3060] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:43.779554 28000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8000fe8a7340039e63a3ecf8c23b70" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:43.780450 28000 raft_consensus.cc:3060] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:43.783519 27999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca9b4020f7467e8f4e3d95a24fd613" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:43.794109 28225 tablet_bootstrap.cc:492] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:43.794366 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca9b4020f7467e8f4e3d95a24fd613" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:43.794817 28225 ts_tablet_manager.cc:1403] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.001s
I20260709 13:21:43.795651 27926 raft_consensus.cc:2393] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d5fd999cbc342118c1d3dc8068bd99b in current term 1: Already voted for candidate 523d4bfd13fa41c78693e670e7919bd5 in this term.
I20260709 13:21:43.794122 28001 raft_consensus.cc:2468] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 1.
I20260709 13:21:43.798139 28225 raft_consensus.cc:359] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.798391 27890 leader_election.cc:304] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 5d5fd999cbc342118c1d3dc8068bd99b
I20260709 13:21:43.798951 28225 raft_consensus.cc:385] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.799291 28225 raft_consensus.cc:740] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.799746 28242 raft_consensus.cc:2804] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:43.800570 28242 raft_consensus.cc:697] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Becoming Leader. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:43.801093 28000 raft_consensus.cc:2468] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 1.
I20260709 13:21:43.801553 28242 consensus_queue.cc:237] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.800060 28225 consensus_queue.cc:260] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.813768 28040 leader_election.cc:304] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:43.815677 28225 ts_tablet_manager.cc:1434] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:21:43.816121 28239 raft_consensus.cc:2749] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:43.816628 28149 leader_election.cc:290] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Requested vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:43.816871 28225 tablet_bootstrap.cc:492] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:43.809662 28074 raft_consensus.cc:2468] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 1.
I20260709 13:21:43.819581 27890 leader_election.cc:304] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:43.823861 28149 raft_consensus.cc:2804] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:43.824141 28225 tablet_bootstrap.cc:654] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.824477 28226 tablet_bootstrap.cc:492] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:43.825078 28226 ts_tablet_manager.cc:1403] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.137s	user 0.023s	sys 0.055s
I20260709 13:21:43.825341 28224 tablet_bootstrap.cc:492] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:43.826171 28224 ts_tablet_manager.cc:1403] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.185s	user 0.062s	sys 0.079s
I20260709 13:21:43.829077 28226 raft_consensus.cc:359] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.830372 28226 raft_consensus.cc:385] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.830830 28226 raft_consensus.cc:740] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.831153 28224 raft_consensus.cc:359] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.824501 28149 raft_consensus.cc:697] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Becoming Leader. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:43.832093 28224 raft_consensus.cc:385] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.832042 28226 consensus_queue.cc:260] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.832875 28224 raft_consensus.cc:740] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.832966 28149 consensus_queue.cc:237] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.834408 28224 consensus_queue.cc:260] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.838231 28225 tablet_bootstrap.cc:492] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:43.838829 28225 ts_tablet_manager.cc:1403] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.010s
I20260709 13:21:43.838987 28224 ts_tablet_manager.cc:1434] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:21:43.840365 28224 tablet_bootstrap.cc:492] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:43.842702 28226 ts_tablet_manager.cc:1434] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:21:43.842331 28225 raft_consensus.cc:359] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.843547 28225 raft_consensus.cc:385] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.844085 28226 tablet_bootstrap.cc:492] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:43.844033 28225 raft_consensus.cc:740] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.845342 28225 consensus_queue.cc:260] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.848174 28225 ts_tablet_manager.cc:1434] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:43.849426 28225 tablet_bootstrap.cc:492] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:43.852416 28226 tablet_bootstrap.cc:654] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.852566 28244 raft_consensus.cc:493] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:43.853170 28244 raft_consensus.cc:515] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.855535 28244 leader_election.cc:290] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:43.856626 28224 tablet_bootstrap.cc:654] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.857172 28074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ca1d03b56f4dc6a248416590f3a74a" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:43.857951 28074 raft_consensus.cc:2468] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 0.
I20260709 13:21:43.859463 27891 leader_election.cc:304] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:43.860853 27823 catalog_manager.cc:5697] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "523d4bfd13fa41c78693e670e7919bd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:43.867930 28225 tablet_bootstrap.cc:654] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.871754 28239 raft_consensus.cc:493] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:43.872486 28239 raft_consensus.cc:515] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.875392 28239 leader_election.cc:290] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:43.876987 28000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac97a86640e48d6b1ddf90ea3fa5bec" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:43.877779 28000 raft_consensus.cc:2468] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:43.877828 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac97a86640e48d6b1ddf90ea3fa5bec" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:43.859851 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ca1d03b56f4dc6a248416590f3a74a" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:43.906415 28242 raft_consensus.cc:2804] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:43.910740 28242 raft_consensus.cc:493] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:43.910778 28040 leader_election.cc:304] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5fd999cbc342118c1d3dc8068bd99b, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:43.911178 28242 raft_consensus.cc:3060] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:43.912693 27890 leader_election.cc:343] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:43.913034 28239 raft_consensus.cc:2804] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:43.913441 28239 raft_consensus.cc:493] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:43.913769 28239 raft_consensus.cc:3060] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:43.909600 27926 raft_consensus.cc:2468] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:43.928839 28242 raft_consensus.cc:515] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.935667 28226 tablet_bootstrap.cc:492] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:43.936998 28226 ts_tablet_manager.cc:1403] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.093s	user 0.024s	sys 0.035s
I20260709 13:21:43.937264 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ca1d03b56f4dc6a248416590f3a74a" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:43.938231 28076 raft_consensus.cc:3060] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:43.938457 28224 tablet_bootstrap.cc:492] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:43.939100 28224 ts_tablet_manager.cc:1403] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.099s	user 0.005s	sys 0.025s
I20260709 13:21:43.935917 28242 leader_election.cc:290] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Requested vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:43.940775 28226 raft_consensus.cc:359] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.941726 28226 raft_consensus.cc:385] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.942178 28226 raft_consensus.cc:740] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.943117 28224 raft_consensus.cc:359] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.943271 28226 consensus_queue.cc:260] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.943969 28224 raft_consensus.cc:385] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.944289 28224 raft_consensus.cc:740] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.945057 28224 consensus_queue.cc:260] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.937268 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ca1d03b56f4dc6a248416590f3a74a" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
W20260709 13:21:43.948107 27890 leader_election.cc:343] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:43.948222 28239 raft_consensus.cc:515] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.954358 28076 raft_consensus.cc:2468] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 1.
I20260709 13:21:43.954538 28238 raft_consensus.cc:493] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:43.955508 28226 ts_tablet_manager.cc:1434] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:21:43.955446 28238 raft_consensus.cc:515] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.957805 28225 tablet_bootstrap.cc:492] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:43.958348 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac97a86640e48d6b1ddf90ea3fa5bec" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:43.959062 27926 raft_consensus.cc:3060] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:43.960062 28000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4c95b026d5428ab161fe1fade2581e" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:43.958401 28225 ts_tablet_manager.cc:1403] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.109s	user 0.021s	sys 0.013s
I20260709 13:21:43.954604 28224 ts_tablet_manager.cc:1434] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:21:43.960220 28239 leader_election.cc:290] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:43.960960 28000 raft_consensus.cc:2468] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:43.962163 28224 tablet_bootstrap.cc:492] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:43.962425 27925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4c95b026d5428ab161fe1fade2581e" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:43.963116 27925 raft_consensus.cc:2468] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:43.964980 28040 leader_election.cc:304] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:43.966398 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac97a86640e48d6b1ddf90ea3fa5bec" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:43.966810 28239 raft_consensus.cc:2804] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:43.967267 28239 raft_consensus.cc:493] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:43.967320 28001 raft_consensus.cc:3060] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:43.967643 28239 raft_consensus.cc:3060] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:43.970050 28225 raft_consensus.cc:359] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.970855 28225 raft_consensus.cc:385] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:43.971158 28225 raft_consensus.cc:740] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:43.971690 28226 tablet_bootstrap.cc:492] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:43.971930 28225 consensus_queue.cc:260] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.973784 28225 ts_tablet_manager.cc:1434] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.000s
I20260709 13:21:43.974144 28238 leader_election.cc:290] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:43.975543 27891 leader_election.cc:304] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:43.976939 28242 raft_consensus.cc:2804] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:43.977499 28242 raft_consensus.cc:697] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Becoming Leader. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:43.978470 28242 consensus_queue.cc:237] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.979843 28226 tablet_bootstrap.cc:654] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.980556 28239 raft_consensus.cc:515] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:43.986423 28001 raft_consensus.cc:2468] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 1.
I20260709 13:21:43.989465 28040 leader_election.cc:304] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5fd999cbc342118c1d3dc8068bd99b, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:43.989598 28239 leader_election.cc:290] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:43.990923 28239 raft_consensus.cc:2804] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:43.990747 28225 tablet_bootstrap.cc:492] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:43.991621 28239 raft_consensus.cc:697] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Becoming Leader. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:43.993299 27925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4c95b026d5428ab161fe1fade2581e" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:43.994004 27925 raft_consensus.cc:3060] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:43.994240 28224 tablet_bootstrap.cc:654] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:43.995048 28000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4c95b026d5428ab161fe1fade2581e" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:43.995669 28000 raft_consensus.cc:3060] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:43.992569 28239 consensus_queue.cc:237] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.002739 27925 raft_consensus.cc:2468] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 1.
I20260709 13:21:44.004184 28000 raft_consensus.cc:2468] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 1.
I20260709 13:21:44.004242 28040 leader_election.cc:304] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:44.006932 28238 raft_consensus.cc:2804] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:44.007439 28238 raft_consensus.cc:697] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Becoming Leader. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:44.008314 28238 consensus_queue.cc:237] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.012086 28226 tablet_bootstrap.cc:492] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:44.012863 28226 ts_tablet_manager.cc:1403] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.001s
I20260709 13:21:44.017369 28226 raft_consensus.cc:359] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.018436 28226 raft_consensus.cc:385] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:44.018918 28226 raft_consensus.cc:740] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:44.020028 28226 consensus_queue.cc:260] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.023592 28226 ts_tablet_manager.cc:1434] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:21:44.024900 28226 tablet_bootstrap.cc:492] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:44.032981 28226 tablet_bootstrap.cc:654] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:44.041201 28226 tablet_bootstrap.cc:492] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:44.041749 28226 ts_tablet_manager.cc:1403] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:21:44.046429 28226 raft_consensus.cc:359] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.047350 28226 raft_consensus.cc:385] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:44.047708 28226 raft_consensus.cc:740] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:44.048544 28226 consensus_queue.cc:260] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.053772 28226 ts_tablet_manager.cc:1434] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:21:44.055022 28226 tablet_bootstrap.cc:492] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b: Bootstrap starting.
I20260709 13:21:44.062027 28226 tablet_bootstrap.cc:654] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:44.066644 28238 raft_consensus.cc:493] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:44.067260 28238 raft_consensus.cc:515] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.069893 28238 leader_election.cc:290] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:44.071790 28226 tablet_bootstrap.cc:492] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b: No bootstrap required, opened a new log
I20260709 13:21:44.072454 28226 ts_tablet_manager.cc:1403] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.004s
I20260709 13:21:44.073340 28225 tablet_bootstrap.cc:654] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:44.075537 28226 raft_consensus.cc:359] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.076335 28226 raft_consensus.cc:385] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:44.076668 28226 raft_consensus.cc:740] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Initialized, Role: FOLLOWER
I20260709 13:21:44.084544 28224 tablet_bootstrap.cc:492] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:44.085325 28224 ts_tablet_manager.cc:1403] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.123s	user 0.010s	sys 0.005s
I20260709 13:21:44.077630 28226 consensus_queue.cc:260] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.088549 28226 ts_tablet_manager.cc:1434] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:21:44.091641 28225 tablet_bootstrap.cc:492] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:44.093011 28225 ts_tablet_manager.cc:1403] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.005s
I20260709 13:21:44.091226 28224 raft_consensus.cc:359] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.094175 28224 raft_consensus.cc:385] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:44.094547 28224 raft_consensus.cc:740] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:44.095561 28238 raft_consensus.cc:493] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:44.096333 28238 raft_consensus.cc:515] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.097142 28224 consensus_queue.cc:260] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.098793 28238 leader_election.cc:290] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:44.099484 28224 ts_tablet_manager.cc:1434] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:21:44.100533 28224 tablet_bootstrap.cc:492] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:44.101799 28225 raft_consensus.cc:359] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.102919 28225 raft_consensus.cc:385] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:44.103175 28225 raft_consensus.cc:740] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:44.103796 28225 consensus_queue.cc:260] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.105544 28225 ts_tablet_manager.cc:1434] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 13:21:44.107689 28225 tablet_bootstrap.cc:492] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e: Bootstrap starting.
I20260709 13:21:44.107704 28224 tablet_bootstrap.cc:654] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:44.113309 28224 tablet_bootstrap.cc:492] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:44.113835 28224 ts_tablet_manager.cc:1403] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:21:44.114300 28225 tablet_bootstrap.cc:654] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:44.116750 28224 raft_consensus.cc:359] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.117517 28224 raft_consensus.cc:385] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:44.117786 28224 raft_consensus.cc:740] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:44.118598 28224 consensus_queue.cc:260] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.119988 28225 tablet_bootstrap.cc:492] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e: No bootstrap required, opened a new log
I20260709 13:21:44.120527 28225 ts_tablet_manager.cc:1403] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:21:44.120705 28224 ts_tablet_manager.cc:1434] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:21:44.121764 28224 tablet_bootstrap.cc:492] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5: Bootstrap starting.
I20260709 13:21:44.123329 28225 raft_consensus.cc:359] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.123909 28225 raft_consensus.cc:385] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:44.124154 28225 raft_consensus.cc:740] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Initialized, Role: FOLLOWER
I20260709 13:21:44.124904 28225 consensus_queue.cc:260] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.127848 28225 ts_tablet_manager.cc:1434] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:21:44.130403 28224 tablet_bootstrap.cc:654] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:44.147665 28224 tablet_bootstrap.cc:492] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5: No bootstrap required, opened a new log
I20260709 13:21:44.148646 28224 ts_tablet_manager.cc:1403] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 13:21:44.151693 28224 raft_consensus.cc:359] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.152441 28224 raft_consensus.cc:385] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:44.152721 28224 raft_consensus.cc:740] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Initialized, Role: FOLLOWER
I20260709 13:21:44.153396 28224 consensus_queue.cc:260] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.185604 28000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdafd5f072464128a332213104fd0d2f" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:44.185915 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1529d5eb47504b29a6ad007fc5c9ee54" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:44.186308 28000 raft_consensus.cc:2468] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:44.186751 28001 raft_consensus.cc:2468] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:44.196664 27925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdafd5f072464128a332213104fd0d2f" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:44.197374 27925 raft_consensus.cc:2468] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:44.206264 28224 ts_tablet_manager.cc:1434] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.001s
I20260709 13:21:44.206250 28242 raft_consensus.cc:493] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:44.207252 28242 raft_consensus.cc:515] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.210021 28242 leader_election.cc:290] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:44.210592 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdafd5f072464128a332213104fd0d2f" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:44.211035 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1529d5eb47504b29a6ad007fc5c9ee54" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:44.211386 28001 raft_consensus.cc:2468] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 0.
I20260709 13:21:44.211875 27927 raft_consensus.cc:2468] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:44.213040 27890 leader_election.cc:304] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:44.215793 28242 raft_consensus.cc:2804] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:44.216365 28242 raft_consensus.cc:493] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:44.216768 28242 raft_consensus.cc:3060] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:44.217684 27926 raft_consensus.cc:2468] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 1.
I20260709 13:21:44.225242 28242 raft_consensus.cc:515] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.227947 28242 leader_election.cc:290] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Requested vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:44.229001 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdafd5f072464128a332213104fd0d2f" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:44.232559 28001 raft_consensus.cc:3060] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:44.241977 28001 raft_consensus.cc:2468] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 1.
I20260709 13:21:44.243628 27890 leader_election.cc:304] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:44.244418 28244 raft_consensus.cc:2804] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:44.244992 28244 raft_consensus.cc:697] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Becoming Leader. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:44.245785 28244 consensus_queue.cc:237] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.254317 28040 leader_election.cc:304] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:44.255441 28040 leader_election.cc:304] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:44.260855 28268 raft_consensus.cc:2804] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:44.261358 28268 raft_consensus.cc:493] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:44.261680 28268 raft_consensus.cc:3060] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:44.264055 28246 raft_consensus.cc:493] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:44.264592 28246 raft_consensus.cc:515] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.266644 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdafd5f072464128a332213104fd0d2f" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:44.267441 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97dafff4fb74bd89626cedfcb6101f1" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:44.268224 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdafd5f072464128a332213104fd0d2f" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:44.270656 28246 leader_election.cc:290] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:44.271576 28211 raft_consensus.cc:2804] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:44.272033 28211 raft_consensus.cc:493] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:44.272392 28211 raft_consensus.cc:3060] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:44.268381 27926 raft_consensus.cc:2468] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 0.
I20260709 13:21:44.275849 27965 leader_election.cc:304] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:44.276762 28246 raft_consensus.cc:2804] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:44.277127 28246 raft_consensus.cc:493] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:44.277452 28246 raft_consensus.cc:3060] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:44.278472 28239 raft_consensus.cc:493] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:44.279019 28239 raft_consensus.cc:515] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.281095 28239 leader_election.cc:290] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:44.284914 28002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97dafff4fb74bd89626cedfcb6101f1" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" is_pre_election: true
I20260709 13:21:44.287720 28211 raft_consensus.cc:515] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.288045 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97dafff4fb74bd89626cedfcb6101f1" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:44.288991 27926 raft_consensus.cc:2468] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 0.
I20260709 13:21:44.290422 28221 raft_consensus.cc:493] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:44.290851 28040 leader_election.cc:304] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:44.291030 28221 raft_consensus.cc:515] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.292697 28238 raft_consensus.cc:2804] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:44.293305 28238 raft_consensus.cc:493] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:44.293977 28238 raft_consensus.cc:3060] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:44.294512 28268 raft_consensus.cc:515] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.295328 28221 leader_election.cc:290] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:44.296304 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ca1d03b56f4dc6a248416590f3a74a" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:44.296803 28268 leader_election.cc:290] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:44.298779 28076 raft_consensus.cc:2393] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 523d4bfd13fa41c78693e670e7919bd5 in current term 1: Already voted for candidate 5d5fd999cbc342118c1d3dc8068bd99b in this term.
I20260709 13:21:44.299332 28211 leader_election.cc:290] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:44.300118 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdafd5f072464128a332213104fd0d2f" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:44.302301 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdafd5f072464128a332213104fd0d2f" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:44.303275 28074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97dafff4fb74bd89626cedfcb6101f1" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:44.303972 28001 raft_consensus.cc:2393] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d5fd999cbc342118c1d3dc8068bd99b in current term 1: Already voted for candidate 523d4bfd13fa41c78693e670e7919bd5 in this term.
I20260709 13:21:44.304313 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1529d5eb47504b29a6ad007fc5c9ee54" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:44.304960 27926 raft_consensus.cc:3060] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:44.305023 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1529d5eb47504b29a6ad007fc5c9ee54" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:44.305683 28001 raft_consensus.cc:3060] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:44.306404 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ca1d03b56f4dc6a248416590f3a74a" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:44.307199 28077 raft_consensus.cc:2393] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da9ab0ed7bc14bbf938be2cffaaf778e in current term 1: Already voted for candidate 523d4bfd13fa41c78693e670e7919bd5 in this term.
I20260709 13:21:44.307087 28040 leader_election.cc:304] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:44.311028 28221 raft_consensus.cc:493] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:44.311573 28221 raft_consensus.cc:515] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.313378 28246 raft_consensus.cc:515] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.313812 28221 leader_election.cc:290] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:44.314633 28002 raft_consensus.cc:2393] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d5fd999cbc342118c1d3dc8068bd99b in current term 1: Already voted for candidate da9ab0ed7bc14bbf938be2cffaaf778e in this term.
I20260709 13:21:44.314332 28219 consensus_queue.cc:1048] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.315261 27926 raft_consensus.cc:2468] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 1.
I20260709 13:21:44.309531 27966 leader_election.cc:304] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b
I20260709 13:21:44.316033 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd12c61ad8c246bdb1d9566248940b25" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5" is_pre_election: true
I20260709 13:21:44.316725 27927 raft_consensus.cc:2468] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 0.
I20260709 13:21:44.316762 28270 raft_consensus.cc:3060] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:44.317950 28040 leader_election.cc:304] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:44.318269 27965 leader_election.cc:304] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:44.318610 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd12c61ad8c246bdb1d9566248940b25" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" is_pre_election: true
I20260709 13:21:44.318768 28268 raft_consensus.cc:2749] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:44.319157 28221 raft_consensus.cc:2804] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:44.319257 28077 raft_consensus.cc:2468] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 0.
I20260709 13:21:44.319450 28268 raft_consensus.cc:2804] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:44.319667 28221 raft_consensus.cc:493] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:44.320073 28268 raft_consensus.cc:697] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Becoming Leader. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:44.320271 28221 raft_consensus.cc:3060] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:44.321172 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97dafff4fb74bd89626cedfcb6101f1" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:44.321007 28268 consensus_queue.cc:237] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.321766 27927 raft_consensus.cc:3060] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:44.323333 28246 leader_election.cc:290] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:44.325069 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97dafff4fb74bd89626cedfcb6101f1" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:44.336941 27927 raft_consensus.cc:2468] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 1.
I20260709 13:21:44.339134 27965 leader_election.cc:304] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 5d5fd999cbc342118c1d3dc8068bd99b
I20260709 13:21:44.340432 28238 raft_consensus.cc:515] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.340974 28246 raft_consensus.cc:2804] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:44.342600 28074 raft_consensus.cc:2393] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da9ab0ed7bc14bbf938be2cffaaf778e in current term 1: Already voted for candidate 5d5fd999cbc342118c1d3dc8068bd99b in this term.
I20260709 13:21:44.341181 27823 catalog_manager.cc:5697] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "523d4bfd13fa41c78693e670e7919bd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.342859 28246 raft_consensus.cc:697] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Becoming Leader. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Running, Role: LEADER
I20260709 13:21:44.346517 28246 consensus_queue.cc:237] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.346796 27825 catalog_manager.cc:5697] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3). New cstate: current_term: 1 leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:44.347980 28238 leader_election.cc:290] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:44.349187 28002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97dafff4fb74bd89626cedfcb6101f1" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:44.344993 27823 catalog_manager.cc:5697] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "523d4bfd13fa41c78693e670e7919bd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.353582 28270 raft_consensus.cc:2749] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:44.350152 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97dafff4fb74bd89626cedfcb6101f1" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:44.354594 27927 raft_consensus.cc:2393] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d5fd999cbc342118c1d3dc8068bd99b in current term 1: Already voted for candidate da9ab0ed7bc14bbf938be2cffaaf778e in this term.
I20260709 13:21:44.354386 28219 consensus_queue.cc:1048] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.355860 28040 leader_election.cc:304] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:44.356161 27823 catalog_manager.cc:5697] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "523d4bfd13fa41c78693e670e7919bd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.357123 28238 raft_consensus.cc:2749] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:44.362413 28219 consensus_queue.cc:1048] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.370740 28001 raft_consensus.cc:2468] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 1.
I20260709 13:21:44.366802 28221 raft_consensus.cc:515] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.373566 28221 leader_election.cc:290] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:44.375316 28077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd12c61ad8c246bdb1d9566248940b25" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:44.375993 28077 raft_consensus.cc:3060] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:44.376847 28244 consensus_queue.cc:1048] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.383427 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd12c61ad8c246bdb1d9566248940b25" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:44.384337 27927 raft_consensus.cc:3060] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:44.387941 27825 catalog_manager.cc:5697] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3). New cstate: current_term: 1 leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:44.389729 27825 catalog_manager.cc:5697] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3). New cstate: current_term: 1 leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:44.392167 27927 raft_consensus.cc:2468] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 1.
I20260709 13:21:44.393558 27965 leader_election.cc:304] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:44.394811 28077 raft_consensus.cc:2468] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 1.
I20260709 13:21:44.395311 28270 raft_consensus.cc:2804] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:44.396433 28270 raft_consensus.cc:697] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Becoming Leader. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Running, Role: LEADER
I20260709 13:21:44.399855 28270 consensus_queue.cc:237] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:44.401089 28219 consensus_queue.cc:1048] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:44.420897 27823 catalog_manager.cc:5697] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e reported cstate change: term changed from 0 to 1, leader changed from <none> to da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2). New cstate: current_term: 1 leader_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.456442 27824 catalog_manager.cc:5697] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e reported cstate change: term changed from 0 to 1, leader changed from <none> to da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2). New cstate: current_term: 1 leader_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.460095 28238 consensus_queue.cc:1048] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:44.464390 28244 consensus_queue.cc:1048] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.481647 28268 consensus_queue.cc:1048] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:44.484639 27873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:44.525029 28268 consensus_queue.cc:1048] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.536813 28268 consensus_queue.cc:1048] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.694619 28076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ac97a86640e48d6b1ddf90ea3fa5bec"
dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
mode: GRACEFUL
new_leader_uuid: "523d4bfd13fa41c78693e670e7919bd5"
 from {username='slave'} at 127.0.0.1:40014
I20260709 13:21:44.695266 28076 raft_consensus.cc:606] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Received request to transfer leadership to TS 523d4bfd13fa41c78693e670e7919bd5
I20260709 13:21:44.705888 28268 consensus_queue.cc:1048] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.707268 28076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc4c95b026d5428ab161fe1fade2581e"
dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
mode: GRACEFUL
new_leader_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
 from {username='slave'} at 127.0.0.1:40014
I20260709 13:21:44.708015 28076 raft_consensus.cc:606] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Received request to transfer leadership to TS da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:44.714401 27927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4ca1d03b56f4dc6a248416590f3a74a"
dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
mode: GRACEFUL
new_leader_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
 from {username='slave'} at 127.0.0.1:41840
I20260709 13:21:44.715020 27927 raft_consensus.cc:606] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Received request to transfer leadership to TS da9ab0ed7bc14bbf938be2cffaaf778e
I20260709 13:21:44.717572 28269 consensus_queue.cc:1048] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.732348 28286 consensus_queue.cc:1048] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.749706 28286 consensus_queue.cc:1048] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.819080 28246 consensus_queue.cc:1048] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.823925 28246 consensus_queue.cc:1048] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.834379 28246 consensus_queue.cc:1048] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:44.841585 28270 consensus_queue.cc:1048] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:45.031935 28283 raft_consensus.cc:993] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5: : Instructing follower da9ab0ed7bc14bbf938be2cffaaf778e to start an election
I20260709 13:21:45.032500 28286 raft_consensus.cc:1081] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Signalling peer da9ab0ed7bc14bbf938be2cffaaf778e to start an election
I20260709 13:21:45.034272 28002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4ca1d03b56f4dc6a248416590f3a74a"
dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
 from {username='slave'} at 127.0.0.1:55640
I20260709 13:21:45.034767 28002 raft_consensus.cc:493] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.035063 28002 raft_consensus.cc:3060] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.042742 28002 raft_consensus.cc:515] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:45.046080 28002 leader_election.cc:290] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 2 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:45.046320 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ca1d03b56f4dc6a248416590f3a74a" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:45.046828 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ca1d03b56f4dc6a248416590f3a74a" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:45.047108 27927 raft_consensus.cc:3055] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:45.047591 27927 raft_consensus.cc:740] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:45.047631 28076 raft_consensus.cc:3060] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.048702 27927 consensus_queue.cc:260] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:45.049892 27927 raft_consensus.cc:3060] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.054085 28076 raft_consensus.cc:2468] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 2.
I20260709 13:21:45.055935 27966 leader_election.cc:304] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5fd999cbc342118c1d3dc8068bd99b, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:45.056747 28270 raft_consensus.cc:2804] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:45.057276 28270 raft_consensus.cc:697] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 LEADER]: Becoming Leader. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Running, Role: LEADER
I20260709 13:21:45.058023 27927 raft_consensus.cc:2468] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 2.
I20260709 13:21:45.058125 28270 consensus_queue.cc:237] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:45.066107 27820 catalog_manager.cc:5697] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e reported cstate change: term changed from 1 to 2, leader changed from 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1) to da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2). New cstate: current_term: 2 leader_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:45.082177 28211 raft_consensus.cc:993] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b: : Instructing follower 523d4bfd13fa41c78693e670e7919bd5 to start an election
I20260709 13:21:45.082616 28239 raft_consensus.cc:1081] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Signalling peer 523d4bfd13fa41c78693e670e7919bd5 to start an election
I20260709 13:21:45.084262 27927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ac97a86640e48d6b1ddf90ea3fa5bec"
dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
 from {username='slave'} at 127.0.0.1:41826
I20260709 13:21:45.084841 27927 raft_consensus.cc:493] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.085134 27927 raft_consensus.cc:3060] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.092478 27927 raft_consensus.cc:515] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:45.094223 27927 leader_election.cc:290] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 2 election: Requested vote from peers da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:45.095445 28002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac97a86640e48d6b1ddf90ea3fa5bec" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:45.095510 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac97a86640e48d6b1ddf90ea3fa5bec" candidate_uuid: "523d4bfd13fa41c78693e670e7919bd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:45.096101 28002 raft_consensus.cc:3060] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.096199 28076 raft_consensus.cc:3055] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:45.096632 28076 raft_consensus.cc:740] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:45.097419 28076 consensus_queue.cc:260] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:45.098423 28076 raft_consensus.cc:3060] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.103073 28002 raft_consensus.cc:2468] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 2.
I20260709 13:21:45.103765 28076 raft_consensus.cc:2468] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523d4bfd13fa41c78693e670e7919bd5 in term 2.
I20260709 13:21:45.104624 27890 leader_election.cc:304] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:45.106207 28286 raft_consensus.cc:2804] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:45.106665 28286 raft_consensus.cc:697] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [term 2 LEADER]: Becoming Leader. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:45.107587 28286 consensus_queue.cc:237] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:45.108471 28211 raft_consensus.cc:993] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b: : Instructing follower da9ab0ed7bc14bbf938be2cffaaf778e to start an election
I20260709 13:21:45.109037 28239 raft_consensus.cc:1081] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Signalling peer da9ab0ed7bc14bbf938be2cffaaf778e to start an election
I20260709 13:21:45.110913 28002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc4c95b026d5428ab161fe1fade2581e"
dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
 from {username='slave'} at 127.0.0.1:55632
I20260709 13:21:45.111459 28002 raft_consensus.cc:493] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.111793 28002 raft_consensus.cc:3060] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.115693 27820 catalog_manager.cc:5697] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 reported cstate change: term changed from 1 to 2, leader changed from 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3) to 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "523d4bfd13fa41c78693e670e7919bd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:45.117688 28002 raft_consensus.cc:515] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:45.120251 28002 leader_election.cc:290] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 2 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3:40625)
I20260709 13:21:45.120612 27927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4c95b026d5428ab161fe1fade2581e" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:45.120975 28076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4c95b026d5428ab161fe1fade2581e" candidate_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
I20260709 13:21:45.121325 27927 raft_consensus.cc:3060] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.121649 28076 raft_consensus.cc:3055] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:45.122040 28076 raft_consensus.cc:740] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:45.122850 28076 consensus_queue.cc:260] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:45.123944 28076 raft_consensus.cc:3060] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.128327 27927 raft_consensus.cc:2468] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 2.
I20260709 13:21:45.129640 27965 leader_election.cc:304] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:45.130497 28270 raft_consensus.cc:2804] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:45.130977 28270 raft_consensus.cc:697] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 LEADER]: Becoming Leader. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Running, Role: LEADER
I20260709 13:21:45.131412 28076 raft_consensus.cc:2468] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da9ab0ed7bc14bbf938be2cffaaf778e in term 2.
I20260709 13:21:45.131889 28270 consensus_queue.cc:237] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:45.139789 27820 catalog_manager.cc:5697] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e reported cstate change: term changed from 1 to 2, leader changed from 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3) to da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2). New cstate: current_term: 2 leader_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:45.165300 28024 debug-util.cc:398] Leaking SignalData structure 0x7b08001c8d40 after lost signal to thread 17231
W20260709 13:21:45.167117 28024 debug-util.cc:398] Leaking SignalData structure 0x7b08000af760 after lost signal to thread 27859
W20260709 13:21:45.168653 28024 debug-util.cc:398] Leaking SignalData structure 0x7b08001fc840 after lost signal to thread 27951
W20260709 13:21:45.170123 28024 debug-util.cc:398] Leaking SignalData structure 0x7b08000b3400 after lost signal to thread 28027
W20260709 13:21:45.171423 28024 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7c80 after lost signal to thread 28101
I20260709 13:21:45.591572 28073 raft_consensus.cc:1275] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Refusing update from remote peer 523d4bfd13fa41c78693e670e7919bd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.592974 28286 consensus_queue.cc:1048] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:45.603659 28002 raft_consensus.cc:1275] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Refusing update from remote peer 523d4bfd13fa41c78693e670e7919bd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.605559 28286 consensus_queue.cc:1048] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:45.631605 27926 raft_consensus.cc:1275] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Refusing update from remote peer da9ab0ed7bc14bbf938be2cffaaf778e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.633709 28210 consensus_queue.cc:1048] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:45.651382 28074 raft_consensus.cc:1275] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Refusing update from remote peer da9ab0ed7bc14bbf938be2cffaaf778e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.651922 28076 raft_consensus.cc:1275] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Refusing update from remote peer da9ab0ed7bc14bbf938be2cffaaf778e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.653024 28310 consensus_queue.cc:1048] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:45.653975 28221 consensus_queue.cc:1048] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:45.683506 27926 raft_consensus.cc:1275] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Refusing update from remote peer da9ab0ed7bc14bbf938be2cffaaf778e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.685333 28221 consensus_queue.cc:1048] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:47.753212 27824 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56238:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:21:47.779484 27824 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56238:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:21:47.809998 17228 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:21:47.994086 28351 tablet.cc:1724] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:47.995489 28362 tablet.cc:1724] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:47.998929 28353 tablet.cc:1724] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.020623 28359 tablet.cc:1724] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:21:48.050180 27965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:35235, user_credentials={real_user=slave}} blocked reactor thread for 45488.6us
W20260709 13:21:48.034041 28360 log.cc:927] Time spent T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:21:48.027611 27890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:42797, user_credentials={real_user=slave}} blocked reactor thread for 80538.2us
W20260709 13:21:48.076742 27953 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:3ac97a86640e48d6b1ddf90ea3fa5bec)
W20260709 13:21:48.087675 27953 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:3ac97a86640e48d6b1ddf90ea3fa5bec)
W20260709 13:21:48.102926 27953 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:3ac97a86640e48d6b1ddf90ea3fa5bec)
I20260709 13:21:48.115819 28371 tablet.cc:1724] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.136695 28374 tablet.cc:1724] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.146958 28377 tablet.cc:1724] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.144783 27925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdafd5f072464128a332213104fd0d2f"
dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
mode: GRACEFUL
new_leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
 from {username='slave'} at 127.0.0.1:58098
I20260709 13:21:48.058094 28361 tablet.cc:1724] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.168331 27925 raft_consensus.cc:606] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Received request to transfer leadership to TS 5d5fd999cbc342118c1d3dc8068bd99b
I20260709 13:21:48.175114 28362 tablet.cc:1724] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.206945 28283 raft_consensus.cc:993] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5: : Instructing follower 5d5fd999cbc342118c1d3dc8068bd99b to start an election
I20260709 13:21:48.207437 28283 raft_consensus.cc:1081] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Signalling peer 5d5fd999cbc342118c1d3dc8068bd99b to start an election
I20260709 13:21:48.211263 28351 tablet.cc:1724] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.088328 28367 tablet.cc:1724] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.217749 28382 tablet.cc:1724] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.218113 28377 tablet.cc:1724] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.217834 28353 tablet.cc:1724] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.161440 28359 tablet.cc:1724] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.236984 28076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdafd5f072464128a332213104fd0d2f"
dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
 from {username='slave'} at 127.0.0.1:39998
I20260709 13:21:48.237933 28076 raft_consensus.cc:493] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:48.238425 28076 raft_consensus.cc:3060] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.241689 28381 tablet.cc:1724] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.253422 28387 tablet.cc:1724] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.271279 28381 tablet.cc:1724] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.280138 28371 tablet.cc:1724] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.283804 28381 tablet.cc:1724] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.292860 28076 raft_consensus.cc:515] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:48.299593 28076 leader_election.cc:290] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 2 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
W20260709 13:21:48.311831 28379 log.cc:927] Time spent T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:21:48.316030 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdafd5f072464128a332213104fd0d2f" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:48.316720 27926 raft_consensus.cc:3055] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:48.304102 28361 tablet.cc:1724] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.317044 27926 raft_consensus.cc:740] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:48.317879 27926 consensus_queue.cc:260] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:48.319998 28353 tablet.cc:1724] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.322402 27926 raft_consensus.cc:3060] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.302876 28374 tablet.cc:1724] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.326474 28362 tablet.cc:1724] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.327277 28367 tablet.cc:1724] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.306123 28351 tablet.cc:1724] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.343971 28000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdafd5f072464128a332213104fd0d2f" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:48.344651 28000 raft_consensus.cc:3060] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.353355 27926 raft_consensus.cc:2468] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 2.
I20260709 13:21:48.354678 28040 leader_election.cc:304] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:48.358356 28372 raft_consensus.cc:2804] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:48.358883 28372 raft_consensus.cc:697] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 LEADER]: Becoming Leader. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:48.359743 28372 consensus_queue.cc:237] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:48.366225 28377 tablet.cc:1724] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:48.371224 28000 raft_consensus.cc:2468] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 2.
I20260709 13:21:48.380813 27822 catalog_manager.cc:5697] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b reported cstate change: term changed from 1 to 2, leader changed from 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1) to 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3). New cstate: current_term: 2 leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:48.405599 28000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd12c61ad8c246bdb1d9566248940b25"
dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
mode: GRACEFUL
new_leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
 from {username='slave'} at 127.0.0.1:43022
I20260709 13:21:48.406333 28000 raft_consensus.cc:606] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Received request to transfer leadership to TS 5d5fd999cbc342118c1d3dc8068bd99b
I20260709 13:21:48.408167 17228 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:21:48.408849 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:48.419977 28000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23fbb2d99216479a9dfe735d0d347e49"
dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
mode: GRACEFUL
new_leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
 from {username='slave'} at 127.0.0.1:43022
I20260709 13:21:48.420578 28000 raft_consensus.cc:606] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 LEADER]: Received request to transfer leadership to TS 5d5fd999cbc342118c1d3dc8068bd99b
I20260709 13:21:48.423554 27926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dd3361a0c254f75aad14e00ef207660"
dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
mode: GRACEFUL
new_leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
 from {username='slave'} at 127.0.0.1:58098
I20260709 13:21:48.424130 27926 raft_consensus.cc:606] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Received request to transfer leadership to TS 5d5fd999cbc342118c1d3dc8068bd99b
I20260709 13:21:48.426096 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:48.428772 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:48.429468 27820 catalog_manager.cc:6242] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb: soft_deleted_table [id=6ed81b7b92bc4cfe861abc23af7de2cd] alter complete (version 1)
I20260709 13:21:48.491123 28385 raft_consensus.cc:993] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e: : Instructing follower 5d5fd999cbc342118c1d3dc8068bd99b to start an election
I20260709 13:21:48.491843 28354 raft_consensus.cc:1081] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Signalling peer 5d5fd999cbc342118c1d3dc8068bd99b to start an election
I20260709 13:21:48.493525 28076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd12c61ad8c246bdb1d9566248940b25"
dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
 from {username='slave'} at 127.0.0.1:39992
I20260709 13:21:48.494057 28076 raft_consensus.cc:493] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:48.494386 28076 raft_consensus.cc:3060] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.500002 28076 raft_consensus.cc:515] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:48.501967 28076 leader_election.cc:290] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 2 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:48.502761 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd12c61ad8c246bdb1d9566248940b25" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:48.503225 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd12c61ad8c246bdb1d9566248940b25" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:48.503420 27926 raft_consensus.cc:3060] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.504019 28001 raft_consensus.cc:3055] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:48.504375 28001 raft_consensus.cc:740] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Running, Role: LEADER
I20260709 13:21:48.505188 28001 consensus_queue.cc:260] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:48.506338 28001 raft_consensus.cc:3060] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.511415 27926 raft_consensus.cc:2468] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 2.
I20260709 13:21:48.512951 28040 leader_election.cc:304] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:48.513104 28001 raft_consensus.cc:2468] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 2.
I20260709 13:21:48.513821 28372 raft_consensus.cc:2804] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:48.514436 28372 raft_consensus.cc:697] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 LEADER]: Becoming Leader. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:48.515303 28372 consensus_queue.cc:237] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:48.523916 27822 catalog_manager.cc:5697] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b reported cstate change: term changed from 1 to 2, leader changed from da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2) to 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3). New cstate: current_term: 2 leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:48.730298 28358 raft_consensus.cc:993] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5: : Instructing follower 5d5fd999cbc342118c1d3dc8068bd99b to start an election
I20260709 13:21:48.730795 28328 raft_consensus.cc:1081] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Signalling peer 5d5fd999cbc342118c1d3dc8068bd99b to start an election
I20260709 13:21:48.732251 28076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dd3361a0c254f75aad14e00ef207660"
dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
 from {username='slave'} at 127.0.0.1:39998
I20260709 13:21:48.732712 28076 raft_consensus.cc:493] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:48.732999 28076 raft_consensus.cc:3060] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.737557 28076 raft_consensus.cc:515] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:48.739233 28076 leader_election.cc:290] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 2 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:48.740077 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd3361a0c254f75aad14e00ef207660" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:48.740306 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd3361a0c254f75aad14e00ef207660" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:48.740808 27926 raft_consensus.cc:3055] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:48.740947 28001 raft_consensus.cc:3060] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.741199 27926 raft_consensus.cc:740] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 523d4bfd13fa41c78693e670e7919bd5, State: Running, Role: LEADER
I20260709 13:21:48.742151 27926 consensus_queue.cc:260] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:48.743412 27926 raft_consensus.cc:3060] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.746887 28001 raft_consensus.cc:2468] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 2.
I20260709 13:21:48.748077 28040 leader_election.cc:304] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5fd999cbc342118c1d3dc8068bd99b, da9ab0ed7bc14bbf938be2cffaaf778e; no voters: 
I20260709 13:21:48.748733 28372 raft_consensus.cc:2804] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:48.749185 28372 raft_consensus.cc:697] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 LEADER]: Becoming Leader. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:48.750003 28372 consensus_queue.cc:237] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:48.750708 27926 raft_consensus.cc:2468] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 2.
I20260709 13:21:48.760644 27822 catalog_manager.cc:5697] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b reported cstate change: term changed from 1 to 2, leader changed from 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1) to 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3). New cstate: current_term: 2 leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:48.813314 27926 raft_consensus.cc:1275] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Refusing update from remote peer 5d5fd999cbc342118c1d3dc8068bd99b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:21:48.814848 28372 consensus_queue.cc:1048] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:48.829859 28001 raft_consensus.cc:1275] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Refusing update from remote peer 5d5fd999cbc342118c1d3dc8068bd99b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:21:48.835052 28372 consensus_queue.cc:1048] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:48.848906 28354 raft_consensus.cc:993] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e: : Instructing follower 5d5fd999cbc342118c1d3dc8068bd99b to start an election
I20260709 13:21:48.852986 28385 raft_consensus.cc:1081] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 LEADER]: Signalling peer 5d5fd999cbc342118c1d3dc8068bd99b to start an election
I20260709 13:21:48.856514 28074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23fbb2d99216479a9dfe735d0d347e49"
dest_uuid: "5d5fd999cbc342118c1d3dc8068bd99b"
 from {username='slave'} at 127.0.0.1:39992
I20260709 13:21:48.857121 28074 raft_consensus.cc:493] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:48.857561 28074 raft_consensus.cc:3060] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.866437 28074 raft_consensus.cc:515] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:48.868727 28074 leader_election.cc:290] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 3 election: Requested vote from peers 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235), da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797)
I20260709 13:21:48.870232 27926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fbb2d99216479a9dfe735d0d347e49" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "523d4bfd13fa41c78693e670e7919bd5"
I20260709 13:21:48.872711 27926 raft_consensus.cc:3060] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.871830 28001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23fbb2d99216479a9dfe735d0d347e49" candidate_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e"
I20260709 13:21:48.876022 28001 raft_consensus.cc:3055] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:48.876284 28001 raft_consensus.cc:740] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da9ab0ed7bc14bbf938be2cffaaf778e, State: Running, Role: LEADER
I20260709 13:21:48.877198 28001 consensus_queue.cc:260] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:48.878227 28001 raft_consensus.cc:3060] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.880618 27926 raft_consensus.cc:2468] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 3.
I20260709 13:21:48.882187 28040 leader_election.cc:304] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523d4bfd13fa41c78693e670e7919bd5, 5d5fd999cbc342118c1d3dc8068bd99b; no voters: 
I20260709 13:21:48.883155 28372 raft_consensus.cc:2804] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:48.883666 28372 raft_consensus.cc:697] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 3 LEADER]: Becoming Leader. State: Replica: 5d5fd999cbc342118c1d3dc8068bd99b, State: Running, Role: LEADER
I20260709 13:21:48.884464 28372 consensus_queue.cc:237] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } }
I20260709 13:21:48.891615 28001 raft_consensus.cc:2468] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5fd999cbc342118c1d3dc8068bd99b in term 3.
I20260709 13:21:48.949559 27821 catalog_manager.cc:5697] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b reported cstate change: term changed from 2 to 3, leader changed from da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2) to 5d5fd999cbc342118c1d3dc8068bd99b (127.16.211.3). New cstate: current_term: 3 leader_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5fd999cbc342118c1d3dc8068bd99b" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 40625 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:48.979727 28000 raft_consensus.cc:1275] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Refusing update from remote peer 5d5fd999cbc342118c1d3dc8068bd99b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:21:48.981607 28372 consensus_queue.cc:1048] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:48.995481 27926 raft_consensus.cc:1275] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Refusing update from remote peer 5d5fd999cbc342118c1d3dc8068bd99b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:21:49.002157 28378 consensus_queue.cc:1048] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:49.289678 28000 raft_consensus.cc:1275] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Refusing update from remote peer 5d5fd999cbc342118c1d3dc8068bd99b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:49.293159 28378 consensus_queue.cc:1048] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:49.305552 27926 raft_consensus.cc:1275] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Refusing update from remote peer 5d5fd999cbc342118c1d3dc8068bd99b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:49.307402 28393 consensus_queue.cc:1048] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:49.330705 28000 raft_consensus.cc:1275] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 3 FOLLOWER]: Refusing update from remote peer 5d5fd999cbc342118c1d3dc8068bd99b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:49.334954 28393 consensus_queue.cc:1048] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9ab0ed7bc14bbf938be2cffaaf778e" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:49.353890 27926 raft_consensus.cc:1275] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 3 FOLLOWER]: Refusing update from remote peer 5d5fd999cbc342118c1d3dc8068bd99b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:49.358140 28393 consensus_queue.cc:1048] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [LEADER]: Connected to new peer: Peer: permanent_uuid: "523d4bfd13fa41c78693e670e7919bd5" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:49.507033 17228 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:21:49.512265 17228 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:21:49.512734 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:49.517522 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:21:49.517990 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:50.547652 17228 tablet_server.cc:179] TabletServer@127.16.211.1:0 shutting down...
I20260709 13:21:50.580673 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:50.581552 17228 tablet_replica.cc:333] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.582798 17228 raft_consensus.cc:2243] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.583822 17228 raft_consensus.cc:2272] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.586365 17228 tablet_replica.cc:333] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.586984 17228 raft_consensus.cc:2243] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.587921 17228 raft_consensus.cc:2272] T 3f8000fe8a7340039e63a3ecf8c23b70 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.590356 17228 tablet_replica.cc:333] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.591168 17228 raft_consensus.cc:2243] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.592289 17228 raft_consensus.cc:2272] T 7f0b89dd50814f41998d31e52b1abc34 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.596345 17228 tablet_replica.cc:333] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.597580 17228 raft_consensus.cc:2243] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.598272 17228 raft_consensus.cc:2272] T 1429996568da4007a81b14fdef35f952 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.602365 17228 tablet_replica.cc:333] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
W20260709 13:21:50.602681 28040 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 13:21:50.603415 17228 raft_consensus.cc:2243] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.604357 17228 raft_consensus.cc:2272] T fd12c61ad8c246bdb1d9566248940b25 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.606350 28040 consensus_peers.cc:597] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b -> Peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Couldn't send request to peer 523d4bfd13fa41c78693e670e7919bd5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.608669 17228 tablet_replica.cc:333] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.609725 17228 raft_consensus.cc:2243] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.611377 17228 raft_consensus.cc:2272] T b757cffb0fe44b94af9cee6d46ada58a P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.615600 17228 tablet_replica.cc:333] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.616433 17228 raft_consensus.cc:2243] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.617096 17228 raft_consensus.cc:2272] T 6e6c916e6ebe4597ac8ded882e7d6812 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.620502 17228 tablet_replica.cc:333] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.621520 17228 raft_consensus.cc:2243] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.622136 17228 raft_consensus.cc:2272] T 3dd3361a0c254f75aad14e00ef207660 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.624325 17228 tablet_replica.cc:333] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.624920 17228 raft_consensus.cc:2243] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.625432 17228 raft_consensus.cc:2272] T b4ca1d03b56f4dc6a248416590f3a74a P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.628449 17228 tablet_replica.cc:333] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.629176 17228 raft_consensus.cc:2243] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.629762 17228 raft_consensus.cc:2272] T 7f0fe1cb57654d61b395f64563344da7 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.632350 17228 tablet_replica.cc:333] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.633069 17228 raft_consensus.cc:2243] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.633726 17228 raft_consensus.cc:2272] T 1529d5eb47504b29a6ad007fc5c9ee54 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.638674 17228 tablet_replica.cc:333] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.639256 17228 raft_consensus.cc:2243] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.640162 17228 raft_consensus.cc:2272] T 7dca9b4020f7467e8f4e3d95a24fd613 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.642735 17228 tablet_replica.cc:333] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.643867 17228 raft_consensus.cc:2243] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.644416 17228 raft_consensus.cc:2272] T d97dafff4fb74bd89626cedfcb6101f1 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.646900 17228 tablet_replica.cc:333] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.647418 17228 raft_consensus.cc:2243] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.647975 17228 raft_consensus.cc:2272] T cdafd5f072464128a332213104fd0d2f P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.650349 17228 tablet_replica.cc:333] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.651109 17228 raft_consensus.cc:2243] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.652072 17228 raft_consensus.cc:2272] T aac2bab3b09549f59154d01a18d812f3 P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.654258 17228 tablet_replica.cc:333] T 7d594e25aaf04d41ba68d5abb14f73c3 P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.654716 17228 raft_consensus.cc:2243] T 7d594e25aaf04d41ba68d5abb14f73c3 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.655164 17228 raft_consensus.cc:2272] T 7d594e25aaf04d41ba68d5abb14f73c3 P 523d4bfd13fa41c78693e670e7919bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.657568 17228 tablet_replica.cc:333] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.658182 17228 raft_consensus.cc:2243] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.658717 17228 raft_consensus.cc:2272] T fc4c95b026d5428ab161fe1fade2581e P 523d4bfd13fa41c78693e670e7919bd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.660847 17228 tablet_replica.cc:333] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5: stopping tablet replica
I20260709 13:21:50.661387 17228 raft_consensus.cc:2243] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.661873 17228 raft_consensus.cc:2272] T 23fbb2d99216479a9dfe735d0d347e49 P 523d4bfd13fa41c78693e670e7919bd5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.710479 17228 tablet_server.cc:196] TabletServer@127.16.211.1:0 shutdown complete.
W20260709 13:21:50.746371 27965 consensus_peers.cc:597] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e -> Peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Couldn't send request to peer 523d4bfd13fa41c78693e670e7919bd5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:35235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.750038 28040 consensus_peers.cc:597] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b -> Peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Couldn't send request to peer 523d4bfd13fa41c78693e670e7919bd5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:35235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.750131 27965 consensus_peers.cc:597] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e -> Peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Couldn't send request to peer 523d4bfd13fa41c78693e670e7919bd5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:35235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.750680 28040 consensus_peers.cc:597] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b -> Peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Couldn't send request to peer 523d4bfd13fa41c78693e670e7919bd5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:35235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.750778 27965 consensus_peers.cc:597] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e -> Peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Couldn't send request to peer 523d4bfd13fa41c78693e670e7919bd5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:35235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.764575 17228 tablet_server.cc:179] TabletServer@127.16.211.2:0 shutting down...
W20260709 13:21:50.787768 28040 consensus_peers.cc:597] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b -> Peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Couldn't send request to peer 523d4bfd13fa41c78693e670e7919bd5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:35235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.800239 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:50.801235 17228 tablet_replica.cc:333] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.802285 17228 raft_consensus.cc:2243] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.803092 17228 raft_consensus.cc:2272] T 3ac97a86640e48d6b1ddf90ea3fa5bec P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.806669 17228 tablet_replica.cc:333] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.807610 17228 raft_consensus.cc:2243] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:50.808286 27965 consensus_peers.cc:597] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e -> Peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Couldn't send request to peer 523d4bfd13fa41c78693e670e7919bd5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:35235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.808424 17228 raft_consensus.cc:2272] T 3f8000fe8a7340039e63a3ecf8c23b70 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.808957 28040 consensus_peers.cc:597] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b -> Peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Couldn't send request to peer 523d4bfd13fa41c78693e670e7919bd5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:35235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.812664 17228 tablet_replica.cc:333] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.813467 17228 raft_consensus.cc:2243] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:21:50.814535 27965 consensus_peers.cc:597] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e -> Peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Couldn't send request to peer 523d4bfd13fa41c78693e670e7919bd5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:35235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.814756 17228 raft_consensus.cc:2272] T 6e6c916e6ebe4597ac8ded882e7d6812 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.817312 17228 tablet_replica.cc:333] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.817869 17228 raft_consensus.cc:2243] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.818374 17228 raft_consensus.cc:2272] T 3dd3361a0c254f75aad14e00ef207660 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.820484 17228 tablet_replica.cc:333] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.821152 17228 raft_consensus.cc:2243] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.822168 17228 raft_consensus.cc:2272] T fc4c95b026d5428ab161fe1fade2581e P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.825057 17228 tablet_replica.cc:333] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.825788 17228 raft_consensus.cc:2243] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.826332 17228 raft_consensus.cc:2272] T 23fbb2d99216479a9dfe735d0d347e49 P da9ab0ed7bc14bbf938be2cffaaf778e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.827135 28040 consensus_peers.cc:597] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b -> Peer 523d4bfd13fa41c78693e670e7919bd5 (127.16.211.1:35235): Couldn't send request to peer 523d4bfd13fa41c78693e670e7919bd5. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:35235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.829154 17228 tablet_replica.cc:333] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.830066 17228 raft_consensus.cc:2243] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:50.830557 28040 consensus_peers.cc:597] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b -> Peer da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797): Couldn't send request to peer da9ab0ed7bc14bbf938be2cffaaf778e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.830717 17228 raft_consensus.cc:2272] T 7d594e25aaf04d41ba68d5abb14f73c3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.833808 28040 consensus_peers.cc:597] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b -> Peer da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797): Couldn't send request to peer da9ab0ed7bc14bbf938be2cffaaf778e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.833988 17228 tablet_replica.cc:333] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.834738 17228 raft_consensus.cc:2243] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.835163 17228 raft_consensus.cc:2272] T fd12c61ad8c246bdb1d9566248940b25 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.837239 17228 tablet_replica.cc:333] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.837811 17228 raft_consensus.cc:2243] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.838368 17228 raft_consensus.cc:2272] T b757cffb0fe44b94af9cee6d46ada58a P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.840654 17228 tablet_replica.cc:333] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.841284 17228 raft_consensus.cc:2243] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.841727 17228 raft_consensus.cc:2272] T 7f0b89dd50814f41998d31e52b1abc34 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.843850 17228 tablet_replica.cc:333] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.844355 17228 raft_consensus.cc:2243] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.845227 17228 raft_consensus.cc:2272] T 1429996568da4007a81b14fdef35f952 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.847505 17228 tablet_replica.cc:333] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.848079 17228 raft_consensus.cc:2243] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.849052 17228 raft_consensus.cc:2272] T b4ca1d03b56f4dc6a248416590f3a74a P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.851637 17228 tablet_replica.cc:333] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.852202 17228 raft_consensus.cc:2243] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.853047 17228 raft_consensus.cc:2272] T 7f0fe1cb57654d61b395f64563344da7 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.855417 17228 tablet_replica.cc:333] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.856041 17228 raft_consensus.cc:2243] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.856546 17228 raft_consensus.cc:2272] T 1529d5eb47504b29a6ad007fc5c9ee54 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.858675 17228 tablet_replica.cc:333] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.859186 17228 raft_consensus.cc:2243] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.859675 17228 raft_consensus.cc:2272] T 7dca9b4020f7467e8f4e3d95a24fd613 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.861828 17228 tablet_replica.cc:333] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.862396 17228 raft_consensus.cc:2243] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.862864 17228 raft_consensus.cc:2272] T cdafd5f072464128a332213104fd0d2f P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.864934 17228 tablet_replica.cc:333] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.865406 17228 raft_consensus.cc:2243] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.866303 17228 raft_consensus.cc:2272] T d97dafff4fb74bd89626cedfcb6101f1 P da9ab0ed7bc14bbf938be2cffaaf778e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.868419 17228 tablet_replica.cc:333] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e: stopping tablet replica
I20260709 13:21:50.868886 17228 raft_consensus.cc:2243] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.869432 17228 raft_consensus.cc:2272] T aac2bab3b09549f59154d01a18d812f3 P da9ab0ed7bc14bbf938be2cffaaf778e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.927762 17228 tablet_server.cc:196] TabletServer@127.16.211.2:0 shutdown complete.
I20260709 13:21:50.968580 17228 tablet_server.cc:179] TabletServer@127.16.211.3:0 shutting down...
W20260709 13:21:50.969244 28040 consensus_peers.cc:597] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b -> Peer da9ab0ed7bc14bbf938be2cffaaf778e (127.16.211.2:42797): Couldn't send request to peer da9ab0ed7bc14bbf938be2cffaaf778e. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:42797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:51.002506 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:51.003326 17228 tablet_replica.cc:333] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.004135 17228 raft_consensus.cc:2243] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.005028 17228 raft_consensus.cc:2272] T 1529d5eb47504b29a6ad007fc5c9ee54 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.007424 17228 tablet_replica.cc:333] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.008021 17228 raft_consensus.cc:2243] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.008538 17228 raft_consensus.cc:2272] T 7dca9b4020f7467e8f4e3d95a24fd613 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.010645 17228 tablet_replica.cc:333] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.011435 17228 raft_consensus.cc:2243] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.012009 17228 raft_consensus.cc:2272] T 3f8000fe8a7340039e63a3ecf8c23b70 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.014137 17228 tablet_replica.cc:333] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.014673 17228 raft_consensus.cc:2243] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.015121 17228 raft_consensus.cc:2272] T 7f0b89dd50814f41998d31e52b1abc34 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.017264 17228 tablet_replica.cc:333] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.017850 17228 raft_consensus.cc:2243] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.018452 17228 raft_consensus.cc:2272] T 1429996568da4007a81b14fdef35f952 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.020648 17228 tablet_replica.cc:333] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.021227 17228 raft_consensus.cc:2243] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.021693 17228 raft_consensus.cc:2272] T 6e6c916e6ebe4597ac8ded882e7d6812 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.024003 17228 tablet_replica.cc:333] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.024554 17228 raft_consensus.cc:2243] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.025300 17228 raft_consensus.cc:2272] T 3dd3361a0c254f75aad14e00ef207660 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.027588 17228 tablet_replica.cc:333] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.028126 17228 raft_consensus.cc:2243] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.028573 17228 raft_consensus.cc:2272] T 3ac97a86640e48d6b1ddf90ea3fa5bec P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.030652 17228 tablet_replica.cc:333] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.031251 17228 raft_consensus.cc:2243] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.031737 17228 raft_consensus.cc:2272] T fc4c95b026d5428ab161fe1fade2581e P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.033769 17228 tablet_replica.cc:333] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.034344 17228 raft_consensus.cc:2243] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.035106 17228 raft_consensus.cc:2272] T 23fbb2d99216479a9dfe735d0d347e49 P 5d5fd999cbc342118c1d3dc8068bd99b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.037076 17228 tablet_replica.cc:333] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.037611 17228 raft_consensus.cc:2243] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.038494 17228 raft_consensus.cc:2272] T 7d594e25aaf04d41ba68d5abb14f73c3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.040591 17228 tablet_replica.cc:333] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.041146 17228 raft_consensus.cc:2243] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.041896 17228 raft_consensus.cc:2272] T fd12c61ad8c246bdb1d9566248940b25 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.044147 17228 tablet_replica.cc:333] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.044811 17228 raft_consensus.cc:2243] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.045389 17228 raft_consensus.cc:2272] T b757cffb0fe44b94af9cee6d46ada58a P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.047569 17228 tablet_replica.cc:333] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.048116 17228 raft_consensus.cc:2243] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.048653 17228 raft_consensus.cc:2272] T d97dafff4fb74bd89626cedfcb6101f1 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.050828 17228 tablet_replica.cc:333] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.051321 17228 raft_consensus.cc:2243] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.052093 17228 raft_consensus.cc:2272] T cdafd5f072464128a332213104fd0d2f P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.054117 17228 tablet_replica.cc:333] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.054584 17228 raft_consensus.cc:2243] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.055071 17228 raft_consensus.cc:2272] T aac2bab3b09549f59154d01a18d812f3 P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.056958 17228 tablet_replica.cc:333] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.057405 17228 raft_consensus.cc:2243] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.057945 17228 raft_consensus.cc:2272] T b4ca1d03b56f4dc6a248416590f3a74a P 5d5fd999cbc342118c1d3dc8068bd99b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.059908 17228 tablet_replica.cc:333] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b: stopping tablet replica
I20260709 13:21:51.060377 17228 raft_consensus.cc:2243] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.060835 17228 raft_consensus.cc:2272] T 7f0fe1cb57654d61b395f64563344da7 P 5d5fd999cbc342118c1d3dc8068bd99b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.101586 17228 tablet_server.cc:196] TabletServer@127.16.211.3:0 shutdown complete.
I20260709 13:21:51.138078 17228 master.cc:562] Master@127.16.211.62:34433 shutting down...
I20260709 13:21:51.168403 17228 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.168985 17228 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.169312 17228 tablet_replica.cc:333] T 00000000000000000000000000000000 P b9273b06274e482ca25a599f10cec7eb: stopping tablet replica
I20260709 13:21:51.192322 17228 master.cc:584] Master@127.16.211.62:34433 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12990 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:21:51.252712 17228 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.211.62:36045
I20260709 13:21:51.253983 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:51.259874 28411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:51.260052 28412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:51.261351 28414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:51.261538 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:51.262624 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:51.262811 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:51.262941 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603311262929 us; error 0 us; skew 500 ppm
I20260709 13:21:51.263394 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:51.265883 17228 webserver.cc:533] Webserver started at http://127.16.211.62:46165/ using document root <none> and password file <none>
I20260709 13:21:51.266515 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:51.266680 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:51.266912 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:51.268055 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/master-0-root/instance:
uuid: "8c24777189d44479b68f7053b63bf615"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-96c3"
I20260709 13:21:51.272572 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:21:51.276029 28419 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.276793 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:51.277096 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/master-0-root
uuid: "8c24777189d44479b68f7053b63bf615"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-96c3"
I20260709 13:21:51.277374 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:51.299612 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:51.300931 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:51.342124 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.62:36045
I20260709 13:21:51.342227 28470 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.62:36045 every 8 connection(s)
I20260709 13:21:51.346107 28471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.357247 28471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615: Bootstrap starting.
I20260709 13:21:51.361970 28471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.366329 28471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615: No bootstrap required, opened a new log
I20260709 13:21:51.368827 28471 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c24777189d44479b68f7053b63bf615" member_type: VOTER }
I20260709 13:21:51.369244 28471 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.369441 28471 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c24777189d44479b68f7053b63bf615, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.370034 28471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c24777189d44479b68f7053b63bf615" member_type: VOTER }
I20260709 13:21:51.370468 28471 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:51.370676 28471 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:51.370905 28471 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.376032 28471 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c24777189d44479b68f7053b63bf615" member_type: VOTER }
I20260709 13:21:51.376547 28471 leader_election.cc:304] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c24777189d44479b68f7053b63bf615; no voters: 
I20260709 13:21:51.377787 28471 leader_election.cc:290] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:51.378238 28474 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.379798 28474 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [term 1 LEADER]: Becoming Leader. State: Replica: 8c24777189d44479b68f7053b63bf615, State: Running, Role: LEADER
I20260709 13:21:51.380513 28474 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c24777189d44479b68f7053b63bf615" member_type: VOTER }
I20260709 13:21:51.380940 28471 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:51.386063 28476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c24777189d44479b68f7053b63bf615. Latest consensus state: current_term: 1 leader_uuid: "8c24777189d44479b68f7053b63bf615" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c24777189d44479b68f7053b63bf615" member_type: VOTER } }
I20260709 13:21:51.386144 28475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c24777189d44479b68f7053b63bf615" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c24777189d44479b68f7053b63bf615" member_type: VOTER } }
I20260709 13:21:51.387247 28475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:51.387265 28476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:51.389348 28481 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:51.397727 28481 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:51.398749 17228 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:51.406776 28481 catalog_manager.cc:1383] Generated new cluster ID: 8a4ef666317b4366b0bea0c3a308964e
I20260709 13:21:51.407083 28481 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:51.428335 28481 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:51.430441 28481 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:51.449272 28481 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615: Generated new TSK 0
I20260709 13:21:51.449894 28481 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:51.466058 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:51.471958 28492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:51.473145 28493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:51.474716 28495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:51.475482 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:51.476356 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:51.476557 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:51.476723 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603311476705 us; error 0 us; skew 500 ppm
I20260709 13:21:51.477257 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:51.479674 17228 webserver.cc:533] Webserver started at http://127.16.211.1:45871/ using document root <none> and password file <none>
I20260709 13:21:51.480137 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:51.480319 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:51.480578 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:51.481647 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-0-root/instance:
uuid: "d51f98307f3848dea031026c70f09750"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-96c3"
I20260709 13:21:51.486440 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:51.489621 28500 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.490509 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:21:51.490741 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-0-root
uuid: "d51f98307f3848dea031026c70f09750"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-96c3"
I20260709 13:21:51.490981 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:51.514889 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:51.516079 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:51.517521 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:51.519862 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:51.520044 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.520326 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:51.520490 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.562973 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.1:39399
I20260709 13:21:51.563086 28562 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.1:39399 every 8 connection(s)
I20260709 13:21:51.567724 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:51.575814 28567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:51.579020 28568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:51.579864 17228 server_base.cc:1061] running on GCE node
W20260709 13:21:51.580335 28570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:51.581377 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:51.581564 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:51.581748 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603311581716 us; error 0 us; skew 500 ppm
I20260709 13:21:51.582324 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:51.582435 28563 heartbeater.cc:344] Connected to a master server at 127.16.211.62:36045
I20260709 13:21:51.582979 28563 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:51.584060 28563 heartbeater.cc:507] Master 127.16.211.62:36045 requested a full tablet report, sending...
I20260709 13:21:51.588629 28436 ts_manager.cc:194] Registered new tserver with Master: d51f98307f3848dea031026c70f09750 (127.16.211.1:39399)
I20260709 13:21:51.590500 17228 webserver.cc:533] Webserver started at http://127.16.211.2:39785/ using document root <none> and password file <none>
I20260709 13:21:51.591221 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:51.591457 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:51.591753 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:51.592023 28436 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43542
I20260709 13:21:51.593531 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-1-root/instance:
uuid: "0658b7a0664e42f4b42b35ed4581c14d"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-96c3"
I20260709 13:21:51.598590 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:51.602136 28575 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.602936 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:21:51.603236 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-1-root
uuid: "0658b7a0664e42f4b42b35ed4581c14d"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-96c3"
I20260709 13:21:51.603482 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:51.622478 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:51.623713 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:51.625222 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:51.627482 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:51.627723 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.627978 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:51.628192 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.670568 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.2:33907
I20260709 13:21:51.670666 28637 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.2:33907 every 8 connection(s)
I20260709 13:21:51.675509 17228 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:51.683192 28641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:51.691130 28638 heartbeater.cc:344] Connected to a master server at 127.16.211.62:36045
W20260709 13:21:51.685344 28642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:51.691881 28638 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:51.692930 28638 heartbeater.cc:507] Master 127.16.211.62:36045 requested a full tablet report, sending...
W20260709 13:21:51.694952 28644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:51.695528 28436 ts_manager.cc:194] Registered new tserver with Master: 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:51.696820 17228 server_base.cc:1061] running on GCE node
I20260709 13:21:51.697026 28436 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43554
I20260709 13:21:51.698055 17228 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:51.698328 17228 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:51.698464 17228 hybrid_clock.cc:648] HybridClock initialized: now 1783603311698453 us; error 0 us; skew 500 ppm
I20260709 13:21:51.698982 17228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:51.701423 17228 webserver.cc:533] Webserver started at http://127.16.211.3:33081/ using document root <none> and password file <none>
I20260709 13:21:51.702097 17228 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:51.702289 17228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:51.702565 17228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:51.703722 17228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-2-root/instance:
uuid: "70416ec32d0c4d78856daf60c9290418"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-96c3"
I20260709 13:21:51.708695 17228 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:21:51.712289 28649 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.713129 17228 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:51.713425 17228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-2-root
uuid: "70416ec32d0c4d78856daf60c9290418"
format_stamp: "Formatted at 2026-07-09 13:21:51 on dist-test-slave-96c3"
I20260709 13:21:51.713706 17228 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqdnI0x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602988568269-17228-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:51.729830 17228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:51.731267 17228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:51.732987 17228 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:51.735575 17228 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:51.735836 17228 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.736109 17228 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:51.736299 17228 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:51.778481 17228 rpc_server.cc:307] RPC server started. Bound to: 127.16.211.3:34069
I20260709 13:21:51.778623 28711 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.211.3:34069 every 8 connection(s)
I20260709 13:21:51.792590 28712 heartbeater.cc:344] Connected to a master server at 127.16.211.62:36045
I20260709 13:21:51.793079 28712 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:51.793813 28712 heartbeater.cc:507] Master 127.16.211.62:36045 requested a full tablet report, sending...
I20260709 13:21:51.795744 28436 ts_manager.cc:194] Registered new tserver with Master: 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:51.796732 17228 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014734153s
I20260709 13:21:51.797147 28436 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43556
I20260709 13:21:51.822571 28436 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43566:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:51.825228 28436 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:51.900880 28603 tablet_service.cc:1511] Processing CreateTablet for tablet 469092d44c10446288fd71f5e5ec6dba (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:51.902376 28603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 469092d44c10446288fd71f5e5ec6dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.910070 28602 tablet_service.cc:1511] Processing CreateTablet for tablet aefc456fb1b046fe9ba1309b495c7394 (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:51.911629 28602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aefc456fb1b046fe9ba1309b495c7394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.912117 28527 tablet_service.cc:1511] Processing CreateTablet for tablet aefc456fb1b046fe9ba1309b495c7394 (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:51.913645 28527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aefc456fb1b046fe9ba1309b495c7394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.913471 28673 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec27a71b4b249de856c6826bfc090a7 (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:51.914911 28673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec27a71b4b249de856c6826bfc090a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.916877 28676 tablet_service.cc:1511] Processing CreateTablet for tablet aefc456fb1b046fe9ba1309b495c7394 (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:51.919222 28675 tablet_service.cc:1511] Processing CreateTablet for tablet e39792ab55ed4b3d9df9c50f3667237b (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:51.919697 28601 tablet_service.cc:1511] Processing CreateTablet for tablet e39792ab55ed4b3d9df9c50f3667237b (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:51.921216 28601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39792ab55ed4b3d9df9c50f3667237b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.921092 28528 tablet_service.cc:1511] Processing CreateTablet for tablet 469092d44c10446288fd71f5e5ec6dba (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:51.922569 28528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 469092d44c10446288fd71f5e5ec6dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.924132 28526 tablet_service.cc:1511] Processing CreateTablet for tablet e39792ab55ed4b3d9df9c50f3667237b (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:51.925518 28526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39792ab55ed4b3d9df9c50f3667237b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.921269 28674 tablet_service.cc:1511] Processing CreateTablet for tablet 9f37c95f25f84fc2ab0362ee29e4ddbf (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:51.927101 28525 tablet_service.cc:1511] Processing CreateTablet for tablet 9f37c95f25f84fc2ab0362ee29e4ddbf (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:51.928469 28525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f37c95f25f84fc2ab0362ee29e4ddbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.931098 28524 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec27a71b4b249de856c6826bfc090a7 (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:51.932729 28524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec27a71b4b249de856c6826bfc090a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.933902 28599 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec27a71b4b249de856c6826bfc090a7 (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:51.936653 28598 tablet_service.cc:1511] Processing CreateTablet for tablet 2715fbba118d481db30cc7119e4dbc80 (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:51.937070 28523 tablet_service.cc:1511] Processing CreateTablet for tablet 2715fbba118d481db30cc7119e4dbc80 (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:51.938935 28520 tablet_service.cc:1511] Processing CreateTablet for tablet 270d950e6ae04d5b9168dc1887bb67ef (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:51.939114 28597 tablet_service.cc:1511] Processing CreateTablet for tablet b32e097c804f415bae7c12132ab293df (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:51.935315 28599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec27a71b4b249de856c6826bfc090a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.940385 28520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 270d950e6ae04d5b9168dc1887bb67ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.945013 28522 tablet_service.cc:1511] Processing CreateTablet for tablet b32e097c804f415bae7c12132ab293df (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:51.946275 28597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b32e097c804f415bae7c12132ab293df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.946405 28677 tablet_service.cc:1511] Processing CreateTablet for tablet 469092d44c10446288fd71f5e5ec6dba (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:51.932751 28600 tablet_service.cc:1511] Processing CreateTablet for tablet 9f37c95f25f84fc2ab0362ee29e4ddbf (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:51.949528 28600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f37c95f25f84fc2ab0362ee29e4ddbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.950248 28521 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7a90801bea49dd849e7c4e3faaeb75 (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:51.952162 28596 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7a90801bea49dd849e7c4e3faaeb75 (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:51.954762 28595 tablet_service.cc:1511] Processing CreateTablet for tablet 270d950e6ae04d5b9168dc1887bb67ef (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:51.955116 28671 tablet_service.cc:1511] Processing CreateTablet for tablet b32e097c804f415bae7c12132ab293df (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:51.957969 28670 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7a90801bea49dd849e7c4e3faaeb75 (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:51.953717 28672 tablet_service.cc:1511] Processing CreateTablet for tablet 2715fbba118d481db30cc7119e4dbc80 (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:51.962126 28669 tablet_service.cc:1511] Processing CreateTablet for tablet 270d950e6ae04d5b9168dc1887bb67ef (DEFAULT_TABLE table=test-workload [id=69333c3ffbdd401fae976a6fb4985c10]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:51.964033 28676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aefc456fb1b046fe9ba1309b495c7394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.967190 28675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39792ab55ed4b3d9df9c50f3667237b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.970772 28674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f37c95f25f84fc2ab0362ee29e4ddbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.974782 28671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b32e097c804f415bae7c12132ab293df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.978772 28672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2715fbba118d481db30cc7119e4dbc80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.982576 28677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 469092d44c10446288fd71f5e5ec6dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.986819 28670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7a90801bea49dd849e7c4e3faaeb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.990772 28669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 270d950e6ae04d5b9168dc1887bb67ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.994961 28521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7a90801bea49dd849e7c4e3faaeb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:51.998561 28522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b32e097c804f415bae7c12132ab293df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.006469 28523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2715fbba118d481db30cc7119e4dbc80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.010676 28595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 270d950e6ae04d5b9168dc1887bb67ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.012507 28596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7a90801bea49dd849e7c4e3faaeb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.015072 28598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2715fbba118d481db30cc7119e4dbc80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:52.032593 28728 tablet_bootstrap.cc:492] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:52.099382 28728 tablet_bootstrap.cc:654] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.171900 28727 tablet_bootstrap.cc:492] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:52.191994 28727 tablet_bootstrap.cc:654] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.204195 28730 tablet_bootstrap.cc:492] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:52.205222 28727 tablet_bootstrap.cc:492] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:52.205801 28727 ts_tablet_manager.cc:1403] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.007s
I20260709 13:21:52.208850 28727 raft_consensus.cc:359] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.209596 28727 raft_consensus.cc:385] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.209880 28727 raft_consensus.cc:740] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.210791 28730 tablet_bootstrap.cc:654] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.219740 28728 tablet_bootstrap.cc:492] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:52.220233 28728 ts_tablet_manager.cc:1403] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.188s	user 0.014s	sys 0.036s
I20260709 13:21:52.221276 28727 consensus_queue.cc:260] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.223387 28730 tablet_bootstrap.cc:492] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:52.224009 28730 ts_tablet_manager.cc:1403] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:21:52.224087 28563 heartbeater.cc:499] Master 127.16.211.62:36045 was elected leader, sending a full tablet report...
I20260709 13:21:52.223803 28728 raft_consensus.cc:359] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } }
I20260709 13:21:52.224674 28727 ts_tablet_manager.cc:1434] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 13:21:52.224707 28728 raft_consensus.cc:385] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.225209 28728 raft_consensus.cc:740] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.225906 28727 tablet_bootstrap.cc:492] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:52.226082 28728 consensus_queue.cc:260] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } }
I20260709 13:21:52.228935 28730 raft_consensus.cc:359] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.229704 28730 raft_consensus.cc:385] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.230041 28730 raft_consensus.cc:740] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.230835 28730 consensus_queue.cc:260] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.234470 28727 tablet_bootstrap.cc:654] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.235570 28728 ts_tablet_manager.cc:1434] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:21:52.236454 28638 heartbeater.cc:499] Master 127.16.211.62:36045 was elected leader, sending a full tablet report...
I20260709 13:21:52.243389 28728 tablet_bootstrap.cc:492] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:52.247730 28727 tablet_bootstrap.cc:492] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:52.248430 28727 ts_tablet_manager.cc:1403] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:21:52.250780 28728 tablet_bootstrap.cc:654] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.251586 28727 raft_consensus.cc:359] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.252458 28727 raft_consensus.cc:385] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.252767 28727 raft_consensus.cc:740] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.253892 28727 consensus_queue.cc:260] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.257174 28727 ts_tablet_manager.cc:1434] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:21:52.258615 28727 tablet_bootstrap.cc:492] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:52.268321 28727 tablet_bootstrap.cc:654] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.268784 28728 tablet_bootstrap.cc:492] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:52.269445 28728 ts_tablet_manager.cc:1403] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.026s	user 0.001s	sys 0.024s
I20260709 13:21:52.273033 28728 raft_consensus.cc:359] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.274083 28728 raft_consensus.cc:385] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.274533 28728 raft_consensus.cc:740] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.275683 28728 consensus_queue.cc:260] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.278599 28728 ts_tablet_manager.cc:1434] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:21:52.280058 28727 tablet_bootstrap.cc:492] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:52.280205 28712 heartbeater.cc:499] Master 127.16.211.62:36045 was elected leader, sending a full tablet report...
I20260709 13:21:52.279778 28728 tablet_bootstrap.cc:492] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:52.280679 28727 ts_tablet_manager.cc:1403] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 13:21:52.280614 28730 ts_tablet_manager.cc:1434] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.054s	user 0.029s	sys 0.022s
I20260709 13:21:52.283596 28730 tablet_bootstrap.cc:492] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:52.288196 28728 tablet_bootstrap.cc:654] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.290216 28727 raft_consensus.cc:359] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.291080 28727 raft_consensus.cc:385] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.291414 28727 raft_consensus.cc:740] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.292238 28727 consensus_queue.cc:260] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.294881 28727 ts_tablet_manager.cc:1434] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:21:52.296044 28727 tablet_bootstrap.cc:492] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:52.300195 28730 tablet_bootstrap.cc:654] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.302652 28727 tablet_bootstrap.cc:654] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.316809 28728 tablet_bootstrap.cc:492] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:52.318122 28733 raft_consensus.cc:493] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.318701 28733 raft_consensus.cc:515] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.320582 28728 ts_tablet_manager.cc:1403] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.015s
I20260709 13:21:52.323962 28728 raft_consensus.cc:359] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.324690 28728 raft_consensus.cc:385] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.324988 28728 raft_consensus.cc:740] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.325553 28730 tablet_bootstrap.cc:492] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:52.326357 28730 ts_tablet_manager.cc:1403] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.008s
I20260709 13:21:52.325866 28728 consensus_queue.cc:260] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.328235 28728 ts_tablet_manager.cc:1434] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:21:52.329401 28728 tablet_bootstrap.cc:492] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:52.329721 28733 leader_election.cc:290] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.329401 28730 raft_consensus.cc:359] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.330900 28730 raft_consensus.cc:385] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.331213 28730 raft_consensus.cc:740] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.332005 28730 consensus_queue.cc:260] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.334621 28730 ts_tablet_manager.cc:1434] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:21:52.335619 28730 tablet_bootstrap.cc:492] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:52.336462 28728 tablet_bootstrap.cc:654] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.343242 28730 tablet_bootstrap.cc:654] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.344296 28727 tablet_bootstrap.cc:492] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:52.344835 28727 ts_tablet_manager.cc:1403] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.008s
I20260709 13:21:52.354192 28734 raft_consensus.cc:493] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.354746 28734 raft_consensus.cc:515] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.359905 28727 raft_consensus.cc:359] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.360802 28727 raft_consensus.cc:385] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.361145 28727 raft_consensus.cc:740] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.361594 28734 leader_election.cc:290] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.361881 28727 consensus_queue.cc:260] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.365326 28733 raft_consensus.cc:493] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.374362 28733 raft_consensus.cc:515] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.376696 28733 leader_election.cc:290] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.384475 28687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32e097c804f415bae7c12132ab293df" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:52.385272 28687 raft_consensus.cc:2468] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 0.
I20260709 13:21:52.386849 28687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270d950e6ae04d5b9168dc1887bb67ef" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:52.388180 28503 leader_election.cc:304] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:52.391252 28728 tablet_bootstrap.cc:492] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
W20260709 13:21:52.393278 28484 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:52.393653 28727 ts_tablet_manager.cc:1434] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:21:52.394889 28727 tablet_bootstrap.cc:492] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:52.399641 28728 ts_tablet_manager.cc:1403] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.063s	user 0.036s	sys 0.013s
I20260709 13:21:52.400631 28733 raft_consensus.cc:2804] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.401768 28730 tablet_bootstrap.cc:492] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:52.401764 28733 raft_consensus.cc:493] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:52.402429 28503 leader_election.cc:343] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.402442 28733 raft_consensus.cc:3060] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.403236 28728 raft_consensus.cc:359] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.403894 28728 raft_consensus.cc:385] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.404142 28728 raft_consensus.cc:740] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.404748 28728 consensus_queue.cc:260] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.406888 28728 ts_tablet_manager.cc:1434] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:21:52.402500 28730 ts_tablet_manager.cc:1403] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.067s	user 0.027s	sys 0.037s
I20260709 13:21:52.411684 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32e097c804f415bae7c12132ab293df" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:52.412381 28613 raft_consensus.cc:2468] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 0.
I20260709 13:21:52.412614 28728 tablet_bootstrap.cc:492] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:52.413820 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270d950e6ae04d5b9168dc1887bb67ef" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:52.414444 28613 raft_consensus.cc:2468] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 0.
I20260709 13:21:52.411921 28727 tablet_bootstrap.cc:654] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.416551 28504 leader_election.cc:304] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 70416ec32d0c4d78856daf60c9290418
I20260709 13:21:52.417281 28733 raft_consensus.cc:515] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.422863 28728 tablet_bootstrap.cc:654] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.423228 28538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32e097c804f415bae7c12132ab293df" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:52.424193 28538 raft_consensus.cc:2393] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0658b7a0664e42f4b42b35ed4581c14d in current term 1: Already voted for candidate d51f98307f3848dea031026c70f09750 in this term.
I20260709 13:21:52.418059 28749 raft_consensus.cc:2804] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.424767 28733 leader_election.cc:290] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Requested vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.425132 28749 raft_consensus.cc:493] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.425515 28749 raft_consensus.cc:3060] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.427070 28687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32e097c804f415bae7c12132ab293df" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:52.427681 28687 raft_consensus.cc:3060] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.428115 28727 tablet_bootstrap.cc:492] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:52.428841 28727 ts_tablet_manager.cc:1403] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 13:21:52.418596 28730 raft_consensus.cc:359] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.429890 28730 raft_consensus.cc:385] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.430297 28730 raft_consensus.cc:740] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.431151 28730 consensus_queue.cc:260] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.431945 28727 raft_consensus.cc:359] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.432690 28727 raft_consensus.cc:385] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.432971 28727 raft_consensus.cc:740] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.433647 28730 ts_tablet_manager.cc:1434] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.007s
I20260709 13:21:52.433609 28749 raft_consensus.cc:515] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.433828 28727 consensus_queue.cc:260] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.435232 28730 tablet_bootstrap.cc:492] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:52.436002 28749 leader_election.cc:290] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Requested vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.436741 28727 ts_tablet_manager.cc:1434] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:52.439282 28686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270d950e6ae04d5b9168dc1887bb67ef" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:52.440064 28728 tablet_bootstrap.cc:492] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:52.440623 28728 ts_tablet_manager.cc:1403] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.003s
W20260709 13:21:52.440757 28503 leader_election.cc:343] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.442600 28730 tablet_bootstrap.cc:654] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.442732 28727 tablet_bootstrap.cc:492] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:52.443682 28728 raft_consensus.cc:359] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.444461 28728 raft_consensus.cc:385] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.444759 28728 raft_consensus.cc:740] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.445591 28728 consensus_queue.cc:260] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.447994 28728 ts_tablet_manager.cc:1434] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:52.449002 28728 tablet_bootstrap.cc:492] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:52.450562 28727 tablet_bootstrap.cc:654] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.451373 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32e097c804f415bae7c12132ab293df" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:52.452206 28613 raft_consensus.cc:3060] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.456099 28728 tablet_bootstrap.cc:654] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.459187 28612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270d950e6ae04d5b9168dc1887bb67ef" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:52.460124 28612 raft_consensus.cc:3060] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.463865 28734 raft_consensus.cc:493] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.464602 28734 raft_consensus.cc:515] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.467233 28734 leader_election.cc:290] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.468879 28538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefc456fb1b046fe9ba1309b495c7394" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:52.469812 28538 raft_consensus.cc:2468] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:52.470108 28728 tablet_bootstrap.cc:492] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:52.471016 28728 ts_tablet_manager.cc:1403] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.022s	user 0.003s	sys 0.018s
I20260709 13:21:52.471709 28577 leader_election.cc:304] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:52.474138 28734 raft_consensus.cc:2804] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.474630 28734 raft_consensus.cc:493] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.475042 28734 raft_consensus.cc:3060] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.475333 28728 raft_consensus.cc:359] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.476588 28728 raft_consensus.cc:385] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.477041 28728 raft_consensus.cc:740] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.478087 28728 consensus_queue.cc:260] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.497598 28686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32e097c804f415bae7c12132ab293df" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:52.499680 28686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefc456fb1b046fe9ba1309b495c7394" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:52.505192 28578 leader_election.cc:304] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d; no voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750
I20260709 13:21:52.508129 28734 raft_consensus.cc:515] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.515750 28687 raft_consensus.cc:2468] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 1.
I20260709 13:21:52.517555 28503 leader_election.cc:304] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:52.518860 28733 raft_consensus.cc:2804] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.519461 28733 raft_consensus.cc:697] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Becoming Leader. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:52.520533 28733 consensus_queue.cc:237] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.523456 28613 raft_consensus.cc:2468] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 1.
I20260709 13:21:52.524973 28612 raft_consensus.cc:2468] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 1.
W20260709 13:21:52.530032 28578 leader_election.cc:343] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.532078 28756 raft_consensus.cc:2749] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.532789 28756 raft_consensus.cc:493] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.533200 28756 raft_consensus.cc:515] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.536242 28538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec27a71b4b249de856c6826bfc090a7" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
W20260709 13:21:52.537771 28577 leader_election.cc:343] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d51f98307f3848dea031026c70f09750 (127.16.211.1:39399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.540297 28538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefc456fb1b046fe9ba1309b495c7394" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:52.541100 28538 raft_consensus.cc:3060] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.546384 28504 leader_election.cc:304] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 70416ec32d0c4d78856daf60c9290418
I20260709 13:21:52.547678 28749 raft_consensus.cc:2804] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.550645 28734 leader_election.cc:290] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.551823 28538 raft_consensus.cc:2468] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:52.553483 28577 leader_election.cc:304] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:52.559566 28687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefc456fb1b046fe9ba1309b495c7394" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:52.560901 28730 tablet_bootstrap.cc:492] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:52.560956 28728 ts_tablet_manager.cc:1434] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.089s	user 0.038s	sys 0.046s
I20260709 13:21:52.561590 28730 ts_tablet_manager.cc:1403] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.127s	user 0.036s	sys 0.026s
I20260709 13:21:52.562603 28755 raft_consensus.cc:2804] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:52.562999 28578 leader_election.cc:343] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.563200 28755 raft_consensus.cc:697] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Leader. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:52.564132 28755 consensus_queue.cc:237] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.566046 28734 raft_consensus.cc:493] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.569043 28749 raft_consensus.cc:697] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Becoming Leader. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:52.569808 28728 tablet_bootstrap.cc:492] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:52.570231 28749 consensus_queue.cc:237] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.571355 28727 tablet_bootstrap.cc:492] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:52.572073 28727 ts_tablet_manager.cc:1403] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.129s	user 0.050s	sys 0.065s
I20260709 13:21:52.571431 28435 catalog_manager.cc:5697] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 reported cstate change: term changed from 0 to 1, leader changed from <none> to d51f98307f3848dea031026c70f09750 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d51f98307f3848dea031026c70f09750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.566563 28734 raft_consensus.cc:515] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.577955 28756 leader_election.cc:290] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.578977 28538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7a90801bea49dd849e7c4e3faaeb75" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:52.580386 28687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec27a71b4b249de856c6826bfc090a7" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:52.580592 28538 raft_consensus.cc:2468] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:52.581233 28727 raft_consensus.cc:359] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } }
I20260709 13:21:52.581722 28686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7a90801bea49dd849e7c4e3faaeb75" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:52.582300 28577 leader_election.cc:304] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:52.583606 28728 tablet_bootstrap.cc:654] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.585098 28756 raft_consensus.cc:2804] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:52.585366 28578 leader_election.cc:343] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.584791 28735 raft_consensus.cc:493] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.584285 28727 raft_consensus.cc:385] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.586433 28727 raft_consensus.cc:740] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.586221 28735 raft_consensus.cc:515] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.578251 28734 leader_election.cc:290] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.587276 28727 consensus_queue.cc:260] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } }
I20260709 13:21:52.589787 28727 ts_tablet_manager.cc:1434] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:21:52.590804 28727 tablet_bootstrap.cc:492] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:52.591323 28686 raft_consensus.cc:2468] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:52.591409 28730 raft_consensus.cc:359] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.592492 28730 raft_consensus.cc:385] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.592836 28730 raft_consensus.cc:740] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.593724 28730 consensus_queue.cc:260] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.594766 28735 leader_election.cc:290] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:52.585572 28756 raft_consensus.cc:493] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.602685 28756 raft_consensus.cc:3060] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.605417 28578 leader_election.cc:304] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d; no voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750
I20260709 13:21:52.607969 28727 tablet_bootstrap.cc:654] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.608131 28755 raft_consensus.cc:2749] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.625808 28727 tablet_bootstrap.cc:492] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:52.626610 28727 ts_tablet_manager.cc:1403] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.012s
I20260709 13:21:52.630579 28727 raft_consensus.cc:359] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.631560 28727 raft_consensus.cc:385] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.631908 28727 raft_consensus.cc:740] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.632804 28727 consensus_queue.cc:260] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.634111 28612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7a90801bea49dd849e7c4e3faaeb75" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:52.635247 28755 raft_consensus.cc:493] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.635799 28755 raft_consensus.cc:515] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } }
I20260709 13:21:52.636315 28727 ts_tablet_manager.cc:1434] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:52.636766 28436 catalog_manager.cc:5697] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2). New cstate: current_term: 1 leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.637689 28727 tablet_bootstrap.cc:492] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:52.639377 28686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469092d44c10446288fd71f5e5ec6dba" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
W20260709 13:21:52.643883 28578 leader_election.cc:343] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.640194 28755 leader_election.cc:290] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069), d51f98307f3848dea031026c70f09750 (127.16.211.1:39399)
I20260709 13:21:52.641774 28538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469092d44c10446288fd71f5e5ec6dba" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:52.645138 28538 raft_consensus.cc:2468] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:52.646572 28577 leader_election.cc:304] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 70416ec32d0c4d78856daf60c9290418
I20260709 13:21:52.647810 28755 raft_consensus.cc:2804] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.648245 28755 raft_consensus.cc:493] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.648639 28755 raft_consensus.cc:3060] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.650068 28728 tablet_bootstrap.cc:492] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:52.650632 28728 ts_tablet_manager.cc:1403] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.081s	user 0.021s	sys 0.021s
I20260709 13:21:52.650851 28756 raft_consensus.cc:515] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.652072 28612 raft_consensus.cc:2393] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70416ec32d0c4d78856daf60c9290418 in current term 1: Already voted for candidate 0658b7a0664e42f4b42b35ed4581c14d in this term.
I20260709 13:21:52.653112 28756 leader_election.cc:290] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.653744 28728 raft_consensus.cc:359] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.654572 28686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7a90801bea49dd849e7c4e3faaeb75" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:52.655284 28686 raft_consensus.cc:3060] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.656473 28730 ts_tablet_manager.cc:1434] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.094s	user 0.019s	sys 0.014s
I20260709 13:21:52.657986 28727 tablet_bootstrap.cc:654] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.659703 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7a90801bea49dd849e7c4e3faaeb75" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:52.660434 28537 raft_consensus.cc:3060] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.663770 28538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7a90801bea49dd849e7c4e3faaeb75" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:52.665517 28651 leader_election.cc:304] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418; no voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750
I20260709 13:21:52.670377 28730 tablet_bootstrap.cc:492] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:52.669363 28435 catalog_manager.cc:5697] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 reported cstate change: term changed from 0 to 1, leader changed from <none> to d51f98307f3848dea031026c70f09750 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d51f98307f3848dea031026c70f09750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.673942 28755 raft_consensus.cc:515] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } }
I20260709 13:21:52.654650 28728 raft_consensus.cc:385] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.675606 28686 raft_consensus.cc:2468] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:52.676429 28728 raft_consensus.cc:740] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.676743 28767 raft_consensus.cc:2749] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.677505 28728 consensus_queue.cc:260] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.680071 28537 raft_consensus.cc:2468] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:52.680579 28578 leader_election.cc:304] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, 70416ec32d0c4d78856daf60c9290418; no voters: 
I20260709 13:21:52.682763 28756 raft_consensus.cc:2804] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.683262 28756 raft_consensus.cc:697] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Leader. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:52.684092 28756 consensus_queue.cc:237] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.686609 28727 tablet_bootstrap.cc:492] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:52.687162 28728 ts_tablet_manager.cc:1434] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.003s
I20260709 13:21:52.687171 28727 ts_tablet_manager.cc:1403] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.006s
I20260709 13:21:52.688295 28728 tablet_bootstrap.cc:492] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:52.691002 28727 raft_consensus.cc:359] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.694253 28755 leader_election.cc:290] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Requested vote from peers 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069), d51f98307f3848dea031026c70f09750 (127.16.211.1:39399)
I20260709 13:21:52.691911 28727 raft_consensus.cc:385] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.694989 28727 raft_consensus.cc:740] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.695832 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469092d44c10446288fd71f5e5ec6dba" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:52.695892 28686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469092d44c10446288fd71f5e5ec6dba" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:52.696619 28730 tablet_bootstrap.cc:654] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.696780 28537 raft_consensus.cc:3060] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:52.697625 28578 leader_election.cc:343] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.695685 28727 consensus_queue.cc:260] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.702993 28727 ts_tablet_manager.cc:1434] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:21:52.704080 28727 tablet_bootstrap.cc:492] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:52.707065 28436 catalog_manager.cc:5697] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2). New cstate: current_term: 1 leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.709972 28730 tablet_bootstrap.cc:492] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:52.710080 28727 tablet_bootstrap.cc:654] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.710861 28730 ts_tablet_manager.cc:1403] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.000s
I20260709 13:21:52.714002 28730 raft_consensus.cc:359] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.714766 28730 raft_consensus.cc:385] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.715062 28730 raft_consensus.cc:740] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.715982 28730 consensus_queue.cc:260] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.718487 28730 ts_tablet_manager.cc:1434] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:21:52.695721 28728 tablet_bootstrap.cc:654] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.719633 28730 tablet_bootstrap.cc:492] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:52.725517 28537 raft_consensus.cc:2468] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:52.727797 28577 leader_election.cc:304] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 70416ec32d0c4d78856daf60c9290418
I20260709 13:21:52.728435 28727 tablet_bootstrap.cc:492] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:52.729023 28727 ts_tablet_manager.cc:1403] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.025s	user 0.003s	sys 0.019s
I20260709 13:21:52.729416 28756 raft_consensus.cc:2804] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.730194 28756 raft_consensus.cc:697] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Leader. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:52.731346 28756 consensus_queue.cc:237] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } }
I20260709 13:21:52.731822 28727 raft_consensus.cc:359] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.732583 28727 raft_consensus.cc:385] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.732872 28727 raft_consensus.cc:740] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.735083 28730 tablet_bootstrap.cc:654] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.733572 28727 consensus_queue.cc:260] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.739693 28728 tablet_bootstrap.cc:492] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:52.740346 28728 ts_tablet_manager.cc:1403] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.006s
I20260709 13:21:52.742260 28727 ts_tablet_manager.cc:1434] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:21:52.744177 28728 raft_consensus.cc:359] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.745299 28728 raft_consensus.cc:385] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.745687 28728 raft_consensus.cc:740] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.746737 28728 consensus_queue.cc:260] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.749675 28728 ts_tablet_manager.cc:1434] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:21:52.755158 28728 tablet_bootstrap.cc:492] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:52.756505 28730 tablet_bootstrap.cc:492] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:52.757148 28730 ts_tablet_manager.cc:1403] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.012s
I20260709 13:21:52.756374 28435 catalog_manager.cc:5697] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2). New cstate: current_term: 1 leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.760459 28730 raft_consensus.cc:359] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } }
I20260709 13:21:52.761312 28730 raft_consensus.cc:385] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.761593 28728 tablet_bootstrap.cc:654] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.761629 28730 raft_consensus.cc:740] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.762809 28730 consensus_queue.cc:260] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } }
I20260709 13:21:52.766250 28730 ts_tablet_manager.cc:1434] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:21:52.767313 28730 tablet_bootstrap.cc:492] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:52.767514 28749 raft_consensus.cc:493] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.768018 28749 raft_consensus.cc:515] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.769860 28749 leader_election.cc:290] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.770610 28612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec27a71b4b249de856c6826bfc090a7" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:52.771306 28612 raft_consensus.cc:2468] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 0.
I20260709 13:21:52.771636 28728 tablet_bootstrap.cc:492] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:52.772146 28728 ts_tablet_manager.cc:1403] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:21:52.772169 28504 leader_election.cc:304] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:52.773464 28749 raft_consensus.cc:2804] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.773835 28749 raft_consensus.cc:493] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.774200 28749 raft_consensus.cc:3060] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.775378 28728 raft_consensus.cc:359] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.776363 28730 tablet_bootstrap.cc:654] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.776317 28728 raft_consensus.cc:385] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.776829 28728 raft_consensus.cc:740] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.777557 28728 consensus_queue.cc:260] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.780233 28728 ts_tablet_manager.cc:1434] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:52.772130 28686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec27a71b4b249de856c6826bfc090a7" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:52.782107 28686 raft_consensus.cc:2468] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 0.
I20260709 13:21:52.782840 28749 raft_consensus.cc:515] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.784179 28730 tablet_bootstrap.cc:492] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:52.784698 28730 ts_tablet_manager.cc:1403] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.018s	user 0.003s	sys 0.009s
I20260709 13:21:52.784830 28749 leader_election.cc:290] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Requested vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.785872 28612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec27a71b4b249de856c6826bfc090a7" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:52.785939 28686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec27a71b4b249de856c6826bfc090a7" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:52.786545 28612 raft_consensus.cc:3060] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.786692 28686 raft_consensus.cc:3060] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.787869 28730 raft_consensus.cc:359] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.788403 28730 raft_consensus.cc:385] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.788590 28730 raft_consensus.cc:740] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.789225 28730 consensus_queue.cc:260] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.791544 28730 ts_tablet_manager.cc:1434] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:52.792758 28730 tablet_bootstrap.cc:492] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:52.797588 28612 raft_consensus.cc:2468] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 1.
I20260709 13:21:52.798162 28749 raft_consensus.cc:493] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.798712 28749 raft_consensus.cc:515] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.799383 28730 tablet_bootstrap.cc:654] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.799187 28504 leader_election.cc:304] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:52.800292 28759 raft_consensus.cc:2804] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.800786 28759 raft_consensus.cc:697] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Becoming Leader. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:52.801065 28749 leader_election.cc:290] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.801637 28759 consensus_queue.cc:237] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.802697 28687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39792ab55ed4b3d9df9c50f3667237b" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:52.802783 28686 raft_consensus.cc:2468] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 1.
I20260709 13:21:52.803403 28687 raft_consensus.cc:2468] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 0.
I20260709 13:21:52.805384 28767 raft_consensus.cc:493] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.805341 28503 leader_election.cc:304] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:52.806149 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39792ab55ed4b3d9df9c50f3667237b" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:52.806116 28767 raft_consensus.cc:515] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.806805 28613 raft_consensus.cc:2468] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 0.
I20260709 13:21:52.806717 28749 raft_consensus.cc:2804] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.807655 28749 raft_consensus.cc:493] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.808135 28749 raft_consensus.cc:3060] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.808792 28767 leader_election.cc:290] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:52.811578 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270d950e6ae04d5b9168dc1887bb67ef" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:52.811172 28612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270d950e6ae04d5b9168dc1887bb67ef" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:52.814996 28612 raft_consensus.cc:2393] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70416ec32d0c4d78856daf60c9290418 in current term 1: Already voted for candidate d51f98307f3848dea031026c70f09750 in this term.
I20260709 13:21:52.816895 28653 leader_election.cc:304] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418; no voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750
I20260709 13:21:52.818080 28767 raft_consensus.cc:3060] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.818730 28749 raft_consensus.cc:515] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.822374 28749 leader_election.cc:290] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Requested vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:52.822971 28687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39792ab55ed4b3d9df9c50f3667237b" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:52.823328 28735 raft_consensus.cc:493] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.823565 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39792ab55ed4b3d9df9c50f3667237b" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:52.824293 28613 raft_consensus.cc:3060] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.823932 28735 raft_consensus.cc:515] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } }
I20260709 13:21:52.823657 28687 raft_consensus.cc:3060] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.826318 28735 leader_election.cc:290] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), d51f98307f3848dea031026c70f09750 (127.16.211.1:39399)
I20260709 13:21:52.828380 28611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469092d44c10446288fd71f5e5ec6dba" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:52.829888 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469092d44c10446288fd71f5e5ec6dba" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:52.830724 28537 raft_consensus.cc:2393] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70416ec32d0c4d78856daf60c9290418 in current term 1: Already voted for candidate 0658b7a0664e42f4b42b35ed4581c14d in this term.
I20260709 13:21:52.831948 28651 leader_election.cc:304] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418; no voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750
I20260709 13:21:52.832423 28687 raft_consensus.cc:2468] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 1.
I20260709 13:21:52.833626 28735 raft_consensus.cc:3060] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.833701 28503 leader_election.cc:304] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:52.839393 28749 raft_consensus.cc:2804] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.840046 28767 raft_consensus.cc:2749] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.840142 28749 raft_consensus.cc:697] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Becoming Leader. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:52.843954 28749 consensus_queue.cc:237] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.845257 28730 tablet_bootstrap.cc:492] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:52.845420 28735 raft_consensus.cc:2749] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.845798 28730 ts_tablet_manager.cc:1403] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.029s
I20260709 13:21:52.846025 28613 raft_consensus.cc:2468] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 1.
I20260709 13:21:52.848846 28730 raft_consensus.cc:359] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.849673 28730 raft_consensus.cc:385] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.850011 28730 raft_consensus.cc:740] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.850710 28730 consensus_queue.cc:260] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.852731 28730 ts_tablet_manager.cc:1434] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:52.853663 28730 tablet_bootstrap.cc:492] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:52.854619 28435 catalog_manager.cc:5697] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 reported cstate change: term changed from 0 to 1, leader changed from <none> to d51f98307f3848dea031026c70f09750 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d51f98307f3848dea031026c70f09750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.859198 28730 tablet_bootstrap.cc:654] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.865077 28730 tablet_bootstrap.cc:492] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:52.866165 28730 ts_tablet_manager.cc:1403] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:21:52.868060 28730 raft_consensus.cc:359] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.868606 28730 raft_consensus.cc:385] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.868840 28730 raft_consensus.cc:740] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.868232 28436 catalog_manager.cc:5697] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 reported cstate change: term changed from 0 to 1, leader changed from <none> to d51f98307f3848dea031026c70f09750 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d51f98307f3848dea031026c70f09750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.869422 28730 consensus_queue.cc:260] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.871204 28730 ts_tablet_manager.cc:1434] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:52.885699 28735 raft_consensus.cc:493] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.886255 28735 raft_consensus.cc:515] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.887902 28735 leader_election.cc:290] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:52.888906 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2715fbba118d481db30cc7119e4dbc80" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:52.888911 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2715fbba118d481db30cc7119e4dbc80" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:52.889573 28613 raft_consensus.cc:2468] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 0.
I20260709 13:21:52.889691 28537 raft_consensus.cc:2468] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 0.
I20260709 13:21:52.890568 28653 leader_election.cc:304] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, 70416ec32d0c4d78856daf60c9290418; no voters: 
I20260709 13:21:52.891235 28735 raft_consensus.cc:2804] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.891642 28735 raft_consensus.cc:493] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.891894 28735 raft_consensus.cc:3060] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.897133 28735 raft_consensus.cc:515] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.899005 28735 leader_election.cc:290] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:52.899829 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2715fbba118d481db30cc7119e4dbc80" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:52.900235 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2715fbba118d481db30cc7119e4dbc80" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:52.900686 28537 raft_consensus.cc:3060] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.900852 28613 raft_consensus.cc:3060] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.908030 28613 raft_consensus.cc:2468] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 1.
I20260709 13:21:52.908030 28537 raft_consensus.cc:2468] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 1.
I20260709 13:21:52.909349 28735 raft_consensus.cc:493] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.909382 28653 leader_election.cc:304] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, 70416ec32d0c4d78856daf60c9290418; no voters: 
I20260709 13:21:52.910095 28735 raft_consensus.cc:515] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.910457 28767 raft_consensus.cc:2804] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.911628 28767 raft_consensus.cc:697] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Becoming Leader. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Running, Role: LEADER
I20260709 13:21:52.912719 28735 leader_election.cc:290] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:52.912513 28767 consensus_queue.cc:237] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.912870 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f37c95f25f84fc2ab0362ee29e4ddbf" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:52.913619 28537 raft_consensus.cc:2468] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 0.
I20260709 13:21:52.913731 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f37c95f25f84fc2ab0362ee29e4ddbf" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:52.914402 28613 raft_consensus.cc:2468] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 0.
I20260709 13:21:52.914726 28651 leader_election.cc:304] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:52.915616 28735 raft_consensus.cc:2804] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.915982 28735 raft_consensus.cc:493] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.916350 28735 raft_consensus.cc:3060] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.920343 28436 catalog_manager.cc:5697] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70416ec32d0c4d78856daf60c9290418 (127.16.211.3). New cstate: current_term: 1 leader_uuid: "70416ec32d0c4d78856daf60c9290418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:52.922655 28735 raft_consensus.cc:515] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.925256 28735 leader_election.cc:290] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:52.925796 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f37c95f25f84fc2ab0362ee29e4ddbf" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:52.926496 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f37c95f25f84fc2ab0362ee29e4ddbf" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:52.926820 28537 raft_consensus.cc:3060] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.927505 28613 raft_consensus.cc:3060] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.928864 28759 consensus_queue.cc:1048] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.934615 28613 raft_consensus.cc:2468] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 1.
I20260709 13:21:52.936015 28653 leader_election.cc:304] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, 70416ec32d0c4d78856daf60c9290418; no voters: 
I20260709 13:21:52.934618 28537 raft_consensus.cc:2468] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 1.
I20260709 13:21:52.936882 28735 raft_consensus.cc:2804] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.937855 28735 raft_consensus.cc:697] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Becoming Leader. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Running, Role: LEADER
I20260709 13:21:52.938908 28735 consensus_queue.cc:237] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:52.944339 28749 consensus_queue.cc:1048] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:52.956358 28436 catalog_manager.cc:5697] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70416ec32d0c4d78856daf60c9290418 (127.16.211.3). New cstate: current_term: 1 leader_uuid: "70416ec32d0c4d78856daf60c9290418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:53.002363 28735 raft_consensus.cc:493] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.002897 28735 raft_consensus.cc:515] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.004671 28735 leader_election.cc:290] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:53.005741 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefc456fb1b046fe9ba1309b495c7394" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:53.005743 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefc456fb1b046fe9ba1309b495c7394" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:53.006870 28537 raft_consensus.cc:2393] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70416ec32d0c4d78856daf60c9290418 in current term 1: Already voted for candidate 0658b7a0664e42f4b42b35ed4581c14d in this term.
I20260709 13:21:53.007809 28651 leader_election.cc:304] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418; no voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750
I20260709 13:21:53.008523 28735 raft_consensus.cc:3060] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.013599 28735 raft_consensus.cc:2749] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.068269 28749 consensus_queue.cc:1048] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.072646 28613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "469092d44c10446288fd71f5e5ec6dba"
dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
mode: GRACEFUL
new_leader_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:45582
I20260709 13:21:53.073350 28613 raft_consensus.cc:606] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Received request to transfer leadership to TS d51f98307f3848dea031026c70f09750
I20260709 13:21:53.082331 28612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aefc456fb1b046fe9ba1309b495c7394"
dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
mode: GRACEFUL
new_leader_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:45582
I20260709 13:21:53.083016 28612 raft_consensus.cc:606] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Received request to transfer leadership to TS d51f98307f3848dea031026c70f09750
I20260709 13:21:53.083858 28749 consensus_queue.cc:1048] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.084466 28756 consensus_queue.cc:1048] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.107406 28755 consensus_queue.cc:1048] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.118326 28685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f37c95f25f84fc2ab0362ee29e4ddbf"
dest_uuid: "70416ec32d0c4d78856daf60c9290418"
mode: GRACEFUL
new_leader_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:49644
I20260709 13:21:53.118980 28685 raft_consensus.cc:606] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Received request to transfer leadership to TS d51f98307f3848dea031026c70f09750
I20260709 13:21:53.119715 28755 consensus_queue.cc:1048] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.133487 28755 consensus_queue.cc:1048] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.136410 28538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ec27a71b4b249de856c6826bfc090a7"
dest_uuid: "d51f98307f3848dea031026c70f09750"
mode: GRACEFUL
new_leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
 from {username='slave'} at 127.0.0.1:51038
I20260709 13:21:53.136921 28538 raft_consensus.cc:606] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Received request to transfer leadership to TS 0658b7a0664e42f4b42b35ed4581c14d
I20260709 13:21:53.143951 28734 raft_consensus.cc:993] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d: : Instructing follower d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:53.144366 28734 raft_consensus.cc:1081] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Signalling peer d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:53.145960 28538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aefc456fb1b046fe9ba1309b495c7394"
dest_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:51018
I20260709 13:21:53.146637 28538 raft_consensus.cc:493] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:53.146994 28538 raft_consensus.cc:3060] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.147809 28756 consensus_queue.cc:1048] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.151371 28686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2715fbba118d481db30cc7119e4dbc80"
dest_uuid: "70416ec32d0c4d78856daf60c9290418"
mode: GRACEFUL
new_leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
 from {username='slave'} at 127.0.0.1:49644
I20260709 13:21:53.151950 28686 raft_consensus.cc:606] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Received request to transfer leadership to TS 0658b7a0664e42f4b42b35ed4581c14d
I20260709 13:21:53.155644 28538 raft_consensus.cc:515] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.158245 28537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b32e097c804f415bae7c12132ab293df"
dest_uuid: "d51f98307f3848dea031026c70f09750"
mode: GRACEFUL
new_leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
 from {username='slave'} at 127.0.0.1:51038
I20260709 13:21:53.158982 28537 raft_consensus.cc:606] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Received request to transfer leadership to TS 0658b7a0664e42f4b42b35ed4581c14d
I20260709 13:21:53.162160 28538 leader_election.cc:290] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Requested vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:53.164915 28687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefc456fb1b046fe9ba1309b495c7394" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:53.165514 28687 raft_consensus.cc:3060] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.166751 28612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefc456fb1b046fe9ba1309b495c7394" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:53.167399 28612 raft_consensus.cc:3055] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:53.167702 28612 raft_consensus.cc:740] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:53.168475 28612 consensus_queue.cc:260] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.169744 28612 raft_consensus.cc:3060] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.177369 28756 consensus_queue.cc:1048] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.178140 28537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "270d950e6ae04d5b9168dc1887bb67ef"
dest_uuid: "d51f98307f3848dea031026c70f09750"
mode: GRACEFUL
new_leader_uuid: "70416ec32d0c4d78856daf60c9290418"
 from {username='slave'} at 127.0.0.1:51038
I20260709 13:21:53.178781 28612 raft_consensus.cc:2468] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 2.
I20260709 13:21:53.179013 28537 raft_consensus.cc:606] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Received request to transfer leadership to TS 70416ec32d0c4d78856daf60c9290418
I20260709 13:21:53.179927 28687 raft_consensus.cc:2468] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 2.
I20260709 13:21:53.179993 28504 leader_election.cc:304] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:53.182164 28749 raft_consensus.cc:2804] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:53.182657 28749 raft_consensus.cc:697] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Becoming Leader. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:53.183452 28749 consensus_queue.cc:237] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.193954 28755 raft_consensus.cc:993] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d: : Instructing follower d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:53.194482 28756 raft_consensus.cc:1081] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Signalling peer d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:53.196067 28538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "469092d44c10446288fd71f5e5ec6dba"
dest_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:51018
I20260709 13:21:53.196558 28538 raft_consensus.cc:493] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:53.196867 28538 raft_consensus.cc:3060] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.197144 28435 catalog_manager.cc:5697] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 reported cstate change: term changed from 1 to 2, leader changed from 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2) to d51f98307f3848dea031026c70f09750 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d51f98307f3848dea031026c70f09750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.203012 28538 raft_consensus.cc:515] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } }
I20260709 13:21:53.205511 28538 leader_election.cc:290] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Requested vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:53.205762 28612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469092d44c10446288fd71f5e5ec6dba" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:53.205835 28685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469092d44c10446288fd71f5e5ec6dba" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:53.206664 28612 raft_consensus.cc:3055] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:53.206681 28685 raft_consensus.cc:3060] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.207105 28612 raft_consensus.cc:740] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:53.207960 28612 consensus_queue.cc:260] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } }
I20260709 13:21:53.209236 28612 raft_consensus.cc:3060] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.214931 28685 raft_consensus.cc:2468] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 2.
I20260709 13:21:53.216298 28503 leader_election.cc:304] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:53.216784 28612 raft_consensus.cc:2468] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 2.
I20260709 13:21:53.217136 28749 raft_consensus.cc:2804] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:53.217700 28749 raft_consensus.cc:697] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Becoming Leader. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:53.218559 28749 consensus_queue.cc:237] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } }
I20260709 13:21:53.224761 28435 catalog_manager.cc:5697] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 reported cstate change: term changed from 1 to 2, leader changed from 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2) to d51f98307f3848dea031026c70f09750 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d51f98307f3848dea031026c70f09750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:53.226465 28749 consensus_queue.cc:1048] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.233904 28733 raft_consensus.cc:993] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750: : Instructing follower 0658b7a0664e42f4b42b35ed4581c14d to start an election
I20260709 13:21:53.234463 28759 raft_consensus.cc:1081] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Signalling peer 0658b7a0664e42f4b42b35ed4581c14d to start an election
I20260709 13:21:53.236640 28612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ec27a71b4b249de856c6826bfc090a7"
dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
 from {username='slave'} at 127.0.0.1:45552
I20260709 13:21:53.237249 28612 raft_consensus.cc:493] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:53.237680 28612 raft_consensus.cc:3060] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.240028 28759 consensus_queue.cc:1048] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.247676 28612 raft_consensus.cc:515] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.248839 28613 raft_consensus.cc:1240] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Rejecting Update request from peer d51f98307f3848dea031026c70f09750 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:53.253520 28538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec27a71b4b249de856c6826bfc090a7" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:53.254844 28538 raft_consensus.cc:3055] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:53.259223 28749 consensus_queue.cc:1059] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.255179 28538 raft_consensus.cc:740] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:53.261932 28612 leader_election.cc:290] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 2 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:53.271809 28685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec27a71b4b249de856c6826bfc090a7" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:53.272495 28685 raft_consensus.cc:3060] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.287360 28685 raft_consensus.cc:2468] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 2.
I20260709 13:21:53.288964 28578 leader_election.cc:304] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, 70416ec32d0c4d78856daf60c9290418; no voters: 
I20260709 13:21:53.290095 28756 raft_consensus.cc:2804] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:53.290612 28756 raft_consensus.cc:697] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 LEADER]: Becoming Leader. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:53.291390 28756 consensus_queue.cc:237] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.571322 28538 consensus_queue.cc:260] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.572710 28538 raft_consensus.cc:3060] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.574587 28804 consensus_queue.cc:1048] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.575013 28735 consensus_queue.cc:1048] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.581441 28538 raft_consensus.cc:2468] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 2.
I20260709 13:21:53.587721 28802 raft_consensus.cc:993] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750: : Instructing follower 0658b7a0664e42f4b42b35ed4581c14d to start an election
I20260709 13:21:53.587814 28749 consensus_queue.cc:1048] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.588198 28802 raft_consensus.cc:1081] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Signalling peer 0658b7a0664e42f4b42b35ed4581c14d to start an election
I20260709 13:21:53.588629 28805 consensus_queue.cc:1048] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.593401 28611 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b32e097c804f415bae7c12132ab293df"
dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
 from {username='slave'} at 127.0.0.1:45552
I20260709 13:21:53.594013 28611 raft_consensus.cc:493] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:53.594404 28611 raft_consensus.cc:3060] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.596637 28805 raft_consensus.cc:993] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418: : Instructing follower d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:53.597137 28805 raft_consensus.cc:1081] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Signalling peer d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:53.601894 28537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f37c95f25f84fc2ab0362ee29e4ddbf"
dest_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:51022
I20260709 13:21:53.602491 28537 raft_consensus.cc:493] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:53.602849 28537 raft_consensus.cc:3060] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.615387 28611 raft_consensus.cc:515] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.615978 28537 raft_consensus.cc:515] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.617825 28611 leader_election.cc:290] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 2 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:53.618570 28537 leader_election.cc:290] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Requested vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:53.618969 28611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f37c95f25f84fc2ab0362ee29e4ddbf" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:53.619604 28611 raft_consensus.cc:3060] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.621871 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32e097c804f415bae7c12132ab293df" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:53.622542 28537 raft_consensus.cc:3055] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:53.622857 28537 raft_consensus.cc:740] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:53.623770 28537 consensus_queue.cc:260] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.624871 28537 raft_consensus.cc:3060] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.627429 28611 raft_consensus.cc:2468] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 2.
I20260709 13:21:53.628999 28504 leader_election.cc:304] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:53.629701 28434 catalog_manager.cc:5697] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d reported cstate change: term changed from 1 to 2, leader changed from d51f98307f3848dea031026c70f09750 (127.16.211.1) to 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2). New cstate: current_term: 2 leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.632563 28537 raft_consensus.cc:2468] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 2.
I20260709 13:21:53.630601 28749 raft_consensus.cc:2804] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:53.633256 28749 raft_consensus.cc:697] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Becoming Leader. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:53.634281 28749 consensus_queue.cc:237] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.637207 28577 leader_election.cc:304] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:53.638197 28734 raft_consensus.cc:2804] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:53.638711 28734 raft_consensus.cc:697] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 2 LEADER]: Becoming Leader. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:53.639564 28734 consensus_queue.cc:237] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.642120 28612 raft_consensus.cc:1240] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Rejecting Update request from peer 70416ec32d0c4d78856daf60c9290418 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:53.650944 28804 consensus_queue.cc:1059] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.652637 28735 raft_consensus.cc:3055] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:53.653105 28735 raft_consensus.cc:740] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Running, Role: LEADER
I20260709 13:21:53.653354 28687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32e097c804f415bae7c12132ab293df" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:53.654062 28687 raft_consensus.cc:3060] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.655591 28735 consensus_queue.cc:260] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.661192 28682 raft_consensus.cc:1275] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:53.662338 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f37c95f25f84fc2ab0362ee29e4ddbf" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:53.666652 28434 catalog_manager.cc:5697] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d reported cstate change: term changed from 1 to 2, leader changed from d51f98307f3848dea031026c70f09750 (127.16.211.1) to 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2). New cstate: current_term: 2 leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.671008 28684 raft_consensus.cc:1275] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:53.670886 28749 consensus_queue.cc:1048] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.673703 28733 consensus_queue.cc:1048] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:53.673942 28802 consensus_queue.cc:1048] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:53.675055 28733 raft_consensus.cc:993] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750: : Instructing follower 70416ec32d0c4d78856daf60c9290418 to start an election
I20260709 13:21:53.675482 28733 raft_consensus.cc:1081] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Signalling peer 70416ec32d0c4d78856daf60c9290418 to start an election
I20260709 13:21:53.686648 28687 raft_consensus.cc:2468] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 2.
I20260709 13:21:53.687615 28680 raft_consensus.cc:1275] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Refusing update from remote peer 0658b7a0664e42f4b42b35ed4581c14d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:53.688045 28685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "270d950e6ae04d5b9168dc1887bb67ef"
dest_uuid: "70416ec32d0c4d78856daf60c9290418"
 from {username='slave'} at 127.0.0.1:49618
I20260709 13:21:53.690243 28685 raft_consensus.cc:493] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:53.690629 28685 raft_consensus.cc:3060] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.691882 28683 raft_consensus.cc:1240] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Rejecting Update request from peer d51f98307f3848dea031026c70f09750 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:53.696131 28435 catalog_manager.cc:5697] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 reported cstate change: term changed from 1 to 2, leader changed from 70416ec32d0c4d78856daf60c9290418 (127.16.211.3) to d51f98307f3848dea031026c70f09750 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d51f98307f3848dea031026c70f09750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.697173 28685 raft_consensus.cc:515] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.704094 28734 consensus_queue.cc:1048] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:53.708652 28613 raft_consensus.cc:1275] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:53.710798 28685 leader_election.cc:290] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 2 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:53.710745 28733 consensus_queue.cc:1048] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:53.711678 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270d950e6ae04d5b9168dc1887bb67ef" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:53.712307 28537 raft_consensus.cc:3055] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:53.712626 28537 raft_consensus.cc:740] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:53.713423 28537 consensus_queue.cc:260] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.715335 28537 raft_consensus.cc:3060] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.715669 28735 raft_consensus.cc:3060] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:53.722007 28653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.2:33907, user_credentials={real_user=slave}} blocked reactor thread for 74523.6us
I20260709 13:21:53.723730 28612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "270d950e6ae04d5b9168dc1887bb67ef" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:53.724311 28612 raft_consensus.cc:3060] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.733197 28538 raft_consensus.cc:1275] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Refusing update from remote peer 0658b7a0664e42f4b42b35ed4581c14d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:53.734285 28537 raft_consensus.cc:2468] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 2.
I20260709 13:21:53.734898 28755 consensus_queue.cc:1048] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:53.728519 28681 raft_consensus.cc:2468] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 2.
I20260709 13:21:53.735692 28651 leader_election.cc:304] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:53.737805 28735 raft_consensus.cc:2804] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:53.738471 28735 raft_consensus.cc:697] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 2 LEADER]: Becoming Leader. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Running, Role: LEADER
I20260709 13:21:53.731338 28612 raft_consensus.cc:2468] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 2.
I20260709 13:21:53.741624 28804 raft_consensus.cc:993] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418: : Instructing follower 0658b7a0664e42f4b42b35ed4581c14d to start an election
I20260709 13:21:53.742174 28804 raft_consensus.cc:1081] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Signalling peer 0658b7a0664e42f4b42b35ed4581c14d to start an election
I20260709 13:21:53.739508 28735 consensus_queue.cc:237] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.750483 28612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2715fbba118d481db30cc7119e4dbc80"
dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
 from {username='slave'} at 127.0.0.1:45566
I20260709 13:21:53.753288 28612 raft_consensus.cc:493] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:53.753710 28612 raft_consensus.cc:3060] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.761061 28613 raft_consensus.cc:1275] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:53.762516 28759 consensus_queue.cc:1048] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:53.762838 28612 raft_consensus.cc:515] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.771425 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2715fbba118d481db30cc7119e4dbc80" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:53.771595 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2715fbba118d481db30cc7119e4dbc80" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:53.772051 28537 raft_consensus.cc:3060] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.772238 28681 raft_consensus.cc:3055] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:53.772652 28681 raft_consensus.cc:740] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Running, Role: LEADER
I20260709 13:21:53.772722 28612 leader_election.cc:290] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 2 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:53.773523 28681 consensus_queue.cc:260] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.773399 28434 catalog_manager.cc:5697] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 reported cstate change: term changed from 1 to 2, leader changed from d51f98307f3848dea031026c70f09750 (127.16.211.1) to 70416ec32d0c4d78856daf60c9290418 (127.16.211.3). New cstate: current_term: 2 leader_uuid: "70416ec32d0c4d78856daf60c9290418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:53.774770 28681 raft_consensus.cc:3060] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.779488 28537 raft_consensus.cc:2468] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 2.
I20260709 13:21:53.780793 28577 leader_election.cc:304] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:53.780838 28681 raft_consensus.cc:2468] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 2.
I20260709 13:21:53.781670 28815 raft_consensus.cc:2804] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:53.782406 28815 raft_consensus.cc:697] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 LEADER]: Becoming Leader. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:53.783138 28815 consensus_queue.cc:237] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:53.791953 28436 catalog_manager.cc:5697] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d reported cstate change: term changed from 1 to 2, leader changed from 70416ec32d0c4d78856daf60c9290418 (127.16.211.3) to 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2). New cstate: current_term: 2 leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.093271 28681 raft_consensus.cc:1275] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Refusing update from remote peer 0658b7a0664e42f4b42b35ed4581c14d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:54.094717 28756 consensus_queue.cc:1048] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:54.104285 28537 raft_consensus.cc:1275] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Refusing update from remote peer 0658b7a0664e42f4b42b35ed4581c14d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:54.106055 28815 consensus_queue.cc:1048] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:54.129580 28612 raft_consensus.cc:1275] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Refusing update from remote peer 70416ec32d0c4d78856daf60c9290418: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:54.130930 28735 consensus_queue.cc:1048] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:54.137205 28537 raft_consensus.cc:1275] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Refusing update from remote peer 70416ec32d0c4d78856daf60c9290418: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:54.138947 28810 consensus_queue.cc:1048] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:54.196998 28682 raft_consensus.cc:1275] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:54.198179 28733 consensus_queue.cc:1048] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:54.209270 28612 raft_consensus.cc:1275] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:54.210794 28759 consensus_queue.cc:1048] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:54.316098 28681 raft_consensus.cc:1275] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Refusing update from remote peer 0658b7a0664e42f4b42b35ed4581c14d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:54.317477 28815 consensus_queue.cc:1048] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:54.325568 28537 raft_consensus.cc:1275] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Refusing update from remote peer 0658b7a0664e42f4b42b35ed4581c14d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:54.327395 28756 consensus_queue.cc:1048] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:54.479009 28559 debug-util.cc:398] Leaking SignalData structure 0x7b0800124180 after lost signal to thread 17231
W20260709 13:21:54.480000 28559 debug-util.cc:398] Leaking SignalData structure 0x7b0800318100 after lost signal to thread 28470
W20260709 13:21:54.481096 28559 debug-util.cc:398] Leaking SignalData structure 0x7b0800220480 after lost signal to thread 28562
W20260709 13:21:54.482017 28559 debug-util.cc:398] Leaking SignalData structure 0x7b0800369960 after lost signal to thread 28637
W20260709 13:21:54.482896 28559 debug-util.cc:398] Leaking SignalData structure 0x7b0800391960 after lost signal to thread 28711
I20260709 13:21:56.487320 28434 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54706:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:56.490794 28434 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:56.553998 28528 tablet_service.cc:1511] Processing CreateTablet for tablet 54a90525f8f34dd4a4ffde6343898ba9 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:56.554738 28600 tablet_service.cc:1511] Processing CreateTablet for tablet 54a90525f8f34dd4a4ffde6343898ba9 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:56.555397 28528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a90525f8f34dd4a4ffde6343898ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.555987 28600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a90525f8f34dd4a4ffde6343898ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.558398 28672 tablet_service.cc:1511] Processing CreateTablet for tablet 54a90525f8f34dd4a4ffde6343898ba9 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:56.559787 28672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a90525f8f34dd4a4ffde6343898ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.559581 28598 tablet_service.cc:1511] Processing CreateTablet for tablet 7602973069494f0caef44985b901a7e7 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:56.562711 28525 tablet_service.cc:1511] Processing CreateTablet for tablet 7602973069494f0caef44985b901a7e7 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:56.561272 28676 tablet_service.cc:1511] Processing CreateTablet for tablet 7602973069494f0caef44985b901a7e7 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:56.566148 28676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7602973069494f0caef44985b901a7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.566586 28598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7602973069494f0caef44985b901a7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.566753 28525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7602973069494f0caef44985b901a7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.564112 28523 tablet_service.cc:1511] Processing CreateTablet for tablet 45a6aa53996e4470bcea605fc519fce2 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:56.570261 28523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a6aa53996e4470bcea605fc519fce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.576857 28596 tablet_service.cc:1511] Processing CreateTablet for tablet 45a6aa53996e4470bcea605fc519fce2 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:56.578405 28596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a6aa53996e4470bcea605fc519fce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.586376 28675 tablet_service.cc:1511] Processing CreateTablet for tablet 45a6aa53996e4470bcea605fc519fce2 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:56.587951 28675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a6aa53996e4470bcea605fc519fce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.594388 28524 tablet_service.cc:1511] Processing CreateTablet for tablet ed8e99f1c12442dc9b35408cf99ce7f3 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:56.595803 28524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed8e99f1c12442dc9b35408cf99ce7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.596334 28601 tablet_service.cc:1511] Processing CreateTablet for tablet ed8e99f1c12442dc9b35408cf99ce7f3 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:56.597573 28601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed8e99f1c12442dc9b35408cf99ce7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.614310 28677 tablet_service.cc:1511] Processing CreateTablet for tablet ed8e99f1c12442dc9b35408cf99ce7f3 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:56.615739 28677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed8e99f1c12442dc9b35408cf99ce7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.622179 28526 tablet_service.cc:1511] Processing CreateTablet for tablet daa60601f9904b40adf8998862b6e881 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:56.623696 28526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa60601f9904b40adf8998862b6e881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.631716 28599 tablet_service.cc:1511] Processing CreateTablet for tablet daa60601f9904b40adf8998862b6e881 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:56.633127 28599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa60601f9904b40adf8998862b6e881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.653083 28672 tablet_service.cc:1511] Processing CreateTablet for tablet daa60601f9904b40adf8998862b6e881 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:56.655112 28672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa60601f9904b40adf8998862b6e881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.661548 28523 tablet_service.cc:1511] Processing CreateTablet for tablet df140283680f4a8dbd2c988bfe8e3f4c (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:56.668493 28834 tablet_bootstrap.cc:492] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:56.668736 28833 tablet_bootstrap.cc:492] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:56.673466 28521 tablet_service.cc:1511] Processing CreateTablet for tablet 70ad4d7e1f434faf9844bc16cc4ea73a (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:56.674357 28676 tablet_service.cc:1511] Processing CreateTablet for tablet df140283680f4a8dbd2c988bfe8e3f4c (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:56.674844 28834 tablet_bootstrap.cc:654] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.675002 28521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ad4d7e1f434faf9844bc16cc4ea73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.675746 28676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df140283680f4a8dbd2c988bfe8e3f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.679308 28601 tablet_service.cc:1511] Processing CreateTablet for tablet df140283680f4a8dbd2c988bfe8e3f4c (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:56.680702 28601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df140283680f4a8dbd2c988bfe8e3f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.684789 28835 tablet_bootstrap.cc:492] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:56.688444 28523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df140283680f4a8dbd2c988bfe8e3f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.694232 28833 tablet_bootstrap.cc:654] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.695647 28599 tablet_service.cc:1511] Processing CreateTablet for tablet 70ad4d7e1f434faf9844bc16cc4ea73a (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:56.698320 28835 tablet_bootstrap.cc:654] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.706723 28525 tablet_service.cc:1511] Processing CreateTablet for tablet 61deddf94fed45fe955d9ca945ccbd29 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:56.708112 28525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61deddf94fed45fe955d9ca945ccbd29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.721256 28598 tablet_service.cc:1511] Processing CreateTablet for tablet 61deddf94fed45fe955d9ca945ccbd29 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:56.721800 28677 tablet_service.cc:1511] Processing CreateTablet for tablet 61deddf94fed45fe955d9ca945ccbd29 (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:56.724506 28677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61deddf94fed45fe955d9ca945ccbd29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.728845 28834 tablet_bootstrap.cc:492] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:56.729367 28834 ts_tablet_manager.cc:1403] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.061s	user 0.006s	sys 0.008s
I20260709 13:21:56.727882 28521 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbf638c1ca94541bf106318f03b955e (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:56.730525 28601 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbf638c1ca94541bf106318f03b955e (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:56.731593 28675 tablet_service.cc:1511] Processing CreateTablet for tablet 70ad4d7e1f434faf9844bc16cc4ea73a (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:56.733796 28521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbf638c1ca94541bf106318f03b955e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.735230 28671 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbf638c1ca94541bf106318f03b955e (DEFAULT_TABLE table=soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 13:21:56.744298 28484 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:56.744445 28671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbf638c1ca94541bf106318f03b955e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.726677 28599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ad4d7e1f434faf9844bc16cc4ea73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.750586 28598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61deddf94fed45fe955d9ca945ccbd29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.750633 28675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ad4d7e1f434faf9844bc16cc4ea73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.754297 28835 tablet_bootstrap.cc:492] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:56.754909 28835 ts_tablet_manager.cc:1403] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.011s
I20260709 13:21:56.755573 28834 raft_consensus.cc:359] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.760627 28834 raft_consensus.cc:385] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.761056 28834 raft_consensus.cc:740] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.761788 28834 consensus_queue.cc:260] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.763034 28601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbf638c1ca94541bf106318f03b955e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:56.759567 28833 tablet_bootstrap.cc:492] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:56.769894 28833 ts_tablet_manager.cc:1403] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.101s	user 0.007s	sys 0.009s
I20260709 13:21:56.772984 28833 raft_consensus.cc:359] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.773691 28833 raft_consensus.cc:385] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.800384 28833 raft_consensus.cc:740] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.782116 28834 ts_tablet_manager.cc:1434] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.005s
I20260709 13:21:56.801230 28833 consensus_queue.cc:260] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.801692 28834 tablet_bootstrap.cc:492] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:56.803718 28833 ts_tablet_manager.cc:1434] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.033s	user 0.001s	sys 0.004s
I20260709 13:21:56.768810 28835 raft_consensus.cc:359] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.804819 28835 raft_consensus.cc:385] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.805197 28835 raft_consensus.cc:740] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.806063 28835 consensus_queue.cc:260] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.808665 28835 ts_tablet_manager.cc:1434] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:21:56.812455 28735 raft_consensus.cc:493] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.812476 28835 tablet_bootstrap.cc:492] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:56.813128 28735 raft_consensus.cc:515] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.816234 28735 leader_election.cc:290] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:56.816917 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a6aa53996e4470bcea605fc519fce2" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:56.818373 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a6aa53996e4470bcea605fc519fce2" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:56.819406 28834 tablet_bootstrap.cc:654] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.820019 28835 tablet_bootstrap.cc:654] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:56.820648 28651 leader_election.cc:343] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d51f98307f3848dea031026c70f09750 (127.16.211.1:39399): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:56.821898 28653 leader_election.cc:343] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.822360 28653 leader_election.cc:304] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418; no voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750
I20260709 13:21:56.824115 28735 raft_consensus.cc:2749] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.834219 28834 tablet_bootstrap.cc:492] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:56.834954 28834 ts_tablet_manager.cc:1403] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.005s
I20260709 13:21:56.838069 28834 raft_consensus.cc:359] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.838914 28834 raft_consensus.cc:385] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.840369 28834 raft_consensus.cc:740] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.842403 28835 tablet_bootstrap.cc:492] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:56.843142 28835 ts_tablet_manager.cc:1403] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.007s
I20260709 13:21:56.843099 28834 consensus_queue.cc:260] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.846176 28834 ts_tablet_manager.cc:1434] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:21:56.830305 28833 tablet_bootstrap.cc:492] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:56.847090 28835 raft_consensus.cc:359] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.850085 28835 raft_consensus.cc:385] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.850456 28835 raft_consensus.cc:740] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.851320 28835 consensus_queue.cc:260] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.848583 28834 tablet_bootstrap.cc:492] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:56.855499 28833 tablet_bootstrap.cc:654] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.858934 28834 tablet_bootstrap.cc:654] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.865877 28835 ts_tablet_manager.cc:1434] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 13:21:56.867091 28835 tablet_bootstrap.cc:492] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:56.882248 28835 tablet_bootstrap.cc:654] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.891304 28833 tablet_bootstrap.cc:492] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:56.891994 28833 ts_tablet_manager.cc:1403] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.008s
I20260709 13:21:56.895042 28833 raft_consensus.cc:359] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.895838 28833 raft_consensus.cc:385] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.896166 28833 raft_consensus.cc:740] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.896407 28834 tablet_bootstrap.cc:492] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:56.897140 28834 ts_tablet_manager.cc:1403] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.012s
I20260709 13:21:56.896961 28833 consensus_queue.cc:260] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.897907 28835 tablet_bootstrap.cc:492] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:56.898649 28835 ts_tablet_manager.cc:1403] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.011s
I20260709 13:21:56.900514 28834 raft_consensus.cc:359] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.901322 28834 raft_consensus.cc:385] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.901635 28834 raft_consensus.cc:740] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.902107 28835 raft_consensus.cc:359] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.903012 28835 raft_consensus.cc:385] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.902580 28834 consensus_queue.cc:260] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.903357 28835 raft_consensus.cc:740] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.905592 28834 ts_tablet_manager.cc:1434] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
W20260709 13:21:56.905715 28713 tablet.cc:2406] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:56.906800 28834 tablet_bootstrap.cc:492] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:56.907298 28835 consensus_queue.cc:260] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.909786 28835 ts_tablet_manager.cc:1434] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:21:56.910898 28835 tablet_bootstrap.cc:492] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:56.917991 28835 tablet_bootstrap.cc:654] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.930038 28834 tablet_bootstrap.cc:654] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.932479 28835 tablet_bootstrap.cc:492] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:56.933120 28835 ts_tablet_manager.cc:1403] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 13:21:56.934418 28833 ts_tablet_manager.cc:1434] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:21:56.935515 28833 tablet_bootstrap.cc:492] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:56.936602 28835 raft_consensus.cc:359] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.937487 28835 raft_consensus.cc:385] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.937815 28835 raft_consensus.cc:740] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.938798 28835 consensus_queue.cc:260] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.941367 28835 ts_tablet_manager.cc:1434] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:56.942610 28835 tablet_bootstrap.cc:492] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:56.942809 28833 tablet_bootstrap.cc:654] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.950258 28835 tablet_bootstrap.cc:654] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.961544 28833 tablet_bootstrap.cc:492] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:56.962124 28833 ts_tablet_manager.cc:1403] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.008s
I20260709 13:21:56.965453 28833 raft_consensus.cc:359] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.966331 28833 raft_consensus.cc:385] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.966681 28833 raft_consensus.cc:740] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.967481 28833 consensus_queue.cc:260] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.969408 28835 tablet_bootstrap.cc:492] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:56.970094 28835 ts_tablet_manager.cc:1403] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.007s
I20260709 13:21:56.973492 28835 raft_consensus.cc:359] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.974301 28835 raft_consensus.cc:385] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.974610 28835 raft_consensus.cc:740] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.970089 28833 ts_tablet_manager.cc:1434] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:21:56.976438 28833 tablet_bootstrap.cc:492] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:56.977959 28834 tablet_bootstrap.cc:492] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:56.978621 28834 ts_tablet_manager.cc:1403] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.005s
I20260709 13:21:56.982079 28835 consensus_queue.cc:260] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.983489 28834 raft_consensus.cc:359] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.984627 28834 raft_consensus.cc:385] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.985127 28834 raft_consensus.cc:740] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.987891 28834 consensus_queue.cc:260] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:56.989195 28833 tablet_bootstrap.cc:654] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.998247 28834 ts_tablet_manager.cc:1434] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.003s
I20260709 13:21:56.999626 28834 tablet_bootstrap.cc:492] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:56.992823 28835 ts_tablet_manager.cc:1434] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:21:57.003345 28835 tablet_bootstrap.cc:492] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:57.017556 28835 tablet_bootstrap.cc:654] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.019117 28833 tablet_bootstrap.cc:492] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:57.019254 28834 tablet_bootstrap.cc:654] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.019862 28833 ts_tablet_manager.cc:1403] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.013s
I20260709 13:21:57.023368 28833 raft_consensus.cc:359] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.024184 28833 raft_consensus.cc:385] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.024494 28833 raft_consensus.cc:740] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.025303 28833 consensus_queue.cc:260] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.027796 28833 ts_tablet_manager.cc:1434] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:21:57.029253 28833 tablet_bootstrap.cc:492] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:57.029858 28835 tablet_bootstrap.cc:492] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:57.030553 28835 ts_tablet_manager.cc:1403] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.008s
I20260709 13:21:57.034053 28835 raft_consensus.cc:359] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.034876 28835 raft_consensus.cc:385] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.035192 28835 raft_consensus.cc:740] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.035996 28835 consensus_queue.cc:260] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.036572 28833 tablet_bootstrap.cc:654] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.043238 28835 ts_tablet_manager.cc:1434] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:21:57.044526 28835 tablet_bootstrap.cc:492] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:57.054389 28833 tablet_bootstrap.cc:492] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:57.055034 28833 ts_tablet_manager.cc:1403] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 13:21:57.055536 28835 tablet_bootstrap.cc:654] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.059505 28833 raft_consensus.cc:359] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.060081 28834 tablet_bootstrap.cc:492] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:57.060318 28833 raft_consensus.cc:385] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.060678 28834 ts_tablet_manager.cc:1403] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.004s
I20260709 13:21:57.060683 28833 raft_consensus.cc:740] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.062382 28833 consensus_queue.cc:260] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.065146 28833 ts_tablet_manager.cc:1434] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:57.066538 28833 tablet_bootstrap.cc:492] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:57.072911 28834 raft_consensus.cc:359] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.073994 28834 raft_consensus.cc:385] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.074371 28834 raft_consensus.cc:740] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.081035 28756 raft_consensus.cc:493] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.075592 28834 consensus_queue.cc:260] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.081674 28756 raft_consensus.cc:515] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.082625 28735 raft_consensus.cc:493] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.083197 28735 raft_consensus.cc:515] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.084133 28756 leader_election.cc:290] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.085466 28735 leader_election.cc:290] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:57.086186 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602973069494f0caef44985b901a7e7" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:57.086963 28537 raft_consensus.cc:2468] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:57.088575 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8e99f1c12442dc9b35408cf99ce7f3" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:57.089418 28834 ts_tablet_manager.cc:1434] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:21:57.089413 28613 raft_consensus.cc:2468] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 0.
I20260709 13:21:57.090724 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602973069494f0caef44985b901a7e7" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:57.094352 28682 raft_consensus.cc:2468] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:57.095849 28833 tablet_bootstrap.cc:654] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.091411 28577 leader_election.cc:304] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:57.092053 28834 tablet_bootstrap.cc:492] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:57.093500 28835 tablet_bootstrap.cc:492] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:57.089660 28538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8e99f1c12442dc9b35408cf99ce7f3" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:57.099045 28538 raft_consensus.cc:2468] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 0.
I20260709 13:21:57.100426 28835 ts_tablet_manager.cc:1403] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.056s	user 0.033s	sys 0.006s
I20260709 13:21:57.100672 28651 leader_election.cc:304] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:57.101686 28735 raft_consensus.cc:2804] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.102106 28735 raft_consensus.cc:493] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.102478 28735 raft_consensus.cc:3060] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.103305 28846 raft_consensus.cc:2804] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.106562 28846 raft_consensus.cc:493] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.107024 28846 raft_consensus.cc:3060] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.107776 28835 raft_consensus.cc:359] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.108611 28835 raft_consensus.cc:385] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.108927 28835 raft_consensus.cc:740] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.110102 28756 raft_consensus.cc:493] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.109745 28835 consensus_queue.cc:260] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.114746 28756 raft_consensus.cc:515] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.115724 28834 tablet_bootstrap.cc:654] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.118443 28756 leader_election.cc:290] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.118726 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa60601f9904b40adf8998862b6e881" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:57.119176 28835 ts_tablet_manager.cc:1434] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:21:57.132050 28756 raft_consensus.cc:493] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.132577 28756 raft_consensus.cc:515] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.135167 28756 leader_election.cc:290] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.139256 28833 tablet_bootstrap.cc:492] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:57.139880 28833 ts_tablet_manager.cc:1403] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.000s
I20260709 13:21:57.141121 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a6aa53996e4470bcea605fc519fce2" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:57.124663 28846 raft_consensus.cc:515] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.132908 28835 tablet_bootstrap.cc:492] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750: Bootstrap starting.
W20260709 13:21:57.139344 28578 leader_election.cc:343] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.141849 28682 raft_consensus.cc:2468] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:57.144690 28578 leader_election.cc:304] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, 70416ec32d0c4d78856daf60c9290418; no voters: 
I20260709 13:21:57.146214 28856 raft_consensus.cc:2804] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.146622 28856 raft_consensus.cc:493] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.146965 28856 raft_consensus.cc:3060] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.149442 28835 tablet_bootstrap.cc:654] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.150271 28834 tablet_bootstrap.cc:492] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:57.150835 28834 ts_tablet_manager.cc:1403] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.000s
I20260709 13:21:57.151146 28538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa60601f9904b40adf8998862b6e881" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:57.151888 28538 raft_consensus.cc:2468] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:57.153002 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a6aa53996e4470bcea605fc519fce2" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:57.153682 28537 raft_consensus.cc:2468] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:57.154497 28846 leader_election.cc:290] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.130614 28735 raft_consensus.cc:515] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.155597 28537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602973069494f0caef44985b901a7e7" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:57.156010 28577 leader_election.cc:304] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 70416ec32d0c4d78856daf60c9290418
I20260709 13:21:57.156194 28537 raft_consensus.cc:3060] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.157681 28846 raft_consensus.cc:2804] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.158085 28846 raft_consensus.cc:493] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.158435 28846 raft_consensus.cc:3060] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.159289 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8e99f1c12442dc9b35408cf99ce7f3" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:57.143112 28833 raft_consensus.cc:359] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.159957 28613 raft_consensus.cc:3060] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.160303 28833 raft_consensus.cc:385] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.160625 28833 raft_consensus.cc:740] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.162359 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602973069494f0caef44985b901a7e7" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:57.162967 28682 raft_consensus.cc:3060] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.158346 28538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8e99f1c12442dc9b35408cf99ce7f3" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:57.166278 28538 raft_consensus.cc:3060] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.165963 28846 raft_consensus.cc:515] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.166419 28833 consensus_queue.cc:260] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.153944 28834 raft_consensus.cc:359] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.168083 28834 raft_consensus.cc:385] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.168391 28834 raft_consensus.cc:740] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.169138 28834 consensus_queue.cc:260] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.171821 28834 ts_tablet_manager.cc:1434] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:21:57.172833 28834 tablet_bootstrap.cc:492] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:57.165805 28856 raft_consensus.cc:515] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.179939 28835 tablet_bootstrap.cc:492] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:57.180851 28835 ts_tablet_manager.cc:1403] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.005s
I20260709 13:21:57.182732 28536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a6aa53996e4470bcea605fc519fce2" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:57.183085 28856 leader_election.cc:290] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.183552 28536 raft_consensus.cc:3060] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.185197 28835 raft_consensus.cc:359] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.185966 28835 raft_consensus.cc:385] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.186218 28835 raft_consensus.cc:740] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.186669 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a6aa53996e4470bcea605fc519fce2" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:57.186846 28835 consensus_queue.cc:260] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.187716 28681 raft_consensus.cc:3060] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.188984 28835 ts_tablet_manager.cc:1434] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:21:57.190173 28835 tablet_bootstrap.cc:492] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750: Bootstrap starting.
I20260709 13:21:57.190749 28834 tablet_bootstrap.cc:654] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.192618 28856 raft_consensus.cc:493] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.193121 28856 raft_consensus.cc:515] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.194329 28535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa60601f9904b40adf8998862b6e881" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:57.194990 28535 raft_consensus.cc:3060] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.195220 28856 leader_election.cc:290] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.196858 28683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa60601f9904b40adf8998862b6e881" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:57.196969 28684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a90525f8f34dd4a4ffde6343898ba9" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:57.197957 28684 raft_consensus.cc:2468] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
W20260709 13:21:57.198347 28578 leader_election.cc:343] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.199878 28846 leader_election.cc:290] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.200034 28534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a90525f8f34dd4a4ffde6343898ba9" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:57.199508 28578 leader_election.cc:304] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, 70416ec32d0c4d78856daf60c9290418; no voters: 
I20260709 13:21:57.200692 28534 raft_consensus.cc:2468] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:57.201308 28846 raft_consensus.cc:2804] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.201699 28846 raft_consensus.cc:493] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.202131 28846 raft_consensus.cc:3060] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.159438 28735 leader_election.cc:290] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:57.211810 28537 raft_consensus.cc:2468] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:57.213800 28577 leader_election.cc:304] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:57.215358 28856 raft_consensus.cc:2804] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.215847 28856 raft_consensus.cc:697] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Leader. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:57.216652 28856 consensus_queue.cc:237] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.217819 28681 raft_consensus.cc:2468] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:57.218616 28846 raft_consensus.cc:515] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.219162 28578 leader_election.cc:304] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, 70416ec32d0c4d78856daf60c9290418; no voters: 
I20260709 13:21:57.221060 28756 raft_consensus.cc:2804] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.221524 28756 raft_consensus.cc:697] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Leader. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:57.222301 28835 tablet_bootstrap.cc:654] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.222340 28756 consensus_queue.cc:237] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.236622 28613 raft_consensus.cc:2468] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 1.
I20260709 13:21:57.238163 28653 leader_election.cc:304] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, 70416ec32d0c4d78856daf60c9290418; no voters: 
I20260709 13:21:57.239174 28735 raft_consensus.cc:2804] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.239259 28535 raft_consensus.cc:2468] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:57.239812 28735 raft_consensus.cc:697] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Becoming Leader. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Running, Role: LEADER
I20260709 13:21:57.244096 28577 leader_election.cc:304] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 70416ec32d0c4d78856daf60c9290418
I20260709 13:21:57.244618 28538 raft_consensus.cc:2468] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 1.
I20260709 13:21:57.241782 28536 raft_consensus.cc:2468] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:57.243304 28682 raft_consensus.cc:2468] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:57.246582 28735 consensus_queue.cc:237] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.242504 28833 ts_tablet_manager.cc:1434] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.102s	user 0.010s	sys 0.017s
I20260709 13:21:57.250440 28856 raft_consensus.cc:2804] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.251231 28856 raft_consensus.cc:697] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Leader. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:57.252980 28846 leader_election.cc:290] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.253677 28834 tablet_bootstrap.cc:492] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:57.252050 28856 consensus_queue.cc:237] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.254372 28834 ts_tablet_manager.cc:1403] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.003s
I20260709 13:21:57.255252 28434 catalog_manager.cc:5697] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2). New cstate: current_term: 1 leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.260128 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a90525f8f34dd4a4ffde6343898ba9" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:57.261053 28682 raft_consensus.cc:3060] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.266810 28833 tablet_bootstrap.cc:492] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:57.267275 28834 raft_consensus.cc:359] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.268116 28834 raft_consensus.cc:385] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.268400 28834 raft_consensus.cc:740] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.273765 28536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a90525f8f34dd4a4ffde6343898ba9" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:57.276851 28536 raft_consensus.cc:3060] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.284600 28436 catalog_manager.cc:5697] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70416ec32d0c4d78856daf60c9290418 (127.16.211.3). New cstate: current_term: 1 leader_uuid: "70416ec32d0c4d78856daf60c9290418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:57.285826 28756 raft_consensus.cc:493] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.286406 28756 raft_consensus.cc:515] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.287052 28834 consensus_queue.cc:260] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.288614 28756 leader_election.cc:290] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.289247 28536 raft_consensus.cc:2468] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:57.290370 28536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140283680f4a8dbd2c988bfe8e3f4c" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:57.290606 28577 leader_election.cc:304] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:57.291045 28536 raft_consensus.cc:2468] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:57.291572 28846 raft_consensus.cc:2804] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.292075 28846 raft_consensus.cc:697] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Leader. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:57.292277 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140283680f4a8dbd2c988bfe8e3f4c" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:57.292567 28577 leader_election.cc:304] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:57.284148 28682 raft_consensus.cc:2468] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:57.293054 28681 raft_consensus.cc:2468] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:57.293591 28857 raft_consensus.cc:2804] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.292943 28846 consensus_queue.cc:237] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.298851 28857 raft_consensus.cc:493] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.299635 28857 raft_consensus.cc:3060] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.292258 28834 ts_tablet_manager.cc:1434] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:21:57.306317 28834 tablet_bootstrap.cc:492] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:57.309543 28835 tablet_bootstrap.cc:492] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750: No bootstrap required, opened a new log
I20260709 13:21:57.297817 28833 tablet_bootstrap.cc:654] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.310074 28434 catalog_manager.cc:5697] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2). New cstate: current_term: 1 leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.312863 28834 tablet_bootstrap.cc:654] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.312242 28434 catalog_manager.cc:5697] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2). New cstate: current_term: 1 leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.314015 28434 catalog_manager.cc:5697] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2). New cstate: current_term: 1 leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.310148 28835 ts_tablet_manager.cc:1403] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750: Time spent bootstrapping tablet: real 0.120s	user 0.017s	sys 0.008s
I20260709 13:21:57.318269 28857 raft_consensus.cc:515] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.321738 28536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140283680f4a8dbd2c988bfe8e3f4c" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:57.321810 28857 leader_election.cc:290] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.322381 28536 raft_consensus.cc:3060] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.326082 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df140283680f4a8dbd2c988bfe8e3f4c" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:57.326802 28681 raft_consensus.cc:3060] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.329862 28536 raft_consensus.cc:2468] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:57.331173 28577 leader_election.cc:304] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:57.332060 28857 raft_consensus.cc:2804] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.332639 28857 raft_consensus.cc:697] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Leader. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:57.333535 28857 consensus_queue.cc:237] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.339452 28833 tablet_bootstrap.cc:492] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:57.340061 28833 ts_tablet_manager.cc:1403] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.002s
I20260709 13:21:57.343474 28834 tablet_bootstrap.cc:492] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:57.344084 28681 raft_consensus.cc:2468] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:57.346078 28834 ts_tablet_manager.cc:1403] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.003s
I20260709 13:21:57.349042 28834 raft_consensus.cc:359] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.347805 28833 raft_consensus.cc:359] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.344961 28835 raft_consensus.cc:359] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.350032 28834 raft_consensus.cc:385] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.350754 28834 raft_consensus.cc:740] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.349202 28436 catalog_manager.cc:5697] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2). New cstate: current_term: 1 leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.351377 28834 consensus_queue.cc:260] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.350214 28835 raft_consensus.cc:385] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.352530 28835 raft_consensus.cc:740] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.353127 28835 consensus_queue.cc:260] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.350088 28833 raft_consensus.cc:385] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.354413 28833 raft_consensus.cc:740] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.355082 28835 ts_tablet_manager.cc:1434] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 13:21:57.355219 28833 consensus_queue.cc:260] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.357831 28833 ts_tablet_manager.cc:1434] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:21:57.358919 28833 tablet_bootstrap.cc:492] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:57.360855 28834 ts_tablet_manager.cc:1434] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:21:57.361958 28834 tablet_bootstrap.cc:492] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d: Bootstrap starting.
I20260709 13:21:57.363937 28843 raft_consensus.cc:493] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.364563 28843 raft_consensus.cc:515] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.368155 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf638c1ca94541bf106318f03b955e" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
W20260709 13:21:57.369700 28504 leader_election.cc:343] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.370318 28843 leader_election.cc:290] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.368182 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf638c1ca94541bf106318f03b955e" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:57.373099 28682 raft_consensus.cc:2468] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 0.
I20260709 13:21:57.377123 28833 tablet_bootstrap.cc:654] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.378659 28503 leader_election.cc:304] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 0658b7a0664e42f4b42b35ed4581c14d
I20260709 13:21:57.379938 28843 raft_consensus.cc:2804] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.380256 28843 raft_consensus.cc:493] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.380535 28843 raft_consensus.cc:3060] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.384222 28834 tablet_bootstrap.cc:654] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.386024 28843 raft_consensus.cc:515] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.388921 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf638c1ca94541bf106318f03b955e" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
W20260709 13:21:57.390192 28504 leader_election.cc:343] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.390403 28843 leader_election.cc:290] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Requested vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.391935 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf638c1ca94541bf106318f03b955e" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:57.392719 28681 raft_consensus.cc:3060] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.394694 28834 tablet_bootstrap.cc:492] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d: No bootstrap required, opened a new log
I20260709 13:21:57.394724 28833 tablet_bootstrap.cc:492] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:57.395407 28834 ts_tablet_manager.cc:1403] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.000s
I20260709 13:21:57.395524 28833 ts_tablet_manager.cc:1403] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.005s
I20260709 13:21:57.398298 28834 raft_consensus.cc:359] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.398988 28834 raft_consensus.cc:385] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.398658 28833 raft_consensus.cc:359] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.399289 28834 raft_consensus.cc:740] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.399463 28833 raft_consensus.cc:385] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.399833 28833 raft_consensus.cc:740] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.400130 28834 consensus_queue.cc:260] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.400557 28833 consensus_queue.cc:260] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.402664 28834 ts_tablet_manager.cc:1434] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:21:57.402990 28833 ts_tablet_manager.cc:1434] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:57.404078 28833 tablet_bootstrap.cc:492] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418: Bootstrap starting.
I20260709 13:21:57.409161 28681 raft_consensus.cc:2468] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 1.
I20260709 13:21:57.410611 28503 leader_election.cc:304] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 0658b7a0664e42f4b42b35ed4581c14d
I20260709 13:21:57.412142 28833 tablet_bootstrap.cc:654] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.417277 28735 raft_consensus.cc:493] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.417977 28735 raft_consensus.cc:515] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.421729 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa60601f9904b40adf8998862b6e881" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:57.422478 28843 raft_consensus.cc:2804] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.423439 28735 leader_election.cc:290] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:57.427503 28536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daa60601f9904b40adf8998862b6e881" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:57.428411 28536 raft_consensus.cc:2393] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70416ec32d0c4d78856daf60c9290418 in current term 1: Already voted for candidate 0658b7a0664e42f4b42b35ed4581c14d in this term.
I20260709 13:21:57.430423 28833 tablet_bootstrap.cc:492] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418: No bootstrap required, opened a new log
I20260709 13:21:57.430814 28843 raft_consensus.cc:697] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Becoming Leader. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:57.430994 28833 ts_tablet_manager.cc:1403] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.004s
I20260709 13:21:57.431977 28843 consensus_queue.cc:237] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.434904 28833 raft_consensus.cc:359] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.435705 28833 raft_consensus.cc:385] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.435993 28833 raft_consensus.cc:740] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.436695 28833 consensus_queue.cc:260] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.439101 28833 ts_tablet_manager.cc:1434] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:57.439823 28857 raft_consensus.cc:493] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.440441 28857 raft_consensus.cc:515] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.442730 28857 leader_election.cc:290] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.442855 28651 leader_election.cc:304] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418; no voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750
I20260709 13:21:57.443466 28536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61deddf94fed45fe955d9ca945ccbd29" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:57.443750 28735 raft_consensus.cc:3060] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.444437 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61deddf94fed45fe955d9ca945ccbd29" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:57.444240 28536 raft_consensus.cc:2468] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:57.445235 28681 raft_consensus.cc:2468] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 0.
I20260709 13:21:57.446105 28577 leader_election.cc:304] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:57.447414 28857 raft_consensus.cc:2804] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.447817 28857 raft_consensus.cc:493] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.448153 28857 raft_consensus.cc:3060] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.451584 28735 raft_consensus.cc:2749] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.455637 28857 raft_consensus.cc:515] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.455714 28435 catalog_manager.cc:5697] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 reported cstate change: term changed from 0 to 1, leader changed from <none> to d51f98307f3848dea031026c70f09750 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d51f98307f3848dea031026c70f09750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.458813 28536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61deddf94fed45fe955d9ca945ccbd29" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:57.459444 28536 raft_consensus.cc:3060] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.470130 28536 raft_consensus.cc:2468] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:57.471339 28577 leader_election.cc:304] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:57.471457 28857 leader_election.cc:290] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.472257 28846 raft_consensus.cc:2804] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.472762 28846 raft_consensus.cc:697] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Leader. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:57.472608 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61deddf94fed45fe955d9ca945ccbd29" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:57.473788 28681 raft_consensus.cc:3060] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.473619 28846 consensus_queue.cc:237] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.482317 28681 raft_consensus.cc:2468] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 1.
I20260709 13:21:57.486765 28876 raft_consensus.cc:493] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.487414 28876 raft_consensus.cc:515] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.490334 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ad4d7e1f434faf9844bc16cc4ea73a" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d" is_pre_election: true
I20260709 13:21:57.490861 28876 leader_election.cc:290] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.490989 28613 raft_consensus.cc:2468] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 0.
I20260709 13:21:57.492362 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ad4d7e1f434faf9844bc16cc4ea73a" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:57.492599 28504 leader_election.cc:304] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:57.493398 28876 raft_consensus.cc:2804] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.493738 28876 raft_consensus.cc:493] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.493039 28681 raft_consensus.cc:2468] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 0.
I20260709 13:21:57.494041 28876 raft_consensus.cc:3060] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.498111 28435 catalog_manager.cc:5697] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2). New cstate: current_term: 1 leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.504441 28876 raft_consensus.cc:515] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.507094 28876 leader_election.cc:290] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Requested vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.508231 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ad4d7e1f434faf9844bc16cc4ea73a" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:57.508906 28681 raft_consensus.cc:3060] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.509936 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ad4d7e1f434faf9844bc16cc4ea73a" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:57.510644 28613 raft_consensus.cc:3060] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.516672 28681 raft_consensus.cc:2468] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 1.
I20260709 13:21:57.518046 28503 leader_election.cc:304] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:57.518607 28613 raft_consensus.cc:2468] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 1.
I20260709 13:21:57.518743 28876 raft_consensus.cc:2804] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.519552 28876 raft_consensus.cc:697] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Becoming Leader. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:57.520377 28876 consensus_queue.cc:237] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.528043 28435 catalog_manager.cc:5697] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 reported cstate change: term changed from 0 to 1, leader changed from <none> to d51f98307f3848dea031026c70f09750 (127.16.211.1). New cstate: current_term: 1 leader_uuid: "d51f98307f3848dea031026c70f09750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.682608 28857 consensus_queue.cc:1048] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.685933 28846 consensus_queue.cc:1048] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.687115 28857 consensus_queue.cc:1048] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.692642 28860 consensus_queue.cc:1048] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:57.702816 28756 consensus_queue.cc:1048] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.707624 28613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54a90525f8f34dd4a4ffde6343898ba9"
dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
mode: GRACEFUL
new_leader_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:45582
I20260709 13:21:57.708261 28613 raft_consensus.cc:606] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Received request to transfer leadership to TS d51f98307f3848dea031026c70f09750
I20260709 13:21:57.717530 28613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7602973069494f0caef44985b901a7e7"
dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
mode: GRACEFUL
new_leader_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:45582
I20260709 13:21:57.718204 28613 raft_consensus.cc:606] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Received request to transfer leadership to TS d51f98307f3848dea031026c70f09750
I20260709 13:21:57.733129 28846 raft_consensus.cc:993] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d: : Instructing follower d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:57.733616 28846 raft_consensus.cc:1081] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Signalling peer d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:57.736124 28756 consensus_queue.cc:1048] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.739162 28538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54a90525f8f34dd4a4ffde6343898ba9"
dest_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:51018
I20260709 13:21:57.739887 28538 raft_consensus.cc:493] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:57.740271 28538 raft_consensus.cc:3060] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.749778 28756 consensus_queue.cc:1048] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:57.755785 28857 consensus_queue.cc:1048] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.767786 28613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45a6aa53996e4470bcea605fc519fce2"
dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
mode: GRACEFUL
new_leader_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:45582
I20260709 13:21:57.768446 28613 raft_consensus.cc:606] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Received request to transfer leadership to TS d51f98307f3848dea031026c70f09750
I20260709 13:21:57.780197 28856 consensus_queue.cc:1048] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.781837 28538 raft_consensus.cc:515] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.784718 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a90525f8f34dd4a4ffde6343898ba9" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:57.785132 28856 raft_consensus.cc:493] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.785750 28856 raft_consensus.cc:515] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.788262 28856 leader_election.cc:290] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.789414 28683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf638c1ca94541bf106318f03b955e" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70416ec32d0c4d78856daf60c9290418" is_pre_election: true
I20260709 13:21:57.790261 28683 raft_consensus.cc:2393] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0658b7a0664e42f4b42b35ed4581c14d in current term 1: Already voted for candidate d51f98307f3848dea031026c70f09750 in this term.
I20260709 13:21:57.793406 28683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed8e99f1c12442dc9b35408cf99ce7f3"
dest_uuid: "70416ec32d0c4d78856daf60c9290418"
mode: GRACEFUL
new_leader_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:49644
I20260709 13:21:57.794097 28533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf638c1ca94541bf106318f03b955e" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51f98307f3848dea031026c70f09750" is_pre_election: true
I20260709 13:21:57.794121 28683 raft_consensus.cc:606] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Received request to transfer leadership to TS d51f98307f3848dea031026c70f09750
I20260709 13:21:57.798184 28683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a90525f8f34dd4a4ffde6343898ba9" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:57.798725 28683 raft_consensus.cc:3060] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.803179 28577 leader_election.cc:304] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d; no voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750
I20260709 13:21:57.804879 28756 raft_consensus.cc:3060] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.807717 28538 leader_election.cc:290] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Requested vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.812552 28683 raft_consensus.cc:2468] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 2.
I20260709 13:21:57.813838 28503 leader_election.cc:304] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:57.815567 28876 raft_consensus.cc:2804] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:57.816320 28876 raft_consensus.cc:697] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Becoming Leader. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:57.817250 28876 consensus_queue.cc:237] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.820343 28896 raft_consensus.cc:993] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d: : Instructing follower d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:57.825640 28857 raft_consensus.cc:1081] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Signalling peer d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:57.826848 28683 raft_consensus.cc:1240] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Rejecting Update request from peer 0658b7a0664e42f4b42b35ed4581c14d for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:57.828444 28857 consensus_queue.cc:1059] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.828953 28860 raft_consensus.cc:993] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418: : Instructing follower d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:57.829348 28613 raft_consensus.cc:3055] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:57.829408 28860 raft_consensus.cc:1081] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Signalling peer d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:57.829761 28613 raft_consensus.cc:740] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:57.830693 28613 consensus_queue.cc:260] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.832201 28613 raft_consensus.cc:3060] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.837821 28856 raft_consensus.cc:993] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d: : Instructing follower d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:57.838511 28856 raft_consensus.cc:1081] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Signalling peer d51f98307f3848dea031026c70f09750 to start an election
I20260709 13:21:57.846071 28856 consensus_queue.cc:1048] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:57.853894 28434 catalog_manager.cc:5697] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 reported cstate change: term changed from 1 to 2, leader changed from 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2) to d51f98307f3848dea031026c70f09750 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d51f98307f3848dea031026c70f09750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.858290 28756 raft_consensus.cc:2749] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.859146 28536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7602973069494f0caef44985b901a7e7"
dest_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:51018
I20260709 13:21:57.858819 28535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed8e99f1c12442dc9b35408cf99ce7f3"
dest_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:51022
I20260709 13:21:57.871403 28536 raft_consensus.cc:493] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:57.871867 28536 raft_consensus.cc:3060] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.873235 28843 consensus_queue.cc:1048] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.876289 28538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45a6aa53996e4470bcea605fc519fce2"
dest_uuid: "d51f98307f3848dea031026c70f09750"
 from {username='slave'} at 127.0.0.1:51018
I20260709 13:21:57.876871 28538 raft_consensus.cc:493] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:57.877261 28538 raft_consensus.cc:3060] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.889897 28535 raft_consensus.cc:493] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:57.891400 28535 raft_consensus.cc:3060] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.884977 28538 raft_consensus.cc:515] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.901180 28898 consensus_queue.cc:1048] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:57.905798 28860 consensus_queue.cc:1048] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:57.908433 28537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70ad4d7e1f434faf9844bc16cc4ea73a"
dest_uuid: "d51f98307f3848dea031026c70f09750"
mode: GRACEFUL
new_leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
 from {username='slave'} at 127.0.0.1:51038
I20260709 13:21:57.908993 28537 raft_consensus.cc:606] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Received request to transfer leadership to TS 0658b7a0664e42f4b42b35ed4581c14d
I20260709 13:21:57.927342 28535 raft_consensus.cc:515] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.929630 28535 leader_election.cc:290] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Requested vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.939584 28612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8e99f1c12442dc9b35408cf99ce7f3" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:57.945622 28613 raft_consensus.cc:2468] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 2.
I20260709 13:21:57.950615 28843 consensus_queue.cc:1048] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.955212 28536 raft_consensus.cc:515] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.955960 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed8e99f1c12442dc9b35408cf99ce7f3" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:57.956632 28681 raft_consensus.cc:3055] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:57.956983 28681 raft_consensus.cc:740] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Running, Role: LEADER
I20260709 13:21:57.958063 28681 consensus_queue.cc:260] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.958818 28538 leader_election.cc:290] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Requested vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:57.963550 28610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a6aa53996e4470bcea605fc519fce2" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:57.964223 28610 raft_consensus.cc:3055] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:57.964527 28610 raft_consensus.cc:740] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:57.965402 28610 consensus_queue.cc:260] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.962920 28681 raft_consensus.cc:3060] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.966722 28610 raft_consensus.cc:3060] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.969547 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602973069494f0caef44985b901a7e7" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:57.970224 28682 raft_consensus.cc:3060] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.971201 28612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7602973069494f0caef44985b901a7e7" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:57.971933 28612 raft_consensus.cc:3055] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:57.972376 28612 raft_consensus.cc:740] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:57.973275 28612 consensus_queue.cc:260] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.977475 28682 raft_consensus.cc:2468] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 2.
I20260709 13:21:57.980427 28610 raft_consensus.cc:2468] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 2.
I20260709 13:21:57.982586 28504 leader_election.cc:304] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:57.983728 28876 raft_consensus.cc:2804] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:57.984213 28876 raft_consensus.cc:697] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Becoming Leader. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:57.984936 28876 consensus_queue.cc:237] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:57.987164 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a6aa53996e4470bcea605fc519fce2" candidate_uuid: "d51f98307f3848dea031026c70f09750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:57.988402 28612 raft_consensus.cc:3060] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.990022 28535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fbf638c1ca94541bf106318f03b955e"
dest_uuid: "d51f98307f3848dea031026c70f09750"
mode: GRACEFUL
new_leader_uuid: "70416ec32d0c4d78856daf60c9290418"
 from {username='slave'} at 127.0.0.1:51038
I20260709 13:21:57.990690 28535 raft_consensus.cc:606] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Received request to transfer leadership to TS 70416ec32d0c4d78856daf60c9290418
I20260709 13:21:57.987918 28682 raft_consensus.cc:3060] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:58.002182 28503 leader_election.cc:304] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:21:58.002528 28612 raft_consensus.cc:2468] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 2.
I20260709 13:21:58.004251 28907 raft_consensus.cc:2804] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:58.004838 28907 raft_consensus.cc:697] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Becoming Leader. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:58.007498 28536 leader_election.cc:290] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Requested vote from peers 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:58.005685 28907 consensus_queue.cc:237] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:58.011708 28681 raft_consensus.cc:2468] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 2.
I20260709 13:21:58.012705 28682 raft_consensus.cc:2468] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d51f98307f3848dea031026c70f09750 in term 2.
I20260709 13:21:58.013948 28856 consensus_queue.cc:1048] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.022169 28876 raft_consensus.cc:993] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750: : Instructing follower 70416ec32d0c4d78856daf60c9290418 to start an election
I20260709 13:21:58.022850 28843 raft_consensus.cc:1081] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Signalling peer 70416ec32d0c4d78856daf60c9290418 to start an election
I20260709 13:21:58.023795 28503 leader_election.cc:304] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 0658b7a0664e42f4b42b35ed4581c14d
I20260709 13:21:58.034228 28436 catalog_manager.cc:5697] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 reported cstate change: term changed from 1 to 2, leader changed from 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2) to d51f98307f3848dea031026c70f09750 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d51f98307f3848dea031026c70f09750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.035555 28436 catalog_manager.cc:5697] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 reported cstate change: term changed from 1 to 2, leader changed from 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2) to d51f98307f3848dea031026c70f09750 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d51f98307f3848dea031026c70f09750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.036265 28908 raft_consensus.cc:2804] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:58.036895 28908 raft_consensus.cc:697] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Becoming Leader. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:58.037760 28908 consensus_queue.cc:237] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:58.041079 28681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fbf638c1ca94541bf106318f03b955e"
dest_uuid: "70416ec32d0c4d78856daf60c9290418"
 from {username='slave'} at 127.0.0.1:49618
I20260709 13:21:58.040927 28907 consensus_queue.cc:1048] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.041798 28681 raft_consensus.cc:493] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:58.042315 28681 raft_consensus.cc:3060] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:58.050088 28681 raft_consensus.cc:515] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:58.061990 28436 catalog_manager.cc:5697] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 reported cstate change: term changed from 1 to 2, leader changed from 70416ec32d0c4d78856daf60c9290418 (127.16.211.3) to d51f98307f3848dea031026c70f09750 (127.16.211.1). New cstate: current_term: 2 leader_uuid: "d51f98307f3848dea031026c70f09750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.064678 28536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf638c1ca94541bf106318f03b955e" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:58.066155 28612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf638c1ca94541bf106318f03b955e" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:21:58.066835 28612 raft_consensus.cc:3060] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:58.067587 28681 leader_election.cc:290] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 2 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:21:58.068866 28536 raft_consensus.cc:3055] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:58.075716 28909 consensus_queue.cc:1048] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.075759 28536 raft_consensus.cc:740] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:58.076858 28536 consensus_queue.cc:260] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:58.078491 28536 raft_consensus.cc:3060] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:58.086485 28612 raft_consensus.cc:2468] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 2.
I20260709 13:21:58.099470 28653 leader_election.cc:304] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, 70416ec32d0c4d78856daf60c9290418; no voters: 
I20260709 13:21:58.100544 28536 raft_consensus.cc:2468] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 2.
I20260709 13:21:58.102548 28876 raft_consensus.cc:993] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750: : Instructing follower 0658b7a0664e42f4b42b35ed4581c14d to start an election
I20260709 13:21:58.102919 28735 raft_consensus.cc:2804] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:58.103008 28876 raft_consensus.cc:1081] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Signalling peer 0658b7a0664e42f4b42b35ed4581c14d to start an election
I20260709 13:21:58.103580 28735 raft_consensus.cc:697] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 2 LEADER]: Becoming Leader. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Running, Role: LEADER
I20260709 13:21:58.104423 28735 consensus_queue.cc:237] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:58.107089 28613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70ad4d7e1f434faf9844bc16cc4ea73a"
dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
 from {username='slave'} at 127.0.0.1:45552
I20260709 13:21:58.107678 28613 raft_consensus.cc:493] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:58.108033 28613 raft_consensus.cc:3060] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:58.115631 28613 raft_consensus.cc:515] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:58.121472 28434 catalog_manager.cc:5697] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 reported cstate change: term changed from 1 to 2, leader changed from d51f98307f3848dea031026c70f09750 (127.16.211.1) to 70416ec32d0c4d78856daf60c9290418 (127.16.211.3). New cstate: current_term: 2 leader_uuid: "70416ec32d0c4d78856daf60c9290418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:58.122800 28613 leader_election.cc:290] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 2 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 70416ec32d0c4d78856daf60c9290418 (127.16.211.3:34069)
I20260709 13:21:58.124866 28685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ad4d7e1f434faf9844bc16cc4ea73a" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70416ec32d0c4d78856daf60c9290418"
I20260709 13:21:58.125504 28685 raft_consensus.cc:3060] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:58.124250 28536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70ad4d7e1f434faf9844bc16cc4ea73a" candidate_uuid: "0658b7a0664e42f4b42b35ed4581c14d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:21:58.126307 28536 raft_consensus.cc:3055] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:58.126771 28536 raft_consensus.cc:740] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:21:58.127780 28536 consensus_queue.cc:260] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:58.129271 28536 raft_consensus.cc:3060] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:58.133129 28685 raft_consensus.cc:2468] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 2.
I20260709 13:21:58.135030 28578 leader_election.cc:304] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, 70416ec32d0c4d78856daf60c9290418; no voters: 
I20260709 13:21:58.136250 28856 raft_consensus.cc:2804] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:58.136741 28856 raft_consensus.cc:697] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [term 2 LEADER]: Becoming Leader. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:21:58.137569 28856 consensus_queue.cc:237] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:21:58.139166 28536 raft_consensus.cc:2468] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0658b7a0664e42f4b42b35ed4581c14d in term 2.
I20260709 13:21:58.146152 28434 catalog_manager.cc:5697] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d reported cstate change: term changed from 1 to 2, leader changed from d51f98307f3848dea031026c70f09750 (127.16.211.1) to 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2). New cstate: current_term: 2 leader_uuid: "0658b7a0664e42f4b42b35ed4581c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.416531 28685 raft_consensus.cc:1275] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.417784 28907 consensus_queue.cc:1048] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:58.430090 28613 raft_consensus.cc:1275] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.431706 28909 consensus_queue.cc:1048] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:58.468408 28685 raft_consensus.cc:1275] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.470360 28907 consensus_queue.cc:1048] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:58.471570 28613 raft_consensus.cc:1275] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.472870 28907 consensus_queue.cc:1048] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:58.487251 28612 raft_consensus.cc:3060] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:58.507156 28685 raft_consensus.cc:1275] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.509979 28907 consensus_queue.cc:1048] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:58.515839 28612 raft_consensus.cc:1275] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.518606 28612 raft_consensus.cc:1275] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.518793 28909 consensus_queue.cc:1048] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:58.521049 28909 consensus_queue.cc:1048] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:58.531303 28685 raft_consensus.cc:1275] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Refusing update from remote peer d51f98307f3848dea031026c70f09750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.534004 28843 consensus_queue.cc:1048] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:58.544323 28681 raft_consensus.cc:1275] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Refusing update from remote peer 0658b7a0664e42f4b42b35ed4581c14d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.546063 28856 consensus_queue.cc:1048] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:58.549497 28612 raft_consensus.cc:1275] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Refusing update from remote peer 70416ec32d0c4d78856daf60c9290418: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.551151 28735 consensus_queue.cc:1048] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:58.557479 28536 raft_consensus.cc:1275] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Refusing update from remote peer 0658b7a0664e42f4b42b35ed4581c14d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.559923 28898 consensus_queue.cc:1048] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:58.561993 28536 raft_consensus.cc:1275] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Refusing update from remote peer 70416ec32d0c4d78856daf60c9290418: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.564152 28903 consensus_queue.cc:1048] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:00.994719 28436 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54706:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:22:01.022296 28436 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54706:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:22:01.065734 17228 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:22:01.253751 28943 log.cc:927] Time spent T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d: Append to log took a long time: real 0.053s	user 0.004s	sys 0.000s
W20260709 13:22:01.256718 28948 log.cc:927] Time spent T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:22:01.272504 28964 tablet.cc:1724] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.327445 28968 tablet.cc:1724] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.342281 28965 tablet.cc:1724] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:01.366019 28503 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:34069, user_credentials={real_user=slave}} blocked reactor thread for 61542.9us
W20260709 13:22:01.382994 28953 log.cc:927] Time spent T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.002s
I20260709 13:22:01.370430 28974 tablet.cc:1724] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:01.417461 28949 log.cc:927] Time spent T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750: Append to log took a long time: real 0.210s	user 0.004s	sys 0.000s
I20260709 13:22:01.418648 28977 tablet.cc:1724] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:01.428869 28970 log.cc:927] Time spent T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:22:01.433102 28955 log.cc:927] Time spent T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:22:01.411978 28503 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:34069, user_credentials={real_user=slave}} blocked reactor thread for 44155.5us
I20260709 13:22:01.417737 28979 tablet.cc:1724] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.476547 28609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2715fbba118d481db30cc7119e4dbc80"
dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
mode: GRACEFUL
new_leader_uuid: "70416ec32d0c4d78856daf60c9290418"
 from {username='slave'} at 127.0.0.1:42698
I20260709 13:22:01.477519 28609 raft_consensus.cc:606] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 LEADER]: Received request to transfer leadership to TS 70416ec32d0c4d78856daf60c9290418
W20260709 13:22:01.497393 28577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:39399, user_credentials={real_user=slave}} blocked reactor thread for 56649.6us
I20260709 13:22:01.500253 28976 tablet.cc:1724] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.503026 28978 tablet.cc:1724] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.504737 28982 tablet.cc:1724] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.504951 28985 tablet.cc:1724] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.508154 28964 tablet.cc:1724] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:01.565706 28578 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.3:34069, user_credentials={real_user=slave}} blocked reactor thread for 76912.1us
I20260709 13:22:01.569135 28920 raft_consensus.cc:993] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d: : Instructing follower 70416ec32d0c4d78856daf60c9290418 to start an election
I20260709 13:22:01.569698 28920 raft_consensus.cc:1081] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 LEADER]: Signalling peer 70416ec32d0c4d78856daf60c9290418 to start an election
I20260709 13:22:01.570255 28990 tablet.cc:1724] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.576673 28682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2715fbba118d481db30cc7119e4dbc80"
dest_uuid: "70416ec32d0c4d78856daf60c9290418"
 from {username='slave'} at 127.0.0.1:49632
I20260709 13:22:01.577433 28682 raft_consensus.cc:493] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:01.577877 28682 raft_consensus.cc:3060] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:01.578022 28965 tablet.cc:1724] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.578930 28968 tablet.cc:1724] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.582787 28979 tablet.cc:1724] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.596133 28979 tablet.cc:1724] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.605638 28989 tablet.cc:1724] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.610708 28985 tablet.cc:1724] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.627801 28682 raft_consensus.cc:515] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:22:01.631493 28682 leader_election.cc:290] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 3 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:22:01.632402 28538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2715fbba118d481db30cc7119e4dbc80" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:22:01.633160 28538 raft_consensus.cc:3060] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:01.634204 28982 tablet.cc:1724] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.648258 28979 tablet.cc:1724] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.648615 28974 tablet.cc:1724] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.648940 28982 tablet.cc:1724] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.634747 28965 tablet.cc:1724] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.658339 28609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2715fbba118d481db30cc7119e4dbc80" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:22:01.659060 28609 raft_consensus.cc:3055] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:01.659466 28609 raft_consensus.cc:740] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0658b7a0664e42f4b42b35ed4581c14d, State: Running, Role: LEADER
I20260709 13:22:01.662287 28609 consensus_queue.cc:260] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:22:01.663831 28609 raft_consensus.cc:3060] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:01.629577 28976 tablet.cc:1724] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.674460 28978 tablet.cc:1724] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.677276 28977 tablet.cc:1724] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.680603 28534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e39792ab55ed4b3d9df9c50f3667237b"
dest_uuid: "d51f98307f3848dea031026c70f09750"
mode: GRACEFUL
new_leader_uuid: "70416ec32d0c4d78856daf60c9290418"
 from {username='slave'} at 127.0.0.1:58346
I20260709 13:22:01.681252 28989 tablet.cc:1724] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:01.692986 28534 raft_consensus.cc:606] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Received request to transfer leadership to TS 70416ec32d0c4d78856daf60c9290418
I20260709 13:22:01.695410 17228 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:01.696099 17228 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:01.691505 28538 raft_consensus.cc:2468] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 3.
I20260709 13:22:01.703054 28651 leader_election.cc:304] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70416ec32d0c4d78856daf60c9290418, d51f98307f3848dea031026c70f09750; no voters: 
I20260709 13:22:01.704321 28952 raft_consensus.cc:2804] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:01.704835 28952 raft_consensus.cc:697] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 3 LEADER]: Becoming Leader. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Running, Role: LEADER
I20260709 13:22:01.705858 28952 consensus_queue.cc:237] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:22:01.707787 28609 raft_consensus.cc:2468] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 3.
I20260709 13:22:01.732928 28433 catalog_manager.cc:5697] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 reported cstate change: term changed from 2 to 3, leader changed from 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2) to 70416ec32d0c4d78856daf60c9290418 (127.16.211.3). New cstate: current_term: 3 leader_uuid: "70416ec32d0c4d78856daf60c9290418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:01.735551 28436 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615: soft_deleted_table [id=96ae12750b3240b8ae9e846c4193c78f] alter complete (version 1)
I20260709 13:22:01.827251 28986 raft_consensus.cc:993] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750: : Instructing follower 70416ec32d0c4d78856daf60c9290418 to start an election
I20260709 13:22:01.827840 28981 raft_consensus.cc:1081] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Signalling peer 70416ec32d0c4d78856daf60c9290418 to start an election
I20260709 13:22:01.829344 28682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e39792ab55ed4b3d9df9c50f3667237b"
dest_uuid: "70416ec32d0c4d78856daf60c9290418"
 from {username='slave'} at 127.0.0.1:49618
I20260709 13:22:01.829833 28682 raft_consensus.cc:493] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:01.830199 28682 raft_consensus.cc:3060] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.835799 28682 raft_consensus.cc:515] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:22:01.837393 28682 leader_election.cc:290] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 2 election: Requested vote from peers d51f98307f3848dea031026c70f09750 (127.16.211.1:39399), 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907)
I20260709 13:22:01.838363 28538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39792ab55ed4b3d9df9c50f3667237b" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d51f98307f3848dea031026c70f09750"
I20260709 13:22:01.838486 28609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39792ab55ed4b3d9df9c50f3667237b" candidate_uuid: "70416ec32d0c4d78856daf60c9290418" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0658b7a0664e42f4b42b35ed4581c14d"
I20260709 13:22:01.839012 28538 raft_consensus.cc:3055] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:01.839095 28609 raft_consensus.cc:3060] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.839320 28538 raft_consensus.cc:740] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d51f98307f3848dea031026c70f09750, State: Running, Role: LEADER
I20260709 13:22:01.840149 28538 consensus_queue.cc:260] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:22:01.841264 28538 raft_consensus.cc:3060] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.844751 28609 raft_consensus.cc:2468] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 2.
I20260709 13:22:01.846110 28653 leader_election.cc:304] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0658b7a0664e42f4b42b35ed4581c14d, 70416ec32d0c4d78856daf60c9290418; no voters: 
I20260709 13:22:01.846380 28538 raft_consensus.cc:2468] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70416ec32d0c4d78856daf60c9290418 in term 2.
I20260709 13:22:01.847090 28952 raft_consensus.cc:2804] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:01.847555 28952 raft_consensus.cc:697] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [term 2 LEADER]: Becoming Leader. State: Replica: 70416ec32d0c4d78856daf60c9290418, State: Running, Role: LEADER
I20260709 13:22:01.848438 28952 consensus_queue.cc:237] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } }
I20260709 13:22:01.858601 28433 catalog_manager.cc:5697] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 reported cstate change: term changed from 1 to 2, leader changed from d51f98307f3848dea031026c70f09750 (127.16.211.1) to 70416ec32d0c4d78856daf60c9290418 (127.16.211.3). New cstate: current_term: 2 leader_uuid: "70416ec32d0c4d78856daf60c9290418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70416ec32d0c4d78856daf60c9290418" member_type: VOTER last_known_addr { host: "127.16.211.3" port: 34069 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:02.085742 28609 raft_consensus.cc:1275] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 3 FOLLOWER]: Refusing update from remote peer 70416ec32d0c4d78856daf60c9290418: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:02.087266 28987 consensus_queue.cc:1048] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:02.098474 28538 raft_consensus.cc:1275] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 3 FOLLOWER]: Refusing update from remote peer 70416ec32d0c4d78856daf60c9290418: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:02.104215 28999 consensus_queue.cc:1048] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:02.333163 28609 raft_consensus.cc:1275] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Refusing update from remote peer 70416ec32d0c4d78856daf60c9290418: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.334654 28952 consensus_queue.cc:1048] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0658b7a0664e42f4b42b35ed4581c14d" member_type: VOTER last_known_addr { host: "127.16.211.2" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:02.346151 28538 raft_consensus.cc:1275] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Refusing update from remote peer 70416ec32d0c4d78856daf60c9290418: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.347609 28999 consensus_queue.cc:1048] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51f98307f3848dea031026c70f09750" member_type: VOTER last_known_addr { host: "127.16.211.1" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:02.756431 17228 tablet_server.cc:179] TabletServer@127.16.211.1:0 shutting down...
I20260709 13:22:02.791345 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:02.792217 17228 tablet_replica.cc:333] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.793367 17228 raft_consensus.cc:2243] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.794045 17228 raft_consensus.cc:2272] T 3fbf638c1ca94541bf106318f03b955e P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.796061 17228 tablet_replica.cc:333] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.796733 17228 raft_consensus.cc:2243] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.797178 17228 raft_consensus.cc:2272] T df140283680f4a8dbd2c988bfe8e3f4c P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.799134 17228 tablet_replica.cc:333] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.799757 17228 raft_consensus.cc:2243] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.800524 17228 raft_consensus.cc:2272] T 7602973069494f0caef44985b901a7e7 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.802830 17228 tablet_replica.cc:333] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.803457 17228 raft_consensus.cc:2243] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.804003 17228 raft_consensus.cc:2272] T daa60601f9904b40adf8998862b6e881 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:02.805871 28577 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
I20260709 13:22:02.806779 17228 tablet_replica.cc:333] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.807479 17228 raft_consensus.cc:2243] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.808538 17228 raft_consensus.cc:2272] T 45a6aa53996e4470bcea605fc519fce2 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:02.810382 28577 consensus_peers.cc:597] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d -> Peer d51f98307f3848dea031026c70f09750 (127.16.211.1:39399): Couldn't send request to peer d51f98307f3848dea031026c70f09750. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:02.811147 17228 tablet_replica.cc:333] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.811902 17228 raft_consensus.cc:2243] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.812700 17228 raft_consensus.cc:2272] T 54a90525f8f34dd4a4ffde6343898ba9 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.814934 17228 tablet_replica.cc:333] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.815606 17228 raft_consensus.cc:2243] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.816062 17228 raft_consensus.cc:2272] T 70ad4d7e1f434faf9844bc16cc4ea73a P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.818302 17228 tablet_replica.cc:333] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.818902 17228 raft_consensus.cc:2243] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.819396 17228 raft_consensus.cc:2272] T 4ec27a71b4b249de856c6826bfc090a7 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.821523 17228 tablet_replica.cc:333] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.822145 17228 raft_consensus.cc:2243] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.822893 17228 raft_consensus.cc:2272] T ed8e99f1c12442dc9b35408cf99ce7f3 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.824882 17228 tablet_replica.cc:333] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.825431 17228 raft_consensus.cc:2243] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.826264 17228 raft_consensus.cc:2272] T 469092d44c10446288fd71f5e5ec6dba P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.828310 17228 tablet_replica.cc:333] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.828887 17228 raft_consensus.cc:2243] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.829732 17228 raft_consensus.cc:2272] T 9f37c95f25f84fc2ab0362ee29e4ddbf P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.831885 17228 tablet_replica.cc:333] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.832427 17228 raft_consensus.cc:2243] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.832829 17228 raft_consensus.cc:2272] T e39792ab55ed4b3d9df9c50f3667237b P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.835682 17228 tablet_replica.cc:333] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.836258 17228 raft_consensus.cc:2243] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.836735 17228 raft_consensus.cc:2272] T 270d950e6ae04d5b9168dc1887bb67ef P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.838886 17228 tablet_replica.cc:333] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.839380 17228 raft_consensus.cc:2243] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.839805 17228 raft_consensus.cc:2272] T 61deddf94fed45fe955d9ca945ccbd29 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.841813 17228 tablet_replica.cc:333] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.842406 17228 raft_consensus.cc:2243] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.842856 17228 raft_consensus.cc:2272] T 2715fbba118d481db30cc7119e4dbc80 P d51f98307f3848dea031026c70f09750 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.846279 17228 tablet_replica.cc:333] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.846900 17228 raft_consensus.cc:2243] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.847369 17228 raft_consensus.cc:2272] T b32e097c804f415bae7c12132ab293df P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.849471 17228 tablet_replica.cc:333] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.850142 17228 raft_consensus.cc:2243] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.850678 17228 raft_consensus.cc:2272] T 7e7a90801bea49dd849e7c4e3faaeb75 P d51f98307f3848dea031026c70f09750 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.853848 17228 tablet_replica.cc:333] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750: stopping tablet replica
I20260709 13:22:02.854590 17228 raft_consensus.cc:2243] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:22:02.855125 28651 consensus_peers.cc:597] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 -> Peer d51f98307f3848dea031026c70f09750 (127.16.211.1:39399): Couldn't send request to peer d51f98307f3848dea031026c70f09750. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:02.855639 17228 raft_consensus.cc:2272] T aefc456fb1b046fe9ba1309b495c7394 P d51f98307f3848dea031026c70f09750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.922986 17228 tablet_server.cc:196] TabletServer@127.16.211.1:0 shutdown complete.
I20260709 13:22:02.959998 17228 tablet_server.cc:179] TabletServer@127.16.211.2:0 shutting down...
W20260709 13:22:02.987021 28577 consensus_peers.cc:597] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d -> Peer d51f98307f3848dea031026c70f09750 (127.16.211.1:39399): Couldn't send request to peer d51f98307f3848dea031026c70f09750. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:39399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:02.987684 28577 consensus_peers.cc:597] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d -> Peer d51f98307f3848dea031026c70f09750 (127.16.211.1:39399): Couldn't send request to peer d51f98307f3848dea031026c70f09750. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:39399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:02.989423 28651 consensus_peers.cc:597] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 -> Peer d51f98307f3848dea031026c70f09750 (127.16.211.1:39399): Couldn't send request to peer d51f98307f3848dea031026c70f09750. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:39399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:02.996559 28577 consensus_peers.cc:597] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d -> Peer d51f98307f3848dea031026c70f09750 (127.16.211.1:39399): Couldn't send request to peer d51f98307f3848dea031026c70f09750. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:39399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.047664 28577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.211.1:39399, user_credentials={real_user=slave}} blocked reactor thread for 51169.6us
W20260709 13:22:03.053516 28651 consensus_peers.cc:597] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 -> Peer d51f98307f3848dea031026c70f09750 (127.16.211.1:39399): Couldn't send request to peer d51f98307f3848dea031026c70f09750. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:39399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.060250 28577 consensus_peers.cc:597] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d -> Peer d51f98307f3848dea031026c70f09750 (127.16.211.1:39399): Couldn't send request to peer d51f98307f3848dea031026c70f09750. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:39399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:03.061371 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:03.062595 17228 tablet_replica.cc:333] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
W20260709 13:22:03.063654 28653 consensus_peers.cc:597] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 -> Peer 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907): Couldn't send request to peer 0658b7a0664e42f4b42b35ed4581c14d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:03.064157 17228 raft_consensus.cc:2243] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.064827 17228 raft_consensus.cc:2272] T 3fbf638c1ca94541bf106318f03b955e P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:03.064693 28653 consensus_peers.cc:597] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 -> Peer 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907): Couldn't send request to peer 0658b7a0664e42f4b42b35ed4581c14d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:03.068156 17228 tablet_replica.cc:333] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.069057 17228 raft_consensus.cc:2243] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:03.070158 17228 raft_consensus.cc:2272] T df140283680f4a8dbd2c988bfe8e3f4c P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.073829 17228 tablet_replica.cc:333] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.075028 17228 raft_consensus.cc:2243] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:03.075978 17228 raft_consensus.cc:2272] T daa60601f9904b40adf8998862b6e881 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.078415 17228 tablet_replica.cc:333] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.079095 17228 raft_consensus.cc:2243] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.079562 17228 raft_consensus.cc:2272] T 45a6aa53996e4470bcea605fc519fce2 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.081772 17228 tablet_replica.cc:333] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.082476 17228 raft_consensus.cc:2243] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.082940 17228 raft_consensus.cc:2272] T 54a90525f8f34dd4a4ffde6343898ba9 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.084936 17228 tablet_replica.cc:333] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.085486 17228 raft_consensus.cc:2243] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.085966 17228 raft_consensus.cc:2272] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.088057 17228 tablet_replica.cc:333] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.088582 17228 raft_consensus.cc:2243] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.089156 17228 raft_consensus.cc:2272] T e39792ab55ed4b3d9df9c50f3667237b P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.091655 17228 tablet_replica.cc:333] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.092324 17228 raft_consensus.cc:2243] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:03.093094 17228 raft_consensus.cc:2272] T 7e7a90801bea49dd849e7c4e3faaeb75 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.095171 17228 tablet_replica.cc:333] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.095674 17228 raft_consensus.cc:2243] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.096086 17228 raft_consensus.cc:2272] T 270d950e6ae04d5b9168dc1887bb67ef P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.098532 17228 tablet_replica.cc:333] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.099014 17228 raft_consensus.cc:2243] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.099399 17228 raft_consensus.cc:2272] T 7602973069494f0caef44985b901a7e7 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.101284 17228 tablet_replica.cc:333] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.101838 17228 raft_consensus.cc:2243] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.102376 17228 raft_consensus.cc:2272] T aefc456fb1b046fe9ba1309b495c7394 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.104358 17228 tablet_replica.cc:333] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.104875 17228 raft_consensus.cc:2243] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:03.105674 17228 raft_consensus.cc:2272] T 70ad4d7e1f434faf9844bc16cc4ea73a P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.107779 17228 tablet_replica.cc:333] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.108295 17228 raft_consensus.cc:2243] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:03.109061 17228 raft_consensus.cc:2272] T 4ec27a71b4b249de856c6826bfc090a7 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.111668 17228 tablet_replica.cc:333] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.112252 17228 raft_consensus.cc:2243] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:03.112968 17228 raft_consensus.cc:2272] T 61deddf94fed45fe955d9ca945ccbd29 P 0658b7a0664e42f4b42b35ed4581c14d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.114893 17228 tablet_replica.cc:333] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.115411 17228 raft_consensus.cc:2243] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.115837 17228 raft_consensus.cc:2272] T 2715fbba118d481db30cc7119e4dbc80 P 0658b7a0664e42f4b42b35ed4581c14d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.117779 17228 tablet_replica.cc:333] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.118335 17228 raft_consensus.cc:2243] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:03.119174 17228 raft_consensus.cc:2272] T b32e097c804f415bae7c12132ab293df P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.121209 17228 tablet_replica.cc:333] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.121675 17228 raft_consensus.cc:2243] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.122118 17228 raft_consensus.cc:2272] T ed8e99f1c12442dc9b35408cf99ce7f3 P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.124009 17228 tablet_replica.cc:333] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d: stopping tablet replica
I20260709 13:22:03.124512 17228 raft_consensus.cc:2243] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.124979 17228 raft_consensus.cc:2272] T 469092d44c10446288fd71f5e5ec6dba P 0658b7a0664e42f4b42b35ed4581c14d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:03.158438 28651 consensus_peers.cc:597] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 -> Peer d51f98307f3848dea031026c70f09750 (127.16.211.1:39399): Couldn't send request to peer d51f98307f3848dea031026c70f09750. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.1:39399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:03.165055 17228 tablet_server.cc:196] TabletServer@127.16.211.2:0 shutdown complete.
I20260709 13:22:03.198690 17228 tablet_server.cc:179] TabletServer@127.16.211.3:0 shutting down...
W20260709 13:22:03.208652 28653 consensus_peers.cc:597] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 -> Peer 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907): Couldn't send request to peer 0658b7a0664e42f4b42b35ed4581c14d. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:33907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.223394 28653 consensus_peers.cc:597] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 -> Peer 0658b7a0664e42f4b42b35ed4581c14d (127.16.211.2:33907): Couldn't send request to peer 0658b7a0664e42f4b42b35ed4581c14d. Status: Network error: Client connection negotiation failed: client connection to 127.16.211.2:33907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:03.233412 17228 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:03.234249 17228 tablet_replica.cc:333] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.234946 17228 raft_consensus.cc:2243] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.235451 17228 raft_consensus.cc:2272] T daa60601f9904b40adf8998862b6e881 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.237489 17228 tablet_replica.cc:333] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.238168 17228 raft_consensus.cc:2243] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:03.238955 17228 raft_consensus.cc:2272] T 3fbf638c1ca94541bf106318f03b955e P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.240954 17228 tablet_replica.cc:333] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.241518 17228 raft_consensus.cc:2243] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.242059 17228 raft_consensus.cc:2272] T df140283680f4a8dbd2c988bfe8e3f4c P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.243925 17228 tablet_replica.cc:333] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.244458 17228 raft_consensus.cc:2243] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.244882 17228 raft_consensus.cc:2272] T 54a90525f8f34dd4a4ffde6343898ba9 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.246857 17228 tablet_replica.cc:333] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.247386 17228 raft_consensus.cc:2243] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.247818 17228 raft_consensus.cc:2272] T 45a6aa53996e4470bcea605fc519fce2 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.249723 17228 tablet_replica.cc:333] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.250341 17228 raft_consensus.cc:2243] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.250777 17228 raft_consensus.cc:2272] T 7602973069494f0caef44985b901a7e7 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.252671 17228 tablet_replica.cc:333] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.253224 17228 raft_consensus.cc:2243] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.253684 17228 raft_consensus.cc:2272] T aefc456fb1b046fe9ba1309b495c7394 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.255692 17228 tablet_replica.cc:333] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.256253 17228 raft_consensus.cc:2243] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.256713 17228 raft_consensus.cc:2272] T ed8e99f1c12442dc9b35408cf99ce7f3 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.258553 17228 tablet_replica.cc:333] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.259088 17228 raft_consensus.cc:2243] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.259544 17228 raft_consensus.cc:2272] T 469092d44c10446288fd71f5e5ec6dba P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.261526 17228 tablet_replica.cc:333] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.262108 17228 raft_consensus.cc:2243] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:03.262962 17228 raft_consensus.cc:2272] T 270d950e6ae04d5b9168dc1887bb67ef P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.265087 17228 tablet_replica.cc:333] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.265609 17228 raft_consensus.cc:2243] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:03.266472 17228 raft_consensus.cc:2272] T e39792ab55ed4b3d9df9c50f3667237b P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.268779 17228 tablet_replica.cc:333] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.269438 17228 raft_consensus.cc:2243] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.269953 17228 raft_consensus.cc:2272] T 9f37c95f25f84fc2ab0362ee29e4ddbf P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.271955 17228 tablet_replica.cc:333] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.272473 17228 raft_consensus.cc:2243] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.272897 17228 raft_consensus.cc:2272] T 7e7a90801bea49dd849e7c4e3faaeb75 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.274914 17228 tablet_replica.cc:333] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.275434 17228 raft_consensus.cc:2243] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.275849 17228 raft_consensus.cc:2272] T 70ad4d7e1f434faf9844bc16cc4ea73a P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.277635 17228 tablet_replica.cc:333] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.278159 17228 raft_consensus.cc:2243] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.278642 17228 raft_consensus.cc:2272] T 4ec27a71b4b249de856c6826bfc090a7 P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.280483 17228 tablet_replica.cc:333] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.281005 17228 raft_consensus.cc:2243] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.281447 17228 raft_consensus.cc:2272] T 61deddf94fed45fe955d9ca945ccbd29 P 70416ec32d0c4d78856daf60c9290418 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.283417 17228 tablet_replica.cc:333] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.284081 17228 raft_consensus.cc:2243] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:03.284982 17228 raft_consensus.cc:2272] T 2715fbba118d481db30cc7119e4dbc80 P 70416ec32d0c4d78856daf60c9290418 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.287060 17228 tablet_replica.cc:333] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418: stopping tablet replica
I20260709 13:22:03.287559 17228 raft_consensus.cc:2243] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:03.288019 17228 raft_consensus.cc:2272] T b32e097c804f415bae7c12132ab293df P 70416ec32d0c4d78856daf60c9290418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.328110 17228 tablet_server.cc:196] TabletServer@127.16.211.3:0 shutdown complete.
I20260709 13:22:03.362396 17228 master.cc:562] Master@127.16.211.62:36045 shutting down...
I20260709 13:22:03.388007 17228 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:03.388589 17228 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:03.388931 17228 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8c24777189d44479b68f7053b63bf615: stopping tablet replica
I20260709 13:22:03.410843 17228 master.cc:584] Master@127.16.211.62:36045 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12215 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25205 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (334738 ms total)
[  PASSED  ] 8 tests.
I20260709 13:22:03.470920 17228 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 428 messages since previous log ~15 seconds ago
I20260709 13:22:03.471165 17228 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 428 messages since previous log ~15 seconds ago
I20260709 13:22:03.471345 17228 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 424 messages since previous log ~15 seconds ago
I20260709 13:22:03.471556 17228 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:22:03.471743 17228 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:22:03.471959 17228 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 7 messages since previous log ~167 seconds ago
I20260709 13:22:03.472224 17228 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 12 messages since previous log ~0 seconds ago
I20260709 13:22:03.472536 17228 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
